2024-08-19T11:04:56.701 INFO:root:teuthology version: 1.2.0 2024-08-19T11:04:56.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T11:04:56.821 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447 branch: main description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete} email: ceph-qa@ceph.com first_in_suite: false job_id: '7859447' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore write v2 random: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 964adda23da9f7b057cb34fdc0b82aeb7ed65324 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 1858 sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b sleep_before_teardown: 0 subset: 29813/100000 suite: rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 964adda23da9f7b057cb34fdc0b82aeb7ed65324 targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWyLdqntv9SVez5+6G8gb1i1fPqvUfUa3zJyXu37dZdzgA9noLh+4h51vU3Ez9tek5GwQU0CeZtmLzcxL/NoVM= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkW0lB2QrXeMTy/nSyrlSSGNoeIXT/FzAYI+mhpXr6Um6S6fLDK/HKNHmU4jp3QLcUMypC/I02hytDjY0HAOuc= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_20:00:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-19T11:04:56.821 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa; will attempt to use it 2024-08-19T11:04:56.822 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks 2024-08-19T11:04:56.822 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-19T11:04:56.826 INFO:teuthology.task.internal:Checking packages... 2024-08-19T11:04:56.847 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '797669399b32d2915e64eb6d4b1257ae3c50f80b' 2024-08-19T11:04:56.847 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T11:04:56.847 INFO:teuthology.packaging:ref: None 2024-08-19T11:04:56.847 INFO:teuthology.packaging:tag: None 2024-08-19T11:04:56.847 INFO:teuthology.packaging:branch: main 2024-08-19T11:04:56.847 INFO:teuthology.packaging:sha1: 797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-19T11:04:56.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-08-19T11:04:57.076 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5847.g79766939 2024-08-19T11:04:57.077 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-19T11:04:57.086 INFO:teuthology.task.internal:no buildpackages task found 2024-08-19T11:04:57.086 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-19T11:04:57.095 INFO:teuthology.task.internal:Saving configuration 2024-08-19T11:04:57.111 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-19T11:04:57.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-19T11:04:57.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-19 10:59:47.405083', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWyLdqntv9SVez5+6G8gb1i1fPqvUfUa3zJyXu37dZdzgA9noLh+4h51vU3Ez9tek5GwQU0CeZtmLzcxL/NoVM='} 2024-08-19T11:04:57.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-19 10:59:47.406968', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkW0lB2QrXeMTy/nSyrlSSGNoeIXT/FzAYI+mhpXr6Um6S6fLDK/HKNHmU4jp3QLcUMypC/I02hytDjY0HAOuc='} 2024-08-19T11:04:57.188 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-19T11:04:57.196 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-08-19T11:04:57.196 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-08-19T11:04:57.196 INFO:teuthology.run_tasks:Running task console_log... 2024-08-19T11:04:57.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c95577ac0>, signals=[15]) 2024-08-19T11:04:57.277 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-19T11:04:57.285 INFO:teuthology.task.internal:Opening connections... 2024-08-19T11:04:57.285 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:04:57.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T11:04:57.374 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:04:57.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T11:04:57.461 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-19T11:04:57.468 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-08-19T11:04:57.486 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-08-19T11:04:57.486 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-08-19T11:04:57.542 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-08-19T11:04:57.543 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-19T11:04:57.544 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-08-19T11:04:57.544 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-19T11:04:57.544 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-19T11:04:57.544 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-19T11:04:57.544 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-08-19T11:04:57.579 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-08-19T11:04:57.598 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-08-19T11:04:57.598 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-08-19T11:04:57.656 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-19T11:04:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-19T11:04:57.657 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-08-19T11:04:57.687 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-19T11:04:57.697 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-19T11:04:57.720 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-19T11:04:57.720 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-08-19T11:04:57.722 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-08-19T11:04:57.738 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-19T11:04:57.770 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-19T11:04:57.770 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-08-19T11:04:57.781 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-08-19T11:04:57.820 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-19T11:04:57.893 INFO:teuthology.run_tasks:Running task kernel... 2024-08-19T11:04:57.908 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-19T11:04:57.908 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.f': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-19T11:04:57.908 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-19T11:04:57.909 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-19T11:04:57.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:04:57.926 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-08-19T11:04:57.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:04:57.927 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-08-19T11:04:57.984 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-480.el9.x86_64 2024-08-19T11:04:57.984 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-480.el9.x86_64 2024-08-19T11:04:57.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-08-19T11:04:57.985 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-480.el9.x86_64 2024-08-19T11:04:57.985 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-480.el9.x86_64 2024-08-19T11:04:57.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-08-19T11:05:00.388 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-08-19T11:05:01.718 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-08-19T11:05:02.079 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-08-19T11:05:06.222 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.6 MB 00:00 2024-08-19T11:05:07.227 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-08-19T11:05:07.664 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 18 kB 00:00 2024-08-19T11:05:08.726 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-19T11:05:11.536 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-19T11:05:13.161 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 18 kB 00:00 2024-08-19T11:05:13.923 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 35 MB/s | 22 MB 00:00 2024-08-19T11:05:14.090 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-19T11:05:16.013 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-19T11:05:16.013 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-19T11:05:16.078 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:05:16.079 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:05:16.079 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:05:16.182 DEBUG:teuthology.orchestra.run.smithi071:> echo no | sudo yum reinstall kernel || true 2024-08-19T11:05:16.706 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:02 ago on Mon 19 Aug 2024 11:05:14 AM UTC. 2024-08-19T11:05:16.854 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:05:16.859 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Reinstalling: 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:05:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:05:16.861 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 1.5 M 2024-08-19T11:05:16.861 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 0 2024-08-19T11:05:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:Operation aborted. 2024-08-19T11:05:16.928 INFO:teuthology.orchestra.run.smithi071.stdout:Is this ok [y/N]: 2024-08-19T11:05:16.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum reinstall -y kernel || true 2024-08-19T11:05:17.446 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:03 ago on Mon 19 Aug 2024 11:05:14 AM UTC. 2024-08-19T11:05:17.567 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout:Reinstalling: 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:05:17.568 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:05:17.569 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:05:17.569 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:05:17.569 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 1.5 M 2024-08-19T11:05:17.569 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 0 2024-08-19T11:05:17.569 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:05:17.859 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-480.el9.x86_64.rpm 6.2 MB/s | 1.5 MB 00:00 2024-08-19T11:05:17.859 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:05:17.859 INFO:teuthology.orchestra.run.smithi071.stdout:Total 5.2 MB/s | 1.5 MB 00:00 2024-08-19T11:05:17.900 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:05:18.138 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:05:18.138 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:05:18.162 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:05:18.163 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:05:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:05:18.402 INFO:teuthology.orchestra.run.smithi071.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T11:05:18.402 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T11:05:19.095 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T11:05:19.095 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T11:05:19.504 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-19T11:05:19.818 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T11:05:19.818 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:05:19.818 INFO:teuthology.orchestra.run.smithi071.stdout:Reinstalled: 2024-08-19T11:05:19.818 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-19T11:05:19.818 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:05:19.818 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:05:19.987 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-08-19T11:05:20.043 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-19T11:05:20.043 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-19T11:05:20.044 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-19T11:05:20.044 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-19T11:05:20.044 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-19T11:05:20.082 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-08-19T11:05:20.101 DEBUG:teuthology.parallel:result is None 2024-08-19T11:05:21.445 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-19T11:05:21.445 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-19T11:05:21.523 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:05:21.524 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:05:21.619 DEBUG:teuthology.orchestra.run.smithi135:> echo no | sudo yum reinstall kernel || true 2024-08-19T11:05:22.147 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Mon 19 Aug 2024 11:05:19 AM UTC. 2024-08-19T11:05:22.302 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:05:22.310 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout:Reinstalling: 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:05:22.311 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 1.5 M 2024-08-19T11:05:22.312 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 0 2024-08-19T11:05:22.312 INFO:teuthology.orchestra.run.smithi135.stderr:Operation aborted. 2024-08-19T11:05:22.376 INFO:teuthology.orchestra.run.smithi135.stdout:Is this ok [y/N]: 2024-08-19T11:05:22.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum reinstall -y kernel || true 2024-08-19T11:05:22.910 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Mon 19 Aug 2024 11:05:19 AM UTC. 2024-08-19T11:05:23.032 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:05:23.033 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:05:23.033 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-08-19T11:05:23.033 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:05:23.033 INFO:teuthology.orchestra.run.smithi135.stdout:Reinstalling: 2024-08-19T11:05:23.033 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T11:05:23.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:05:23.034 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:05:23.034 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:05:23.034 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:05:23.034 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 1.5 M 2024-08-19T11:05:23.034 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 0 2024-08-19T11:05:23.034 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:05:24.265 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-480.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:00 2024-08-19T11:05:24.265 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:05:24.265 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.2 MB/s | 1.5 MB 00:01 2024-08-19T11:05:24.302 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:05:24.551 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:05:24.551 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:05:24.577 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:05:24.577 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:05:24.755 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:05:24.850 INFO:teuthology.orchestra.run.smithi135.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T11:05:24.850 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T11:05:25.680 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T11:05:25.680 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T11:05:26.431 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T11:05:26.431 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:05:26.431 INFO:teuthology.orchestra.run.smithi135.stdout:Reinstalled: 2024-08-19T11:05:26.431 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-19T11:05:26.431 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:05:26.431 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:05:26.648 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-08-19T11:05:26.747 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-19T11:05:26.747 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-19T11:05:26.747 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-19T11:05:26.748 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-08-19T11:05:26.748 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-19T11:05:26.778 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-08-19T11:05:26.798 DEBUG:teuthology.parallel:result is None 2024-08-19T11:05:26.799 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-19T11:05:26.807 INFO:teuthology.task.internal:Creating test directory... 2024-08-19T11:05:26.807 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-19T11:05:26.810 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-19T11:05:26.853 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-19T11:05:26.873 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-19T11:05:26.947 INFO:teuthology.task.internal:Creating archive directory... 2024-08-19T11:05:26.948 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-19T11:05:26.950 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-19T11:05:27.062 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-19T11:05:27.070 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-19T11:05:27.070 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-19T11:05:27.073 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-19T11:05:27.103 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T11:05:27.112 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T11:05:27.128 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T11:05:27.140 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T11:05:27.142 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-19T11:05:27.150 INFO:teuthology.task.internal:Configuring sudo... 2024-08-19T11:05:27.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-19T11:05:27.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-19T11:05:27.179 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-19T11:05:27.193 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-19T11:05:27.193 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-19T11:05:27.221 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-19T11:05:27.236 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T11:05:27.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T11:05:27.374 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T11:05:27.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T11:05:27.500 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:05:27.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-19T11:05:27.566 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T11:05:27.617 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T11:05:27.678 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T11:05:27.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T11:05:27.761 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:05:27.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-19T11:05:27.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-08-19T11:05:27.828 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-08-19T11:05:27.865 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T11:05:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T11:05:28.195 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-19T11:05:28.203 INFO:teuthology.task.internal:Starting timer... 2024-08-19T11:05:28.203 INFO:teuthology.run_tasks:Running task pcp... 2024-08-19T11:05:28.285 INFO:teuthology.run_tasks:Running task selinux... 2024-08-19T11:05:28.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-08-19T11:05:28.428 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-08-19T11:05:28.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-08-19T11:05:28.486 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-08-19T11:05:28.488 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-19T11:05:28.488 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-08-19T11:05:28.513 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-08-19T11:05:28.514 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-08-19T11:05:28.533 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-08-19T11:05:28.534 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-08-19T11:05:28.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-19T11:05:28.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:05:28.579 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-19T11:05:28.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:05:28.605 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-19T11:05:28.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-08-19T11:05:28.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-08-19T11:05:28.682 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-19T11:05:28.692 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-19T11:05:28.703 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-19T11:05:28.704 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-19T11:07:11.906 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-08-19T11:07:11.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-08-19T11:07:11.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T11:07:12.009 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-08-19T11:07:12.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-08-19T11:07:12.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-08-19T11:07:12.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T11:07:12.167 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-08-19T11:07:12.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-08-19T11:07:12.250 INFO:teuthology.run_tasks:Running task clock... 2024-08-19T11:07:12.260 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-19T11:07:12.260 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T11:07:12.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T11:07:12.263 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T11:07:12.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T11:07:12.290 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T11:07:12.305 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T11:07:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T11:07:12.328 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-08-19T11:07:12.333 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T11:07:12.339 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-08-19T11:07:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T11:07:12.357 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-08-19T11:07:12.368 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-08-19T11:07:12.368 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T11:07:12.382 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T11:07:12.396 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T11:07:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-08-19T11:07:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T11:07:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-08-19T11:07:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.439 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.453 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-08-19T11:07:12.458 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T11:07:12.458 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-08-19T11:07:12.458 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.458 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.458 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.458 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:07:12.459 INFO:teuthology.run_tasks:Running task install... 2024-08-19T11:07:12.473 DEBUG:teuthology.task.install:project ceph 2024-08-19T11:07:12.474 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}} 2024-08-19T11:07:12.474 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'} 2024-08-19T11:07:12.474 INFO:teuthology.task.install:Using flavor: default 2024-08-19T11:07:12.479 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-19T11:07:12.479 INFO:teuthology.task.install:extra packages: [] 2024-08-19T11:07:12.480 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b', 'tag': None, 'wait_for_package': False} 2024-08-19T11:07:12.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-19T11:07:12.483 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b', 'tag': None, 'wait_for_package': False} 2024-08-19T11:07:12.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-19T11:07:12.629 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/ 2024-08-19T11:07:12.630 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5847.g79766939 2024-08-19T11:07:12.641 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/ 2024-08-19T11:07:12.642 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5847.g79766939 2024-08-19T11:07:12.748 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T11:07:12.748 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:07:12.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T11:07:12.758 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/797669399b32d2915e64eb6d4b1257ae3c50f80b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T11:07:12.758 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:07:12.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T11:07:12.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-19T11:07:12.774 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/797669399b32d2915e64eb6d4b1257ae3c50f80b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T11:07:12.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-19T11:07:12.784 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/797669399b32d2915e64eb6d4b1257ae3c50f80b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T11:07:12.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T11:07:12.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T11:07:12.914 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T11:07:12.926 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T11:07:12.978 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-08-19T11:07:12.980 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-08-19T11:07:12.991 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-08-19T11:07:12.992 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-08-19T11:07:13.205 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-08-19T11:07:13.217 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-08-19T11:07:13.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2024-08-19T11:07:13.245 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw 2024-08-19T11:07:13.778 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-08-19T11:07:13.824 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 279 kB/s | 84 kB 00:00 2024-08-19T11:07:14.062 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-19T11:07:14.116 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-08-19T11:07:14.337 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-08-19T11:07:14.383 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-08-19T11:07:15.896 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-08-19T11:07:16.292 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-08-19T11:07:18.513 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-08-19T11:07:19.377 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-08-19T11:07:23.039 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.6 MB 00:00 2024-08-19T11:07:24.690 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 18 kB 00:00 2024-08-19T11:07:25.452 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 35 MB/s | 22 MB 00:00 2024-08-19T11:07:25.693 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.6 MB 00:02 2024-08-19T11:07:27.336 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-08-19T11:07:28.215 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-19T11:07:30.791 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-19T11:07:33.025 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.0.0-5847.g79766939.el9 ceph 11 M 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.0.0-5847.g79766939.el9 ceph 3.5 M 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.0.0-5847.g79766939.el9 ceph 3.2 M 2024-08-19T11:07:33.027 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.0.0-5847.g79766939.el9 ceph 5.5 M 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.0.0-5847.g79766939.el9 ceph 22 M 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.0.0-5847.g79766939.el9 ceph 25 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.0.0-5847.g79766939.el9 ceph 755 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T11:07:33.028 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.0.0-5847.g79766939.el9 ceph 508 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.0.0-5847.g79766939.el9 ceph 5.5 M 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.0.0-5847.g79766939.el9 ceph 45 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.0.0-5847.g79766939.el9 ceph 138 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.0.0-5847.g79766939.el9 ceph 188 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.0.0-5847.g79766939.el9 ceph 371 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.0.0-5847.g79766939.el9 ceph 356 k 2024-08-19T11:07:33.029 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.0.0-5847.g79766939.el9 ceph 116 k 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout:Install 30 Packages 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-08-19T11:07:33.030 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 62 M 2024-08-19T11:07:33.031 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:07:33.645 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-08-19T11:07:34.000 INFO:teuthology.orchestra.run.smithi071.stdout:(1/32): ceph-base-19.0.0-5847.g79766939.el9.x86 9.4 MB/s | 5.5 MB 00:00 2024-08-19T11:07:34.059 INFO:teuthology.orchestra.run.smithi071.stdout:(2/32): ceph-selinux-19.0.0-5847.g79766939.el9. 432 kB/s | 25 kB 00:00 2024-08-19T11:07:34.167 INFO:teuthology.orchestra.run.smithi071.stdout:(3/32): libcephfs2-19.0.0-5847.g79766939.el9.x8 6.8 MB/s | 755 kB 00:00 2024-08-19T11:07:34.293 INFO:teuthology.orchestra.run.smithi071.stdout:(4/32): ceph-radosgw-19.0.0-5847.g79766939.el9. 12 MB/s | 11 MB 00:00 2024-08-19T11:07:34.326 INFO:teuthology.orchestra.run.smithi071.stdout:(5/32): libradosstriper1-19.0.0-5847.g79766939. 3.1 MB/s | 508 kB 00:00 2024-08-19T11:07:34.385 INFO:teuthology.orchestra.run.smithi071.stdout:(6/32): python3-ceph-argparse-19.0.0-5847.g7976 772 kB/s | 45 kB 00:00 2024-08-19T11:07:34.635 INFO:teuthology.orchestra.run.smithi071.stdout:(7/32): ceph-common-19.0.0-5847.g79766939.el9.x 18 MB/s | 22 MB 00:01 2024-08-19T11:07:34.660 INFO:teuthology.orchestra.run.smithi071.stdout:(8/32): python3-ceph-common-19.0.0-5847.g797669 503 kB/s | 138 kB 00:00 2024-08-19T11:07:34.686 INFO:teuthology.orchestra.run.smithi071.stdout:(9/32): python3-cephfs-19.0.0-5847.g79766939.el 3.7 MB/s | 188 kB 00:00 2024-08-19T11:07:34.711 INFO:teuthology.orchestra.run.smithi071.stdout:(10/32): python3-rados-19.0.0-5847.g79766939.el 7.2 MB/s | 371 kB 00:00 2024-08-19T11:07:34.736 INFO:teuthology.orchestra.run.smithi071.stdout:(11/32): python3-rbd-19.0.0-5847.g79766939.el9. 6.9 MB/s | 356 kB 00:00 2024-08-19T11:07:34.761 INFO:teuthology.orchestra.run.smithi071.stdout:(12/32): python3-rgw-19.0.0-5847.g79766939.el9. 2.3 MB/s | 116 kB 00:00 2024-08-19T11:07:34.837 INFO:teuthology.orchestra.run.smithi071.stdout:(13/32): librgw2-19.0.0-5847.g79766939.el9.x86_ 10 MB/s | 5.5 MB 00:00 2024-08-19T11:07:34.887 INFO:teuthology.orchestra.run.smithi071.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 711 kB/s | 107 kB 00:00 2024-08-19T11:07:34.962 INFO:teuthology.orchestra.run.smithi071.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-08-19T11:07:34.987 INFO:teuthology.orchestra.run.smithi071.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 709 kB/s | 160 kB 00:00 2024-08-19T11:07:35.029 INFO:teuthology.orchestra.run.smithi071.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-08-19T11:07:35.079 INFO:teuthology.orchestra.run.smithi071.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-08-19T11:07:35.097 INFO:teuthology.orchestra.run.smithi071.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 388 kB/s | 42 kB 00:00 2024-08-19T11:07:35.122 INFO:teuthology.orchestra.run.smithi071.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-08-19T11:07:35.147 INFO:teuthology.orchestra.run.smithi071.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 534 kB/s | 36 kB 00:00 2024-08-19T11:07:35.189 INFO:teuthology.orchestra.run.smithi071.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 514 kB/s | 47 kB 00:00 2024-08-19T11:07:35.222 INFO:teuthology.orchestra.run.smithi071.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-08-19T11:07:35.256 INFO:teuthology.orchestra.run.smithi071.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 399 kB/s | 26 kB 00:00 2024-08-19T11:07:35.281 INFO:teuthology.orchestra.run.smithi071.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 855 kB/s | 49 kB 00:00 2024-08-19T11:07:35.307 INFO:teuthology.orchestra.run.smithi071.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-19T11:07:35.332 INFO:teuthology.orchestra.run.smithi071.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-08-19T11:07:35.374 INFO:teuthology.orchestra.run.smithi071.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-08-19T11:07:35.432 INFO:teuthology.orchestra.run.smithi071.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-19T11:07:35.508 INFO:teuthology.orchestra.run.smithi071.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-08-19T11:07:35.633 INFO:teuthology.orchestra.run.smithi071.stdout:(31/32): librados2-19.0.0-5847.g79766939.el9.x8 13 MB/s | 3.5 MB 00:00 2024-08-19T11:07:35.691 INFO:teuthology.orchestra.run.smithi071.stdout:(32/32): librbd1-19.0.0-5847.g79766939.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-08-19T11:07:35.696 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:07:35.696 INFO:teuthology.orchestra.run.smithi071.stdout:Total 23 MB/s | 62 MB 00:02 2024-08-19T11:07:35.792 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:07:35.827 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:07:35.828 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:07:35.888 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:07:35.890 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-5847.g79766939.el9 ceph 11 M 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-5847.g79766939.el9 ceph 3.5 M 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-5847.g79766939.el9 ceph 3.2 M 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-5847.g79766939.el9 ceph 5.5 M 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-5847.g79766939.el9 ceph 22 M 2024-08-19T11:07:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-5847.g79766939.el9 ceph 25 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-5847.g79766939.el9 ceph 755 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-5847.g79766939.el9 ceph 508 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-5847.g79766939.el9 ceph 5.5 M 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T11:07:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-5847.g79766939.el9 ceph 45 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-5847.g79766939.el9 ceph 138 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-5847.g79766939.el9 ceph 188 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-5847.g79766939.el9 ceph 371 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-5847.g79766939.el9 ceph 356 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-5847.g79766939.el9 ceph 116 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-08-19T11:07:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T11:07:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:07:35.894 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:07:35.894 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:07:35.894 INFO:teuthology.orchestra.run.smithi135.stdout:Install 30 Packages 2024-08-19T11:07:35.894 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-08-19T11:07:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:07:35.895 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 62 M 2024-08-19T11:07:35.895 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:07:36.303 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:07:36.304 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:07:36.839 INFO:teuthology.orchestra.run.smithi135.stdout:(1/32): ceph-base-19.0.0-5847.g79766939.el9.x86 9.9 MB/s | 5.5 MB 00:00 2024-08-19T11:07:36.897 INFO:teuthology.orchestra.run.smithi135.stdout:(2/32): ceph-selinux-19.0.0-5847.g79766939.el9. 433 kB/s | 25 kB 00:00 2024-08-19T11:07:37.123 INFO:teuthology.orchestra.run.smithi135.stdout:(3/32): ceph-radosgw-19.0.0-5847.g79766939.el9. 13 MB/s | 11 MB 00:00 2024-08-19T11:07:37.156 INFO:teuthology.orchestra.run.smithi135.stdout:(4/32): libcephfs2-19.0.0-5847.g79766939.el9.x8 2.9 MB/s | 755 kB 00:00 2024-08-19T11:07:37.181 INFO:teuthology.orchestra.run.smithi135.stdout:(5/32): libradosstriper1-19.0.0-5847.g79766939. 8.5 MB/s | 508 kB 00:00 2024-08-19T11:07:37.232 INFO:teuthology.orchestra.run.smithi135.stdout:(6/32): python3-ceph-argparse-19.0.0-5847.g7976 906 kB/s | 45 kB 00:00 2024-08-19T11:07:37.298 INFO:teuthology.orchestra.run.smithi135.stdout:(7/32): python3-ceph-common-19.0.0-5847.g797669 2.0 MB/s | 138 kB 00:00 2024-08-19T11:07:37.499 INFO:teuthology.orchestra.run.smithi135.stdout:(8/32): ceph-common-19.0.0-5847.g79766939.el9.x 18 MB/s | 22 MB 00:01 2024-08-19T11:07:37.524 INFO:teuthology.orchestra.run.smithi135.stdout:(9/32): python3-cephfs-19.0.0-5847.g79766939.el 836 kB/s | 188 kB 00:00 2024-08-19T11:07:37.549 INFO:teuthology.orchestra.run.smithi135.stdout:(10/32): python3-rados-19.0.0-5847.g79766939.el 7.3 MB/s | 371 kB 00:00 2024-08-19T11:07:37.574 INFO:teuthology.orchestra.run.smithi135.stdout:(11/32): python3-rbd-19.0.0-5847.g79766939.el9. 6.9 MB/s | 356 kB 00:00 2024-08-19T11:07:37.591 INFO:teuthology.orchestra.run.smithi135.stdout:(12/32): python3-rgw-19.0.0-5847.g79766939.el9. 2.7 MB/s | 116 kB 00:00 2024-08-19T11:07:37.717 INFO:teuthology.orchestra.run.smithi135.stdout:(13/32): librgw2-19.0.0-5847.g79766939.el9.x86_ 9.8 MB/s | 5.5 MB 00:00 2024-08-19T11:07:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:07:37.759 INFO:teuthology.orchestra.run.smithi135.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 582 kB/s | 107 kB 00:00 2024-08-19T11:07:37.817 INFO:teuthology.orchestra.run.smithi135.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 710 kB/s | 160 kB 00:00 2024-08-19T11:07:37.841 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-08-19T11:07:37.842 INFO:teuthology.orchestra.run.smithi135.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 360 kB/s | 45 kB 00:00 2024-08-19T11:07:37.879 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-08-19T11:07:37.913 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-08-19T11:07:37.917 INFO:teuthology.orchestra.run.smithi135.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 564 kB/s | 42 kB 00:00 2024-08-19T11:07:37.936 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-19T11:07:37.943 INFO:teuthology.orchestra.run.smithi135.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-08-19T11:07:37.960 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-19T11:07:37.976 INFO:teuthology.orchestra.run.smithi135.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-08-19T11:07:38.002 INFO:teuthology.orchestra.run.smithi135.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 613 kB/s | 36 kB 00:00 2024-08-19T11:07:38.027 INFO:teuthology.orchestra.run.smithi135.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-08-19T11:07:38.061 INFO:teuthology.orchestra.run.smithi135.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-08-19T11:07:38.102 INFO:teuthology.orchestra.run.smithi135.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-08-19T11:07:38.128 INFO:teuthology.orchestra.run.smithi135.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-08-19T11:07:38.153 INFO:teuthology.orchestra.run.smithi135.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-08-19T11:07:38.178 INFO:teuthology.orchestra.run.smithi135.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-19T11:07:38.203 INFO:teuthology.orchestra.run.smithi135.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 7.6 MB/s | 192 kB 00:00 2024-08-19T11:07:38.238 INFO:teuthology.orchestra.run.smithi135.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-08-19T11:07:38.250 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-19T11:07:38.287 INFO:teuthology.orchestra.run.smithi135.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-19T11:07:38.315 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-19T11:07:38.379 INFO:teuthology.orchestra.run.smithi135.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-08-19T11:07:38.496 INFO:teuthology.orchestra.run.smithi135.stdout:(31/32): librbd1-19.0.0-5847.g79766939.el9.x86_ 16 MB/s | 3.2 MB 00:00 2024-08-19T11:07:38.596 INFO:teuthology.orchestra.run.smithi135.stdout:(32/32): librados2-19.0.0-5847.g79766939.el9.x8 9.7 MB/s | 3.5 MB 00:00 2024-08-19T11:07:38.601 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:07:38.601 INFO:teuthology.orchestra.run.smithi135.stdout:Total 23 MB/s | 62 MB 00:02 2024-08-19T11:07:38.704 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:07:38.711 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-08-19T11:07:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:07:38.740 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:07:38.840 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.0.0-5847.g79766939.el9.x86_64 7/34 2024-08-19T11:07:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.0.0-5847.g79766939.el9.x86_64 7/34 2024-08-19T11:07:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 8/34 2024-08-19T11:07:39.049 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 9/34 2024-08-19T11:07:39.137 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 9/34 2024-08-19T11:07:39.157 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-08-19T11:07:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.0.0-5847.g79766939.el9. 11/34 2024-08-19T11:07:39.223 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:07:39.224 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:07:39.263 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 12/34 2024-08-19T11:07:39.285 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_6 13/34 2024-08-19T11:07:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_6 13/34 2024-08-19T11:07:39.383 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-08-19T11:07:39.494 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-08-19T11:07:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-08-19T11:07:39.566 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-08-19T11:07:39.591 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-08-19T11:07:39.620 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-08-19T11:07:39.653 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-08-19T11:07:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-08-19T11:07:40.016 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.0.0-5847.g79766939.el9.x86_64 22/34 2024-08-19T11:07:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.0.0-5847.g79766939.el9.x86_64 22/34 2024-08-19T11:07:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 23/34 2024-08-19T11:07:40.189 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-08-19T11:07:40.679 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:07:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-08-19T11:07:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.0.0-5847.g79766939.el9.x86_64 26/34 2024-08-19T11:07:40.763 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-08-19T11:07:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.0.0-5847.g79766939.el9.x86_64 26/34 2024-08-19T11:07:40.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-08-19T11:07:40.826 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-08-19T11:07:40.849 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-19T11:07:40.866 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 27/34 2024-08-19T11:07:40.876 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-08-19T11:07:40.895 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.0.0-5847.g79766939.el9.x8 28/34 2024-08-19T11:07:41.142 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-19T11:07:41.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-08-19T11:07:41.535 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-08-19T11:07:41.670 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-5847.g79766939.el9.x86_64 7/34 2024-08-19T11:07:41.791 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-5847.g79766939.el9.x86_64 7/34 2024-08-19T11:07:41.886 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 8/34 2024-08-19T11:07:41.921 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 9/34 2024-08-19T11:07:41.984 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 9/34 2024-08-19T11:07:42.021 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-08-19T11:07:42.068 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-5847.g79766939.el9. 11/34 2024-08-19T11:07:42.135 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 12/34 2024-08-19T11:07:42.157 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_6 13/34 2024-08-19T11:07:42.221 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_6 13/34 2024-08-19T11:07:42.255 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-08-19T11:07:42.366 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-08-19T11:07:42.406 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-08-19T11:07:42.446 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-08-19T11:07:42.480 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-08-19T11:07:42.509 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-08-19T11:07:42.541 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-08-19T11:07:42.864 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-08-19T11:07:42.921 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-5847.g79766939.el9.x86_64 22/34 2024-08-19T11:07:43.008 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-5847.g79766939.el9.x86_64 22/34 2024-08-19T11:07:43.034 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 23/34 2024-08-19T11:07:43.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-08-19T11:07:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 29/34 2024-08-19T11:07:43.283 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 29/34 2024-08-19T11:07:43.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-08-19T11:07:43.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-5847.g79766939.el9.x86_64 26/34 2024-08-19T11:07:43.663 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-5847.g79766939.el9.x86_64 26/34 2024-08-19T11:07:43.739 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 27/34 2024-08-19T11:07:43.767 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-5847.g79766939.el9.x8 28/34 2024-08-19T11:07:43.836 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 29/34 2024-08-19T11:07:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 30/34 2024-08-19T11:07:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 30/34 2024-08-19T11:07:43.969 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T11:07:43.969 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T11:07:43.969 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:43.998 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 31/34 2024-08-19T11:07:46.126 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 29/34 2024-08-19T11:07:46.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 29/34 2024-08-19T11:07:46.728 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 29/34 2024-08-19T11:07:46.771 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 30/34 2024-08-19T11:07:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 30/34 2024-08-19T11:07:46.863 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T11:07:46.863 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T11:07:46.863 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:07:46.897 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 31/34 2024-08-19T11:07:53.877 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 31/34 2024-08-19T11:07:53.877 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-08-19T11:07:53.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:54.902 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 32/34 2024-08-19T11:07:54.926 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 32/34 2024-08-19T11:07:54.926 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:07:54.926 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T11:07:54.926 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T11:07:54.927 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T11:07:54.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:54.928 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-19T11:07:55.021 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-19T11:07:55.021 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-19T11:07:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-19T11:07:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 1/34 2024-08-19T11:07:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 2/34 2024-08-19T11:07:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 3/34 2024-08-19T11:07:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 4/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 5/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_6 6/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.0.0-5847.g79766939.el9.x86_64 7/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5847.g79766939.el9. 8/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.0.0-5847.g79766939.el9.x8 9/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 10/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 11/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 12/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 13/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-08-19T11:07:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-08-19T11:07:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-08-19T11:07:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-08-19T11:07:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.0.0-5847.g79766939.el9.x86_64 31/34 2024-08-19T11:07:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-08-19T11:07:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.0.0-5847.g79766939.el9.x86_64 33/34 2024-08-19T11:07:56.606 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 31/34 2024-08-19T11:07:56.606 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-08-19T11:07:56.606 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-08-19T11:07:56.606 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-08-19T11:07:56.606 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-08-19T11:07:56.606 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-08-19T11:07:56.607 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-08-19T11:07:56.607 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-08-19T11:07:56.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:07:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-08-19T11:07:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:57.173 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-08-19T11:07:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T11:07:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:57.176 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:07:57.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2024-08-19T11:07:57.630 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 32/34 2024-08-19T11:07:57.657 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 32/34 2024-08-19T11:07:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:07:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T11:07:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T11:07:57.657 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T11:07:57.658 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:07:57.659 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-19T11:07:57.750 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-08-19T11:07:57.750 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-19T11:07:57.976 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:27 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:07:58.105 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:07:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:07:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:07:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:07:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:07:58.107 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.0.0-5847.g79766939.el9 ceph 50 M 2024-08-19T11:07:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.0.0-5847.g79766939.el9 ceph 163 k 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 51 M 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 216 M 2024-08-19T11:07:58.108 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:07:58.566 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-08-19T11:07:58.625 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): libcephsqlite-19.0.0-5847.g79766939.el9. 618 kB/s | 163 kB 00:00 2024-08-19T11:07:58.659 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 690 kB/s | 64 kB 00:00 2024-08-19T11:07:59.191 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 1/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 2/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 3/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 4/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 5/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_6 6/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-5847.g79766939.el9.x86_64 7/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5847.g79766939.el9. 8/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-5847.g79766939.el9.x8 9/34 2024-08-19T11:07:59.192 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 10/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 11/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 12/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 13/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-08-19T11:07:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-08-19T11:07:59.194 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-08-19T11:07:59.195 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-08-19T11:07:59.195 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-5847.g79766939.el9.x86_64 31/34 2024-08-19T11:07:59.195 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-08-19T11:07:59.195 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-5847.g79766939.el9.x86_64 33/34 2024-08-19T11:08:00.019 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): ceph-test-19.0.0-5847.g79766939.el9.x86_ 30 MB/s | 50 MB 00:01 2024-08-19T11:08:00.021 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:00.022 INFO:teuthology.orchestra.run.smithi071.stdout:Total 27 MB/s | 51 MB 00:01 2024-08-19T11:08:00.049 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:00.059 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-08-19T11:08:00.059 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:00.059 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T11:08:00.060 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.061 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T11:08:00.062 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T11:08:00.063 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:00.063 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:00.069 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:00.069 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:00.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-test 2024-08-19T11:08:00.450 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:00.450 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:00.886 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:27 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:00.984 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:01.019 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-5847.g79766939.el9 ceph 50 M 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-5847.g79766939.el9 ceph 163 k 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T11:08:01.020 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 51 M 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 216 M 2024-08-19T11:08:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-19T11:08:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-19T11:08:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 3/4 2024-08-19T11:08:01.398 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-08-19T11:08:01.465 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-08-19T11:08:01.499 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): libcephsqlite-19.0.0-5847.g79766939.el9. 745 kB/s | 163 kB 00:00 2024-08-19T11:08:02.878 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): ceph-test-19.0.0-5847.g79766939.el9.x86_ 31 MB/s | 50 MB 00:01 2024-08-19T11:08:02.880 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:02.881 INFO:teuthology.orchestra.run.smithi135.stdout:Total 27 MB/s | 51 MB 00:01 2024-08-19T11:08:02.910 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:02.929 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:02.929 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:03.311 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:03.311 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:08:03.849 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:08:03.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-19T11:08:03.977 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-19T11:08:04.005 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 3/4 2024-08-19T11:08:05.816 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 3/4 2024-08-19T11:08:05.893 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 4/4 2024-08-19T11:08:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 4/4 2024-08-19T11:08:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 1/4 2024-08-19T11:08:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 2/4 2024-08-19T11:08:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T11:08:08.660 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:08.661 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:08.716 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 3/4 2024-08-19T11:08:08.786 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 4/4 2024-08-19T11:08:08.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2024-08-19T11:08:09.510 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:39 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:09.648 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.0.0-5847.g79766939.el9 ceph 6.6 k 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.0.0-5847.g79766939.el9 ceph 2.4 M 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.0.0-5847.g79766939.el9 ceph 1.5 M 2024-08-19T11:08:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 284 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.0.0-5847.g79766939.el9 ceph 4.8 M 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.0.0-5847.g79766939.el9 ceph 17 M 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T11:08:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T11:08:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:09.654 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:09.655 INFO:teuthology.orchestra.run.smithi071.stdout:Install 37 Packages 2024-08-19T11:08:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:09.655 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 31 M 2024-08-19T11:08:09.655 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 109 M 2024-08-19T11:08:09.655 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:10.232 INFO:teuthology.orchestra.run.smithi071.stdout:(1/37): ceph-19.0.0-5847.g79766939.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-08-19T11:08:10.440 INFO:teuthology.orchestra.run.smithi071.stdout:(2/37): ceph-mgr-19.0.0-5847.g79766939.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-08-19T11:08:10.498 INFO:teuthology.orchestra.run.smithi071.stdout:(3/37): ceph-mds-19.0.0-5847.g79766939.el9.x86_ 6.1 MB/s | 2.4 MB 00:00 2024-08-19T11:08:10.574 INFO:teuthology.orchestra.run.smithi071.stdout:(4/37): ceph-mon-19.0.0-5847.g79766939.el9.x86_ 14 MB/s | 4.8 MB 00:00 2024-08-19T11:08:10.601 INFO:teuthology.orchestra.run.smithi071.stdout:(5/37): ceph-mgr-modules-core-19.0.0-5847.g7976 2.8 MB/s | 284 kB 00:00 2024-08-19T11:08:10.766 INFO:teuthology.orchestra.run.smithi071.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-08-19T11:08:10.817 INFO:teuthology.orchestra.run.smithi071.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-19T11:08:10.876 INFO:teuthology.orchestra.run.smithi071.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 4.4 MB/s | 1.2 MB 00:00 2024-08-19T11:08:10.901 INFO:teuthology.orchestra.run.smithi071.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-08-19T11:08:10.926 INFO:teuthology.orchestra.run.smithi071.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-08-19T11:08:11.110 INFO:teuthology.orchestra.run.smithi071.stdout:(11/37): ceph-osd-19.0.0-5847.g79766939.el9.x86 26 MB/s | 17 MB 00:00 2024-08-19T11:08:11.135 INFO:teuthology.orchestra.run.smithi071.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 917 kB/s | 215 kB 00:00 2024-08-19T11:08:11.177 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 4/4 2024-08-19T11:08:11.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 1/4 2024-08-19T11:08:11.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 2/4 2024-08-19T11:08:11.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-19T11:08:11.252 INFO:teuthology.orchestra.run.smithi071.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 298 kB/s | 35 kB 00:00 2024-08-19T11:08:11.311 INFO:teuthology.orchestra.run.smithi071.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 859 kB/s | 172 kB 00:00 2024-08-19T11:08:11.336 INFO:teuthology.orchestra.run.smithi071.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 460 kB/s | 188 kB 00:00 2024-08-19T11:08:11.361 INFO:teuthology.orchestra.run.smithi071.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 709 kB/s | 77 kB 00:00 2024-08-19T11:08:11.386 INFO:teuthology.orchestra.run.smithi071.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-08-19T11:08:11.420 INFO:teuthology.orchestra.run.smithi071.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-08-19T11:08:11.454 INFO:teuthology.orchestra.run.smithi071.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-08-19T11:08:11.474 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:11.475 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:11.479 INFO:teuthology.orchestra.run.smithi071.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 763 kB/s | 43 kB 00:00 2024-08-19T11:08:11.513 INFO:teuthology.orchestra.run.smithi071.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-08-19T11:08:11.538 INFO:teuthology.orchestra.run.smithi071.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 126 kB/s | 22 kB 00:00 2024-08-19T11:08:11.563 INFO:teuthology.orchestra.run.smithi071.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-08-19T11:08:11.597 INFO:teuthology.orchestra.run.smithi071.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 884 kB/s | 23 kB 00:00 2024-08-19T11:08:11.622 INFO:teuthology.orchestra.run.smithi071.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 843 kB/s | 19 kB 00:00 2024-08-19T11:08:11.647 INFO:teuthology.orchestra.run.smithi071.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 162 kB/s | 18 kB 00:00 2024-08-19T11:08:11.673 INFO:teuthology.orchestra.run.smithi071.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-08-19T11:08:11.698 INFO:teuthology.orchestra.run.smithi071.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-08-19T11:08:11.723 INFO:teuthology.orchestra.run.smithi071.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-08-19T11:08:11.749 INFO:teuthology.orchestra.run.smithi071.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-08-19T11:08:11.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph 2024-08-19T11:08:11.774 INFO:teuthology.orchestra.run.smithi071.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-08-19T11:08:11.799 INFO:teuthology.orchestra.run.smithi071.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-08-19T11:08:11.825 INFO:teuthology.orchestra.run.smithi071.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-08-19T11:08:11.859 INFO:teuthology.orchestra.run.smithi071.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-08-19T11:08:11.884 INFO:teuthology.orchestra.run.smithi071.stdout:(35/37): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-19T11:08:11.909 INFO:teuthology.orchestra.run.smithi071.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-08-19T11:08:11.934 INFO:teuthology.orchestra.run.smithi071.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-08-19T11:08:11.939 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:11.939 INFO:teuthology.orchestra.run.smithi071.stdout:Total 13 MB/s | 31 MB 00:02 2024-08-19T11:08:12.091 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:12.131 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:12.131 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:12.331 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:39 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:12.433 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:12.433 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:12.480 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-5847.g79766939.el9 ceph 6.6 k 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-5847.g79766939.el9 ceph 2.4 M 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-5847.g79766939.el9 ceph 1.5 M 2024-08-19T11:08:12.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 284 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-5847.g79766939.el9 ceph 4.8 M 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-5847.g79766939.el9 ceph 17 M 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T11:08:12.484 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T11:08:12.485 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:12.486 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:12.487 INFO:teuthology.orchestra.run.smithi135.stdout:Install 37 Packages 2024-08-19T11:08:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:12.487 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 31 M 2024-08-19T11:08:12.487 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 109 M 2024-08-19T11:08:12.487 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:13.295 INFO:teuthology.orchestra.run.smithi135.stdout:(1/37): ceph-19.0.0-5847.g79766939.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-08-19T11:08:13.478 INFO:teuthology.orchestra.run.smithi135.stdout:(2/37): ceph-mds-19.0.0-5847.g79766939.el9.x86_ 7.3 MB/s | 2.4 MB 00:00 2024-08-19T11:08:13.520 INFO:teuthology.orchestra.run.smithi135.stdout:(3/37): ceph-mgr-19.0.0-5847.g79766939.el9.x86_ 4.2 MB/s | 1.5 MB 00:00 2024-08-19T11:08:13.612 INFO:teuthology.orchestra.run.smithi135.stdout:(4/37): ceph-mgr-modules-core-19.0.0-5847.g7976 3.0 MB/s | 284 kB 00:00 2024-08-19T11:08:13.788 INFO:teuthology.orchestra.run.smithi135.stdout:(5/37): ceph-mon-19.0.0-5847.g79766939.el9.x86_ 9.7 MB/s | 4.8 MB 00:00 2024-08-19T11:08:13.813 INFO:teuthology.orchestra.run.smithi135.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-08-19T11:08:13.827 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:13.855 INFO:teuthology.orchestra.run.smithi135.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-19T11:08:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-08-19T11:08:13.897 INFO:teuthology.orchestra.run.smithi135.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.1 MB/s | 135 kB 00:00 2024-08-19T11:08:13.928 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-08-19T11:08:13.956 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-08-19T11:08:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-08-19T11:08:14.056 INFO:teuthology.orchestra.run.smithi135.stdout:(9/37): ceph-osd-19.0.0-5847.g79766939.el9.x86_ 30 MB/s | 17 MB 00:00 2024-08-19T11:08:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-08-19T11:08:14.081 INFO:teuthology.orchestra.run.smithi135.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 679 kB/s | 125 kB 00:00 2024-08-19T11:08:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-08-19T11:08:14.131 INFO:teuthology.orchestra.run.smithi135.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 3.6 MB/s | 1.2 MB 00:00 2024-08-19T11:08:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-08-19T11:08:14.215 INFO:teuthology.orchestra.run.smithi135.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.3 MB/s | 215 kB 00:00 2024-08-19T11:08:14.283 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-08-19T11:08:14.324 INFO:teuthology.orchestra.run.smithi135.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-08-19T11:08:14.325 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/37 2024-08-19T11:08:14.349 INFO:teuthology.orchestra.run.smithi135.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 704 kB/s | 188 kB 00:00 2024-08-19T11:08:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-08-19T11:08:14.374 INFO:teuthology.orchestra.run.smithi135.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 710 kB/s | 172 kB 00:00 2024-08-19T11:08:14.390 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-08-19T11:08:14.425 INFO:teuthology.orchestra.run.smithi135.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-08-19T11:08:14.441 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-08-19T11:08:14.459 INFO:teuthology.orchestra.run.smithi135.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-08-19T11:08:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-08-19T11:08:14.484 INFO:teuthology.orchestra.run.smithi135.stdout:(18/37): python3-packaging-20.9-5.el9.noarch.rp 484 kB/s | 77 kB 00:00 2024-08-19T11:08:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-08-19T11:08:14.526 INFO:teuthology.orchestra.run.smithi135.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-08-19T11:08:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-08-19T11:08:14.551 INFO:teuthology.orchestra.run.smithi135.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-08-19T11:08:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-08-19T11:08:14.585 INFO:teuthology.orchestra.run.smithi135.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-08-19T11:08:14.610 INFO:teuthology.orchestra.run.smithi135.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-08-19T11:08:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-08-19T11:08:14.636 INFO:teuthology.orchestra.run.smithi135.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 220 kB/s | 11 kB 00:00 2024-08-19T11:08:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-08-19T11:08:14.662 INFO:teuthology.orchestra.run.smithi135.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-08-19T11:08:14.686 INFO:teuthology.orchestra.run.smithi135.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-08-19T11:08:14.712 INFO:teuthology.orchestra.run.smithi135.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-08-19T11:08:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-08-19T11:08:14.737 INFO:teuthology.orchestra.run.smithi135.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-08-19T11:08:14.762 INFO:teuthology.orchestra.run.smithi135.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-08-19T11:08:14.788 INFO:teuthology.orchestra.run.smithi135.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-08-19T11:08:14.813 INFO:teuthology.orchestra.run.smithi135.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-08-19T11:08:14.830 INFO:teuthology.orchestra.run.smithi135.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-08-19T11:08:14.855 INFO:teuthology.orchestra.run.smithi135.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-08-19T11:08:14.860 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-08-19T11:08:14.881 INFO:teuthology.orchestra.run.smithi135.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-08-19T11:08:14.906 INFO:teuthology.orchestra.run.smithi135.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-08-19T11:08:14.923 INFO:teuthology.orchestra.run.smithi135.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-08-19T11:08:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-08-19T11:08:14.948 INFO:teuthology.orchestra.run.smithi135.stdout:(36/37): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-19T11:08:14.974 INFO:teuthology.orchestra.run.smithi135.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-08-19T11:08:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:14.978 INFO:teuthology.orchestra.run.smithi135.stdout:Total 12 MB/s | 31 MB 00:02 2024-08-19T11:08:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-08-19T11:08:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-08-19T11:08:15.090 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-08-19T11:08:15.128 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:15.145 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-08-19T11:08:15.167 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:15.168 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-08-19T11:08:15.388 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-08-19T11:08:15.466 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-08-19T11:08:15.466 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:15.468 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:08:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-08-19T11:08:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-08-19T11:08:15.724 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-08-19T11:08:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5847.g79766939.el9. 32/37 2024-08-19T11:08:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 33/37 2024-08-19T11:08:15.940 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 33/37 2024-08-19T11:08:15.940 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:15.941 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T11:08:15.941 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T11:08:15.941 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T11:08:15.941 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:16.823 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:08:16.877 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-08-19T11:08:16.918 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-08-19T11:08:16.946 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-08-19T11:08:17.034 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-08-19T11:08:17.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-08-19T11:08:17.103 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-08-19T11:08:17.196 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-08-19T11:08:17.265 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-08-19T11:08:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/37 2024-08-19T11:08:17.350 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-08-19T11:08:17.380 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-08-19T11:08:17.398 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 34/37 2024-08-19T11:08:17.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-08-19T11:08:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 34/37 2024-08-19T11:08:17.425 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:17.425 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T11:08:17.425 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T11:08:17.425 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T11:08:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:17.456 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-08-19T11:08:17.506 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-08-19T11:08:17.540 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-08-19T11:08:17.592 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-08-19T11:08:17.640 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-08-19T11:08:17.672 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-08-19T11:08:17.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-08-19T11:08:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 35/37 2024-08-19T11:08:17.890 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 35/37 2024-08-19T11:08:17.890 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:17.890 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T11:08:17.890 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T11:08:17.890 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T11:08:17.891 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:17.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-08-19T11:08:17.973 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-08-19T11:08:18.027 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-08-19T11:08:18.073 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-08-19T11:08:18.117 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 36/37 2024-08-19T11:08:18.131 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-08-19T11:08:18.141 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 36/37 2024-08-19T11:08:18.141 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:18.141 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T11:08:18.141 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T11:08:18.141 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T11:08:18.141 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-08-19T11:08:18.203 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.0.0-5847.g79766939.el9.x86_64 37/37 2024-08-19T11:08:18.379 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-08-19T11:08:18.429 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-08-19T11:08:18.506 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-08-19T11:08:18.596 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-08-19T11:08:18.636 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-08-19T11:08:18.761 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-08-19T11:08:18.917 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5847.g79766939.el9. 32/37 2024-08-19T11:08:18.948 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 33/37 2024-08-19T11:08:18.974 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 33/37 2024-08-19T11:08:18.974 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:18.974 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T11:08:18.975 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T11:08:18.975 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T11:08:18.975 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:19.943 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:19.0.0-5847.g79766939.el9.x86_64 37/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.0.0-5847.g79766939.el9.x86_64 1/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 2/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 3/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 4/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 5/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5847.g79766939.el9. 6/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-08-19T11:08:19.944 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-08-19T11:08:19.945 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 35/37 2024-08-19T11:08:19.946 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-08-19T11:08:20.432 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 34/37 2024-08-19T11:08:20.460 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 34/37 2024-08-19T11:08:20.460 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:20.460 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T11:08:20.460 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T11:08:20.460 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T11:08:20.460 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T11:08:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T11:08:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T11:08:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T11:08:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T11:08:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:20.878 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 35/37 2024-08-19T11:08:20.932 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 35/37 2024-08-19T11:08:20.933 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:20.933 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T11:08:20.933 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T11:08:20.933 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T11:08:20.933 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 36/37 2024-08-19T11:08:21.183 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 36/37 2024-08-19T11:08:21.183 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:21.183 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T11:08:21.183 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T11:08:21.183 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T11:08:21.183 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:21.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2024-08-19T11:08:21.246 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-5847.g79766939.el9.x86_64 37/37 2024-08-19T11:08:21.751 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:51 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:21.835 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:08:21.876 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:21.878 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:08:21.878 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:21.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2024-08-19T11:08:22.481 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:52 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:22.605 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:22.605 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 772 k 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:08:22.606 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:22.607 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 772 k 2024-08-19T11:08:22.607 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 779 k 2024-08-19T11:08:22.607 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:22.884 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-19.0.0-5847.g79766939.el9.noarch.rpm 2.7 MB/s | 772 kB 00:00 2024-08-19T11:08:22.884 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:22.884 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.7 MB/s | 772 kB 00:00 2024-08-19T11:08:22.885 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:22.890 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:22.890 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:22.896 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:22.896 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:23.019 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-2:19.0.0-5847.g79766939.el9.x86_64 37/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-5847.g79766939.el9.x86_64 1/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 2/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 3/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 4/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 5/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5847.g79766939.el9. 6/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-08-19T11:08:23.020 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-08-19T11:08:23.021 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 35/37 2024-08-19T11:08:23.022 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-08-19T11:08:23.445 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T11:08:24.041 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T11:08:24.042 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T11:08:24.043 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T11:08:24.044 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T11:08:24.044 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T11:08:24.044 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T11:08:24.044 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:24.044 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:24.094 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:24.095 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:24.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2024-08-19T11:08:24.382 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-base 2024-08-19T11:08:24.867 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:54 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:24.930 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:51 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:24.998 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:24.999 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:24.999 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-08-19T11:08:24.999 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5847.g79766939.el9 ceph 145 k 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 145 k 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 436 k 2024-08-19T11:08:25.000 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:25.014 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-base-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:08:25.056 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:25.057 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:08:25.057 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:25.124 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install cephadm 2024-08-19T11:08:25.208 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-19.0.0-5847.g797669 697 kB/s | 145 kB 00:00 2024-08-19T11:08:25.208 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:25.208 INFO:teuthology.orchestra.run.smithi071.stdout:Total 691 kB/s | 145 kB 00:00 2024-08-19T11:08:25.209 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:25.216 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:25.216 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:25.272 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:25.273 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:25.475 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5847.g79766939. 1/1 2024-08-19T11:08:25.500 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5847.g79766939. 1/1 2024-08-19T11:08:25.501 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:25.501 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T11:08:25.501 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:25.667 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:52 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:25.794 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:25.794 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:25.794 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 772 k 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 772 k 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 779 k 2024-08-19T11:08:25.795 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:26.055 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm-19.0.0-5847.g79766939.el9.noarch.rpm 2.9 MB/s | 772 kB 00:00 2024-08-19T11:08:26.055 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:26.055 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.9 MB/s | 772 kB 00:00 2024-08-19T11:08:26.055 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:26.060 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:26.060 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:26.066 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:26.066 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:08:26.141 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:08:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5847.g79766939. 1/1 2024-08-19T11:08:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:26.457 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:26.457 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:26.624 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:26.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2024-08-19T11:08:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:27.029 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:27.224 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:57 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:27.276 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:08:27.276 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:27.276 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:27.276 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:27.277 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:27.277 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:27.311 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:08:27.355 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:27.356 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:08:27.356 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:27.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2024-08-19T11:08:27.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-immutable-object-cache 2024-08-19T11:08:27.948 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:57 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:28.034 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:55 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:28.073 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 14 M 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:08:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 34 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 16 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:28.075 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:28.076 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-08-19T11:08:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:28.076 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 19 M 2024-08-19T11:08:28.076 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 158 M 2024-08-19T11:08:28.076 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:28.165 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5847.g79766939.el9 ceph 145 k 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:08:28.166 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:28.167 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 145 k 2024-08-19T11:08:28.167 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 436 k 2024-08-19T11:08:28.167 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:28.373 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-immutable-object-cache-19.0.0-5847.g797669 703 kB/s | 145 kB 00:00 2024-08-19T11:08:28.373 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:28.374 INFO:teuthology.orchestra.run.smithi135.stdout:Total 696 kB/s | 145 kB 00:00 2024-08-19T11:08:28.374 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:28.381 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:28.381 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:28.438 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:28.438 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:08:28.584 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:08:28.666 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5847.g79766939. 1/1 2024-08-19T11:08:28.688 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): ceph-grafana-dashboards-19.0.0-5847.g79 224 kB/s | 34 kB 00:00 2024-08-19T11:08:28.691 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5847.g79766939. 1/1 2024-08-19T11:08:28.691 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:08:28.691 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T11:08:28.691 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:28.705 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): ceph-prometheus-alerts-19.0.0-5847.g797 97 kB/s | 16 kB 00:00 2024-08-19T11:08:28.830 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-08-19T11:08:28.939 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-08-19T11:08:28.997 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-08-19T11:08:29.023 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-08-19T11:08:29.081 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-08-19T11:08:29.107 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-08-19T11:08:29.140 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.1 MB/s | 31 kB 00:00 2024-08-19T11:08:29.299 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): ceph-mgr-dashboard-19.0.0-5847.g797669 18 MB/s | 14 MB 00:00 2024-08-19T11:08:29.324 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-08-19T11:08:29.574 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5847.g79766939. 1/1 2024-08-19T11:08:29.575 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:29.575 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:29.575 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:08:29.575 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:29.575 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:29.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr 2024-08-19T11:08:29.924 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 789 kB/s | 863 kB 00:01 2024-08-19T11:08:29.929 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:29.929 INFO:teuthology.orchestra.run.smithi071.stdout:Total 10 MB/s | 19 MB 00:01 2024-08-19T11:08:29.981 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:30.222 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:30.224 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:30.344 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:57 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:30.431 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-mgr-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:08:30.474 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:30.475 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:08:30.475 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:30.538 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-dashboard 2024-08-19T11:08:30.818 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:30.892 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-08-19T11:08:30.927 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-08-19T11:08:30.973 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-08-19T11:08:31.012 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-08-19T11:08:31.081 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:58 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:31.088 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-08-19T11:08:31.207 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:31.208 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:31.208 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:08:31.208 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:31.208 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:31.208 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 14 M 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 34 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 16 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:31.209 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:31.210 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:31.210 INFO:teuthology.orchestra.run.smithi135.stdout:Install 12 Packages 2024-08-19T11:08:31.210 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:31.210 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 19 M 2024-08-19T11:08:31.210 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 158 M 2024-08-19T11:08:31.210 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:31.222 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-08-19T11:08:31.311 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-08-19T11:08:31.368 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-08-19T11:08:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-08-19T11:08:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5847.g79766939.el9 10/12 2024-08-19T11:08:31.647 INFO:teuthology.orchestra.run.smithi135.stdout:(1/12): ceph-prometheus-alerts-19.0.0-5847.g797 99 kB/s | 16 kB 00:00 2024-08-19T11:08:31.664 INFO:teuthology.orchestra.run.smithi135.stdout:(2/12): ceph-grafana-dashboards-19.0.0-5847.g79 187 kB/s | 34 kB 00:00 2024-08-19T11:08:32.123 INFO:teuthology.orchestra.run.smithi135.stdout:(3/12): ceph-mgr-dashboard-19.0.0-5847.g7976693 22 MB/s | 14 MB 00:00 2024-08-19T11:08:32.173 INFO:teuthology.orchestra.run.smithi135.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 529 kB/s | 269 kB 00:00 2024-08-19T11:08:32.224 INFO:teuthology.orchestra.run.smithi135.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-08-19T11:08:32.240 INFO:teuthology.orchestra.run.smithi135.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-08-19T11:08:32.299 INFO:teuthology.orchestra.run.smithi135.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-08-19T11:08:32.325 INFO:teuthology.orchestra.run.smithi135.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-08-19T11:08:32.342 INFO:teuthology.orchestra.run.smithi135.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-08-19T11:08:32.384 INFO:teuthology.orchestra.run.smithi135.stdout:(10/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-08-19T11:08:32.409 INFO:teuthology.orchestra.run.smithi135.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-08-19T11:08:32.484 INFO:teuthology.orchestra.run.smithi135.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.3 MB/s | 863 kB 00:00 2024-08-19T11:08:32.487 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:32.487 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 19 MB 00:01 2024-08-19T11:08:32.535 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:32.553 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:32.553 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:32.778 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:32.778 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:08:33.371 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:08:33.468 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-08-19T11:08:33.520 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-08-19T11:08:33.566 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-08-19T11:08:33.606 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-08-19T11:08:33.682 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-08-19T11:08:33.807 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-08-19T11:08:33.893 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-08-19T11:08:33.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-08-19T11:08:33.966 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-08-19T11:08:33.999 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5847.g79766939.el9 10/12 2024-08-19T11:08:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5847.g79766939.el 11/12 2024-08-19T11:08:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noa 12/12 2024-08-19T11:08:36.663 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noa 12/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5847.g79766939.el 1/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noa 2/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5847.g79766939.el9 3/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-08-19T11:08:36.664 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-08-19T11:08:36.665 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-08-19T11:08:36.665 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-08-19T11:08:36.665 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-08-19T11:08:36.665 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-08-19T11:08:36.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-08-19T11:08:36.970 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:36.970 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:36.970 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T11:08:36.970 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:36.971 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:37.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5847.g79766939.el 11/12 2024-08-19T11:08:37.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-19T11:08:37.247 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noa 12/12 2024-08-19T11:08:37.769 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:07 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:37.898 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 7.4 M 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T11:08:37.899 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-08-19T11:08:37.900 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-08-19T11:08:37.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:37.901 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 38 M 2024-08-19T11:08:37.901 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 209 M 2024-08-19T11:08:37.901 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:38.400 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-08-19T11:08:38.517 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-08-19T11:08:38.542 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-08-19T11:08:38.592 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-08-19T11:08:38.685 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): ceph-mgr-diskprediction-local-19.0.0-58 16 MB/s | 7.4 MB 00:00 2024-08-19T11:08:38.701 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 324 kB/s | 35 kB 00:00 2024-08-19T11:08:38.818 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): python3-devel-3.9.19-4.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-08-19T11:08:39.101 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noa 12/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5847.g79766939.el 1/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noa 2/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5847.g79766939.el9 3/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-08-19T11:08:39.102 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-08-19T11:08:39.400 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-08-19T11:08:39.400 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:39.400 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:39.400 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T11:08:39.400 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:39.400 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:39.401 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:39.560 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.9 MB/s | 5.1 MB 00:00 2024-08-19T11:08:39.619 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-08-19T11:08:39.656 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-19T11:08:39.694 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 2.5 MB/s | 3.0 MB 00:01 2024-08-19T11:08:40.201 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:07 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:40.332 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 7.4 M 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T11:08:40.333 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout:Install 12 Packages 2024-08-19T11:08:40.334 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:40.335 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 38 M 2024-08-19T11:08:40.335 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 209 M 2024-08-19T11:08:40.335 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:40.519 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 2.6 MB/s | 4.7 MB 00:01 2024-08-19T11:08:40.915 INFO:teuthology.orchestra.run.smithi135.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-58 17 MB/s | 7.4 MB 00:00 2024-08-19T11:08:41.023 INFO:teuthology.orchestra.run.smithi135.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 303 kB/s | 33 kB 00:00 2024-08-19T11:08:41.274 INFO:teuthology.orchestra.run.smithi135.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 249 kB/s | 195 kB 00:00 2024-08-19T11:08:41.382 INFO:teuthology.orchestra.run.smithi135.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-08-19T11:08:41.424 INFO:teuthology.orchestra.run.smithi135.stdout:(5/12): libgfortran-11.4.1-3.el9.x86_64.rpm 859 kB/s | 803 kB 00:00 2024-08-19T11:08:41.467 INFO:teuthology.orchestra.run.smithi135.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 420 kB/s | 35 kB 00:00 2024-08-19T11:08:41.575 INFO:teuthology.orchestra.run.smithi135.stdout:(7/12): python3-devel-3.9.19-4.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-08-19T11:08:41.786 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.5 MB/s | 16 MB 00:02 2024-08-19T11:08:41.787 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:41.787 INFO:teuthology.orchestra.run.smithi071.stdout:Total 9.8 MB/s | 38 MB 00:03 2024-08-19T11:08:41.842 INFO:teuthology.orchestra.run.smithi135.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.7 MB/s | 3.0 MB 00:00 2024-08-19T11:08:41.984 INFO:teuthology.orchestra.run.smithi135.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-08-19T11:08:42.145 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:42.171 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:42.171 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:42.580 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:42.580 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:43.326 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:43.351 INFO:teuthology.orchestra.run.smithi135.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-08-19T11:08:43.382 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-19T11:08:43.426 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-19T11:08:43.434 INFO:teuthology.orchestra.run.smithi135.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 2.4 MB/s | 4.7 MB 00:02 2024-08-19T11:08:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-19T11:08:43.561 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 4/12 2024-08-19T11:08:43.737 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-19T11:08:43.768 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-19T11:08:43.844 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-19T11:08:44.481 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-19T11:08:44.597 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-19T11:08:45.830 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T11:08:46.859 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-19T11:08:46.886 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766 12/12 2024-08-19T11:08:49.592 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766 12/12 2024-08-19T11:08:49.593 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766 1/12 2024-08-19T11:08:49.593 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-19T11:08:49.593 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-19T11:08:49.593 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-19T11:08:49.593 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-19T11:08:49.594 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-19T11:08:49.594 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-19T11:08:49.594 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-19T11:08:49.594 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 9/12 2024-08-19T11:08:49.594 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T11:08:49.594 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-19T11:08:49.826 INFO:teuthology.orchestra.run.smithi135.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-08-19T11:08:49.827 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:49.827 INFO:teuthology.orchestra.run.smithi135.stdout:Total 4.0 MB/s | 38 MB 00:09 2024-08-19T11:08:50.038 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-19T11:08:50.038 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:50.038 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:50.038 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:50.038 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T11:08:50.038 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T11:08:50.039 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T11:08:50.039 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T11:08:50.039 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T11:08:50.039 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T11:08:50.039 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T11:08:50.039 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T11:08:50.040 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T11:08:50.040 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T11:08:50.040 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T11:08:50.040 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:50.040 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:50.186 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:50.212 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:50.212 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:50.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2024-08-19T11:08:50.623 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:50.623 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:08:50.953 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:20 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:51.080 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 49 k 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T11:08:51.081 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-08-19T11:08:51.082 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:51.083 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.2 M 2024-08-19T11:08:51.083 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 26 M 2024-08-19T11:08:51.083 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:51.396 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:08:51.414 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 196 kB/s | 19 kB 00:00 2024-08-19T11:08:51.439 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 208 kB/s | 26 kB 00:00 2024-08-19T11:08:51.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-19T11:08:51.498 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): ceph-mgr-rook-19.0.0-5847.g79766939.el9 271 kB/s | 49 kB 00:00 2024-08-19T11:08:51.507 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-19T11:08:51.523 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-08-19T11:08:51.548 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-19T11:08:51.573 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-08-19T11:08:51.605 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-19T11:08:51.615 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-08-19T11:08:51.641 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-08-19T11:08:51.659 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 4/12 2024-08-19T11:08:51.666 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-08-19T11:08:51.699 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-google-auth-2.33.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-08-19T11:08:51.725 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-19T11:08:51.750 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-08-19T11:08:51.792 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-08-19T11:08:51.795 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:51.795 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-08-19T11:08:51.838 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-19T11:08:51.858 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:51.867 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-19T11:08:51.872 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:51.872 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:51.943 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-19T11:08:51.957 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:51.959 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:52.466 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:52.582 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-19T11:08:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-19T11:08:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-19T11:08:52.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-19T11:08:52.733 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-19T11:08:52.769 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-19T11:08:52.811 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-19T11:08:52.913 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-19T11:08:53.015 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 7/13 2024-08-19T11:08:53.063 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-19T11:08:53.774 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-19T11:08:53.819 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-19T11:08:53.878 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-19T11:08:53.926 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T11:08:53.934 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-19T11:08:53.956 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 13/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 13/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 1/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-19T11:08:54.681 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-19T11:08:54.682 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-19T11:08:54.682 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-19T11:08:54.682 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 10/13 2024-08-19T11:08:54.682 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-19T11:08:54.682 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-19T11:08:54.992 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T11:08:55.001 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:55.002 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:08:55.030 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766 12/12 2024-08-19T11:08:55.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2024-08-19T11:08:55.816 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:25 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:08:55.944 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 150 k 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T11:08:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-08-19T11:08:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:08:55.947 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 7.0 M 2024-08-19T11:08:55.947 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 33 M 2024-08-19T11:08:55.947 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:08:56.715 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-08-19T11:08:56.741 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): ceph-mgr-cephadm-19.0.0-5847.g79766939.e 711 kB/s | 150 kB 00:00 2024-08-19T11:08:56.791 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-08-19T11:08:56.816 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 839 kB/s | 58 kB 00:00 2024-08-19T11:08:56.841 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-08-19T11:08:57.620 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766 12/12 2024-08-19T11:08:57.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766 1/12 2024-08-19T11:08:57.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-19T11:08:57.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-19T11:08:57.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-19T11:08:57.620 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-19T11:08:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-19T11:08:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-19T11:08:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-19T11:08:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 9/12 2024-08-19T11:08:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T11:08:57.621 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-19T11:08:57.833 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-08-19T11:08:57.835 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:57.836 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.7 MB/s | 7.0 MB 00:01 2024-08-19T11:08:57.908 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:08:57.919 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:08:57.920 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:08:58.018 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:08:58.020 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:08:58.023 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T11:08:58.024 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T11:08:58.025 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T11:08:58.025 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T11:08:58.025 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:58.025 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:08:58.329 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:08:58.395 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-rook 2024-08-19T11:08:58.525 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-19T11:08:58.577 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-19T11:08:58.950 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:25 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:08:59.075 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 49 k 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:08:59.076 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:08:59.077 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:08:59.078 INFO:teuthology.orchestra.run.smithi135.stdout:Install 13 Packages 2024-08-19T11:08:59.078 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:08:59.078 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 2.2 M 2024-08-19T11:08:59.078 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 26 M 2024-08-19T11:08:59.078 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:08:59.091 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-19T11:08:59.171 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-19T11:08:59.238 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-19T11:08:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 6/6 2024-08-19T11:08:59.386 INFO:teuthology.orchestra.run.smithi135.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 142 kB/s | 19 kB 00:00 2024-08-19T11:08:59.403 INFO:teuthology.orchestra.run.smithi135.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 169 kB/s | 26 kB 00:00 2024-08-19T11:08:59.419 INFO:teuthology.orchestra.run.smithi135.stdout:(3/13): ceph-mgr-rook-19.0.0-5847.g79766939.el9 292 kB/s | 49 kB 00:00 2024-08-19T11:08:59.553 INFO:teuthology.orchestra.run.smithi135.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-08-19T11:08:59.579 INFO:teuthology.orchestra.run.smithi135.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.1 MB/s | 222 kB 00:00 2024-08-19T11:08:59.612 INFO:teuthology.orchestra.run.smithi135.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 911 kB/s | 54 kB 00:00 2024-08-19T11:08:59.646 INFO:teuthology.orchestra.run.smithi135.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-08-19T11:08:59.672 INFO:teuthology.orchestra.run.smithi135.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-08-19T11:08:59.697 INFO:teuthology.orchestra.run.smithi135.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 170 kB/s | 14 kB 00:00 2024-08-19T11:08:59.731 INFO:teuthology.orchestra.run.smithi135.stdout:(10/13): python3-google-auth-2.33.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-08-19T11:08:59.756 INFO:teuthology.orchestra.run.smithi135.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-19T11:08:59.782 INFO:teuthology.orchestra.run.smithi135.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-08-19T11:08:59.823 INFO:teuthology.orchestra.run.smithi135.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-08-19T11:08:59.826 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:08:59.826 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-08-19T11:08:59.892 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:08:59.907 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:08:59.907 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:08:59.992 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:08:59.993 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:00.050 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 6/6 2024-08-19T11:09:00.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/6 2024-08-19T11:09:00.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-19T11:09:00.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-19T11:09:00.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-19T11:09:00.050 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T11:09:00.309 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T11:09:00.310 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T11:09:00.310 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T11:09:00.310 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:00.310 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:00.499 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:00.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2024-08-19T11:09:00.670 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-19T11:09:00.725 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-19T11:09:00.780 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-19T11:09:00.820 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-19T11:09:00.860 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-19T11:09:00.960 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-19T11:09:01.107 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:31 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:01.117 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 7/13 2024-08-19T11:09:01.189 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-19T11:09:01.234 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:01.234 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:01.234 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.0.0-5847.g79766939.el9 ceph 901 k 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2024-08-19T11:09:01.235 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:01.236 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 981 k 2024-08-19T11:09:01.236 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.9 M 2024-08-19T11:09:01.236 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:01.428 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 822 kB/s | 80 kB 00:00 2024-08-19T11:09:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): ceph-fuse-19.0.0-5847.g79766939.el9.x86_ 2.9 MB/s | 901 kB 00:00 2024-08-19T11:09:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:Total 2.4 MB/s | 981 kB 00:00 2024-08-19T11:09:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:01.671 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:01.671 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:01.750 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:01.751 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:01.903 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-19T11:09:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:01.954 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-19T11:09:01.996 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-19T11:09:02.045 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-19T11:09:02.075 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 13/13 2024-08-19T11:09:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-19T11:09:02.150 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 2/2 2024-08-19T11:09:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 13/13 2024-08-19T11:09:02.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 1/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 10/13 2024-08-19T11:09:02.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-19T11:09:02.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-19T11:09:02.801 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 2/2 2024-08-19T11:09:02.801 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/2 2024-08-19T11:09:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-19T11:09:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:03.075 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-19T11:09:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:03.075 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T11:09:03.088 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:03.089 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:03.349 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-cephadm 2024-08-19T11:09:03.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-volume 2024-08-19T11:09:03.899 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:30 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:03.930 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:04.028 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 150 k 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:09:04.029 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout:Install 6 Packages 2024-08-19T11:09:04.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:04.031 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 7.0 M 2024-08-19T11:09:04.031 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 33 M 2024-08-19T11:09:04.031 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:04.059 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 285 k 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:04.060 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 285 k 2024-08-19T11:09:04.061 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.3 M 2024-08-19T11:09:04.061 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:04.293 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-volume-19.0.0-5847.g79766939.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-08-19T11:09:04.293 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:04.294 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-08-19T11:09:04.294 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:04.302 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:04.302 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:04.322 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:04.323 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:04.323 INFO:teuthology.orchestra.run.smithi135.stdout:(1/6): ceph-mgr-cephadm-19.0.0-5847.g79766939.e 712 kB/s | 150 kB 00:00 2024-08-19T11:09:04.391 INFO:teuthology.orchestra.run.smithi135.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-08-19T11:09:04.416 INFO:teuthology.orchestra.run.smithi135.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-08-19T11:09:04.441 INFO:teuthology.orchestra.run.smithi135.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-08-19T11:09:04.544 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:04.642 INFO:teuthology.orchestra.run.smithi135.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 469 kB/s | 248 kB 00:00 2024-08-19T11:09:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:09:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:09:04.669 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:09:04.669 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T11:09:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:05.649 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:09:05.649 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:05.649 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:05.650 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:09:05.650 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:05.650 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:05.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2024-08-19T11:09:06.476 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:36 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:06.518 INFO:teuthology.orchestra.run.smithi135.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-08-19T11:09:06.520 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:06.520 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.8 MB/s | 7.0 MB 00:02 2024-08-19T11:09:06.595 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.0.0-5847.g79766939.el9 ceph 127 k 2024-08-19T11:09:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:06.607 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:06.607 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:06.607 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:09:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:06.607 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:06.608 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:06.608 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 127 k 2024-08-19T11:09:06.608 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 456 k 2024-08-19T11:09:06.608 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:06.705 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:06.706 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:06.807 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-19.0.0-5847.g79766939.el9.x86_64 634 kB/s | 127 kB 00:00 2024-08-19T11:09:06.808 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:06.808 INFO:teuthology.orchestra.run.smithi071.stdout:Total 630 kB/s | 127 kB 00:00 2024-08-19T11:09:06.808 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:06.813 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:06.813 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:06.877 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:06.878 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:07.023 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:07.028 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:07.197 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-19T11:09:07.244 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-19T11:09:07.541 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:07.762 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-19T11:09:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:07.806 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:07.806 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:07.848 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-19T11:09:07.914 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-19T11:09:07.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 6/6 2024-08-19T11:09:08.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2024-08-19T11:09:08.585 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:38 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:08.670 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:08.713 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:08.714 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:08.714 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:08.720 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 6/6 2024-08-19T11:09:08.720 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 1/6 2024-08-19T11:09:08.720 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-19T11:09:08.720 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-19T11:09:08.720 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-19T11:09:08.720 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-19T11:09:08.795 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2024-08-19T11:09:08.994 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-19T11:09:08.994 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:08.994 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:08.995 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:09.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-fuse 2024-08-19T11:09:09.340 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:39 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:09.469 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.0.0-5847.g79766939.el9 ceph 32 k 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:09:09.470 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:09.471 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 32 k 2024-08-19T11:09:09.471 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 142 k 2024-08-19T11:09:09.471 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:09.636 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-19.0.0-5847.g79766939.el9.x86_6 192 kB/s | 32 kB 00:00 2024-08-19T11:09:09.637 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:09.637 INFO:teuthology.orchestra.run.smithi071.stdout:Total 190 kB/s | 32 kB 00:00 2024-08-19T11:09:09.637 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:09.641 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:09.641 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:09.644 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:09.645 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:09.735 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:09.815 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:36 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:09.840 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-5847.g79766939.el9 ceph 901 k 2024-08-19T11:09:09.943 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout:Install 2 Packages 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 981 k 2024-08-19T11:09:09.944 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 2.9 M 2024-08-19T11:09:09.945 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:10.263 INFO:teuthology.orchestra.run.smithi135.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 544 kB/s | 80 kB 00:00 2024-08-19T11:09:10.396 INFO:teuthology.orchestra.run.smithi135.stdout:(2/2): ceph-fuse-19.0.0-5847.g79766939.el9.x86_ 3.1 MB/s | 901 kB 00:00 2024-08-19T11:09:10.397 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:10.397 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.1 MB/s | 981 kB 00:00 2024-08-19T11:09:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:10.404 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:10.404 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:10.410 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:10.432 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:10.432 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:10.511 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:10.511 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:10.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2024-08-19T11:09:10.706 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:10.858 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-19T11:09:10.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 2/2 2024-08-19T11:09:11.142 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:41 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:11.224 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:11.267 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:11.268 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:11.268 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:11.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2024-08-19T11:09:11.601 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 2/2 2024-08-19T11:09:11.601 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/2 2024-08-19T11:09:11.873 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:41 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:11.894 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-19T11:09:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:11.895 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-5847.g79766939.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-19T11:09:11.895 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:11.895 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:11.957 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:12.001 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:12.002 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:12.002 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:12.069 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2024-08-19T11:09:12.170 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-volume 2024-08-19T11:09:12.608 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:42 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:12.692 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:12.735 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:39 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:12.736 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:12.737 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:12.737 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:12.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2024-08-19T11:09:12.866 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:12.867 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-19T11:09:12.867 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:12.867 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-5847.g79766939.el9 ceph-noarch 285 k 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 285 k 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 1.3 M 2024-08-19T11:09:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:13.071 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-volume-19.0.0-5847.g79766939.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-08-19T11:09:13.072 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:13.072 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-08-19T11:09:13.072 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:13.080 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:13.081 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:13.101 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:13.101 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:13.313 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:13.347 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:43 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:13.382 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:09:13.398 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:09:13.399 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:09:13.399 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T11:09:13.399 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:13.431 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:13.474 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:13.475 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:13.475 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:13.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2024-08-19T11:09:14.088 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:44 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:14.173 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:14.216 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:14.217 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:14.217 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:14.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2024-08-19T11:09:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 1/1 2024-08-19T11:09:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:14.409 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-5847.g79766939.el9.noarch 2024-08-19T11:09:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:14.409 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:14.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados-devel 2024-08-19T11:09:14.823 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:44 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:14.909 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:14.952 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:14.953 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-08-19T11:09:14.953 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:15.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2024-08-19T11:09:15.258 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:42 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:15.387 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:15.388 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-08-19T11:09:15.388 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:15.388 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-5847.g79766939.el9 ceph 127 k 2024-08-19T11:09:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 127 k 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 456 k 2024-08-19T11:09:15.389 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:15.558 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:45 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:15.589 INFO:teuthology.orchestra.run.smithi135.stdout:librados-devel-19.0.0-5847.g79766939.el9.x86_64 636 kB/s | 127 kB 00:00 2024-08-19T11:09:15.589 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:15.589 INFO:teuthology.orchestra.run.smithi135.stdout:Total 631 kB/s | 127 kB 00:00 2024-08-19T11:09:15.589 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:15.595 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:15.595 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:15.659 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:15.659 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.0.0-5847.g79766939.el9 ceph 85 k 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:15.685 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:15.686 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:09:15.686 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:15.686 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 85 k 2024-08-19T11:09:15.686 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 231 k 2024-08-19T11:09:15.686 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:15.808 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:15.890 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-19.0.0-5847.g79766939.el9.x86_64.rpm 417 kB/s | 85 kB 00:00 2024-08-19T11:09:15.891 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:15.891 INFO:teuthology.orchestra.run.smithi071.stdout:Total 415 kB/s | 85 kB 00:00 2024-08-19T11:09:15.891 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:15.897 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:15.898 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:15.902 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:15.960 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:15.960 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:16.103 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:16.351 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:16.625 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:16.626 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:16.626 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:16.626 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:16.864 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:16.865 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:16.892 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs2 2024-08-19T11:09:17.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2024-08-19T11:09:17.453 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:44 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:17.541 INFO:teuthology.orchestra.run.smithi135.stdout:Package libcephfs2-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:17.586 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:17.587 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:17.587 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:17.659 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs-devel 2024-08-19T11:09:17.731 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:47 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:17.868 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.0.0-5847.g79766939.el9 ceph 3.2 M 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:17.869 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:17.870 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:09:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:17.870 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.2 M 2024-08-19T11:09:17.870 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 14 M 2024-08-19T11:09:17.870 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:18.207 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:45 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:18.219 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-19.0.0-5847.g79766939.el9.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2024-08-19T11:09:18.220 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:18.221 INFO:teuthology.orchestra.run.smithi071.stdout:Total 9.0 MB/s | 3.2 MB 00:00 2024-08-19T11:09:18.221 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:18.230 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:18.230 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:18.315 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:18.315 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:18.337 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:18.337 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:18.337 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-08-19T11:09:18.337 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:18.337 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:18.337 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-5847.g79766939.el9 ceph 32 k 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 32 k 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 142 k 2024-08-19T11:09:18.338 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:18.478 INFO:teuthology.orchestra.run.smithi135.stdout:libcephfs-devel-19.0.0-5847.g79766939.el9.x86_6 226 kB/s | 32 kB 00:00 2024-08-19T11:09:18.479 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:18.479 INFO:teuthology.orchestra.run.smithi135.stdout:Total 224 kB/s | 32 kB 00:00 2024-08-19T11:09:18.479 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:18.482 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:18.483 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:18.486 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:18.487 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:18.572 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:18.674 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:18.765 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:18.854 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:09:18.854 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T11:09:18.854 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T11:09:18.854 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T11:09:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:19.031 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:19.241 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:19.242 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:19.242 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:19.242 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:19.242 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:19.242 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:19.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados2 2024-08-19T11:09:19.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:19.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:19.956 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:19.956 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:19.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:19.956 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:19.984 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:46 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:20.069 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:20.113 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:20.114 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:20.115 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:20.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librbd1 2024-08-19T11:09:20.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2024-08-19T11:09:20.734 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:47 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:20.785 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:50 ago on Mon 19 Aug 2024 11:07:30 AM UTC. 2024-08-19T11:09:20.821 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:20.864 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:20.864 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:20.865 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:20.913 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.0.0-5847.g79766939.el9 ceph 171 k 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-08-19T11:09:20.914 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:20.915 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 171 k 2024-08-19T11:09:20.915 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 490 k 2024-08-19T11:09:20.915 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-08-19T11:09:20.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rados 2024-08-19T11:09:21.125 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-19.0.0-5847.g79766939.el9.x86_64.rpm 813 kB/s | 171 kB 00:00 2024-08-19T11:09:21.126 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:21.126 INFO:teuthology.orchestra.run.smithi071.stdout:Total 807 kB/s | 171 kB 00:00 2024-08-19T11:09:21.126 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-08-19T11:09:21.133 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-08-19T11:09:21.134 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-08-19T11:09:21.199 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-08-19T11:09:21.199 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-08-19T11:09:21.356 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-08-19T11:09:21.447 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:21.479 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:48 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:21.565 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rados-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:21.607 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:21.608 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:21.608 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:21.683 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rgw 2024-08-19T11:09:21.902 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:22.170 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-08-19T11:09:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:22.170 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-08-19T11:09:22.230 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:49 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:22.316 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rgw-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:22.360 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:22.361 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:22.361 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:22.432 DEBUG:teuthology.parallel:result is None 2024-08-19T11:09:22.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-cephfs 2024-08-19T11:09:22.983 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:49 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:23.071 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-cephfs-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:23.114 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:23.115 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:23.115 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:23.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rbd 2024-08-19T11:09:23.738 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:50 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:23.824 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rbd-2:19.0.0-5847.g79766939.el9.x86_64 is already installed. 2024-08-19T11:09:23.867 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:23.867 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-08-19T11:09:23.867 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:23.943 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-fuse 2024-08-19T11:09:24.487 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:51 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:24.616 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-5847.g79766939.el9 ceph 85 k 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 85 k 2024-08-19T11:09:24.617 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 231 k 2024-08-19T11:09:24.618 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:24.808 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-fuse-19.0.0-5847.g79766939.el9.x86_64.rpm 449 kB/s | 85 kB 00:00 2024-08-19T11:09:24.808 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:24.808 INFO:teuthology.orchestra.run.smithi135.stdout:Total 446 kB/s | 85 kB 00:00 2024-08-19T11:09:24.808 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:24.815 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:24.815 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:24.877 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:24.878 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:25.014 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:25.145 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:25.503 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:25.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:25.742 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:25.743 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:25.743 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:25.743 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:25.743 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:26.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-mirror 2024-08-19T11:09:26.613 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:53 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:26.751 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:26.751 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-5847.g79766939.el9 ceph 3.2 M 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:09:26.752 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:26.753 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 3.2 M 2024-08-19T11:09:26.753 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 14 M 2024-08-19T11:09:26.753 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:27.090 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-mirror-19.0.0-5847.g79766939.el9.x86_64.rpm 9.4 MB/s | 3.2 MB 00:00 2024-08-19T11:09:27.090 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:27.091 INFO:teuthology.orchestra.run.smithi135.stdout:Total 9.3 MB/s | 3.2 MB 00:00 2024-08-19T11:09:27.091 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:27.100 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:27.100 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:27.184 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:27.184 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:27.635 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:27.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:27.733 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:27.734 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T11:09:27.734 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T11:09:27.734 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T11:09:27.734 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T11:09:27.734 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:28.767 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:28.767 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:28.767 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:28.767 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:28.767 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:28.767 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:29.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-nbd 2024-08-19T11:09:29.611 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:56 ago on Mon 19 Aug 2024 11:07:33 AM UTC. 2024-08-19T11:09:29.740 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-5847.g79766939.el9 ceph 171 k 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:29.741 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-19T11:09:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-08-19T11:09:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-08-19T11:09:29.742 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 171 k 2024-08-19T11:09:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 490 k 2024-08-19T11:09:29.742 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-19T11:09:29.954 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-nbd-19.0.0-5847.g79766939.el9.x86_64.rpm 805 kB/s | 171 kB 00:00 2024-08-19T11:09:29.955 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-19T11:09:29.955 INFO:teuthology.orchestra.run.smithi135.stdout:Total 798 kB/s | 171 kB 00:00 2024-08-19T11:09:29.955 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-19T11:09:29.963 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-19T11:09:29.963 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-19T11:09:30.028 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-19T11:09:30.028 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-19T11:09:30.182 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-19T11:09:30.292 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:30.709 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:30.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 1/1 2024-08-19T11:09:30.958 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:30.958 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-19T11:09:30.959 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-5847.g79766939.el9.x86_64 2024-08-19T11:09:30.959 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:30.959 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-19T11:09:31.220 DEBUG:teuthology.parallel:result is None 2024-08-19T11:09:31.220 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-19T11:09:31.377 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T11:09:31.402 INFO:teuthology.orchestra.run.smithi071.stdout:19.0.0-5847.g79766939.el9 2024-08-19T11:09:31.402 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5847.g79766939.el9 2024-08-19T11:09:31.403 INFO:teuthology.task.install:The correct ceph version 19.0.0-5847.g79766939 is installed. 2024-08-19T11:09:31.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=797669399b32d2915e64eb6d4b1257ae3c50f80b 2024-08-19T11:09:31.557 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T11:09:31.580 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-5847.g79766939.el9 2024-08-19T11:09:31.580 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5847.g79766939.el9 2024-08-19T11:09:31.580 INFO:teuthology.task.install:The correct ceph version 19.0.0-5847.g79766939 is installed. 2024-08-19T11:09:31.582 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-19T11:09:31.582 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:31.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T11:09:31.613 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:31.613 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T11:09:31.645 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-19T11:09:31.646 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:31.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T11:09:31.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T11:09:31.751 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:31.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T11:09:31.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T11:09:31.840 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-19T11:09:31.840 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:31.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T11:09:31.869 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T11:09:31.936 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:31.937 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T11:09:31.961 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T11:09:32.026 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-19T11:09:32.026 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:32.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T11:09:32.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T11:09:32.120 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:32.120 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T11:09:32.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T11:09:32.210 INFO:teuthology.run_tasks:Running task ceph... 2024-08-19T11:09:32.295 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-19T11:09:32.295 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-08-19T11:09:32.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-08-19T11:09:32.323 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-19T11:09:32.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-19T11:09:32.365 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-19T11:09:32.390 INFO:tasks.ceph:Creating extra log directories... 2024-08-19T11:09:32.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-19T11:09:32.431 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-19T11:09:32.465 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-19T11:09:32.465 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-19T11:09:32.465 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447', 'branch': 'main', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7859447', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '964adda23da9f7b057cb34fdc0b82aeb7ed65324'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 1858, 'sha1': '797669399b32d2915e64eb6d4b1257ae3c50f80b', 'sleep_before_teardown': 0, 'subset': '29813/100000', 'suite': 'rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '964adda23da9f7b057cb34fdc0b82aeb7ed65324', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPWyLdqntv9SVez5+6G8gb1i1fPqvUfUa3zJyXu37dZdzgA9noLh+4h51vU3Ez9tek5GwQU0CeZtmLzcxL/NoVM=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOkW0lB2QrXeMTy/nSyrlSSGNoeIXT/FzAYI+mhpXr6Um6S6fLDK/HKNHmU4jp3QLcUMypC/I02hytDjY0HAOuc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 20, 'thrash_delay': 1}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-18_20:00:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-19T11:09:32.465 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-19T11:09:32.498 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-19T11:09:32.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-08-19T11:09:32.554 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-08-19T11:09:32.579 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:32.580 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T11:09:32.635 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T11:09:32.636 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-08-19 11:09:19.102006453 +0000 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-08-19 11:06:51.996197612 +0000 2024-08-19T11:09:32.692 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-08-19 11:06:51.996197612 +0000 2024-08-19T11:09:32.693 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-08-19 11:06:51.996197612 +0000 2024-08-19T11:09:32.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T11:09:32.756 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-08-19T11:09:32.756 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-08-19T11:09:32.756 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000202395 s, 2.5 MB/s 2024-08-19T11:09:32.757 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T11:09:32.813 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-08-19T11:09:32.869 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-08-19 11:09:19.103006436 +0000 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-08-19 11:06:52.336195240 +0000 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-08-19 11:06:52.336195240 +0000 2024-08-19T11:09:32.870 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-08-19 11:06:52.336195240 +0000 2024-08-19T11:09:32.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T11:09:32.933 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-08-19T11:09:32.933 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-08-19T11:09:32.933 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000190709 s, 2.7 MB/s 2024-08-19T11:09:32.934 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T11:09:32.991 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 713 Links: 1 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-08-19 11:09:19.103006436 +0000 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-08-19 11:06:52.651193042 +0000 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-08-19 11:06:52.651193042 +0000 2024-08-19T11:09:33.048 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-08-19 11:06:52.651193042 +0000 2024-08-19T11:09:33.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T11:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-08-19T11:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-08-19T11:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000187557 s, 2.7 MB/s 2024-08-19T11:09:33.122 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T11:09:33.184 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-08-19T11:09:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T11:09:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 731 Links: 1 2024-08-19T11:09:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:33.243 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-08-19 11:09:19.104006419 +0000 2024-08-19T11:09:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-08-19 11:06:52.980190746 +0000 2024-08-19T11:09:33.244 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-08-19 11:06:52.980190746 +0000 2024-08-19T11:09:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-08-19 11:06:52.980190746 +0000 2024-08-19T11:09:33.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T11:09:33.308 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-08-19T11:09:33.309 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-08-19T11:09:33.309 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000263432 s, 1.9 MB/s 2024-08-19T11:09:33.310 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T11:09:33.366 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:33.367 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:33.367 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T11:09:33.384 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T11:09:33.384 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-19 11:09:27.992504068 +0000 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-19 11:06:51.991276042 +0000 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-19 11:06:51.991276042 +0000 2024-08-19T11:09:33.441 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-19 11:06:51.991276042 +0000 2024-08-19T11:09:33.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T11:09:33.506 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-19T11:09:33.506 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-19T11:09:33.506 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000189849 s, 2.7 MB/s 2024-08-19T11:09:33.508 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T11:09:33.565 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-08-19T11:09:33.621 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T11:09:33.621 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:33.621 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-19T11:09:33.621 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:33.621 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:33.622 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-19 11:09:27.992504068 +0000 2024-08-19T11:09:33.622 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-19 11:06:52.329269532 +0000 2024-08-19T11:09:33.622 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-19 11:06:52.329269532 +0000 2024-08-19T11:09:33.622 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-19 11:06:52.329269532 +0000 2024-08-19T11:09:33.622 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T11:09:33.685 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-19T11:09:33.686 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-19T11:09:33.686 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000208327 s, 2.5 MB/s 2024-08-19T11:09:33.687 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T11:09:33.743 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-08-19T11:09:33.800 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T11:09:33.800 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:33.800 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-19T11:09:33.800 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:33.800 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:33.801 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-19 11:09:27.992504068 +0000 2024-08-19T11:09:33.801 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-19 11:06:52.650263349 +0000 2024-08-19T11:09:33.801 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-19 11:06:52.650263349 +0000 2024-08-19T11:09:33.801 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-19 11:06:52.650263349 +0000 2024-08-19T11:09:33.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T11:09:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-19T11:09:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-19T11:09:33.863 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000166177 s, 3.1 MB/s 2024-08-19T11:09:33.865 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T11:09:33.921 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-08-19T11:09:33.976 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T11:09:33.976 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T11:09:33.976 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-19T11:09:33.976 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T11:09:33.976 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T11:09:33.977 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-19 11:09:27.992504068 +0000 2024-08-19T11:09:33.977 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-19 11:06:52.984256916 +0000 2024-08-19T11:09:33.977 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-19 11:06:52.984256916 +0000 2024-08-19T11:09:33.977 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-19 11:06:52.984256916 +0000 2024-08-19T11:09:33.977 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T11:09:34.039 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-19T11:09:34.039 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-19T11:09:34.039 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000172403 s, 3.0 MB/s 2024-08-19T11:09:34.041 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T11:09:34.097 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:34.098 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-08-19T11:09:34.098 INFO:tasks.ceph:Generating config... 2024-08-19T11:09:34.099 INFO:tasks.ceph:[client] debug monc = 20 2024-08-19T11:09:34.099 INFO:tasks.ceph:[client] debug ms = 1 2024-08-19T11:09:34.099 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-08-19T11:09:34.099 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms bind msgr1 = False 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms bind msgr2 = True 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms inject delay max = 1 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms inject delay type = mon 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-08-19T11:09:34.100 INFO:tasks.ceph:[global] ms type = async 2024-08-19T11:09:34.100 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-19T11:09:34.100 INFO:tasks.ceph:[mgr] debug monc = 10 2024-08-19T11:09:34.100 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-08-19T11:09:34.101 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-08-19T11:09:34.101 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-19T11:09:34.101 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-08-19T11:09:34.101 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-08-19T11:09:34.101 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-08-19T11:09:34.102 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-19T11:09:34.103 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-08-19T11:09:34.103 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-08-19T11:09:34.103 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-19T11:09:34.103 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-08-19T11:09:34.103 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-08-19T11:09:34.103 INFO:tasks.ceph:Setting up mon.a... 2024-08-19T11:09:34.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-19T11:09:34.158 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2024-08-19T11:09:34.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-19T11:09:34.208 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-19T11:09:34.235 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.b', '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]'), ('mon.c', '[v2:172.21.15.71:3302,v1:172.21.15.71:6791]'), ('mon.d', '[v2:172.21.15.71:3303,v1:172.21.15.71:6792]'), ('mon.e', '[v2:172.21.15.71:3304,v1:172.21.15.71:6793]'), ('mon.f', '172.21.15.135'), ('mon.g', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]'), ('mon.h', '[v2:172.21.15.135:3302,v1:172.21.15.135:6791]'), ('mon.i', '[v2:172.21.15.135:3303,v1:172.21.15.135:6792]')] 2024-08-19T11:09:34.235 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],[v2:172.21.15.71:3302,v1:172.21.15.71:6791],[v2:172.21.15.71:3303,v1:172.21.15.71:6792],[v2:172.21.15.71:3304,v1:172.21.15.71:6793],172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790],[v2:172.21.15.135:3302,v1:172.21.15.135:6791],[v2:172.21.15.135:3303,v1:172.21.15.135:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-08-19T11:09:34.236 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:34.236 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-19T11:09:34.291 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --addv b '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]' --addv c '[v2:172.21.15.71:3302,v1:172.21.15.71:6791]' --addv d '[v2:172.21.15.71:3303,v1:172.21.15.71:6792]' --addv e '[v2:172.21.15.71:3304,v1:172.21.15.71:6793]' --add f 172.21.15.135 --addv g '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --addv h '[v2:172.21.15.135:3302,v1:172.21.15.135:6791]' --addv i '[v2:172.21.15.135:3303,v1:172.21.15.135:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 17 (quincy) 2024-08-19T11:09:34.397 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:3: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:4: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:5: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:6: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:7: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:8: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:09:34.398 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-08-19T11:09:34.402 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-19T11:09:34.417 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e00860b6-633c-4a91-b05e-d46659da1ed6... 2024-08-19T11:09:34.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-19T11:09:34.460 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-08-19T11:09:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-08-19T11:09:34.501 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-08-19T11:09:34.502 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-08-19T11:09:34.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],[v2:172.21.15.71:3302,v1:172.21.15.71:6791],[v2:172.21.15.71:3303,v1:172.21.15.71:6792],[v2:172.21.15.71:3304,v1:172.21.15.71:6793],172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790],[v2:172.21.15.135:3302,v1:172.21.15.135:6791],[v2:172.21.15.135:3303,v1:172.21.15.135:6792]" 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: mon client directed command retry = 5 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: mon election default strategy = 1 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms bind msgr1 = False 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms bind msgr2 = True 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject delay max = 1 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject delay probability = 0.005 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject delay type = mon 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject internal delays = 0.002 2024-08-19T11:09:34.504 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject socket failures = 2500 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: ms type = async 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-08-19T11:09:34.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.506 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore compression algorithm = snappy 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore compression mode = aggressive 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-08-19T11:09:34.507 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore write v2 random = True 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore zero block detection = True 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 20 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 20 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 10 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify cached snaps = True 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify missing on start = True 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-08-19T11:09:34.508 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock override recovery settings = True 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: osd op queue = debug_random 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: osd op queue cut off = debug_random 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: debug monc = 10 2024-08-19T11:09:34.509 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.510 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon min osdmap epochs = 25 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune interval = 2 2024-08-19T11:09:34.511 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune min = 15 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: mon osdmap full prune txsize = 2 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: mon scrub inject crc mismatch = 0.01 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: mon scrub inject missing keys = 0.05 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: mon scrub interval = 300 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: paxos service trim min = 5 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-19T11:09:34.512 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout: debug monc = 20 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.d] 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.e] 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.f] 2024-08-19T11:09:34.513 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.g] 2024-08-19T11:09:34.514 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.h] 2024-08-19T11:09:34.514 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.i] 2024-08-19T11:09:34.515 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-08-19T11:09:34.515 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-08-19T11:09:34.515 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-19T11:09:34.515 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-08-19T11:09:34.515 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-08-19T11:09:34.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-08-19T11:09:34.517 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-08-19T11:09:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],[v2:172.21.15.71:3302,v1:172.21.15.71:6791],[v2:172.21.15.71:3303,v1:172.21.15.71:6792],[v2:172.21.15.71:3304,v1:172.21.15.71:6793],172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790],[v2:172.21.15.135:3302,v1:172.21.15.135:6791],[v2:172.21.15.135:3303,v1:172.21.15.135:6792]" 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: mon client directed command retry = 5 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: mon election default strategy = 1 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms bind msgr1 = False 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms bind msgr2 = True 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms inject delay max = 1 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms inject delay probability = 0.005 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms inject delay type = mon 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms inject internal delays = 0.002 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms inject socket failures = 2500 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: ms type = async 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-08-19T11:09:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-08-19T11:09:34.520 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.521 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore compression algorithm = snappy 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore compression mode = aggressive 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore write v2 random = True 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore zero block detection = True 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2024-08-19T11:09:34.522 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify cached snaps = True 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify missing on start = True 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock override recovery settings = True 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd op queue = debug_random 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: osd op queue cut off = debug_random 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-08-19T11:09:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug monc = 10 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-08-19T11:09:34.524 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-19T11:09:34.525 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon min osdmap epochs = 25 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon osdmap full prune interval = 2 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon osdmap full prune min = 15 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon osdmap full prune txsize = 2 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon scrub inject crc mismatch = 0.01 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon scrub inject missing keys = 0.05 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: mon scrub interval = 300 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: paxos service trim min = 5 2024-08-19T11:09:34.526 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: debug monc = 20 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.d] 2024-08-19T11:09:34.527 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.e] 2024-08-19T11:09:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.f] 2024-08-19T11:09:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.g] 2024-08-19T11:09:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.h] 2024-08-19T11:09:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.i] 2024-08-19T11:09:34.528 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-19T11:09:34.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-19T11:09:34.610 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-19T11:09:34.611 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:34.611 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-19T11:09:34.626 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:34.626 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-19T11:09:34.681 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:09:34.681 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:34.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-19T11:09:34.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-19T11:09:34.755 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:09:34.755 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:34.810 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:09:34.810 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:34.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-19T11:09:34.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-19T11:09:34.845 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:09:34.845 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:34.901 INFO:tasks.ceph:Setting up mon nodes... 2024-08-19T11:09:34.901 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-19T11:09:34.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-19T11:09:35.031 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-19T11:09:35.034 INFO:tasks.ceph:Setting up mds nodes... 2024-08-19T11:09:35.034 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-19T11:09:35.035 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-19T11:09:35.075 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-19T11:09:35.088 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-19T11:09:35.088 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-08-19T11:09:35.088 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-19T11:09:35.114 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:35.114 INFO:tasks.ceph:role: osd.0 2024-08-19T11:09:35.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:09:35.114 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-19T11:09:35.186 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T11:09:35.186 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T11:09:35.186 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T11:09:35.186 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T11:09:35.186 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T11:09:35.187 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-08-19T11:09:35.187 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T11:09:35.187 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T11:09:35.187 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T11:09:35.187 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T11:09:35.700 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-08-19T11:09:35.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-08-19T11:09:35.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-19T11:09:35.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-19T11:09:35.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-19T11:09:35.912 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:35.912 INFO:tasks.ceph:role: osd.1 2024-08-19T11:09:35.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:09:35.913 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-19T11:09:35.985 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T11:09:35.985 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T11:09:35.985 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T11:09:35.985 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T11:09:35.986 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T11:09:35.986 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-08-19T11:09:35.986 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T11:09:35.986 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T11:09:35.986 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T11:09:35.986 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T11:09:36.434 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-08-19T11:09:36.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-08-19T11:09:36.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-19T11:09:36.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-19T11:09:36.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-19T11:09:36.627 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:36.627 INFO:tasks.ceph:role: osd.2 2024-08-19T11:09:36.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:09:36.627 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-19T11:09:36.698 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T11:09:36.699 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T11:09:37.185 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-08-19T11:09:37.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-08-19T11:09:37.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-19T11:09:37.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-19T11:09:37.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:37.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:37.459+0000 7f4bc4818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-19T11:09:37.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:37.459+0000 7f4bc4818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-19T11:09:37.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:37.460+0000 7f4bc4818640 -1 bdev(0x564c7c129800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-08-19T11:09:37.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:37.460+0000 7f4bc4818640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-19T11:09:40.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-19T11:09:40.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:40.739+0000 7fb2d5c32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-19T11:09:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:40.740+0000 7fb2d5c32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-19T11:09:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:40.740+0000 7fb2d5c32640 -1 bdev(0x561ae37e9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-08-19T11:09:40.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:40.740+0000 7fb2d5c32640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-19T11:09:44.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-19T11:09:44.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:44.512+0000 7fce09830640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-19T11:09:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:44.512+0000 7fce09830640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-19T11:09:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:44.512+0000 7fce09830640 -1 bdev(0x55c6d405b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-08-19T11:09:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:09:44.512+0000 7fce09830640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-19T11:09:47.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-19T11:09:47.949 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-19T11:09:47.979 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:47.979 INFO:tasks.ceph:role: osd.3 2024-08-19T11:09:47.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:09:47.980 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T11:09:48.056 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T11:09:48.563 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-08-19T11:09:48.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-08-19T11:09:48.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-08-19T11:09:48.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-19T11:09:48.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-19T11:09:48.807 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:48.807 INFO:tasks.ceph:role: osd.4 2024-08-19T11:09:48.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:09:48.808 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-19T11:09:48.880 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T11:09:48.881 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T11:09:49.344 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-08-19T11:09:49.346 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-08-19T11:09:49.347 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-08-19T11:09:49.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-19T11:09:49.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-19T11:09:49.531 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-08-19T11:09:49.531 INFO:tasks.ceph:role: osd.5 2024-08-19T11:09:49.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:09:49.531 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-19T11:09:49.603 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-19T11:09:49.603 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-19T11:09:49.603 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-19T11:09:49.604 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-19T11:09:50.091 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-08-19T11:09:50.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-08-19T11:09:50.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-08-19T11:09:50.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-19T11:09:50.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:50.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:50.346+0000 7f02c2f2a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-19T11:09:50.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:50.350+0000 7f02c2f2a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-19T11:09:50.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:50.350+0000 7f02c2f2a640 -1 bdev(0x562377cb7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-08-19T11:09:50.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:50.350+0000 7f02c2f2a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-19T11:09:53.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-19T11:09:53.302 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:53.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:53.390+0000 7f70b461a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-19T11:09:53.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:53.390+0000 7f70b461a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-19T11:09:53.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:53.390+0000 7f70b461a640 -1 bdev(0x55a493971800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-08-19T11:09:53.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:53.391+0000 7f70b461a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-19T11:09:56.564 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-19T11:09:56.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:09:56.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:56.679+0000 7f8b83e32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-19T11:09:56.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:56.679+0000 7f8b83e32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-19T11:09:56.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:56.679+0000 7f8b83e32640 -1 bdev(0x564309517800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-08-19T11:09:56.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:09:56.679+0000 7f8b83e32640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-19T11:10:00.334 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-19T11:10:00.363 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-19T11:10:00.364 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:10:00.364 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-19T11:10:00.395 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:10:00.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-19T11:10:00.465 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:10:00.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-19T11:10:00.531 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:00.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-19T11:10:00.559 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:00.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-19T11:10:00.625 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:00.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-19T11:10:00.691 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:00.691 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-19T11:10:00.756 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:00.756 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-19T11:10:00.812 INFO:tasks.ceph:Adding keys to all mons... 2024-08-19T11:10:00.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-19T11:10:00.814 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-19T11:10:00.855 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDxJ8NmLg55GxAAcwd3jsQUKTnDqD2KQ8pXOQ== 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD0J8NmmlMzLBAATHKSMbGHi8HX+ZSbz2d1cg== 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD4J8NmV9CQHhAA7VdOT2iUj8GuIkxN2KnsUA== 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDvJ8NmsxHbARAAf0QYmra08vF0tZXwd7VusA== 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD+J8NmjwywFBAAY8e/iH41bVLxudQzBN4ZDw== 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-08-19T11:10:00.856 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQABKMNmYWtkFxAANlMyAPdwkUdInx+SFl6cVg== 2024-08-19T11:10:00.857 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-08-19T11:10:00.857 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAEKMNmIaWbKBAAFs4Pwidqhaaj9WJ2spm6jA== 2024-08-19T11:10:00.857 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-08-19T11:10:00.857 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDvJ8Nm/Zp9BBAAIT6e5H94JgqC+ULqecVCnw== 2024-08-19T11:10:00.875 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-08-19T11:10:00.875 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDxJ8NmLg55GxAAcwd3jsQUKTnDqD2KQ8pXOQ== 2024-08-19T11:10:00.875 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD0J8NmmlMzLBAATHKSMbGHi8HX+ZSbz2d1cg== 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD4J8NmV9CQHhAA7VdOT2iUj8GuIkxN2KnsUA== 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDvJ8NmsxHbARAAf0QYmra08vF0tZXwd7VusA== 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQD+J8NmjwywFBAAY8e/iH41bVLxudQzBN4ZDw== 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQABKMNmYWtkFxAANlMyAPdwkUdInx+SFl6cVg== 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAEKMNmIaWbKBAAFs4Pwidqhaaj9WJ2spm6jA== 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-08-19T11:10:00.876 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDvJ8Nm/Zp9BBAAIT6e5H94JgqC+ULqecVCnw== 2024-08-19T11:10:00.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:00.900 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:00.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:00.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-19T11:10:01.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-19T11:10:01.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.183 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.237 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-19T11:10:01.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T11:10:01.292 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-19T11:10:01.346 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-19T11:10:01.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-19T11:10:01.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:01.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-19T11:10:01.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-19T11:10:01.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:01.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-19T11:10:01.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-19T11:10:01.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:01.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-19T11:10:01.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-08-19T11:10:01.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:02.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-08-19T11:10:02.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-08-19T11:10:02.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:02.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-08-19T11:10:02.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-08-19T11:10:02.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:02.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-08-19T11:10:02.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-08-19T11:10:02.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:02.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-08-19T11:10:02.585 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-08-19T11:10:02.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:02.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-08-19T11:10:02.770 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-08-19T11:10:02.835 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-19T11:10:02.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-08-19T11:10:02.957 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:10:02.959 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-19T11:10:03.012 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-19T11:10:03.012 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-19T11:10:03.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-19T11:10:03.016 INFO:tasks.ceph.mon.a:Started 2024-08-19T11:10:03.016 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-19T11:10:03.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-19T11:10:03.018 INFO:tasks.ceph.mon.b:Started 2024-08-19T11:10:03.019 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-19T11:10:03.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-19T11:10:03.021 INFO:tasks.ceph.mon.c:Started 2024-08-19T11:10:03.021 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-19T11:10:03.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-19T11:10:03.023 INFO:tasks.ceph.mon.d:Started 2024-08-19T11:10:03.023 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-19T11:10:03.023 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-19T11:10:03.026 INFO:tasks.ceph.mon.e:Started 2024-08-19T11:10:03.026 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-19T11:10:03.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-19T11:10:03.054 INFO:tasks.ceph.mon.f:Started 2024-08-19T11:10:03.054 INFO:tasks.ceph.mon.g:Restarting daemon 2024-08-19T11:10:03.055 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-08-19T11:10:03.056 INFO:tasks.ceph.mon.g:Started 2024-08-19T11:10:03.057 INFO:tasks.ceph.mon.h:Restarting daemon 2024-08-19T11:10:03.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-08-19T11:10:03.059 INFO:tasks.ceph.mon.h:Started 2024-08-19T11:10:03.059 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-19T11:10:03.059 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-19T11:10:03.061 INFO:tasks.ceph.mon.i:Started 2024-08-19T11:10:03.062 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-19T11:10:03.062 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-19T11:10:03.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-19T11:10:03.068 INFO:tasks.ceph.mgr.x:Started 2024-08-19T11:10:03.068 DEBUG:tasks.ceph:set 0 configs 2024-08-19T11:10:03.068 INFO:tasks.ceph:Setting crush tunables to default 2024-08-19T11:10:03.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.189+0000 7f18b33f4640 10 monclient: get_monmap_and_config 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.189+0000 7f18b33f4640 10 monclient: build_initial_monmap 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.189+0000 7f18b33f4640 10 monclient: monmap: 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:03.189697+0000 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:03.189697+0000 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:03.190 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:03.191 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:03.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.189+0000 7f18b33f4640 1 Processor -- start 2024-08-19T11:10:03.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.189+0000 7f18b33f4640 1 -- start start 2024-08-19T11:10:03.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.189+0000 7f18b33f4640 10 monclient: init 2024-08-19T11:10:03.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:03.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient: _add_conns ranks=[6,1,3,8,0,2,4,9,5,10,7] 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): picked mon.noname-d con 0x7f18ac0a3170 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f18ac0a3550 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): picked mon.noname-g con 0x7f18ac0a3990 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18ac0a1d10 con 0x7f18ac0a3550 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac0741e0 con 0x7f18ac0a3990 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f18ac072810 con 0x7f18ac0a3170 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:03.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b33f4640 10 monclient(hunting): authenticate will time out at 661.231453s 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:33778/0 (socket says 172.21.15.71:33778) 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 learned_addr learned my addr 172.21.15.71:0/2612816211 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3170 auth_method 0 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3990 auth_method 0 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:03.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.190+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:03.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.192+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> v1:172.21.15.135:6789/0 conn(0x7f18ac0a3550 legacy=0x7f18ac0a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3170 auth_method 0 2024-08-19T11:10:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:03.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3990 auth_method 0 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:03.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.391+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:03.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3990 auth_method 0 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3170 auth_method 0 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:03.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:03.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:03.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:03.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:03.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:03.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:03.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:03.792+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:04.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:04.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3170 auth_method 0 2024-08-19T11:10:04.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f18ac0a3990 auth_method 0 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:04.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:04.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:04.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:04.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:04.593+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:06.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): tick 2024-08-19T11:10:06.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:10:06.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 msgr2=0x7f18ac0a17d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18ac0a3170 0x7f18ac0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 msgr2=0x7f18ac0a5ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18ac0a3990 0x7f18ac0a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> v1:172.21.15.135:6789/0 conn(0x7f18ac0a3550 legacy=0x7f18ac0a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient: _add_conns ranks=[9,8,0,10,4,7,5,2] 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f18900038a0 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f18900062d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1890008e20 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:06.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18ac0738b0 con 0x7f1890008e20 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f18ac0741e0 con 0x7f18900038a0 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f18ac072810 con 0x7f18900062d0 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18a2ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18900038a0 auth_method 0 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:06.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b1190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f18900062d0 auth_method 0 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.190+0000 7f18b098f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:06.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:06.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:06.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:06.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:06.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:06.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.193+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> v1:172.21.15.71:6789/0 conn(0x7f1890008e20 legacy=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18900038a0 auth_method 0 2024-08-19T11:10:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:06.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f18900062d0 auth_method 0 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:06.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:06.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18900038a0 auth_method 0 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f18900062d0 auth_method 0 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:06.793+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:07.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f18900038a0 auth_method 0 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f18900062d0 auth_method 0 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:07.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.594+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.595+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.595+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.595+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:07.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:07.595+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:09.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): tick 2024-08-19T11:10:09.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900062d0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 msgr2=0x7f1890005cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.71:3300/0 conn(0x7f18900038a0 0x7f1890005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> v1:172.21.15.71:6789/0 conn(0x7f1890008e20 legacy=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 reap_dead start 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient: _add_conns ranks=[10,4,7,2,5] 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 reap_dead start 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:09.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-f con 0x7f189000cea0 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f189000d320 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-i con 0x7f189000bab0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f18ac0741e0 con 0x7f189000cea0 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f18ac072810 con 0x7f189000d320 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f189000d8c0 con 0x7f189000bab0 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18a2ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f189000d320 auth_method 0 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000cea0 auth_method 0 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f189000bab0 auth_method 0 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:09.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.191+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f189000d320 auth_method 0 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f189000bab0 auth_method 0 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000cea0 auth_method 0 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.393+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:09.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.794+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.794+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f189000d320 auth_method 0 2024-08-19T11:10:09.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.794+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.794+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.794+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f189000bab0 auth_method 0 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:09.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000cea0 auth_method 0 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:09.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:09.795+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f189000d320 auth_method 0 2024-08-19T11:10:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000cea0 auth_method 0 2024-08-19T11:10:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f189000bab0 auth_method 0 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:10.596+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): tick 2024-08-19T11:10:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:10:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:10:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 msgr2=0x7f189000b2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f189000bab0 0x7f189000b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 msgr2=0x7f1890005c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000d320 0x7f1890005c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 msgr2=0x7f1890008760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> v2:172.21.15.135:3300/0 conn(0x7f189000cea0 0x7f1890008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient: _add_conns ranks=[2,5] 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f189000c040 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f1890010060 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac0741e0 con 0x7f189000c040 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f18ac072810 con 0x7f1890010060 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18a2ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:12.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000c040 auth_method 0 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:12.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f1890010060 auth_method 0 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:12.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f1890010060 auth_method 0 2024-08-19T11:10:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.392+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000c040 auth_method 0 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.393+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:10:12.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f1890010060 auth_method 0 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.793+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000c040 auth_method 0 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:12.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.794+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:12.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:12.795+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:10:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f1890010060 auth_method 0 2024-08-19T11:10:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:13.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:13.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:13.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:13.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:13.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.595+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000c040 auth_method 0 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:13.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:13.597+0000 7f18b1190640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): tick 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 msgr2=0x7f1890012450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1890010060 0x7f1890012450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 msgr2=0x7f189000c420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000c040 0x7f189000c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient: _add_conns ranks=[1,8,2,0,7,9,5,3,4,10,6] 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f1890012d20 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 reap_dead start 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900168d0 0x7f1890018cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f18900168d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 0x7f189000c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f189000bab0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189000dd40 con 0x7f1890012d20 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac0741e0 con 0x7f189000bab0 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f18ac072810 con 0x7f18900168d0 2024-08-19T11:10:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18a2ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 0x7f189000c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900168d0 0x7f1890018cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): get_auth_request con 0x7f18900168d0 auth_method 0 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): get_auth_request con 0x7f189000bab0 auth_method 0 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b098f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.191+0000 7f18b1991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 10 monclient(hunting): handle_auth_done global_id 4124 payload 274 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900168d0 msgr2=0x7f1890018cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900168d0 0x7f1890018cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> v1:172.21.15.135:6789/0 conn(0x7f1890012d20 legacy=0x7f1890015110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 10 monclient: _finish_hunting 0 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 1 monclient: found mon.noname-b 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189000c550 con 0x7f189000bab0 2024-08-19T11:10:15.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.192+0000 7f18b098f640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900168d0 0x7f1890018cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.194+0000 7f18b1991640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 msgr2=0x7f189000c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.194+0000 7f18b1991640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 0x7f189000c010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0a7760 tx=0x7f18a802b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f7fd1b6c37023e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 1 -- 172.21.15.71:0/2612816211 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18a8039070 con 0x7f189000bab0 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: dump: 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:15.203 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.204 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 1 -- 172.21.15.71:0/2612816211 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a80318f0 con 0x7f189000bab0 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18b33f4640 5 monclient: authenticate success, global_id 4124 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18b33f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 1 -- 172.21.15.71:0/2612816211 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18a8033370 con 0x7f189000bab0 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18b33f4640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18b33f4640 4 set_mon_vals no callback set 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.195+0000 7f18a3fff640 10 monclient: dump: 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 10 monclient: shutdown 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 -- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 msgr2=0x7f189000c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 0x7f189000c010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0a7760 tx=0x7f18a802b7c0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 -- 172.21.15.71:0/2612816211 shutdown_connections 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f189000bab0 0x7f189000c010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 --2- 172.21.15.71:0/2612816211 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18900168d0 0x7f1890018cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 -- 172.21.15.71:0/2612816211 >> 172.21.15.71:0/2612816211 conn(0x7f18ac0aa3f0 msgr2=0x7f18ac0a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 -- 172.21.15.71:0/2612816211 shutdown_connections 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.196+0000 7f18b33f4640 1 -- 172.21.15.71:0/2612816211 wait complete. 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.197+0000 7f18b33f4640 10 monclient: build_initial_monmap 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.197+0000 7f18b33f4640 10 monclient: monmap: 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.197+0000 7f18b33f4640 1 Processor -- start 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.197+0000 7f18b33f4640 1 -- start start 2024-08-19T11:10:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.197+0000 7f18b33f4640 10 monclient: init 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient: _add_conns ranks=[4,1,7,8,0,5,6,3,2] 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 0x7f18ac1bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): picked mon.noname-c con 0x7f189000bab0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1890012d20 0x7f18ac1bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): picked mon.noname-f con 0x7f1890012d20 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18900168d0 0x7f18ac1a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): picked mon.noname-i con 0x7f18900168d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac072470 con 0x7f1890012d20 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f18ac0a17d0 con 0x7f189000bab0 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f18ac0a9380 con 0x7f18900168d0 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b33f4640 10 monclient(hunting): authenticate will time out at 673.239253s 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 0x7f18ac1bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 0x7f18ac1bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:57614/0 (socket says 172.21.15.71:57614) 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 -- 172.21.15.71:0/163049063 learned_addr learned my addr 172.21.15.71:0/163049063 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): get_auth_request con 0x7f189000bab0 auth_method 0 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1991640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18900168d0 0x7f18ac1a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b098f640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1890012d20 0x7f18ac1bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 -- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18900168d0 msgr2=0x7f18ac1a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18900168d0 0x7f18ac1a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 -- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1890012d20 msgr2=0x7f18ac1bcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1890012d20 0x7f18ac1bcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient: _finish_hunting 0 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 monclient: found mon.noname-c 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1190640 1 -- 172.21.15.71:0/163049063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac0a2b00 con 0x7f189000bab0 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1991640 10 monclient: get_auth_request con 0x7f18900168d0 auth_method 0 2024-08-19T11:10:15.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b1991640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18900168d0 0x7f18ac1a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b098f640 10 monclient: get_auth_request con 0x7f1890012d20 auth_method 0 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.198+0000 7f18b098f640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1890012d20 0x7f18ac1bcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b1190640 1 -- 172.21.15.71:0/163049063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 msgr2=0x7f18ac1bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b1190640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 0x7f18ac1bc5e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18a4018f10 tx=0x7f18a40177b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18a400f040 con 0x7f189000bab0 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: dump: 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.213 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:15.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 5 monclient: authenticate success, global_id 4117 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a4028070 con 0x7f189000bab0 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 10 monclient: _renew_subs 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ac1a9ce0 con 0x7f189000bab0 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f18a40044a0 con 0x7f189000bab0 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 10 monclient: dump: 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.215 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:15.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a37fe640 4 set_mon_vals no callback set 2024-08-19T11:10:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 10 monclient: _renew_subs 2024-08-19T11:10:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ac1a9700 con 0x7f189000bab0 2024-08-19T11:10:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f18a402a020 con 0x7f189000bab0 2024-08-19T11:10:15.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.201+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18a40038d0 con 0x7f189000bab0 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.202+0000 7f18b33f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.202+0000 7f18b33f4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.202+0000 7f18b33f4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.202+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ac0a1b00 con 0x7f189000bab0 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.205+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f18ac0a2b00 con 0x7f189000bab0 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.205+0000 7f18a1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:15.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.205+0000 7f18a1ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:15.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.269+0000 7f18b33f4640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-08-19T11:10:15.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.269+0000 7f18b33f4640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-08-19T11:10:15.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.269+0000 7f18b33f4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:15.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.269+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f18ac1aa060 con 0x7f189000bab0 2024-08-19T11:10:15.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.280+0000 7f18a1ffb640 1 -- 172.21.15.71:0/163049063 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f18a401f040 con 0x7f189000bab0 2024-08-19T11:10:15.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.280+0000 7f18a1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-08-19T11:10:15.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.280+0000 7f18a1ffb640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-08-19T11:10:15.281 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-08-19T11:10:15.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 10 monclient: shutdown 2024-08-19T11:10:15.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:15.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 msgr2=0x7f18ac1bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:15.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 0x7f18ac1bc5e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18a4018f10 tx=0x7f18a40177b0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 shutdown_connections 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18900168d0 0x7f18ac1a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1890012d20 0x7f18ac1bcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 --2- 172.21.15.71:0/163049063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f189000bab0 0x7f18ac1bc5e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 >> 172.21.15.71:0/163049063 conn(0x7f18ac0aa3f0 msgr2=0x7f18ac0a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 shutdown_connections 2024-08-19T11:10:15.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:15.281+0000 7f18b33f4640 1 -- 172.21.15.71:0/163049063 wait complete. 2024-08-19T11:10:15.293 INFO:tasks.ceph:check_enable_crimson: False 2024-08-19T11:10:15.293 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-19T11:10:15.294 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:10:15.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-19T11:10:15.324 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:10:15.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-19T11:10:15.390 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-08-19T11:10:15.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-19T11:10:15.454 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:15.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-19T11:10:15.480 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:15.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-19T11:10:15.545 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-19T11:10:15.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-19T11:10:15.611 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 4cd56453-bc2e-438f-a8b0-6ab2980ae8a9 0 2024-08-19T11:10:15.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.748+0000 7f6aefd98640 10 monclient: get_monmap_and_config 2024-08-19T11:10:15.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.748+0000 7f6aefd98640 10 monclient: build_initial_monmap 2024-08-19T11:10:15.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.748+0000 7f6aefd98640 10 monclient: monmap: 2024-08-19T11:10:15.750 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:10:15.749779+0000 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:10:15.749779+0000 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:15.751 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:15.752 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:15.752 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:15.752 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:15.752 INFO:teuthology.orchestra.run.smithi135.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:15.752 INFO:teuthology.orchestra.run.smithi135.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:15.752 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.749+0000 7f6aefd98640 1 Processor -- start 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.749+0000 7f6aefd98640 1 -- start start 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.749+0000 7f6aefd98640 10 monclient: init 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient: _add_conns ranks=[2,9,3,0,6,8,1,7,10,5,4] 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae81399f0 0x7f6ae806e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): picked mon.noname-b con 0x7f6ae81399f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ae8139dd0 0x7f6ae80a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): picked mon.noname-a con 0x7f6ae8139dd0 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:15.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 0x7f6ae80a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): picked mon.noname-g con 0x7f6ae813a1f0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae8071fe0 con 0x7f6ae8139dd0 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae806e640 con 0x7f6ae81399f0 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae806de80 con 0x7f6ae813a1f0 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aefd98640 10 monclient(hunting): authenticate will time out at 693.774347s 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 0x7f6ae80a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 0x7f6ae80a5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:51814/0 (socket says 172.21.15.135:51814) 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 -- 172.21.15.135:0/3923362751 learned_addr learned my addr 172.21.15.135:0/3923362751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): get_auth_request con 0x7f6ae813a1f0 auth_method 0 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 1 --2- 172.21.15.135:0/3923362751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae81399f0 0x7f6ae806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 1 --2- 172.21.15.135:0/3923362751 >> v2:172.21.15.71:3300/0 conn(0x7f6ae8139dd0 0x7f6ae80a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): get_auth_request con 0x7f6ae81399f0 auth_method 0 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): get_auth_request con 0x7f6ae8139dd0 auth_method 0 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aed333640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aedb34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient(hunting): handle_auth_done global_id 4116 payload 274 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 -- 172.21.15.135:0/3923362751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae81399f0 msgr2=0x7f6ae806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 --2- 172.21.15.135:0/3923362751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae81399f0 0x7f6ae806e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 -- 172.21.15.135:0/3923362751 >> v2:172.21.15.71:3300/0 conn(0x7f6ae8139dd0 msgr2=0x7f6ae80a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 --2- 172.21.15.135:0/3923362751 >> v2:172.21.15.71:3300/0 conn(0x7f6ae8139dd0 0x7f6ae80a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient: _finish_hunting 0 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 monclient: found mon.noname-g 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.750+0000 7f6aee335640 1 -- 172.21.15.135:0/3923362751 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae806f1a0 con 0x7f6ae813a1f0 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aee335640 1 -- 172.21.15.135:0/3923362751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 msgr2=0x7f6ae80a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aee335640 1 --2- 172.21.15.135:0/3923362751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 0x7f6ae80a5ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009e80 tx=0x7f6ae002a610 comp rx=0 tx=0).ready entity=mon.3 client_cookie=2d129f4f0ee82b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 1 -- 172.21.15.135:0/3923362751 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ae0036070 con 0x7f6ae813a1f0 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: dump: 2024-08-19T11:10:15.768 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.769 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: _finish_auth 0 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: _check_auth_tickets 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 1 -- 172.21.15.135:0/3923362751 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae0007860 con 0x7f6ae813a1f0 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 5 monclient: authenticate success, global_id 4116 2024-08-19T11:10:15.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 1 -- 172.21.15.135:0/3923362751 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ae0030360 con 0x7f6ae813a1f0 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 4 set_mon_vals no callback set 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aecb32640 10 monclient: dump: 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.771 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 10 monclient: shutdown 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 -- 172.21.15.135:0/3923362751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 msgr2=0x7f6ae80a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 --2- 172.21.15.135:0/3923362751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 0x7f6ae80a5ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009e80 tx=0x7f6ae002a610 comp rx=0 tx=0).stop 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 -- 172.21.15.135:0/3923362751 shutdown_connections 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 --2- 172.21.15.135:0/3923362751 >> v2:172.21.15.71:3300/0 conn(0x7f6ae8139dd0 0x7f6ae80a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 --2- 172.21.15.135:0/3923362751 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ae813a1f0 0x7f6ae80a5ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 --2- 172.21.15.135:0/3923362751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae81399f0 0x7f6ae806e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.754+0000 7f6aefd98640 1 -- 172.21.15.135:0/3923362751 >> 172.21.15.135:0/3923362751 conn(0x7f6ae80aa380 msgr2=0x7f6ae80a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.755+0000 7f6aefd98640 1 -- 172.21.15.135:0/3923362751 shutdown_connections 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.755+0000 7f6aefd98640 1 -- 172.21.15.135:0/3923362751 wait complete. 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.755+0000 7f6aefd98640 10 monclient: build_initial_monmap 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.755+0000 7f6aefd98640 10 monclient: monmap: 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 0.000000 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:created 0.000000 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.755+0000 7f6aefd98640 1 Processor -- start 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 -- start start 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient: init 2024-08-19T11:10:15.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient: _add_conns ranks=[5,1,2,8,7,4,0,3,6] 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 0x7f6ae81ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): picked mon.noname-h con 0x7f6ae81399f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): picked mon.noname-f con 0x7f6ae8139dd0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae813a1f0 0x7f6ae8121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): picked mon.noname-b con 0x7f6ae813a1f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae806e890 con 0x7f6ae8139dd0 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae80a7260 con 0x7f6ae813a1f0 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:15.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6ae806ea10 con 0x7f6ae81399f0 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aefd98640 10 monclient(hunting): authenticate will time out at 693.780562s 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 0x7f6ae81ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41072/0 (socket says 172.21.15.135:41072) 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 -- 172.21.15.135:0/2911212033 learned_addr learned my addr 172.21.15.135:0/2911212033 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): get_auth_request con 0x7f6ae8139dd0 auth_method 0 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 10 monclient(hunting): get_auth_request con 0x7f6ae81399f0 auth_method 0 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae813a1f0 0x7f6ae8121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): get_auth_request con 0x7f6ae813a1f0 auth_method 0 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 1 -- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 msgr2=0x7f6ae81ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:10:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 1 -- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 msgr2=0x7f6ae81ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 0x7f6ae81ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aedb34640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 0x7f6ae81ce840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aee335640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient(hunting): handle_auth_done global_id 4114 payload 824 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 -- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 msgr2=0x7f6ae81ce840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 0x7f6ae81ce840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 -- 172.21.15.135:0/2911212033 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae813a1f0 msgr2=0x7f6ae8121d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae813a1f0 0x7f6ae8121d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient: _finish_hunting 0 2024-08-19T11:10:15.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 monclient: found mon.noname-f 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.756+0000 7f6aed333640 1 -- 172.21.15.135:0/2911212033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae80a7c70 con 0x7f6ae8139dd0 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aed333640 1 -- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 msgr2=0x7f6ae81ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aed333640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e980 tx=0x7f6ae400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ae4017070 con 0x7f6ae8139dd0 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: dump: 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.780 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:15.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae400cc10 con 0x7f6ae8139dd0 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 5 monclient: authenticate success, global_id 4114 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 10 monclient: _renew_subs 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae80a80a0 con 0x7f6ae8139dd0 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ae400cdc0 con 0x7f6ae8139dd0 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:15.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 10 monclient: dump: 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:15.783 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 10 monclient: _renew_subs 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6adbfff640 4 set_mon_vals no callback set 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae8125870 con 0x7f6ae8139dd0 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ae401a070 con 0x7f6ae8139dd0 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.759+0000 7f6aed333640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e980 tx=0x7f6ae400ee40 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f6ae400f040 osd_map(2..2 src has 1..2) 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.760+0000 7f6aefd98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:15.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.760+0000 7f6aefd98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.760+0000 7f6aefd98640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.760+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8136bd0 con 0x7f6ae8139dd0 2024-08-19T11:10:15.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:15.762+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6ae400f040 con 0x7f6ae8139dd0 2024-08-19T11:10:16.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.587+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6ae8136bd0 con 0x7f6ae8139dd0 2024-08-19T11:10:16.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.587+0000 7f6ada7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:16.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.587+0000 7f6ada7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:16.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.658+0000 7f6aefd98640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4cd56453-bc2e-438f-a8b0-6ab2980ae8a9", "id": 0}] 2024-08-19T11:10:16.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.658+0000 7f6aefd98640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4cd56453-bc2e-438f-a8b0-6ab2980ae8a9", "id": 0}] 2024-08-19T11:10:16.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.658+0000 7f6aefd98640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:16.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.658+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4cd56453-bc2e-438f-a8b0-6ab2980ae8a9", "id": 0} v 0) -- 0x7f6ae8073d10 con 0x7f6ae8139dd0 2024-08-19T11:10:16.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.666+0000 7f6ada7fc640 1 -- 172.21.15.135:0/2911212033 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4cd56453-bc2e-438f-a8b0-6ab2980ae8a9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6ae8073d10 con 0x7f6ae8139dd0 2024-08-19T11:10:16.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.666+0000 7f6ada7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4cd56453-bc2e-438f-a8b0-6ab2980ae8a9", "id": 0}] 2024-08-19T11:10:16.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.666+0000 7f6ada7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:16.668 INFO:teuthology.orchestra.run.smithi135.stdout:0 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 10 monclient: shutdown 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 msgr2=0x7f6ae81ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400e980 tx=0x7f6ae400ee40 comp rx=0 tx=0).stop 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 shutdown_connections 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae813a1f0 0x7f6ae8121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ae8139dd0 0x7f6ae81ced80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 --2- 172.21.15.135:0/2911212033 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ae81399f0 0x7f6ae81ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 >> 172.21.15.135:0/2911212033 conn(0x7f6ae80aa380 msgr2=0x7f6ae81bf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 shutdown_connections 2024-08-19T11:10:16.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.667+0000 7f6aefd98640 1 -- 172.21.15.135:0/2911212033 wait complete. 2024-08-19T11:10:16.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 21f6bd64-11ab-44cb-b905-aadbedbf636f 1 2024-08-19T11:10:16.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.777+0000 7f968a9c9640 10 monclient: get_monmap_and_config 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.777+0000 7f968a9c9640 10 monclient: build_initial_monmap 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.777+0000 7f968a9c9640 10 monclient: monmap: 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:10:16.778303+0000 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:10:16.778303+0000 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:16.780 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 Processor -- start 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 -- start start 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient: init 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient: _add_conns ranks=[9,5,3,0,10,6,4,2,8,1,7] 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f96840a47c0 0x7f96840a1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): picked mon.noname-a con 0x7f96840a47c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): picked mon.noname-h con 0x7f96840a4ba0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 0x7f9684139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): picked mon.noname-g con 0x7f9684139a50 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f968406cd60 con 0x7f96840a47c0 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f968406cf60 con 0x7f9684139a50 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f96840a0b80 con 0x7f96840a4ba0 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f968a9c9640 10 monclient(hunting): authenticate will time out at 694.802789s 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f9688f66640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 0x7f9684139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.135:47238/0 (socket says 172.21.15.135:47238) 2024-08-19T11:10:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 1 -- 172.21.15.135:0/182802790 learned_addr learned my addr 172.21.15.135:0/182802790 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 10 monclient(hunting): get_auth_request con 0x7f96840a4ba0 auth_method 0 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f9688f66640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 0x7f9684139ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:51822/0 (socket says 172.21.15.135:51822) 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f96837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f9688f66640 10 monclient(hunting): get_auth_request con 0x7f9684139a50 auth_method 0 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f9688f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f9688f66640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.778+0000 7f9688f66640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f96837fe640 1 -- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 msgr2=0x7f96840a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f96837fe640 1 -- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 msgr2=0x7f96840a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f96837fe640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f96837fe640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 1 --2- 172.21.15.135:0/182802790 >> v2:172.21.15.71:3300/0 conn(0x7f96840a47c0 0x7f96840a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): get_auth_request con 0x7f96840a47c0 auth_method 0 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9683fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 10 monclient(hunting): handle_auth_done global_id 4125 payload 274 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 1 -- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 msgr2=0x7f96840a4fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 1 -- 172.21.15.135:0/182802790 >> v2:172.21.15.71:3300/0 conn(0x7f96840a47c0 msgr2=0x7f96840a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 1 --2- 172.21.15.135:0/182802790 >> v2:172.21.15.71:3300/0 conn(0x7f96840a47c0 0x7f96840a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 10 monclient: _finish_hunting 0 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 1 monclient: found mon.noname-g 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.779+0000 7f9688f66640 1 -- 172.21.15.135:0/182802790 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96840a5520 con 0x7f9684139a50 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.781+0000 7f9688f66640 1 -- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 msgr2=0x7f9684139ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:16.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.781+0000 7f9688f66640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 0x7f9684139ee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f967c009d90 tx=0x7f967c02a490 comp rx=0 tx=0).ready entity=mon.3 client_cookie=ddeb920331d373a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:16.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 1 -- 172.21.15.135:0/182802790 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f967c007bc0 con 0x7f9684139a50 2024-08-19T11:10:16.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: dump: 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:16.793 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 1 -- 172.21.15.135:0/182802790 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c007d80 con 0x7f9684139a50 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 5 monclient: authenticate success, global_id 4125 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:16.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 1 -- 172.21.15.135:0/182802790 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f967c031870 con 0x7f9684139a50 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f9682ffd640 10 monclient: dump: 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:16.795 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 4 set_mon_vals no callback set 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 10 monclient: shutdown 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 -- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 msgr2=0x7f9684139ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 0x7f9684139ee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f967c009d90 tx=0x7f967c02a490 comp rx=0 tx=0).stop 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 -- 172.21.15.135:0/182802790 shutdown_connections 2024-08-19T11:10:16.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9684139a50 0x7f9684139ee0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 --2- 172.21.15.135:0/182802790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f96840a4ba0 0x7f96840a4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 --2- 172.21.15.135:0/182802790 >> v2:172.21.15.71:3300/0 conn(0x7f96840a47c0 0x7f96840a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.782+0000 7f968a9c9640 1 -- 172.21.15.135:0/182802790 >> 172.21.15.135:0/182802790 conn(0x7f96840a93e0 msgr2=0x7f96840a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.783+0000 7f968a9c9640 1 -- 172.21.15.135:0/182802790 shutdown_connections 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.783+0000 7f968a9c9640 1 -- 172.21.15.135:0/182802790 wait complete. 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.783+0000 7f968a9c9640 10 monclient: build_initial_monmap 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.783+0000 7f968a9c9640 10 monclient: monmap: 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 0.000000 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:created 0.000000 2024-08-19T11:10:16.797 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.783+0000 7f968a9c9640 1 Processor -- start 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 -- start start 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient: init 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient: _add_conns ranks=[3,1,5,8,2,4,7,6,0] 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 0x7f96841260e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): picked mon.noname-g con 0x7f96840a47c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 0x7f9684126620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): picked mon.noname-f con 0x7f96840a4ba0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): picked mon.noname-h con 0x7f9684139a50 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96840a1f00 con 0x7f96840a4ba0 2024-08-19T11:10:16.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f96840a1d80 con 0x7f96840a47c0 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f968413a420 con 0x7f9684139a50 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f968a9c9640 10 monclient(hunting): authenticate will time out at 694.808575s 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 0x7f96841260e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 0x7f9684126620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.135:47244/0 (socket says 172.21.15.135:47244) 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 0x7f9684126620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41084/0 (socket says 172.21.15.135:41084) 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 -- 172.21.15.135:0/1449735637 learned_addr learned my addr 172.21.15.135:0/1449735637 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:16.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 10 monclient(hunting): get_auth_request con 0x7f9684139a50 auth_method 0 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): get_auth_request con 0x7f96840a4ba0 auth_method 0 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 0x7f96841260e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:51836/0 (socket says 172.21.15.135:51836) 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): get_auth_request con 0x7f96840a47c0 auth_method 0 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 -- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 msgr2=0x7f9684126b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 -- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 msgr2=0x7f9684126b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9683fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f96837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.784+0000 7f9688f66640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 10 monclient(hunting): handle_auth_done global_id 4123 payload 824 2024-08-19T11:10:16.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 1 -- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 msgr2=0x7f9684126b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 1 -- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 msgr2=0x7f96841260e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 0x7f96841260e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 1 monclient: found mon.noname-f 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f96837fe640 1 -- 172.21.15.135:0/1449735637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9684138a30 con 0x7f96840a4ba0 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.785+0000 7f9683fff640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 0x7f96841260e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f96837fe640 1 -- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 msgr2=0x7f9684126620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f96837fe640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 0x7f9684126620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f967800e5e0 tx=0x7f967800eaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9678017070 con 0x7f96840a4ba0 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: dump: 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678013a90 con 0x7f96840a4ba0 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 5 monclient: authenticate success, global_id 4123 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 10 monclient: _renew_subs 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9684129760 con 0x7f96840a4ba0 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f967800f040 con 0x7f96840a4ba0 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 10 monclient: dump: 2024-08-19T11:10:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 10 monclient: _renew_subs 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96840a8430 con 0x7f96840a4ba0 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f96827fc640 4 set_mon_vals no callback set 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9678013c40 con 0x7f96840a4ba0 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.787+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9678003d10 con 0x7f96840a4ba0 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.788+0000 7f968a9c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.788+0000 7f968a9c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.788+0000 7f968a9c9640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.788+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968413a720 con 0x7f96840a4ba0 2024-08-19T11:10:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.790+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9678020070 con 0x7f96840a4ba0 2024-08-19T11:10:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.790+0000 7f9680ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.790+0000 7f9680ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:16.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.861+0000 7f968a9c9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "21f6bd64-11ab-44cb-b905-aadbedbf636f", "id": 1}] 2024-08-19T11:10:16.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.861+0000 7f968a9c9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "21f6bd64-11ab-44cb-b905-aadbedbf636f", "id": 1}] 2024-08-19T11:10:16.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.861+0000 7f968a9c9640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:16.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.861+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "21f6bd64-11ab-44cb-b905-aadbedbf636f", "id": 1} v 0) -- 0x7f96841279c0 con 0x7f96840a4ba0 2024-08-19T11:10:16.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.869+0000 7f9680ff9640 1 -- 172.21.15.135:0/1449735637 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21f6bd64-11ab-44cb-b905-aadbedbf636f", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9678013740 con 0x7f96840a4ba0 2024-08-19T11:10:16.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.869+0000 7f9680ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "21f6bd64-11ab-44cb-b905-aadbedbf636f", "id": 1}] 2024-08-19T11:10:16.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.869+0000 7f9680ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:16.871 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 10 monclient: shutdown 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 msgr2=0x7f9684126620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 0x7f9684126620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f967800e5e0 tx=0x7f967800eaa0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 shutdown_connections 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9684139a50 0x7f9684126b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96840a4ba0 0x7f9684126620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 --2- 172.21.15.135:0/1449735637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f96840a47c0 0x7f96841260e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 >> 172.21.15.135:0/1449735637 conn(0x7f96840a93e0 msgr2=0x7f968409c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 shutdown_connections 2024-08-19T11:10:16.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.870+0000 7f968a9c9640 1 -- 172.21.15.135:0/1449735637 wait complete. 2024-08-19T11:10:16.881 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 94e08bf3-3063-40a2-98b7-d8ca5247b521 2 2024-08-19T11:10:16.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.979+0000 7f60fd563640 10 monclient: get_monmap_and_config 2024-08-19T11:10:16.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.979+0000 7f60fd563640 10 monclient: build_initial_monmap 2024-08-19T11:10:16.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.979+0000 7f60fd563640 10 monclient: monmap: 2024-08-19T11:10:16.984 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:16.984 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:10:16.979895+0000 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:10:16.979895+0000 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:16.985 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.979+0000 7f60fd563640 1 Processor -- start 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.979+0000 7f60fd563640 1 -- start start 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.979+0000 7f60fd563640 10 monclient: init 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient: _add_conns ranks=[6,4,2,1,0,5,3,10,7,9,8] 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 0x7f60f80a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): picked mon.noname-d con 0x7f60f80a3170 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:16.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 0x7f60f80a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): picked mon.noname-c con 0x7f60f80a3550 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 0x7f60f80a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): picked mon.noname-b con 0x7f60f80a3970 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f60f80741e0 con 0x7f60f80a3970 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f60f8072810 con 0x7f60f80a3550 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f60f80a1d10 con 0x7f60f80a3170 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60fd563640 10 monclient(hunting): authenticate will time out at 695.004206s 2024-08-19T11:10:16.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 0x7f60f80a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 0x7f60f80a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 0x7f60f80a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 0x7f60f80a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.135:37278/0 (socket says 172.21.15.135:37278) 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 0x7f60f80a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.135:53840/0 (socket says 172.21.15.135:53840) 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 0x7f60f80a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.135:46206/0 (socket says 172.21.15.135:46206) 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 -- 172.21.15.135:0/1286168235 learned_addr learned my addr 172.21.15.135:0/1286168235 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): get_auth_request con 0x7f60f80a3170 auth_method 0 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): get_auth_request con 0x7f60f80a3550 auth_method 0 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): get_auth_request con 0x7f60f80a3970 auth_method 0 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:16.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_done global_id 4110 payload 274 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 -- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 msgr2=0x7f60f80a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 0x7f60f80a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 -- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 msgr2=0x7f60f80a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 0x7f60f80a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 monclient: found mon.noname-d 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f6ffd640 1 -- 172.21.15.135:0/1286168235 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f80738b0 con 0x7f60f80a3170 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f67fc640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 0x7f60f80a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:16.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.980+0000 7f60f77fe640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 0x7f60f80a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.983+0000 7f60f6ffd640 1 -- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 msgr2=0x7f60f80a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.983+0000 7f60f6ffd640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 0x7f60f80a17d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60e80098d0 tx=0x7f60e802a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c1a973fdb15996ea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.983+0000 7f60f5ffb640 1 -- 172.21.15.135:0/1286168235 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60e8037070 con 0x7f60f80a3170 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.983+0000 7f60f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.983+0000 7f60f5ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.983+0000 7f60f5ffb640 10 monclient: dump: 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:16.997 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:16.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 5 monclient: authenticate success, global_id 4110 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 1 -- 172.21.15.135:0/1286168235 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e802adc0 con 0x7f60f80a3170 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 4 set_mon_vals no callback set 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 1 -- 172.21.15.135:0/1286168235 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60e8030c20 con 0x7f60f80a3170 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60f5ffb640 10 monclient: dump: 2024-08-19T11:10:16.999 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.000 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 10 monclient: shutdown 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 -- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 msgr2=0x7f60f80a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 0x7f60f80a17d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60e80098d0 tx=0x7f60e802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 -- 172.21.15.135:0/1286168235 shutdown_connections 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3970 0x7f60f80a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60f80a3550 0x7f60f80a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 --2- 172.21.15.135:0/1286168235 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3170 0x7f60f80a17d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 -- 172.21.15.135:0/1286168235 >> 172.21.15.135:0/1286168235 conn(0x7f60f80aa3f0 msgr2=0x7f60f80a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:17.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 -- 172.21.15.135:0/1286168235 shutdown_connections 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.984+0000 7f60fd563640 1 -- 172.21.15.135:0/1286168235 wait complete. 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.985+0000 7f60fd563640 10 monclient: build_initial_monmap 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.985+0000 7f60fd563640 10 monclient: monmap: 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 0.000000 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:created 0.000000 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:17.002 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.985+0000 7f60fd563640 1 Processor -- start 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.985+0000 7f60fd563640 1 -- start start 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.985+0000 7f60fd563640 10 monclient: init 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient: _add_conns ranks=[2,1,6,0,8,5,7,4,3] 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3170 0x7f60f81bc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): picked mon.noname-b con 0x7f60f80a3170 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 0x7f60f81bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): picked mon.noname-f con 0x7f60f80a3550 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3970 0x7f60f81a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): picked mon.noname-d con 0x7f60f80a3970 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60f8072470 con 0x7f60f80a3550 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f60f80a6250 con 0x7f60f80a3170 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f60f81a7da0 con 0x7f60f80a3970 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60fd563640 10 monclient(hunting): authenticate will time out at 695.010293s 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 0x7f60f81bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 0x7f60f81bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41096/0 (socket says 172.21.15.135:41096) 2024-08-19T11:10:17.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 -- 172.21.15.135:0/2250861354 learned_addr learned my addr 172.21.15.135:0/2250861354 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): get_auth_request con 0x7f60f80a3550 auth_method 0 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3170 0x7f60f81bc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): get_auth_request con 0x7f60f80a3170 auth_method 0 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3970 0x7f60f81a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): get_auth_request con 0x7f60f80a3970 auth_method 0 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient(hunting): handle_auth_done global_id 4132 payload 824 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 -- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3970 msgr2=0x7f60f81a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3970 0x7f60f81a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 -- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3170 msgr2=0x7f60f81bc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3170 0x7f60f81bc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient: _finish_hunting 0 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 monclient: found mon.noname-f 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.986+0000 7f60f67fc640 1 -- 172.21.15.135:0/2250861354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f80a9540 con 0x7f60f80a3550 2024-08-19T11:10:17.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.988+0000 7f60f67fc640 1 -- 172.21.15.135:0/2250861354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 msgr2=0x7f60f81bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.988+0000 7f60f67fc640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 0x7f60f81bcc80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00ebe0 tx=0x7f60ec00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60ec017070 con 0x7f60f80a3550 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: dump: 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.008 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ec00ce40 con 0x7f60f80a3550 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 5 monclient: authenticate success, global_id 4132 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:17.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60ec013d50 con 0x7f60f80a3550 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 10 monclient: _renew_subs 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f80a2880 con 0x7f60f80a3550 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 10 monclient: dump: 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.010 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60f57fa640 4 set_mon_vals no callback set 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 10 monclient: _renew_subs 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f81a9860 con 0x7f60f80a3550 2024-08-19T11:10:17.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60ec01a070 con 0x7f60f80a3550 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.989+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f60ec00f040 con 0x7f60f80a3550 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.990+0000 7f60fd563640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.990+0000 7f60fd563640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.990+0000 7f60fd563640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.990+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f80a6520 con 0x7f60f80a3550 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.992+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f60ec013740 con 0x7f60f80a3550 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.992+0000 7f60df7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:16.992+0000 7f60df7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.063+0000 7f60fd563640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "94e08bf3-3063-40a2-98b7-d8ca5247b521", "id": 2}] 2024-08-19T11:10:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.063+0000 7f60fd563640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "94e08bf3-3063-40a2-98b7-d8ca5247b521", "id": 2}] 2024-08-19T11:10:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.063+0000 7f60fd563640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:17.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.063+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94e08bf3-3063-40a2-98b7-d8ca5247b521", "id": 2} v 0) -- 0x7f60f81a9c40 con 0x7f60f80a3550 2024-08-19T11:10:17.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.071+0000 7f60df7fe640 1 -- 172.21.15.135:0/2250861354 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94e08bf3-3063-40a2-98b7-d8ca5247b521", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f60ec013920 con 0x7f60f80a3550 2024-08-19T11:10:17.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.071+0000 7f60df7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "94e08bf3-3063-40a2-98b7-d8ca5247b521", "id": 2}] 2024-08-19T11:10:17.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.071+0000 7f60df7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:17.072 INFO:teuthology.orchestra.run.smithi135.stdout:2 2024-08-19T11:10:17.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 10 monclient: shutdown 2024-08-19T11:10:17.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:17.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 msgr2=0x7f60f81bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 0x7f60f81bcc80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00ebe0 tx=0x7f60ec00c520 comp rx=0 tx=0).stop 2024-08-19T11:10:17.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 shutdown_connections 2024-08-19T11:10:17.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f60f80a3970 0x7f60f81a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80a3550 0x7f60f81bcc80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.072+0000 7f60fd563640 1 --2- 172.21.15.135:0/2250861354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f60f80a3170 0x7f60f81bc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.073+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 >> 172.21.15.135:0/2250861354 conn(0x7f60f80aa3f0 msgr2=0x7f60f80a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:17.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.073+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 shutdown_connections 2024-08-19T11:10:17.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.073+0000 7f60fd563640 1 -- 172.21.15.135:0/2250861354 wait complete. 2024-08-19T11:10:17.086 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new db4fe71c-7178-4d23-9459-aa91d3e27aaa 3 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.182+0000 7f9adadd9640 10 monclient: get_monmap_and_config 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.182+0000 7f9adadd9640 10 monclient: build_initial_monmap 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.182+0000 7f9adadd9640 10 monclient: monmap: 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:10:17.183484+0000 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:10:17.183484+0000 2024-08-19T11:10:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:17.185 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 Processor -- start 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 -- start start 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient: init 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient: _add_conns ranks=[6,8,4,7,3,1,10,5,2,9,0] 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ad40a47c0 0x7f9ad40a1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): picked mon.noname-d con 0x7f9ad40a47c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9ad406cd60 0x7f9ad40a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): picked mon.noname-e con 0x7f9ad406cd60 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4139a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): picked mon.noname-c con 0x7f9ad40a50e0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9ad40a1420 con 0x7f9ad40a50e0 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9ad40a0b80 con 0x7f9ad40a47c0 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9ad40a62f0 con 0x7f9ad406cd60 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.183+0000 7f9adadd9640 10 monclient(hunting): authenticate will time out at 695.207938s 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9ad406cd60 0x7f9ad40a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ad40a47c0 0x7f9ad40a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.135:37290/0 (socket says 172.21.15.135:37290) 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9ad406cd60 0x7f9ad40a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.135:47650/0 (socket says 172.21.15.135:47650) 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 -- 172.21.15.135:0/2151444353 learned_addr learned my addr 172.21.15.135:0/2151444353 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): get_auth_request con 0x7f9ad40a50e0 auth_method 0 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): get_auth_request con 0x7f9ad406cd60 auth_method 0 2024-08-19T11:10:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): get_auth_request con 0x7f9ad40a47c0 auth_method 0 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient(hunting): handle_auth_done global_id 4135 payload 274 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 -- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9ad406cd60 msgr2=0x7f9ad40a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9ad406cd60 0x7f9ad40a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 -- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ad40a47c0 msgr2=0x7f9ad40a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ad40a47c0 0x7f9ad40a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient: _finish_hunting 0 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 monclient: found mon.noname-c 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.184+0000 7f9ad9376640 1 -- 172.21.15.135:0/2151444353 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40a1d80 con 0x7f9ad40a50e0 2024-08-19T11:10:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad9376640 1 -- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 msgr2=0x7f9ad4139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad9376640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4139a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009e80 tx=0x7f9acc02a530 comp rx=0 tx=0).ready entity=mon.4 client_cookie=79a25ba33dd4ecc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 1 -- 172.21.15.135:0/2151444353 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9acc036070 con 0x7f9ad40a50e0 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: dump: 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9adadd9640 5 monclient: authenticate success, global_id 4135 2024-08-19T11:10:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 1 -- 172.21.15.135:0/2151444353 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc007a70 con 0x7f9ad40a50e0 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9adadd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9adadd9640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 1 -- 172.21.15.135:0/2151444353 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9acc007c20 con 0x7f9ad40a50e0 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9adadd9640 4 set_mon_vals no callback set 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.187+0000 7f9ad37fe640 10 monclient: dump: 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 10 monclient: shutdown 2024-08-19T11:10:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 -- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 msgr2=0x7f9ad4139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4139a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009e80 tx=0x7f9acc02a530 comp rx=0 tx=0).stop 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 -- 172.21.15.135:0/2151444353 shutdown_connections 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4139a50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9ad406cd60 0x7f9ad40a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 --2- 172.21.15.135:0/2151444353 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ad40a47c0 0x7f9ad40a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 -- 172.21.15.135:0/2151444353 >> 172.21.15.135:0/2151444353 conn(0x7f9ad40a93e0 msgr2=0x7f9ad40a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 -- 172.21.15.135:0/2151444353 shutdown_connections 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 1 -- 172.21.15.135:0/2151444353 wait complete. 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.188+0000 7f9adadd9640 10 monclient: build_initial_monmap 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient: monmap: 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 0.000000 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:created 0.000000 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 Processor -- start 2024-08-19T11:10:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 -- start start 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient: init 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient: _add_conns ranks=[7,2,4,8,0,1,6,5,3] 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 0x7f9ad4126190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): picked mon.noname-i con 0x7f9ad406cd60 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ad40a47c0 0x7f9ad41266d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): picked mon.noname-b con 0x7f9ad40a47c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:17.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4126c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): picked mon.noname-c con 0x7f9ad40a50e0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad413a110 con 0x7f9ad40a47c0 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9ad4139f90 con 0x7f9ad40a50e0 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9ad413a290 con 0x7f9ad406cd60 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.189+0000 7f9adadd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9adadd9640 10 monclient(hunting): authenticate will time out at 695.214011s 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 0x7f9ad4126190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 0x7f9ad4126190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.135:60006/0 (socket says 172.21.15.135:60006) 2024-08-19T11:10:17.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 -- 172.21.15.135:0/4294146684 learned_addr learned my addr 172.21.15.135:0/4294146684 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): get_auth_request con 0x7f9ad406cd60 auth_method 0 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ad40a47c0 0x7f9ad41266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4126c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): get_auth_request con 0x7f9ad40a47c0 auth_method 0 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): get_auth_request con 0x7f9ad40a50e0 auth_method 0 2024-08-19T11:10:17.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad9376640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient(hunting): handle_auth_done global_id 4111 payload 824 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 -- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 msgr2=0x7f9ad4126c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4126c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 -- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ad40a47c0 msgr2=0x7f9ad41266d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ad40a47c0 0x7f9ad41266d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient: _finish_hunting 0 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 monclient: found mon.noname-i 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad8b75640 1 -- 172.21.15.135:0/4294146684 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad4129e10 con 0x7f9ad406cd60 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.190+0000 7f9ad3fff640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ad40a47c0 0x7f9ad41266d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:17.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad8b75640 1 -- 172.21.15.135:0/4294146684 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 msgr2=0x7f9ad4126190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad8b75640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 0x7f9ad4126190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800e9b0 tx=0x7f9ac800ee70 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ac8017070 con 0x7f9ad406cd60 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 10 monclient: dump: 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.212 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:17.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9adadd9640 5 monclient: authenticate success, global_id 4111 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac800cbb0 con 0x7f9ad406cd60 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ac800cd60 con 0x7f9ad406cd60 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9adadd9640 10 monclient: _renew_subs 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9adadd9640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad40740c0 con 0x7f9ad406cd60 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9ad17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9ad17fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.192+0000 7f9ad2ffd640 4 set_mon_vals no callback set 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9ad17fa640 10 monclient: dump: 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.214 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.215 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 10 monclient: _renew_subs 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad4127ab0 con 0x7f9ad406cd60 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ac801a070 con 0x7f9ad406cd60 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9ac800f040 con 0x7f9ad406cd60 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.193+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad40a04d0 con 0x7f9ad406cd60 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.197+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9ad40a04d0 con 0x7f9ad406cd60 2024-08-19T11:10:17.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.197+0000 7f9ad17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.197+0000 7f9ad17fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:17.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.266+0000 7f9adadd9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "db4fe71c-7178-4d23-9459-aa91d3e27aaa", "id": 3}] 2024-08-19T11:10:17.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.266+0000 7f9adadd9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "db4fe71c-7178-4d23-9459-aa91d3e27aaa", "id": 3}] 2024-08-19T11:10:17.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.266+0000 7f9adadd9640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:17.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.266+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_command({"prefix": "osd new", "uuid": "db4fe71c-7178-4d23-9459-aa91d3e27aaa", "id": 3} v 0) -- 0x7f9ad413a5f0 con 0x7f9ad406cd60 2024-08-19T11:10:17.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.355+0000 7f9ad17fa640 1 -- 172.21.15.135:0/4294146684 <== mon.7 v2:172.21.15.135:3303/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db4fe71c-7178-4d23-9459-aa91d3e27aaa", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9ac8021070 con 0x7f9ad406cd60 2024-08-19T11:10:17.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.355+0000 7f9ad17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "db4fe71c-7178-4d23-9459-aa91d3e27aaa", "id": 3}] 2024-08-19T11:10:17.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.355+0000 7f9ad17fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:17.357 INFO:teuthology.orchestra.run.smithi135.stdout:3 2024-08-19T11:10:17.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 10 monclient: shutdown 2024-08-19T11:10:17.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:17.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 msgr2=0x7f9ad4126190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 0x7f9ad4126190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800e9b0 tx=0x7f9ac800ee70 comp rx=0 tx=0).stop 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 shutdown_connections 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9ad40a50e0 0x7f9ad4126c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ad40a47c0 0x7f9ad41266d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 --2- 172.21.15.135:0/4294146684 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ad406cd60 0x7f9ad4126190 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 >> 172.21.15.135:0/4294146684 conn(0x7f9ad40a93e0 msgr2=0x7f9ad40a6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 shutdown_connections 2024-08-19T11:10:17.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.356+0000 7f9adadd9640 1 -- 172.21.15.135:0/4294146684 wait complete. 2024-08-19T11:10:17.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 40bf3a44-e244-4a0c-92a9-83b53eca16cd 4 2024-08-19T11:10:17.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.465+0000 7f3b0ae8b640 10 monclient: get_monmap_and_config 2024-08-19T11:10:17.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.465+0000 7f3b0ae8b640 10 monclient: build_initial_monmap 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.465+0000 7f3b0ae8b640 10 monclient: monmap: 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:10:17.465971+0000 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:10:17.465971+0000 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:17.467 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:17.468 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:17.468 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:17.468 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:17.468 INFO:teuthology.orchestra.run.smithi135.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:17.468 INFO:teuthology.orchestra.run.smithi135.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:17.468 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.465+0000 7f3b0ae8b640 1 Processor -- start 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.465+0000 7f3b0ae8b640 1 -- start start 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.465+0000 7f3b0ae8b640 10 monclient: init 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient: _add_conns ranks=[7,5,6,1,3,8,10,0,4,2,9] 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 0x7f3b040a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): picked mon.noname-i con 0x7f3b040a5760 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:17.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): picked mon.noname-h con 0x7f3b040a5b40 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b04137510 0x7f3b04137970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): picked mon.noname-d con 0x7f3b04137510 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3b04072880 con 0x7f3b040a5b40 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b040a72f0 con 0x7f3b04137510 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3b040741c0 con 0x7f3b040a5760 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b0ae8b640 10 monclient(hunting): authenticate will time out at 695.490463s 2024-08-19T11:10:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 0x7f3b040a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.135:47256/0 (socket says 172.21.15.135:47256) 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 -- 172.21.15.135:0/1161382330 learned_addr learned my addr 172.21.15.135:0/1161382330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 10 monclient(hunting): get_auth_request con 0x7f3b040a5b40 auth_method 0 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): get_auth_request con 0x7f3b040a5760 auth_method 0 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 -- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 msgr2=0x7f3b040a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 -- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 msgr2=0x7f3b040a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b03fff640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient(hunting): handle_auth_done global_id 4120 payload 274 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 -- 172.21.15.135:0/1161382330 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b04137510 msgr2=0x7f3b04137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b09428640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b04137510 0x7f3b04137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b04137510 0x7f3b04137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 -- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 msgr2=0x7f3b040a5f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient: _finish_hunting 0 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 monclient: found mon.noname-i 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b08c27640 1 -- 172.21.15.135:0/1161382330 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b04073920 con 0x7f3b040a5760 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b09428640 10 monclient: get_auth_request con 0x7f3b04137510 auth_method 0 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.466+0000 7f3b09428640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b04137510 0x7f3b04137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b08c27640 1 -- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 msgr2=0x7f3b040a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b08c27640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 0x7f3b040a17d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009800 tx=0x7f3af8029fe0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=e436d56d071434bc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 1 -- 172.21.15.135:0/1161382330 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3af8037070 con 0x7f3b040a5760 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: dump: 2024-08-19T11:10:17.476 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.477 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 1 -- 172.21.15.135:0/1161382330 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af802ad00 con 0x7f3b040a5760 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b0ae8b640 5 monclient: authenticate success, global_id 4120 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b0ae8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 1 -- 172.21.15.135:0/1161382330 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3af8030c20 con 0x7f3b040a5760 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b0ae8b640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b0ae8b640 4 set_mon_vals no callback set 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.469+0000 7f3b037fe640 10 monclient: dump: 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.479 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 10 monclient: shutdown 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 msgr2=0x7f3b040a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 0x7f3b040a17d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009800 tx=0x7f3af8029fe0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/1161382330 shutdown_connections 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b04137510 0x7f3b04137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b040a5b40 0x7f3b040a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/1161382330 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b040a5760 0x7f3b040a17d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/1161382330 >> 172.21.15.135:0/1161382330 conn(0x7f3b040aa380 msgr2=0x7f3b040a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:17.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/1161382330 shutdown_connections 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.470+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/1161382330 wait complete. 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.471+0000 7f3b0ae8b640 10 monclient: build_initial_monmap 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.471+0000 7f3b0ae8b640 10 monclient: monmap: 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 0.000000 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:created 0.000000 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:17.481 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:17.482 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:17.482 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:17.482 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:17.482 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:17.482 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.471+0000 7f3b0ae8b640 1 Processor -- start 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.471+0000 7f3b0ae8b640 1 -- start start 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.471+0000 7f3b0ae8b640 10 monclient: init 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient: _add_conns ranks=[2,3,8,6,0,1,4,5,7] 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b040a5760 0x7f3b041ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): picked mon.noname-b con 0x7f3b040a5760 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): picked mon.noname-g con 0x7f3b040a5b40 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b04137510 0x7f3b0406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:17.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): picked mon.noname-e con 0x7f3b04137510 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b040725f0 con 0x7f3b040a5760 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3b04072470 con 0x7f3b040a5b40 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3b04137eb0 con 0x7f3b04137510 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b0ae8b640 10 monclient(hunting): authenticate will time out at 695.496278s 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:51842/0 (socket says 172.21.15.135:51842) 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 -- 172.21.15.135:0/729306635 learned_addr learned my addr 172.21.15.135:0/729306635 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): get_auth_request con 0x7f3b040a5b40 auth_method 0 2024-08-19T11:10:17.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b040a5760 0x7f3b041ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): get_auth_request con 0x7f3b040a5760 auth_method 0 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b04137510 0x7f3b0406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): get_auth_request con 0x7f3b04137510 auth_method 0 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:17.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b08c27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b09428640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient(hunting): handle_auth_done global_id 4143 payload 824 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 -- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b04137510 msgr2=0x7f3b0406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b04137510 0x7f3b0406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 -- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b040a5760 msgr2=0x7f3b041ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:17.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b040a5760 0x7f3b041ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 monclient: found mon.noname-g 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.472+0000 7f3b03fff640 1 -- 172.21.15.135:0/729306635 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b041260a0 con 0x7f3b040a5b40 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b03fff640 1 -- 172.21.15.135:0/729306635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 msgr2=0x7f3b04136980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b03fff640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e840 tx=0x7f3af000ed00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3af0017070 con 0x7f3b040a5b40 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: dump: 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.491 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.492 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 5 monclient: authenticate success, global_id 4143 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af000cb40 con 0x7f3b040a5b40 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3af000f040 con 0x7f3b040a5b40 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 10 monclient: _renew_subs 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b04126380 con 0x7f3b040a5b40 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b02ffd640 4 set_mon_vals no callback set 2024-08-19T11:10:17.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 10 monclient: dump: 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:17.494 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 10 monclient: _renew_subs 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040a3870 con 0x7f3b040a5b40 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3af000ccf0 con 0x7f3b040a5b40 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.475+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3af000c670 con 0x7f3b040a5b40 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.476+0000 7f3b0ae8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.476+0000 7f3b0ae8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.476+0000 7f3b0ae8b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.476+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b040a5fb0 con 0x7f3b040a5b40 2024-08-19T11:10:17.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:17.478+0000 7f3b03fff640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e840 tx=0x7f3af000ed00 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f3af0020030 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2024-08-19T11:10:18.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.306+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3af0020030 con 0x7f3b040a5b40 2024-08-19T11:10:18.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.306+0000 7f3b017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:18.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.306+0000 7f3b017fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:18.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.379+0000 7f3b0ae8b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "40bf3a44-e244-4a0c-92a9-83b53eca16cd", "id": 4}] 2024-08-19T11:10:18.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.379+0000 7f3b0ae8b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "40bf3a44-e244-4a0c-92a9-83b53eca16cd", "id": 4}] 2024-08-19T11:10:18.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.379+0000 7f3b0ae8b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:18.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.379+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "40bf3a44-e244-4a0c-92a9-83b53eca16cd", "id": 4} v 0) -- 0x7f3b04124900 con 0x7f3b040a5b40 2024-08-19T11:10:18.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.422+0000 7f3b017fa640 1 -- 172.21.15.135:0/729306635 <== mon.3 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40bf3a44-e244-4a0c-92a9-83b53eca16cd", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3af0004150 con 0x7f3b040a5b40 2024-08-19T11:10:18.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.422+0000 7f3b017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "40bf3a44-e244-4a0c-92a9-83b53eca16cd", "id": 4}] 2024-08-19T11:10:18.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.422+0000 7f3b017fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:18.424 INFO:teuthology.orchestra.run.smithi135.stdout:4 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 10 monclient: shutdown 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 msgr2=0x7f3b04136980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3af000e840 tx=0x7f3af000ed00 comp rx=0 tx=0).stop 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 shutdown_connections 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b04137510 0x7f3b0406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b040a5b40 0x7f3b04136980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 --2- 172.21.15.135:0/729306635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b040a5760 0x7f3b041ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 >> 172.21.15.135:0/729306635 conn(0x7f3b040aa380 msgr2=0x7f3b041bf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:18.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 shutdown_connections 2024-08-19T11:10:18.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.423+0000 7f3b0ae8b640 1 -- 172.21.15.135:0/729306635 wait complete. 2024-08-19T11:10:18.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 942f3892-f798-41d8-ba74-498d61449191 5 2024-08-19T11:10:18.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.532+0000 7fc7e936b640 10 monclient: get_monmap_and_config 2024-08-19T11:10:18.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.532+0000 7fc7e936b640 10 monclient: build_initial_monmap 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.532+0000 7fc7e936b640 10 monclient: monmap: 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:10:18.533137+0000 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:10:18.533137+0000 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:18.534 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:18.535 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:18.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.532+0000 7fc7e936b640 1 Processor -- start 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.532+0000 7fc7e936b640 1 -- start start 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.532+0000 7fc7e936b640 10 monclient: init 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient: _add_conns ranks=[4,2,3,6,9,10,0,5,1,7,8] 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc7e40a47c0 0x7fc7e40a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): picked mon.noname-c con 0x7fc7e40a47c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7e409fc90 0x7fc7e40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): picked mon.noname-b con 0x7fc7e409fc90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 0x7fc7e4136970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): picked mon.noname-g con 0x7fc7e4136570 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:18.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40a1fc0 con 0x7fc7e409fc90 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40a5620 con 0x7fc7e4136570 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc7e40a24f0 con 0x7fc7e40a47c0 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e936b640 10 monclient(hunting): authenticate will time out at 696.557482s 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 0x7fc7e4136970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 0x7fc7e4136970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:51858/0 (socket says 172.21.15.135:51858) 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 -- 172.21.15.135:0/3463375987 learned_addr learned my addr 172.21.15.135:0/3463375987 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): get_auth_request con 0x7fc7e4136570 auth_method 0 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:18.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc7e40a47c0 0x7fc7e40a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7e409fc90 0x7fc7e40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): get_auth_request con 0x7fc7e40a47c0 auth_method 0 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): get_auth_request con 0x7fc7e409fc90 auth_method 0 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:18.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_done global_id 4152 payload 274 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 -- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc7e40a47c0 msgr2=0x7fc7e40a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc7e40a47c0 0x7fc7e40a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 -- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7e409fc90 msgr2=0x7fc7e40a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7e409fc90 0x7fc7e40a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 monclient: found mon.noname-g 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.533+0000 7fc7e37fe640 1 -- 172.21.15.135:0/3463375987 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e40a04f0 con 0x7fc7e4136570 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.536+0000 7fc7e37fe640 1 -- 172.21.15.135:0/3463375987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 msgr2=0x7fc7e4136970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.536+0000 7fc7e37fe640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 0x7fc7e4136970 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009eb0 tx=0x7fc7dc02a5f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=2858a29f04d70ba5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 1 -- 172.21.15.135:0/3463375987 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc7dc036070 con 0x7fc7e4136570 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: dump: 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:18.544 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:18.545 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 1 -- 172.21.15.135:0/3463375987 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc007a70 con 0x7fc7e4136570 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 5 monclient: authenticate success, global_id 4152 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 1 -- 172.21.15.135:0/3463375987 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc7dc007c20 con 0x7fc7e4136570 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 4 set_mon_vals no callback set 2024-08-19T11:10:18.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e1ffb640 10 monclient: dump: 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:18.547 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 10 monclient: shutdown 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 -- 172.21.15.135:0/3463375987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 msgr2=0x7fc7e4136970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 0x7fc7e4136970 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009eb0 tx=0x7fc7dc02a5f0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 -- 172.21.15.135:0/3463375987 shutdown_connections 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e4136570 0x7fc7e4136970 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc7e409fc90 0x7fc7e40a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3463375987 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc7e40a47c0 0x7fc7e40a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 -- 172.21.15.135:0/3463375987 >> 172.21.15.135:0/3463375987 conn(0x7fc7e40a93e0 msgr2=0x7fc7e40a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 -- 172.21.15.135:0/3463375987 shutdown_connections 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.537+0000 7fc7e936b640 1 -- 172.21.15.135:0/3463375987 wait complete. 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.538+0000 7fc7e936b640 10 monclient: build_initial_monmap 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.538+0000 7fc7e936b640 10 monclient: monmap: 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 0 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 0.000000 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:created 0.000000 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:18.549 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.538+0000 7fc7e936b640 1 Processor -- start 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.538+0000 7fc7e936b640 1 -- start start 2024-08-19T11:10:18.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.538+0000 7fc7e936b640 10 monclient: init 2024-08-19T11:10:18.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient: _add_conns ranks=[3,8,1,2,4,0,5,7,6] 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): picked mon.noname-g con 0x7fc7e409fc90 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc7e40a47c0 0x7fc7e4135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): picked mon.noname-e con 0x7fc7e40a47c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 0x7fc7e4135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): picked mon.noname-f con 0x7fc7e4136570 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40a62c0 con 0x7fc7e4136570 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40a1cb0 con 0x7fc7e409fc90 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc7e40a0810 con 0x7fc7e40a47c0 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e936b640 10 monclient(hunting): authenticate will time out at 696.563389s 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 0x7fc7e4135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 0x7fc7e4135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41098/0 (socket says 172.21.15.135:41098) 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 1 -- 172.21.15.135:0/3258280134 learned_addr learned my addr 172.21.15.135:0/3258280134 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:51868/0 (socket says 172.21.15.135:51868) 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): get_auth_request con 0x7fc7e4136570 auth_method 0 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:18.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): get_auth_request con 0x7fc7e409fc90 auth_method 0 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc7e40a47c0 0x7fc7e4135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): get_auth_request con 0x7fc7e40a47c0 auth_method 0 2024-08-19T11:10:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient(hunting): handle_auth_done global_id 4161 payload 824 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 -- 172.21.15.135:0/3258280134 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc7e40a47c0 msgr2=0x7fc7e4135930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc7e40a47c0 0x7fc7e4135930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 -- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 msgr2=0x7fc7e4135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 0x7fc7e4135e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 monclient: found mon.noname-g 2024-08-19T11:10:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e2ffd640 1 -- 172.21.15.135:0/3258280134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e4122a50 con 0x7fc7e409fc90 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.539+0000 7fc7e37fe640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 0x7fc7e4135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e2ffd640 1 -- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 msgr2=0x7fc7e41cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e2ffd640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e850 tx=0x7fc7d400ed10 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc7d4017070 con 0x7fc7e409fc90 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: dump: 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:18.559 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4013470 con 0x7fc7e409fc90 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 5 monclient: authenticate success, global_id 4161 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 10 monclient: _renew_subs 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e40a8820 con 0x7fc7e409fc90 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc7d4013a90 con 0x7fc7e409fc90 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 10 monclient: dump: 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:epoch 1 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:election_strategy: 1 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:18.561 INFO:teuthology.orchestra.run.smithi135.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e17fa640 4 set_mon_vals no callback set 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 10 monclient: _renew_subs 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41232f0 con 0x7fc7e409fc90 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7e2ffd640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e850 tx=0x7fc7d400ed10 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fc7d401a070 mgrmap(e 1) 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.542+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7d401a070 con 0x7fc7e409fc90 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.543+0000 7fc7e936b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.543+0000 7fc7e936b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.543+0000 7fc7e936b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.543+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e4136c10 con 0x7fc7e409fc90 2024-08-19T11:10:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:18.545+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc7d400f040 con 0x7fc7e409fc90 2024-08-19T11:10:19.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.370+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc7e4136c10 con 0x7fc7e409fc90 2024-08-19T11:10:19.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.370+0000 7fc7cb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:19.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.370+0000 7fc7cb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.441+0000 7fc7e936b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "942f3892-f798-41d8-ba74-498d61449191", "id": 5}] 2024-08-19T11:10:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.441+0000 7fc7e936b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "942f3892-f798-41d8-ba74-498d61449191", "id": 5}] 2024-08-19T11:10:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.441+0000 7fc7e936b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:10:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:19.441+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "942f3892-f798-41d8-ba74-498d61449191", "id": 5} v 0) -- 0x7fc7e40a4ba0 con 0x7fc7e409fc90 2024-08-19T11:10:20.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.168+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 7 ==== mgrmap(e 2) ==== 49591+0+0 (secure 0 0 0) 0x7fc7d400cb50 con 0x7fc7e409fc90 2024-08-19T11:10:20.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.178+0000 7fc7cb7fe640 1 -- 172.21.15.135:0/3258280134 <== mon.3 v2:172.21.15.135:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "942f3892-f798-41d8-ba74-498d61449191", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc7d4021070 con 0x7fc7e409fc90 2024-08-19T11:10:20.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.178+0000 7fc7cb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "942f3892-f798-41d8-ba74-498d61449191", "id": 5}] 2024-08-19T11:10:20.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.178+0000 7fc7cb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:20.179 INFO:teuthology.orchestra.run.smithi135.stdout:5 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 10 monclient: shutdown 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 msgr2=0x7fc7e41cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400e850 tx=0x7fc7d400ed10 comp rx=0 tx=0).stop 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 shutdown_connections 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7e4136570 0x7fc7e4135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc7e40a47c0 0x7fc7e4135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 --2- 172.21.15.135:0/3258280134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7e409fc90 0x7fc7e41cc1b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 >> 172.21.15.135:0/3258280134 conn(0x7fc7e40a93e0 msgr2=0x7fc7e41bd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:20.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 shutdown_connections 2024-08-19T11:10:20.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-19T11:10:20.179+0000 7fc7e936b640 1 -- 172.21.15.135:0/3258280134 wait complete. 2024-08-19T11:10:20.193 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-19T11:10:20.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-19T11:10:20.196 INFO:tasks.ceph.osd.0:Started 2024-08-19T11:10:20.196 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-19T11:10:20.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-19T11:10:20.198 INFO:tasks.ceph.osd.1:Started 2024-08-19T11:10:20.198 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-19T11:10:20.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-19T11:10:20.200 INFO:tasks.ceph.osd.2:Started 2024-08-19T11:10:20.200 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-19T11:10:20.201 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-19T11:10:20.203 INFO:tasks.ceph.osd.3:Started 2024-08-19T11:10:20.203 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-19T11:10:20.203 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-19T11:10:20.205 INFO:tasks.ceph.osd.4:Started 2024-08-19T11:10:20.205 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-19T11:10:20.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-19T11:10:20.208 INFO:tasks.ceph.osd.5:Started 2024-08-19T11:10:20.208 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.313+0000 7fc48d5d9640 10 monclient: get_monmap_and_config 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.313+0000 7fc48d5d9640 10 monclient: build_initial_monmap 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.313+0000 7fc48d5d9640 10 monclient: monmap: 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:20.315562+0000 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:20.315562+0000 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:20.316 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:20.317 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:20.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.314+0000 7fc48d5d9640 1 Processor -- start 2024-08-19T11:10:20.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.314+0000 7fc48d5d9640 1 -- start start 2024-08-19T11:10:20.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.314+0000 7fc48d5d9640 10 monclient: init 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient: _add_conns ranks=[0,2,1,9,10,7,3,6,8,5,4] 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc488073330 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 0x7fc48813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient(hunting): picked mon.noname-b con 0x7fc4880a2f90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc48813ba70 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc488070d50 con 0x7fc488073330 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4880a1fa0 con 0x7fc48813ba70 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc4880a2280 con 0x7fc4880a2f90 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc48d5d9640 10 monclient(hunting): authenticate will time out at 678.357103s 2024-08-19T11:10:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 0x7fc48813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc486ffd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc488073330 0x7fc488073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54362/0 (socket says 172.21.15.71:54362) 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc486ffd640 1 -- 172.21.15.71:0/3986256936 learned_addr learned my addr 172.21.15.71:0/3986256936 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): get_auth_request con 0x7fc4880a2f90 auth_method 0 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient(hunting): handle_auth_done global_id 4214 payload 274 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 1 -- 172.21.15.71:0/3986256936 >> v1:172.21.15.135:6789/0 conn(0x7fc48813ba70 legacy=0x7fc48813de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 1 -- 172.21.15.71:0/3986256936 >> v1:172.21.15.71:6789/0 conn(0x7fc488073330 legacy=0x7fc488073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient: _finish_hunting 0 2024-08-19T11:10:20.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 1 monclient: found mon.noname-b 2024-08-19T11:10:20.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:20.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:20.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.315+0000 7fc4867fc640 1 -- 172.21.15.71:0/3986256936 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4880a09a0 con 0x7fc4880a2f90 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc4867fc640 1 -- 172.21.15.71:0/3986256936 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 msgr2=0x7fc48813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc4867fc640 1 --2- 172.21.15.71:0/3986256936 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 0x7fc48813b530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc4880a0440 tx=0x7fc47c029f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67243977d9e27515 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 1 -- 172.21.15.71:0/3986256936 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc47c037070 con 0x7fc4880a2f90 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: dump: 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.329 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:20.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 1 -- 172.21.15.71:0/3986256936 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47c02adc0 con 0x7fc4880a2f90 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 1 -- 172.21.15.71:0/3986256936 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc47c030c20 con 0x7fc4880a2f90 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc485ffb640 10 monclient: dump: 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 5 monclient: authenticate success, global_id 4214 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:20.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 4 set_mon_vals no callback set 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 10 monclient: shutdown 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 1 -- 172.21.15.71:0/3986256936 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 msgr2=0x7fc48813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 1 --2- 172.21.15.71:0/3986256936 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 0x7fc48813b530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc4880a0440 tx=0x7fc47c029f80 comp rx=0 tx=0).stop 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 1 -- 172.21.15.71:0/3986256936 shutdown_connections 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.318+0000 7fc48d5d9640 1 --2- 172.21.15.71:0/3986256936 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc4880a2f90 0x7fc48813b530 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.319+0000 7fc48d5d9640 1 -- 172.21.15.71:0/3986256936 >> 172.21.15.71:0/3986256936 conn(0x7fc48806dfe0 msgr2=0x7fc4880a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.319+0000 7fc48d5d9640 1 -- 172.21.15.71:0/3986256936 shutdown_connections 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.319+0000 7fc48d5d9640 1 -- 172.21.15.71:0/3986256936 wait complete. 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.319+0000 7fc48d5d9640 10 monclient: build_initial_monmap 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.319+0000 7fc48d5d9640 10 monclient: monmap: 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:20.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:20.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 Processor -- start 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 -- start start 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient: init 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient: _add_conns ranks=[6,3,5,7,4,2,0,1,8] 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 0x7fc48813a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): picked mon.noname-d con 0x7fc488073330 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4880a2f90 0x7fc488137530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): picked mon.noname-g con 0x7fc4880a2f90 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc48813ba70 0x7fc488137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): picked mon.noname-h con 0x7fc48813ba70 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:20.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc4880a0c20 con 0x7fc4880a2f90 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc4880a6250 con 0x7fc48813ba70 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc48813f580 con 0x7fc488073330 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc48d5d9640 10 monclient(hunting): authenticate will time out at 678.362660s 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 0x7fc48813a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 0x7fc48813a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:45656/0 (socket says 172.21.15.71:45656) 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 1 -- 172.21.15.71:0/2601998525 learned_addr learned my addr 172.21.15.71:0/2601998525 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): get_auth_request con 0x7fc488073330 auth_method 0 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:20.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4880a2f90 0x7fc488137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc486ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): get_auth_request con 0x7fc4880a2f90 auth_method 0 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4877fe640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc48813ba70 0x7fc488137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4877fe640 10 monclient(hunting): get_auth_request con 0x7fc48813ba70 auth_method 0 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:20.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.320+0000 7fc4867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc4877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc4877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc4877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 10 monclient(hunting): handle_auth_done global_id 4155 payload 824 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 1 -- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc48813ba70 msgr2=0x7fc488137a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc48813ba70 0x7fc488137a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 1 -- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4880a2f90 msgr2=0x7fc488137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4880a2f90 0x7fc488137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 1 monclient: found mon.noname-d 2024-08-19T11:10:20.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.321+0000 7fc486ffd640 1 -- 172.21.15.71:0/2601998525 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc488123f00 con 0x7fc488073330 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc486ffd640 1 -- 172.21.15.71:0/2601998525 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 msgr2=0x7fc48813a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc486ffd640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 0x7fc48813a740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c460 tx=0x7fc47800c920 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc478005cf0 con 0x7fc488073330 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: dump: 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:20.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4780074e0 con 0x7fc488073330 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 5 monclient: authenticate success, global_id 4155 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 10 monclient: _renew_subs 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc488072800 con 0x7fc488073330 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc478007690 con 0x7fc488073330 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc46f7fe640 10 monclient: dump: 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:20.341 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:20.342 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 10 monclient: _renew_subs 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48813b730 con 0x7fc488073330 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.323+0000 7fc4857fa640 4 set_mon_vals no callback set 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.324+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 2) ==== 49591+0+0 (secure 0 0 0) 0x7fc478007070 con 0x7fc488073330 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.324+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc478050a70 con 0x7fc488073330 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.324+0000 7fc48d5d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.324+0000 7fc48d5d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.324+0000 7fc48d5d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.324+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48806a590 con 0x7fc488073330 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.326+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc47801b5e0 con 0x7fc488073330 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.326+0000 7fc46f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:20.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.326+0000 7fc46f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.386+0000 7fc48d5d9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.386+0000 7fc48d5d9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.386+0000 7fc48d5d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.386+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc488073710 con 0x7fc488073330 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc46f7fe640 1 -- 172.21.15.71:0/2601998525 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7fc478019d10 con 0x7fc488073330 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc46f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc46f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:20.389 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:20.171174+0000","last_up_change":"0.000000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc48d5d9640 10 monclient: shutdown 2024-08-19T11:10:20.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc48d5d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 msgr2=0x7fc48813a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.387+0000 7fc48d5d9640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 0x7fc48813a740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c460 tx=0x7fc47800c920 comp rx=0 tx=0).stop 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 shutdown_connections 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4880a2f90 0x7fc488137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc48813ba70 0x7fc488137a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 --2- 172.21.15.71:0/2601998525 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc488073330 0x7fc48813a740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 >> 172.21.15.71:0/2601998525 conn(0x7fc48806dfe0 msgr2=0x7fc4880a6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 shutdown_connections 2024-08-19T11:10:20.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:20.388+0000 7fc48d5d9640 1 -- 172.21.15.71:0/2601998525 wait complete. 2024-08-19T11:10:20.400 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-19T11:10:20.400 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-19T11:10:21.004 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:21.095 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.093+0000 7fdc9af81640 10 monclient: get_monmap_and_config 2024-08-19T11:10:21.095 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.093+0000 7fdc9af81640 10 monclient: build_initial_monmap 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.093+0000 7fdc9af81640 10 monclient: monmap: 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:epoch 0 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:10:21.095137+0000 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:10:21.095137+0000 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:21.096 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:21.097 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:21.097 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:21.097 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:21.097 INFO:teuthology.misc.health.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:21.097 INFO:teuthology.misc.health.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:21.097 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:21.101 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 Processor -- start 2024-08-19T11:10:21.101 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 -- start start 2024-08-19T11:10:21.101 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient: init 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient: _add_conns ranks=[5,7,9,4,3,8,10,2,6,1,0] 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc940a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): picked mon.noname-h con 0x7fdc940a47d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdc9406d4c0 0x7fdc940a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): picked mon.noname-i con 0x7fdc9406d4c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdc94139980 0x7fdc94139e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): picked mon.noname-a con 0x7fdc94139980 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fdc940a5630 con 0x7fdc94139980 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fdc9406d280 con 0x7fdc940a47d0 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:21.102 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fdc940744e0 con 0x7fdc9406d4c0 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9af81640 10 monclient(hunting): authenticate will time out at 679.136779s 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdc94139980 0x7fdc94139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdc94139980 0x7fdc94139e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55998/0 (socket says 172.21.15.71:55998) 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 1 -- 172.21.15.71:0/1044545719 learned_addr learned my addr 172.21.15.71:0/1044545719 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 10 monclient(hunting): get_auth_request con 0x7fdc94139980 auth_method 0 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.094+0000 7fdc9951e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdc9406d4c0 0x7fdc940a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:21.103 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): get_auth_request con 0x7fdc9406d4c0 auth_method 0 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc940a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): get_auth_request con 0x7fdc940a47d0 auth_method 0 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:21.104 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 10 monclient(hunting): handle_auth_done global_id 4140 payload 274 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 1 -- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdc9406d4c0 msgr2=0x7fdc940a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdc9406d4c0 0x7fdc940a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 1 -- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 msgr2=0x7fdc940a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc940a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 10 monclient: _finish_hunting 0 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 1 monclient: found mon.noname-a 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.095+0000 7fdc9951e640 1 -- 172.21.15.71:0/1044545719 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc940a0430 con 0x7fdc94139980 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9951e640 1 -- 172.21.15.71:0/1044545719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc94139980 msgr2=0x7fdc94139e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9951e640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc94139980 0x7fdc94139e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009e50 tx=0x7fdc8c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c03865ce6cdb8d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 1 -- 172.21.15.71:0/1044545719 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc8c036070 con 0x7fdc94139980 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:21.105 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: dump: 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:21.106 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 5 monclient: authenticate success, global_id 4140 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 1 -- 172.21.15.71:0/1044545719 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c007a70 con 0x7fdc94139980 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 4 set_mon_vals no callback set 2024-08-19T11:10:21.107 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 1 -- 172.21.15.71:0/1044545719 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc8c007c20 con 0x7fdc94139980 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc937fe640 10 monclient: dump: 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:21.108 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 10 monclient: shutdown 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 -- 172.21.15.71:0/1044545719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc94139980 msgr2=0x7fdc94139e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc94139980 0x7fdc94139e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009e50 tx=0x7fdc8c02a560 comp rx=0 tx=0).stop 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 -- 172.21.15.71:0/1044545719 shutdown_connections 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc94139980 0x7fdc94139e30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.109 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdc9406d4c0 0x7fdc940a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 --2- 172.21.15.71:0/1044545719 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc940a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 -- 172.21.15.71:0/1044545719 >> 172.21.15.71:0/1044545719 conn(0x7fdc940a93f0 msgr2=0x7fdc940a58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 -- 172.21.15.71:0/1044545719 shutdown_connections 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.098+0000 7fdc9af81640 1 -- 172.21.15.71:0/1044545719 wait complete. 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.099+0000 7fdc9af81640 10 monclient: build_initial_monmap 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.099+0000 7fdc9af81640 10 monclient: monmap: 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:epoch 0 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:created 0.000000 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:21.110 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.099+0000 7fdc9af81640 1 Processor -- start 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.099+0000 7fdc9af81640 1 -- start start 2024-08-19T11:10:21.111 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.099+0000 7fdc9af81640 10 monclient: init 2024-08-19T11:10:21.115 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:21.115 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient: _add_conns ranks=[2,5,6,1,0,4,7,3,8] 2024-08-19T11:10:21.115 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 0x7fdc94072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:21.115 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): picked mon.noname-b con 0x7fdc9406d4c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc94138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): picked mon.noname-h con 0x7fdc940a47d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc94139980 0x7fdc94139070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): picked mon.noname-d con 0x7fdc94139980 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdc940a6300 con 0x7fdc9406d4c0 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fdc9406cd90 con 0x7fdc940a47d0 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fdc9413a370 con 0x7fdc94139980 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9af81640 10 monclient(hunting): authenticate will time out at 679.142569s 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 0x7fdc94072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:21.116 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc94139980 0x7fdc94139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 0x7fdc94072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35888/0 (socket says 172.21.15.71:35888) 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 1 -- 172.21.15.71:0/88534306 learned_addr learned my addr 172.21.15.71:0/88534306 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): get_auth_request con 0x7fdc9406d4c0 auth_method 0 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): get_auth_request con 0x7fdc94139980 auth_method 0 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc94138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:21.117 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): get_auth_request con 0x7fdc940a47d0 auth_method 0 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc9951e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.100+0000 7fdc98d1d640 10 monclient(hunting): handle_auth_done global_id 4241 payload 824 2024-08-19T11:10:21.118 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 1 -- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc94139980 msgr2=0x7fdc94139070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc94139980 0x7fdc94139070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 1 -- 172.21.15.71:0/88534306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 msgr2=0x7fdc94138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc94138b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 10 monclient: _finish_hunting 0 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 1 monclient: found mon.noname-b 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc98d1d640 1 -- 172.21.15.71:0/88534306 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc941264f0 con 0x7fdc9406d4c0 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc9951e640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc94139980 0x7fdc94139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.101+0000 7fdc93fff640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc94138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc98d1d640 1 -- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 msgr2=0x7fdc94072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc98d1d640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 0x7fdc94072c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800e9b0 tx=0x7fdc8800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:21.119 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc88017070 con 0x7fdc9406d4c0 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: dump: 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:21.120 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 5 monclient: authenticate success, global_id 4241 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 10 monclient: _renew_subs 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8800cbb0 con 0x7fdc9406d4c0 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc940a81b0 con 0x7fdc9406d4c0 2024-08-19T11:10:21.121 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc8800cd60 con 0x7fdc9406d4c0 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc917fa640 10 monclient: dump: 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:21.122 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc92ffd640 4 set_mon_vals no callback set 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 10 monclient: _renew_subs 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.103+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc94073630 con 0x7fdc9406d4c0 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.104+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 2) ==== 49591+0+0 (secure 0 0 0) 0x7fdc8801a070 con 0x7fdc9406d4c0 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.104+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fdc8800f040 con 0x7fdc9406d4c0 2024-08-19T11:10:21.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.104+0000 7fdc9af81640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:21.124 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.104+0000 7fdc9af81640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:21.124 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.104+0000 7fdc9af81640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:21.124 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.104+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9413a700 con 0x7fdc9406d4c0 2024-08-19T11:10:21.124 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.106+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdc88021070 con 0x7fdc9406d4c0 2024-08-19T11:10:21.124 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.106+0000 7fdc917fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:21.124 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.106+0000 7fdc917fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:21.169 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.167+0000 7fdc9af81640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:21.169 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.167+0000 7fdc9af81640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:21.169 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.167+0000 7fdc9af81640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:21.169 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.167+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc9406a0b0 con 0x7fdc9406d4c0 2024-08-19T11:10:21.170 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc917fa640 1 -- 172.21.15.71:0/88534306 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (secure 0 0 0) 0x7fdc8801bdc0 con 0x7fdc9406d4c0 2024-08-19T11:10:21.170 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc917fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:21.170 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc917fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:21.170 INFO:teuthology.misc.health.smithi071.stdout: 2024-08-19T11:10:21.171 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":8,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:20.171174+0000","last_up_change":"0.000000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:21.171 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc9af81640 10 monclient: shutdown 2024-08-19T11:10:21.171 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc9af81640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 msgr2=0x7fdc94072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.168+0000 7fdc9af81640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 0x7fdc94072c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc8800e9b0 tx=0x7fdc8800ee70 comp rx=0 tx=0).stop 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 shutdown_connections 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc94139980 0x7fdc94139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdc940a47d0 0x7fdc94138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 --2- 172.21.15.71:0/88534306 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc9406d4c0 0x7fdc94072c70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 >> 172.21.15.71:0/88534306 conn(0x7fdc940a93f0 msgr2=0x7fdc940a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 shutdown_connections 2024-08-19T11:10:21.172 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:21.169+0000 7fdc9af81640 1 -- 172.21.15.71:0/88534306 wait complete. 2024-08-19T11:10:21.183 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-08-19T11:10:21.201 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.199+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-19T11:10:21.201 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.200+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-08-19T11:10:21.206 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.204+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-08-19T11:10:21.206 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.204+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-19T11:10:21.206 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.204+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-08-19T11:10:21.210 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.208+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.i 2024-08-19T11:10:21.210 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.209+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-08-19T11:10:21.210 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-08-19T11:10:21.209+0000 7f9c8d90c640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-08-19T11:10:21.410 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-08-19T11:10:21.408+0000 7fd377a15640 -1 Falling back to public interface 2024-08-19T11:10:21.637 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-08-19T11:10:21.636+0000 7f74d90ee640 -1 Falling back to public interface 2024-08-19T11:10:21.661 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-08-19T11:10:21.659+0000 7f790762f640 -1 Falling back to public interface 2024-08-19T11:10:21.922 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-08-19T11:10:21.920+0000 7f45cfadf640 -1 Falling back to public interface 2024-08-19T11:10:22.086 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-08-19T11:10:22.084+0000 7f29fb13b640 -1 Falling back to public interface 2024-08-19T11:10:22.122 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-08-19T11:10:22.120+0000 7effb5215640 -1 Falling back to public interface 2024-08-19T11:10:25.161 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-08-19T11:10:25.160+0000 7f74d90ee640 -1 osd.5 0 log_to_monitors true 2024-08-19T11:10:25.233 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-08-19T11:10:25.231+0000 7fd377a15640 -1 osd.0 0 log_to_monitors true 2024-08-19T11:10:25.455 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-08-19T11:10:25.453+0000 7f45cfadf640 -1 osd.2 0 log_to_monitors true 2024-08-19T11:10:25.825 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-08-19T11:10:25.823+0000 7f29fb13b640 -1 osd.3 0 log_to_monitors true 2024-08-19T11:10:25.949 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-08-19T11:10:25.947+0000 7f790762f640 -1 osd.1 0 log_to_monitors true 2024-08-19T11:10:26.142 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-08-19T11:10:26.141+0000 7effb5215640 -1 osd.4 0 log_to_monitors true 2024-08-19T11:10:26.289 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-08-19T11:10:26.287+0000 7f74d5084640 -1 osd.5 0 waiting for initial osdmap 2024-08-19T11:10:26.292 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-08-19T11:10:26.291+0000 7f74d0eab640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T11:10:27.294 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-08-19T11:10:27.292+0000 7fd37330c640 -1 osd.0 0 waiting for initial osdmap 2024-08-19T11:10:27.302 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-08-19T11:10:27.300+0000 7fd36f133640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T11:10:27.788 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:27.904 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.902+0000 7f9c09e15640 10 monclient: get_monmap_and_config 2024-08-19T11:10:27.904 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.902+0000 7f9c09e15640 10 monclient: build_initial_monmap 2024-08-19T11:10:27.904 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.902+0000 7f9c09e15640 10 monclient: monmap: 2024-08-19T11:10:27.904 INFO:teuthology.misc.health.smithi071.stderr:epoch 0 2024-08-19T11:10:27.904 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:27.904 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:10:27.903756+0000 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:10:27.903756+0000 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:27.905 INFO:teuthology.misc.health.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:27.906 INFO:teuthology.misc.health.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:27.906 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:27.913 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 Processor -- start 2024-08-19T11:10:27.913 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 -- start start 2024-08-19T11:10:27.913 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient: init 2024-08-19T11:10:27.913 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:27.913 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient: _add_conns ranks=[10,4,5,9,8,2,0,7,1,3,6] 2024-08-19T11:10:27.914 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c0409b970 0x7f9c040a1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.914 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): picked mon.noname-f con 0x7f9c0409b970 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:27.914 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c0409bd50 0x7f9c040a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.914 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): picked mon.noname-c con 0x7f9c0409bd50 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:27.914 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 0x7f9c040a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.915 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): picked mon.noname-h con 0x7f9c040a3750 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:27.915 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:27.915 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9c040a0dc0 con 0x7f9c0409b970 2024-08-19T11:10:27.915 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:27.915 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9c040a0ae0 con 0x7f9c0409bd50 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9c0409c130 con 0x7f9c040a3750 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.903+0000 7f9c09e15640 10 monclient(hunting): authenticate will time out at 685.945980s 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c0409bd50 0x7f9c040a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c0409bd50 0x7f9c040a3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:37468/0 (socket says 172.21.15.71:37468) 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 0x7f9c040a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9c0409b970 0x7f9c040a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): get_auth_request con 0x7f9c040a3750 auth_method 0 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): get_auth_request con 0x7f9c0409b970 auth_method 0 2024-08-19T11:10:27.916 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 1 -- 172.21.15.71:0/3878162838 learned_addr learned my addr 172.21.15.71:0/3878162838 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): get_auth_request con 0x7f9c0409bd50 auth_method 0 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:27.917 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c02ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient(hunting): handle_auth_done global_id 14189 payload 274 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 -- 172.21.15.71:0/3878162838 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c0409bd50 msgr2=0x7f9c040a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 --2- 172.21.15.71:0/3878162838 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c0409bd50 0x7f9c040a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 -- 172.21.15.71:0/3878162838 >> v2:172.21.15.135:3300/0 conn(0x7f9c0409b970 msgr2=0x7f9c040a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 --2- 172.21.15.71:0/3878162838 >> v2:172.21.15.135:3300/0 conn(0x7f9c0409b970 0x7f9c040a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 monclient: found mon.noname-h 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.904+0000 7f9c03fff640 1 -- 172.21.15.71:0/3878162838 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c040a4820 con 0x7f9c040a3750 2024-08-19T11:10:27.918 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.907+0000 7f9c03fff640 1 -- 172.21.15.71:0/3878162838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 msgr2=0x7f9c040a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.907+0000 7f9c03fff640 1 --2- 172.21.15.71:0/3878162838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 0x7f9c040a3c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009dc0 tx=0x7f9bfc02a560 comp rx=0 tx=0).ready entity=mon.5 client_cookie=6b71612a1382163 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 1 -- 172.21.15.71:0/3878162838 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bfc007bc0 con 0x7f9c040a3750 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: dump: 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:27.919 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:27.920 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c09e15640 5 monclient: authenticate success, global_id 14189 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 1 -- 172.21.15.71:0/3878162838 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc007d80 con 0x7f9c040a3750 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c09e15640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 1 -- 172.21.15.71:0/3878162838 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bfc031870 con 0x7f9c040a3750 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c09e15640 4 set_mon_vals no callback set 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.908+0000 7f9c027fc640 10 monclient: dump: 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.921 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 10 monclient: shutdown 2024-08-19T11:10:27.922 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 -- 172.21.15.71:0/3878162838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 msgr2=0x7f9c040a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3878162838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 0x7f9c040a3c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009dc0 tx=0x7f9bfc02a560 comp rx=0 tx=0).stop 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 -- 172.21.15.71:0/3878162838 shutdown_connections 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3878162838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c040a3750 0x7f9c040a3c00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3878162838 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c0409bd50 0x7f9c040a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3878162838 >> v2:172.21.15.135:3300/0 conn(0x7f9c0409b970 0x7f9c040a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 -- 172.21.15.71:0/3878162838 >> 172.21.15.71:0/3878162838 conn(0x7f9c040a8810 msgr2=0x7f9c040a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 -- 172.21.15.71:0/3878162838 shutdown_connections 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.909+0000 7f9c09e15640 1 -- 172.21.15.71:0/3878162838 wait complete. 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.910+0000 7f9c09e15640 10 monclient: build_initial_monmap 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.910+0000 7f9c09e15640 10 monclient: monmap: 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:epoch 0 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:27.923 INFO:teuthology.misc.health.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:created 0.000000 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:27.924 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:27.925 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.911+0000 7f9c09e15640 1 Processor -- start 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.911+0000 7f9c09e15640 1 -- start start 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.911+0000 7f9c09e15640 10 monclient: init 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient: _add_conns ranks=[6,7,1,8,0,5,3,2,4] 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 0x7f9c041ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): picked mon.noname-d con 0x7f9c0409b970 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c0409bd50 0x7f9c041cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.931 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): picked mon.noname-i con 0x7f9c0409bd50 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:27.932 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c040a3750 0x7f9c04094f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.932 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): picked mon.noname-f con 0x7f9c040a3750 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:27.932 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:27.932 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0409fe00 con 0x7f9c040a3750 2024-08-19T11:10:27.932 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:27.932 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9c04069400 con 0x7f9c0409b970 2024-08-19T11:10:27.933 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:27.933 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9c040a7300 con 0x7f9c0409bd50 2024-08-19T11:10:27.933 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:27.933 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c09e15640 10 monclient(hunting): authenticate will time out at 685.954441s 2024-08-19T11:10:27.934 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c040a3750 0x7f9c04094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.934 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c0409bd50 0x7f9c041cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.934 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c0409bd50 0x7f9c041cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:43130/0 (socket says 172.21.15.71:43130) 2024-08-19T11:10:27.934 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 1 -- 172.21.15.71:0/3526402863 learned_addr learned my addr 172.21.15.71:0/3526402863 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 10 monclient(hunting): get_auth_request con 0x7f9c0409bd50 auth_method 0 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.912+0000 7f9c02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 0x7f9c041ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): get_auth_request con 0x7f9c0409b970 auth_method 0 2024-08-19T11:10:27.935 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): get_auth_request con 0x7f9c040a3750 auth_method 0 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c02ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c02ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c02ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:27.936 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient(hunting): handle_auth_done global_id 4191 payload 824 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 1 -- 172.21.15.71:0/3526402863 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c0409bd50 msgr2=0x7f9c041cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c0409bd50 0x7f9c041cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 1 -- 172.21.15.71:0/3526402863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c040a3750 msgr2=0x7f9c04094f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c040a3750 0x7f9c04094f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.913+0000 7f9c037fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.914+0000 7f9c037fe640 1 monclient: found mon.noname-d 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.914+0000 7f9c037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.914+0000 7f9c037fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:27.937 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.914+0000 7f9c037fe640 1 -- 172.21.15.71:0/3526402863 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c04096a60 con 0x7f9c0409b970 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c037fe640 1 -- 172.21.15.71:0/3526402863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 msgr2=0x7f9c041ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c037fe640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 0x7f9c041ce710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400e880 tx=0x7f9bf400ed40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bf4017070 con 0x7f9c0409b970 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: dump: 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:27.938 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:27.939 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: _finish_auth 0 2024-08-19T11:10:27.940 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:27.940 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:27.940 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c09e15640 5 monclient: authenticate success, global_id 4191 2024-08-19T11:10:27.940 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf4013470 con 0x7f9c0409b970 2024-08-19T11:10:27.940 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bf4013a90 con 0x7f9c0409b970 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9bebfff640 10 monclient: dump: 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:27.941 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c09e15640 10 monclient: _renew_subs 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c017fa640 4 set_mon_vals no callback set 2024-08-19T11:10:27.942 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c09e15640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.916+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c04098520 con 0x7f9c0409b970 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.917+0000 7f9c09e15640 10 monclient: _renew_subs 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.917+0000 7f9c09e15640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.917+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0409b2b0 con 0x7f9c0409b970 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 4) ==== 49789+0+0 (secure 0 0 0) 0x7f9bf401a070 con 0x7f9c0409b970 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9c09e15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9c09e15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9c09e15640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0406a0b0 con 0x7f9c0409b970 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9bebfff640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:27.943 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(11..11 src has 1..11) ==== 2067+0+0 (secure 0 0 0) 0x7f9bf400f040 con 0x7f9c0409b970 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9c02ffd640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.918+0000 7f9c02ffd640 10 monclient: get_auth_request con 0x7f9bf003e9f0 auth_method 0 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.919+0000 7f9c02ffd640 1 -- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 msgr2=0x7f9bf0040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.919+0000 7f9c02ffd640 1 -- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 msgr2=0x7f9bf0040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.919+0000 7f9c02ffd640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f9c040966d0 tx=0x7f9bf8009240 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.919+0000 7f9c02ffd640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.925+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9bf4021070 con 0x7f9c0409b970 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.925+0000 7f9bebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:27.944 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:27.925+0000 7f9bebfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:28.037 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-08-19T11:10:28.035+0000 7effb0b2c640 -1 osd.4 0 waiting for initial osdmap 2024-08-19T11:10:28.039 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-08-19T11:10:28.038+0000 7effa894b640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T11:10:28.047 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-08-19T11:10:28.045+0000 7f45cc289640 -1 osd.2 0 waiting for initial osdmap 2024-08-19T11:10:28.054 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-08-19T11:10:28.052+0000 7f45c3894640 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T11:10:28.057 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-08-19T11:10:28.056+0000 7f29f70d1640 -1 osd.3 0 waiting for initial osdmap 2024-08-19T11:10:28.062 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-08-19T11:10:28.060+0000 7f29eeef0640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T11:10:28.063 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-08-19T11:10:28.062+0000 7f7903394640 -1 osd.1 0 waiting for initial osdmap 2024-08-19T11:10:28.068 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-08-19T11:10:28.066+0000 7f78fa9b0640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T11:10:28.122 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.120+0000 7f9c02ffd640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:28.123 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.120+0000 7f9c02ffd640 10 monclient: get_auth_request con 0x7f9bf003e9f0 auth_method 0 2024-08-19T11:10:28.125 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.123+0000 7f9c02ffd640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c040966d0 tx=0x7f9bf8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:28.142 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.140+0000 7f9c09e15640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.140+0000 7f9c09e15640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.140+0000 7f9c09e15640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.140+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c040a1550 con 0x7f9c0409b970 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.141+0000 7f9bebfff640 1 -- 172.21.15.71:0/3526402863 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+5871 (secure 0 0 0) 0x7f9bf40509f0 con 0x7f9c0409b970 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.141+0000 7f9bebfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.141+0000 7f9bebfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stdout: 2024-08-19T11:10:28.143 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":11,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:27.283661+0000","last_up_change":"2024-08-19T11:10:27.283661+0000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":2277825240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2277825240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2277825240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6803","nonce":2277825240}]},"public_addr":"172.21.15.135:6801/2277825240","cluster_addr":"172.21.15.135:6802/2277825240","heartbeat_back_addr":"172.21.15.135:6804/2277825240","heartbeat_front_addr":"172.21.15.135:6803/2277825240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:28.145 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 msgr2=0x7f9bf0040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c040966d0 tx=0x7f9bf8008040 comp rx=0 tx=0).stop 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 10 monclient: shutdown 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 msgr2=0x7f9c041ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 0x7f9c041ce710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400e880 tx=0x7f9bf400ed40 comp rx=0 tx=0).stop 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 shutdown_connections 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3526402863 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bf003e9f0 0x7f9bf0040eb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c0409bd50 0x7f9c041cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c040a3750 0x7f9c04094f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 --2- 172.21.15.71:0/3526402863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9c0409b970 0x7f9c041ce710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:28.146 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 >> 172.21.15.71:0/3526402863 conn(0x7f9c040a8810 msgr2=0x7f9c0409d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:28.147 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 shutdown_connections 2024-08-19T11:10:28.147 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:28.143+0000 7f9c09e15640 1 -- 172.21.15.71:0/3526402863 wait complete. 2024-08-19T11:10:28.154 DEBUG:teuthology.misc:1 of 6 OSDs are up 2024-08-19T11:10:34.760 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:34.859 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.857+0000 7f765b3aa640 10 monclient: get_monmap_and_config 2024-08-19T11:10:34.859 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.857+0000 7f765b3aa640 10 monclient: build_initial_monmap 2024-08-19T11:10:34.859 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.857+0000 7f765b3aa640 10 monclient: monmap: 2024-08-19T11:10:34.859 INFO:teuthology.misc.health.smithi071.stderr:epoch 0 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:10:34.858825+0000 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:10:34.858825+0000 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:34.860 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:34.861 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:34.861 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:34.861 INFO:teuthology.misc.health.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:34.861 INFO:teuthology.misc.health.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:34.861 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:34.861 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.857+0000 7f765b3aa640 1 Processor -- start 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 1 -- start start 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient: init 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient: _add_conns ranks=[3,9,0,6,8,5,4,7,1,2,10] 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a47d0 0x7f76540a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): picked mon.noname-g con 0x7f76540a47d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:34.863 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f765406d4c0 0x7f76540a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): picked mon.noname-a con 0x7f765406d4c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7654139980 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f765406d280 con 0x7f7654139980 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f76540a5630 con 0x7f765406d4c0 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f76540744e0 con 0x7f76540a47d0 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f765b3aa640 10 monclient(hunting): authenticate will time out at 692.900571s 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f765406d4c0 0x7f76540a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7659947640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7654139980 0x7f7654139e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41620/0 (socket says 172.21.15.71:41620) 2024-08-19T11:10:34.864 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7659947640 1 -- 172.21.15.71:0/4245728568 learned_addr learned my addr 172.21.15.71:0/4245728568 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): get_auth_request con 0x7f765406d4c0 auth_method 0 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7659146640 1 --2- 172.21.15.71:0/4245728568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a47d0 0x7f76540a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient(hunting): handle_auth_done global_id 4185 payload 274 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 1 -- 172.21.15.71:0/4245728568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a47d0 msgr2=0x7f76540a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 1 --2- 172.21.15.71:0/4245728568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a47d0 0x7f76540a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 1 -- 172.21.15.71:0/4245728568 >> v1:172.21.15.71:6789/0 conn(0x7f7654139980 legacy=0x7f7654139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:34.865 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient: _finish_hunting 0 2024-08-19T11:10:34.866 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 1 monclient: found mon.noname-a 2024-08-19T11:10:34.866 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:34.866 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:34.866 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.858+0000 7f7658945640 1 -- 172.21.15.71:0/4245728568 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76540a0430 con 0x7f765406d4c0 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.861+0000 7f7658945640 1 -- 172.21.15.71:0/4245728568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f765406d4c0 msgr2=0x7f76540a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.861+0000 7f7658945640 1 --2- 172.21.15.71:0/4245728568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f765406d4c0 0x7f76540a50f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7648009d90 tx=0x7f764802a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c38d2a5bdd8aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 1 -- 172.21.15.71:0/4245728568 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7648007ca0 con 0x7f765406d4c0 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: dump: 2024-08-19T11:10:34.872 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:34.873 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 1 -- 172.21.15.71:0/4245728568 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7648031400 con 0x7f765406d4c0 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 5 monclient: authenticate success, global_id 4185 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:34.874 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 1 -- 172.21.15.71:0/4245728568 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7648007e60 con 0x7f765406d4c0 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 4 set_mon_vals no callback set 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f7653fff640 10 monclient: dump: 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:34.875 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 10 monclient: shutdown 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:34.876 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 -- 172.21.15.71:0/4245728568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f765406d4c0 msgr2=0x7f76540a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 --2- 172.21.15.71:0/4245728568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f765406d4c0 0x7f76540a50f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7648009d90 tx=0x7f764802a490 comp rx=0 tx=0).stop 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 -- 172.21.15.71:0/4245728568 shutdown_connections 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 --2- 172.21.15.71:0/4245728568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f765406d4c0 0x7f76540a50f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 --2- 172.21.15.71:0/4245728568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a47d0 0x7f76540a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 -- 172.21.15.71:0/4245728568 >> 172.21.15.71:0/4245728568 conn(0x7f76540a93f0 msgr2=0x7f76540a58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 -- 172.21.15.71:0/4245728568 shutdown_connections 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.862+0000 7f765b3aa640 1 -- 172.21.15.71:0/4245728568 wait complete. 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.863+0000 7f765b3aa640 10 monclient: build_initial_monmap 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.863+0000 7f765b3aa640 10 monclient: monmap: 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:epoch 0 2024-08-19T11:10:34.877 INFO:teuthology.misc.health.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:created 0.000000 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:34.878 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.863+0000 7f765b3aa640 1 Processor -- start 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.863+0000 7f765b3aa640 1 -- start start 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.863+0000 7f765b3aa640 10 monclient: init 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient: _add_conns ranks=[8,0,6,4,2,5,7,1,3] 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 0x7f76541cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): picked mon.noname-e con 0x7f765406d4c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 0x7f76541cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): picked mon.noname-a con 0x7f76540a47d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:34.879 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7654139980 0x7f76541261c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): picked mon.noname-d con 0x7f7654139980 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76540a6300 con 0x7f76540a47d0 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f765406cd90 con 0x7f7654139980 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f765413a540 con 0x7f765406d4c0 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f765b3aa640 10 monclient(hunting): authenticate will time out at 692.906267s 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 0x7f76541cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:34.880 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 0x7f76541cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 0x7f76541cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59238/0 (socket says 172.21.15.71:59238) 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 0x7f76541cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47576/0 (socket says 172.21.15.71:47576) 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 -- 172.21.15.71:0/568306848 learned_addr learned my addr 172.21.15.71:0/568306848 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): get_auth_request con 0x7f765406d4c0 auth_method 0 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7654139980 0x7f76541261c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): get_auth_request con 0x7f76540a47d0 auth_method 0 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:34.881 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): get_auth_request con 0x7f7654139980 auth_method 0 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:34.882 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient(hunting): handle_auth_done global_id 4193 payload 824 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 -- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7654139980 msgr2=0x7f76541261c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7654139980 0x7f76541261c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 -- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 msgr2=0x7f76541cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 0x7f76541cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient: _finish_hunting 0 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 monclient: found mon.noname-e 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:34.883 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7659146640 1 -- 172.21.15.71:0/568306848 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76541298c0 con 0x7f765406d4c0 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.864+0000 7f7658945640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 0x7f76541cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7659146640 1 -- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 msgr2=0x7f76541cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7659146640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 0x7f76541cee80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f764400c7f0 tx=0x7f764400ccb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7644015070 con 0x7f765406d4c0 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: dump: 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:34.884 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:34.885 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7644007ca0 con 0x7f765406d4c0 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 5 monclient: authenticate success, global_id 4193 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 10 monclient: _renew_subs 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7654129ba0 con 0x7f765406d4c0 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7644007e50 con 0x7f765406d4c0 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:34.886 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f7651ffb640 10 monclient: dump: 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:epoch 1 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:34.887 INFO:teuthology.misc.health.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr: 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 10 monclient: _renew_subs 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f76540a8700 con 0x7f765406d4c0 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.867+0000 7f76537fe640 4 set_mon_vals no callback set 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f765b3aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:34.888 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f765b3aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f765b3aa640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76540a81b0 con 0x7f765406d4c0 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7644007830 con 0x7f765406d4c0 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f7651ffb640 1 --2- 172.21.15.71:0/568306848 >> v2:172.21.15.135:6800/726754104 conn(0x7f764003ec20 0x7f76400410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.868+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(15..15 src has 1..15) ==== 3153+0+0 (secure 0 0 0) 0x7f7644051400 con 0x7f765406d4c0 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.869+0000 7f7658945640 1 --2- 172.21.15.71:0/568306848 >> v2:172.21.15.135:6800/726754104 conn(0x7f764003ec20 0x7f76400410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:34.889 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.869+0000 7f7658945640 10 monclient: get_auth_request con 0x7f764003ec20 auth_method 0 2024-08-19T11:10:34.890 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.871+0000 7f7658945640 1 --2- 172.21.15.71:0/568306848 >> v2:172.21.15.135:6800/726754104 conn(0x7f764003ec20 0x7f76400410e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7648034000 tx=0x7f764802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:34.890 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.873+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f764401e070 con 0x7f765406d4c0 2024-08-19T11:10:34.890 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.873+0000 7f7651ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:34.890 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:34.873+0000 7f7651ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:35.051 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.049+0000 7f765b3aa640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:35.052 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.049+0000 7f765b3aa640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:35.052 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.049+0000 7f765b3aa640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:35.052 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.049+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76540a6c50 con 0x7f765406d4c0 2024-08-19T11:10:35.357 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.354+0000 7f7651ffb640 1 -- 172.21.15.71:0/568306848 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9025 (secure 0 0 0) 0x7f7644050450 con 0x7f765406d4c0 2024-08-19T11:10:35.357 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.354+0000 7f7651ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:35.357 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.354+0000 7f7651ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:35.357 INFO:teuthology.misc.health.smithi071.stdout: 2024-08-19T11:10:35.357 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":15,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:32.358253+0000","last_up_change":"2024-08-19T11:10:28.285326+0000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T11:10:28.605759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1867070009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1867070009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1867070009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1867070009}]},"public_addr":"172.21.15.71:6800/1867070009","cluster_addr":"172.21.15.71:6801/1867070009","heartbeat_back_addr":"172.21.15.71:6803/1867070009","heartbeat_front_addr":"172.21.15.71:6802/1867070009","state":["exists","up"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":227121352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":227121352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":227121352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":227121352}]},"public_addr":"172.21.15.71:6804/227121352","cluster_addr":"172.21.15.71:6805/227121352","heartbeat_back_addr":"172.21.15.71:6807/227121352","heartbeat_front_addr":"172.21.15.71:6806/227121352","state":["exists","up"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":80758171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":80758171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":80758171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":80758171}]},"public_addr":"172.21.15.71:6808/80758171","cluster_addr":"172.21.15.71:6809/80758171","heartbeat_back_addr":"172.21.15.71:6811/80758171","heartbeat_front_addr":"172.21.15.71:6810/80758171","state":["exists","up"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":3339144447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3339144447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3339144447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6807","nonce":3339144447}]},"public_addr":"172.21.15.135:6805/3339144447","cluster_addr":"172.21.15.135:6806/3339144447","heartbeat_back_addr":"172.21.15.135:6808/3339144447","heartbeat_front_addr":"172.21.15.135:6807/3339144447","state":["exists","up"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":879361358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":879361358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":879361358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6811","nonce":879361358}]},"public_addr":"172.21.15.135:6809/879361358","cluster_addr":"172.21.15.135:6810/879361358","heartbeat_back_addr":"172.21.15.135:6812/879361358","heartbeat_front_addr":"172.21.15.135:6811/879361358","state":["exists","up"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":2277825240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2277825240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2277825240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6803","nonce":2277825240}]},"public_addr":"172.21.15.135:6801/2277825240","cluster_addr":"172.21.15.135:6802/2277825240","heartbeat_back_addr":"172.21.15.135:6804/2277825240","heartbeat_front_addr":"172.21.15.135:6803/2277825240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.215895+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.920536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.414247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.789439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:27.153740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.131984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:35.359 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 >> v2:172.21.15.135:6800/726754104 conn(0x7f764003ec20 msgr2=0x7f76400410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:35.359 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 --2- 172.21.15.71:0/568306848 >> v2:172.21.15.135:6800/726754104 conn(0x7f764003ec20 0x7f76400410e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7648034000 tx=0x7f764802f000 comp rx=0 tx=0).stop 2024-08-19T11:10:35.359 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 10 monclient: shutdown 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 msgr2=0x7f76541cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 0x7f76541cee80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f764400c7f0 tx=0x7f764400ccb0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 shutdown_connections 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 --2- 172.21.15.71:0/568306848 >> v2:172.21.15.135:6800/726754104 conn(0x7f764003ec20 0x7f76400410e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7654139980 0x7f76541261c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76540a47d0 0x7f76541cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 --2- 172.21.15.71:0/568306848 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f765406d4c0 0x7f76541cee80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 >> 172.21.15.71:0/568306848 conn(0x7f76540a93f0 msgr2=0x7f765409f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 shutdown_connections 2024-08-19T11:10:35.360 INFO:teuthology.misc.health.smithi071.stderr:2024-08-19T11:10:35.357+0000 7f765b3aa640 1 -- 172.21.15.71:0/568306848 wait complete. 2024-08-19T11:10:35.370 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-08-19T11:10:35.370 INFO:tasks.ceph:Creating RBD pool 2024-08-19T11:10:35.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2024-08-19T11:10:35.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.466+0000 7f04169e2640 10 monclient: get_monmap_and_config 2024-08-19T11:10:35.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.466+0000 7f04169e2640 10 monclient: build_initial_monmap 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.466+0000 7f04169e2640 10 monclient: monmap: 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:35.468231+0000 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:35.468231+0000 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:35.469 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:35.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:35.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 Processor -- start 2024-08-19T11:10:35.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 -- start start 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient: init 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient: _add_conns ranks=[1,10,5,7,6,9,0,2,4,8,3] 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f04100a69c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0410139e90 0x7f041013ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): picked mon.noname-f con 0x7f0410139e90 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410141120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): picked mon.noname-h con 0x7f041013a2d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041009c9f0 con 0x7f04100a69c0 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f04100a5840 con 0x7f0410139e90 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f04100a4740 con 0x7f041013a2d0 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.467+0000 7f04169e2640 10 monclient(hunting): authenticate will time out at 693.509876s 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0410139e90 0x7f041013ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:49980/0 (socket says 172.21.15.71:49980) 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 -- 172.21.15.71:0/3137499806 learned_addr learned my addr 172.21.15.71:0/3137499806 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): get_auth_request con 0x7f041013a2d0 auth_method 0 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): get_auth_request con 0x7f0410139e90 auth_method 0 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040ffff640 1 --1- 172.21.15.71:0/3137499806 >> v1:172.21.15.135:6789/0 conn(0x7f04100a69c0 0x7f0410139780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:42150/0 (socket says 172.21.15.71:42150) 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient(hunting): handle_auth_done global_id 14207 payload 274 2024-08-19T11:10:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 -- 172.21.15.71:0/3137499806 >> v2:172.21.15.135:3300/0 conn(0x7f0410139e90 msgr2=0x7f041013ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 --2- 172.21.15.71:0/3137499806 >> v2:172.21.15.135:3300/0 conn(0x7f0410139e90 0x7f041013ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 -- 172.21.15.71:0/3137499806 >> v1:172.21.15.135:6789/0 conn(0x7f04100a69c0 legacy=0x7f0410139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient: _finish_hunting 0 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 monclient: found mon.noname-h 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f0414f7f640 1 -- 172.21.15.71:0/3137499806 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04100a4a20 con 0x7f041013a2d0 2024-08-19T11:10:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.468+0000 7f040f7fe640 1 --2- 172.21.15.71:0/3137499806 >> v2:172.21.15.135:3300/0 conn(0x7f0410139e90 0x7f041013ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.471+0000 7f0414f7f640 1 -- 172.21.15.71:0/3137499806 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 msgr2=0x7f0410141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.471+0000 7f0414f7f640 1 --2- 172.21.15.71:0/3137499806 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410141120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e50 tx=0x7f040802a560 comp rx=0 tx=0).ready entity=mon.5 client_cookie=b683bc3e2b6b2df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.471+0000 7f040effd640 1 -- 172.21.15.71:0/3137499806 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0408036070 con 0x7f041013a2d0 2024-08-19T11:10:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.471+0000 7f040effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: dump: 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: _finish_auth 0 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 1 -- 172.21.15.71:0/3137499806 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408007a70 con 0x7f041013a2d0 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 5 monclient: authenticate success, global_id 14207 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 1 -- 172.21.15.71:0/3137499806 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0408007ca0 con 0x7f041013a2d0 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 4 set_mon_vals no callback set 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f040effd640 10 monclient: dump: 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 10 monclient: shutdown 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 -- 172.21.15.71:0/3137499806 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 msgr2=0x7f0410141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 --2- 172.21.15.71:0/3137499806 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410141120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0408009e50 tx=0x7f040802a560 comp rx=0 tx=0).stop 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 -- 172.21.15.71:0/3137499806 shutdown_connections 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 --2- 172.21.15.71:0/3137499806 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410141120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 --2- 172.21.15.71:0/3137499806 >> v2:172.21.15.135:3300/0 conn(0x7f0410139e90 0x7f041013ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 -- 172.21.15.71:0/3137499806 >> 172.21.15.71:0/3137499806 conn(0x7f04100abfc0 msgr2=0x7f04100ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 -- 172.21.15.71:0/3137499806 shutdown_connections 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.472+0000 7f04169e2640 1 -- 172.21.15.71:0/3137499806 wait complete. 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.473+0000 7f04169e2640 10 monclient: build_initial_monmap 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.473+0000 7f04169e2640 10 monclient: monmap: 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.473+0000 7f04169e2640 1 Processor -- start 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.473+0000 7f04169e2640 1 -- start start 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.473+0000 7f04169e2640 10 monclient: init 2024-08-19T11:10:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient: _add_conns ranks=[6,4,5,2,7,0,1,3,8] 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 0x7f0410137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): picked mon.noname-d con 0x7f04100a69c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0410139e90 0x7f0410137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): picked mon.noname-c con 0x7f0410139e90 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): picked mon.noname-h con 0x7f041013a2d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f04101417e0 con 0x7f0410139e90 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0410141660 con 0x7f041013a2d0 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f0410141960 con 0x7f04100a69c0 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f04169e2640 10 monclient(hunting): authenticate will time out at 693.516283s 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 0x7f0410137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0410139e90 0x7f0410137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 0x7f0410137a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44588/0 (socket says 172.21.15.71:44588) 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 -- 172.21.15.71:0/1635736089 learned_addr learned my addr 172.21.15.71:0/1635736089 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): get_auth_request con 0x7f04100a69c0 auth_method 0 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): get_auth_request con 0x7f0410139e90 auth_method 0 2024-08-19T11:10:35.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): get_auth_request con 0x7f041013a2d0 auth_method 0 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:35.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f0414f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient(hunting): handle_auth_done global_id 4227 payload 824 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 -- 172.21.15.71:0/1635736089 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 msgr2=0x7f0410138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 -- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0410139e90 msgr2=0x7f0410137f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0410139e90 0x7f0410137f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 monclient: found mon.noname-d 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:35.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040ffff640 1 -- 172.21.15.71:0/1635736089 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041009dd50 con 0x7f04100a69c0 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.474+0000 7f040f7fe640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0410139e90 0x7f0410137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.476+0000 7f040ffff640 1 -- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 msgr2=0x7f0410137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.476+0000 7f040ffff640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 0x7f0410137a10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f040000c450 tx=0x7f040000c910 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0400017070 con 0x7f04100a69c0 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: dump: 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:35.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:35.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04000074f0 con 0x7f04100a69c0 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 5 monclient: authenticate success, global_id 4227 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 10 monclient: _renew_subs 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0410140d30 con 0x7f04100a69c0 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0400005c60 con 0x7f04100a69c0 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040cff9640 10 monclient: dump: 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:35.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:35.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 10 monclient: _renew_subs 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f040e7fc640 4 set_mon_vals no callback set 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.477+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f0410141280 con 0x7f04100a69c0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f04000057f0 con 0x7f04100a69c0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f04169e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f04169e2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f04169e2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04100a3d80 con 0x7f04100a69c0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f040cff9640 1 --2- 172.21.15.71:0/1635736089 >> v2:172.21.15.135:6800/726754104 conn(0x7f03fc03e9b0 0x7f03fc040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(15..15 src has 1..15) ==== 3153+0+0 (secure 0 0 0) 0x7f0400050d60 con 0x7f04100a69c0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f040f7fe640 1 --2- 172.21.15.71:0/1635736089 >> v2:172.21.15.135:6800/726754104 conn(0x7f03fc03e9b0 0x7f03fc040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:35.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.478+0000 7f040f7fe640 10 monclient: get_auth_request con 0x7f03fc03e9b0 auth_method 0 2024-08-19T11:10:35.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.481+0000 7f040f7fe640 1 --2- 172.21.15.71:0/1635736089 >> v2:172.21.15.135:6800/726754104 conn(0x7f03fc03e9b0 0x7f03fc040e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0410139170 tx=0x7f0404009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:35.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.483+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f04100a3d80 con 0x7f04100a69c0 2024-08-19T11:10:35.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.483+0000 7f040cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:35.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.483+0000 7f040cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.660+0000 7f04169e2640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-08-19T11:10:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.660+0000 7f04169e2640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-08-19T11:10:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.660+0000 7f04169e2640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:35.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:35.660+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f041009cd10 con 0x7f04100a69c0 2024-08-19T11:10:36.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.650+0000 7f040cff9640 1 -- 172.21.15.71:0/1635736089 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7f041009cd10 con 0x7f04100a69c0 2024-08-19T11:10:36.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.650+0000 7f040cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-08-19T11:10:36.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.650+0000 7f040cff9640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-08-19T11:10:36.654 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2024-08-19T11:10:36.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 >> v2:172.21.15.135:6800/726754104 conn(0x7f03fc03e9b0 msgr2=0x7f03fc040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:36.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 --2- 172.21.15.71:0/1635736089 >> v2:172.21.15.135:6800/726754104 conn(0x7f03fc03e9b0 0x7f03fc040e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0410139170 tx=0x7f0404009190 comp rx=0 tx=0).stop 2024-08-19T11:10:36.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 10 monclient: shutdown 2024-08-19T11:10:36.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:36.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 msgr2=0x7f0410137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 0x7f0410137a10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f040000c450 tx=0x7f040000c910 comp rx=0 tx=0).stop 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 shutdown_connections 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 --2- 172.21.15.71:0/1635736089 >> v2:172.21.15.135:6800/726754104 conn(0x7f03fc03e9b0 0x7f03fc040e70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0410139e90 0x7f0410137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f041013a2d0 0x7f0410138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 --2- 172.21.15.71:0/1635736089 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04100a69c0 0x7f0410137a10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 >> 172.21.15.71:0/1635736089 conn(0x7f04100abfc0 msgr2=0x7f0410134e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 shutdown_connections 2024-08-19T11:10:36.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.655+0000 7f04169e2640 1 -- 172.21.15.71:0/1635736089 wait complete. 2024-08-19T11:10:36.668 DEBUG:teuthology.orchestra.run.smithi071:> rbd --cluster ceph pool init rbd 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.703+0000 7f901eb1df00 10 monclient: get_monmap_and_config 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.703+0000 7f901eb1df00 10 monclient: build_initial_monmap 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.703+0000 7f901eb1df00 10 monclient: monmap: 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:36.704719+0000 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:36.704719+0000 2024-08-19T11:10:36.705 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:36.706 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.703+0000 7f901eb1df00 1 Processor -- start 2024-08-19T11:10:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.703+0000 7f901eb1df00 1 -- start start 2024-08-19T11:10:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.703+0000 7f901eb1df00 10 monclient: init 2024-08-19T11:10:36.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient: _reopen_session rank -1 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient: _add_conns ranks=[5,9,6,1,4,7,8,0,10,2,3] 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x55a6fe0accf0 0x55a6fe0ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): picked mon.noname-h con 0x55a6fe0accf0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 1 --2- >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 0x55a6fe0ad610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): picked mon.noname-a con 0x55a6fe0ab060 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe13ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): picked mon.noname-d con 0x55a6fe13fb10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x55a6fdf781c0 con 0x55a6fe0ab060 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x55a6fdf88cc0 con 0x55a6fe0accf0 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:36.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x55a6fdf7c200 con 0x55a6fe13fb10 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): _renew_subs 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901eb1df00 10 monclient(hunting): authenticate will time out at 694.746327s 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe13ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 0x55a6fe0ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe13ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44596/0 (socket says 172.21.15.71:44596) 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 0x55a6fe0ad610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47578/0 (socket says 172.21.15.71:47578) 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 -- 172.21.15.71:0/2294253275 learned_addr learned my addr 172.21.15.71:0/2294253275 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): get_auth_request con 0x55a6fe13fb10 auth_method 0 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): get_auth_request con 0x55a6fe0ab060 auth_method 0 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:36.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901d60a640 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x55a6fe0accf0 0x55a6fe0ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901d60a640 10 monclient(hunting): get_auth_request con 0x55a6fe0accf0 auth_method 0 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901d60a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901d60a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901d60a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient(hunting): handle_auth_done global_id 4236 payload 274 2024-08-19T11:10:36.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 -- 172.21.15.71:0/2294253275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x55a6fe0accf0 msgr2=0x55a6fe0ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x55a6fe0accf0 0x55a6fe0ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 -- 172.21.15.71:0/2294253275 >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 msgr2=0x55a6fe0ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 --2- 172.21.15.71:0/2294253275 >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 0x55a6fe0ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 monclient: found mon.noname-d 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901e86c640 1 -- 172.21.15.71:0/2294253275 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fdf399a0 con 0x55a6fe13fb10 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901ce09640 1 --2- 172.21.15.71:0/2294253275 >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 0x55a6fe0ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.704+0000 7f901d60a640 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x55a6fe0accf0 0x55a6fe0ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f901e86c640 1 -- 172.21.15.71:0/2294253275 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 msgr2=0x55a6fe13ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:36.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f901e86c640 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe13ff30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9010005fd0 tx=0x7f9010045ab0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=d2de093a92eb0332 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 1 -- 172.21.15.71:0/2294253275 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f90100518e0 con 0x55a6fe13fb10 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: dump: 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:36.719 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: _finish_auth 0 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f901eb1df00 5 monclient: authenticate success, global_id 4236 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 1 -- 172.21.15.71:0/2294253275 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9010057070 con 0x55a6fe13fb10 2024-08-19T11:10:36.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f901eb1df00 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f901eb1df00 10 monclient: get_monmap_and_config success 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 1 -- 172.21.15.71:0/2294253275 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9010052450 con 0x55a6fe13fb10 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f901eb1df00 4 set_mon_vals no callback set 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.708+0000 7f900ffff640 10 monclient: dump: 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:36.721 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 10 monclient: shutdown 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:36.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 -- 172.21.15.71:0/2294253275 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 msgr2=0x55a6fe13ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe13ff30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9010005fd0 tx=0x7f9010045ab0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 -- 172.21.15.71:0/2294253275 shutdown_connections 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 --2- 172.21.15.71:0/2294253275 >> v2:172.21.15.71:3300/0 conn(0x55a6fe0ab060 0x55a6fe0ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe13ff30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 --2- 172.21.15.71:0/2294253275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x55a6fe0accf0 0x55a6fe0ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 -- 172.21.15.71:0/2294253275 >> 172.21.15.71:0/2294253275 conn(0x55a6fe08ecd0 msgr2=0x55a6fe08f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 -- 172.21.15.71:0/2294253275 shutdown_connections 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 1 -- 172.21.15.71:0/2294253275 wait complete. 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.709+0000 7f901eb1df00 10 monclient: build_initial_monmap 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient: monmap: 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:36.723 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:36.724 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 Processor -- start 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 -- start start 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient: init 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient: _reopen_session rank -1 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient: _add_conns ranks=[4,6,7,1,5,0,3,8,2] 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x55a6fe0accf0 0x55a6fe13d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): picked mon.noname-c con 0x55a6fe0accf0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe0a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): picked mon.noname-d con 0x55a6fe13fb10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x55a6fe0a60b0 0x55a6fe0a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): picked mon.noname-i con 0x55a6fe0a60b0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:36.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x55a6fe0adb50 con 0x55a6fe0accf0 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x55a6fdf1ebb0 con 0x55a6fe13fb10 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x55a6fe0ab4e0 con 0x55a6fe0a60b0 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): _renew_subs 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901eb1df00 10 monclient(hunting): authenticate will time out at 694.752886s 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901ce09640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe0a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901d60a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x55a6fe0accf0 0x55a6fe13d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901ce09640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe0a5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44604/0 (socket says 172.21.15.71:44604) 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901d60a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x55a6fe0accf0 0x55a6fe13d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46780/0 (socket says 172.21.15.71:46780) 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.710+0000 7f901ce09640 1 -- 172.21.15.71:0/3263645227 learned_addr learned my addr 172.21.15.71:0/3263645227 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): get_auth_request con 0x55a6fe13fb10 auth_method 0 2024-08-19T11:10:36.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): get_auth_request con 0x55a6fe0accf0 auth_method 0 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:36.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient(hunting): handle_auth_done global_id 4245 payload 824 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 1 -- 172.21.15.71:0/3263645227 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x55a6fe0a60b0 msgr2=0x55a6fe0a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901e86c640 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x55a6fe0a60b0 0x55a6fe0a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x55a6fe0a60b0 0x55a6fe0a64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 1 -- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x55a6fe0accf0 msgr2=0x55a6fe13d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x55a6fe0accf0 0x55a6fe13d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient: _finish_hunting 0 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 1 monclient: found mon.noname-d 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901ce09640 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6fdf12010 con 0x55a6fe13fb10 2024-08-19T11:10:36.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.711+0000 7f901d60a640 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x55a6fe0accf0 0x55a6fe13d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:36.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901ce09640 1 -- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 msgr2=0x55a6fe0a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:36.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901ce09640 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe0a5b70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9008008a10 tx=0x7f9008008b00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:36.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9008017020 con 0x55a6fe13fb10 2024-08-19T11:10:36.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:36.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: dump: 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:36.731 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 5 monclient: authenticate success, global_id 4245 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9008013c90 con 0x55a6fe13fb10 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9008013e40 con 0x55a6fe13fb10 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 10 monclient: _renew_subs 2024-08-19T11:10:36.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6fdef70c0 con 0x55a6fe13fb10 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900f7fe640 4 set_mon_vals no callback set 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f900d7fa640 10 monclient: dump: 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:36.733 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:36.734 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 10 monclient: _renew_subs 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.713+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x55a6fe129530 con 0x55a6fe13fb10 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.714+0000 7f901ce09640 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe0a5b70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9008008a10 tx=0x7f9008008b00 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f9008050aa0 osd_map(16..16 src has 1..16) 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.714+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f900801a020 con 0x55a6fe13fb10 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.714+0000 7f900d7fa640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.135:6800/726754104 conn(0x7f8ffc03d370 0x7f8ffc03f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.715+0000 7f901d60a640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.135:6800/726754104 conn(0x7f8ffc03d370 0x7f8ffc03f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.715+0000 7f901d60a640 10 monclient: get_auth_request con 0x7f8ffc03d370 auth_method 0 2024-08-19T11:10:36.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:36.717+0000 7f901d60a640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.135:6800/726754104 conn(0x7f8ffc03d370 0x7f8ffc03f830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90140098c0 tx=0x7f9014005c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.542+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(16..16 src has 1..16) ==== 3495+0+0 (secure 0 0 0) 0x7f9008050aa0 con 0x55a6fe13fb10 2024-08-19T11:10:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.542+0000 7f901eb1df00 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-08-19T11:10:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.542+0000 7f901eb1df00 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-08-19T11:10:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.542+0000 7f901eb1df00 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.542+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55a6fe13dab0 con 0x55a6fe13fb10 2024-08-19T11:10:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.655+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (secure 0 0 0) 0x7f9008021070 con 0x55a6fe13fb10 2024-08-19T11:10:37.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.655+0000 7f900d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-08-19T11:10:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.655+0000 7f900d7fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2024-08-19T11:10:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.655+0000 7f901eb1df00 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:37.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.655+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9010057070 con 0x55a6fe13fb10 2024-08-19T11:10:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9008019b90 con 0x55a6fe13fb10 2024-08-19T11:10:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f900d7fa640 10 monclient: handle_get_version_reply finishing 1 version 17 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f900f7fe640 10 monclient: _renew_subs 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f900f7fe640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f900f7fe640 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=17}) -- 0x7f8ff4002c40 con 0x55a6fe13fb10 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 8 ==== osd_map(17..17 src has 1..17) ==== 674+0+0 (secure 0 0 0) 0x7f9008013820 con 0x55a6fe13fb10 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f901eb1df00 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6804/227121352 conn(0x55a6fe155cd0 0x55a6fe1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> v2:172.21.15.71:6804/227121352 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x55a6fe158600 con 0x55a6fe155cd0 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f901e86c640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6804/227121352 conn(0x55a6fe155cd0 0x55a6fe1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.669+0000 7f901e86c640 10 monclient: get_auth_request con 0x55a6fe155cd0 auth_method 0 2024-08-19T11:10:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.674+0000 7f901e86c640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6804/227121352 conn(0x55a6fe155cd0 0x55a6fe1580c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.675+0000 7f901e86c640 1 -- 172.21.15.71:0/3263645227 <== osd.1 v2:172.21.15.71:6804/227121352 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f90100526b0 con 0x55a6fe155cd0 2024-08-19T11:10:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.678+0000 7f901eb1df00 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6800/1867070009 conn(0x55a6fe1ab430 0x55a6fe1ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.678+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> v2:172.21.15.71:6800/1867070009 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55a6fe1ade50 con 0x55a6fe1ab430 2024-08-19T11:10:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.678+0000 7f901d60a640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6800/1867070009 conn(0x55a6fe1ab430 0x55a6fe1ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:37.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.678+0000 7f901d60a640 10 monclient: get_auth_request con 0x55a6fe1ab430 auth_method 0 2024-08-19T11:10:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.683+0000 7f901d60a640 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6800/1867070009 conn(0x55a6fe1ab430 0x55a6fe1ad8c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.683+0000 7f901d60a640 1 -- 172.21.15.71:0/3263645227 <== osd.0 v2:172.21.15.71:6800/1867070009 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9014008890 con 0x55a6fe1ab430 2024-08-19T11:10:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.683+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 --> v2:172.21.15.71:6800/1867070009 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55a6fe1a9ec0 con 0x55a6fe1ab430 2024-08-19T11:10:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.683+0000 7f901d60a640 1 -- 172.21.15.71:0/3263645227 <== osd.0 v2:172.21.15.71:6800/1867070009 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f9014008890 con 0x55a6fe1ab430 2024-08-19T11:10:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.683+0000 7f900effd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:37.683+0000 7f900effd640 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f8ff8001f00 con 0x55a6fe13fb10 2024-08-19T11:10:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.661+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 9 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (secure 0 0 0) 0x7f9008041070 con 0x55a6fe13fb10 2024-08-19T11:10:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.661+0000 7f900d7fa640 10 monclient: _renew_subs 2024-08-19T11:10:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.661+0000 7f900d7fa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.661+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=18}) -- 0x7f8ffc043150 con 0x55a6fe13fb10 2024-08-19T11:10:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.661+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 10 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (secure 0 0 0) 0x7f90080194a0 con 0x55a6fe13fb10 2024-08-19T11:10:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.661+0000 7f900f7fe640 1 -- 172.21.15.71:0/3263645227 --> v2:172.21.15.71:6800/1867070009 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f8ff40058f0 con 0x55a6fe1ab430 2024-08-19T11:10:38.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.663+0000 7f901d60a640 1 -- 172.21.15.71:0/3263645227 <== osd.0 v2:172.21.15.71:6800/1867070009 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9014008890 con 0x55a6fe1ab430 2024-08-19T11:10:38.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.663+0000 7f900effd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:38.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:38.663+0000 7f900effd640 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f8ff8003350 con 0x55a6fe13fb10 2024-08-19T11:10:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.664+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 11 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (secure 0 0 0) 0x7f900802a020 con 0x55a6fe13fb10 2024-08-19T11:10:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.664+0000 7f900d7fa640 10 monclient: _renew_subs 2024-08-19T11:10:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.664+0000 7f900d7fa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:39.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.664+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=19}) -- 0x7f8ffc043200 con 0x55a6fe13fb10 2024-08-19T11:10:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.664+0000 7f900d7fa640 1 -- 172.21.15.71:0/3263645227 <== mon.6 v2:172.21.15.71:3303/0 12 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (secure 0 0 0) 0x7f90080196a0 con 0x55a6fe13fb10 2024-08-19T11:10:39.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.664+0000 7f900f7fe640 1 -- 172.21.15.71:0/3263645227 --> v2:172.21.15.71:6800/1867070009 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f8ff4005cb0 con 0x55a6fe1ab430 2024-08-19T11:10:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901d60a640 1 -- 172.21.15.71:0/3263645227 <== osd.0 v2:172.21.15.71:6800/1867070009 4 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9014008890 con 0x55a6fe1ab430 2024-08-19T11:10:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6800/1867070009 conn(0x55a6fe1ab430 msgr2=0x55a6fe1ad8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6800/1867070009 conn(0x55a6fe1ab430 0x55a6fe1ad8c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6804/227121352 conn(0x55a6fe155cd0 msgr2=0x55a6fe1580c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.71:6804/227121352 conn(0x55a6fe155cd0 0x55a6fe1580c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 >> v2:172.21.15.135:6800/726754104 conn(0x7f8ffc03d370 msgr2=0x7f8ffc03f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 --2- 172.21.15.71:0/3263645227 >> v2:172.21.15.135:6800/726754104 conn(0x7f8ffc03d370 0x7f8ffc03f830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f90140098c0 tx=0x7f9014005c00 comp rx=0 tx=0).stop 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 10 monclient: shutdown 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 msgr2=0x55a6fe0a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 --2- 172.21.15.71:0/3263645227 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x55a6fe13fb10 0x55a6fe0a5b70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9008008a10 tx=0x7f9008008b00 comp rx=0 tx=0).stop 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901e86c640 1 -- 172.21.15.71:0/3263645227 reap_dead start 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 shutdown_connections 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 >> 172.21.15.71:0/3263645227 conn(0x55a6fe08ecd0 msgr2=0x55a6fe0af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 shutdown_connections 2024-08-19T11:10:39.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.667+0000 7f901eb1df00 1 -- 172.21.15.71:0/3263645227 wait complete. 2024-08-19T11:10:39.744 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-19T11:10:39.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-08-19T11:10:39.745 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-19T11:10:39.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.889+0000 7f7b36798640 10 monclient: get_monmap_and_config 2024-08-19T11:10:39.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.889+0000 7f7b36798640 10 monclient: build_initial_monmap 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.889+0000 7f7b36798640 10 monclient: monmap: 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:39.891367+0000 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:39.891367+0000 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:39.892 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:39.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.890+0000 7f7b36798640 1 Processor -- start 2024-08-19T11:10:39.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.890+0000 7f7b36798640 1 -- start start 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.890+0000 7f7b36798640 10 monclient: init 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.890+0000 7f7b36798640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient: _add_conns ranks=[4,5,1,8,6,0,2,10,9,7,3] 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 0x7f7b300a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): picked mon.noname-c con 0x7f7b300a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b300a57c0 0x7f7b300a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): picked mon.noname-h con 0x7f7b300a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7b30139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b300a6380 con 0x7f7b30139710 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7b300a5020 con 0x7f7b300a6950 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:39.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7b300a77b0 con 0x7f7b300a57c0 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b36798640 10 monclient(hunting): authenticate will time out at 697.933107s 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 0x7f7b300a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 0x7f7b300a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46810/0 (socket says 172.21.15.71:46810) 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 -- 172.21.15.71:0/1723656815 learned_addr learned my addr 172.21.15.71:0/1723656815 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): get_auth_request con 0x7f7b300a6950 auth_method 0 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:39.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_done global_id 4243 payload 274 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2f7fe640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b300a57c0 0x7f7b300a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 -- 172.21.15.71:0/1723656815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b300a57c0 msgr2=0x7f7b300a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b300a57c0 0x7f7b300a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 -- 172.21.15.71:0/1723656815 >> v1:172.21.15.135:6789/0 conn(0x7f7b30139710 legacy=0x7f7b30139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 monclient: found mon.noname-c 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2ffff640 1 -- 172.21.15.71:0/1723656815 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300a3650 con 0x7f7b300a6950 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2f7fe640 10 monclient: get_auth_request con 0x7f7b300a57c0 auth_method 0 2024-08-19T11:10:39.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.891+0000 7f7b2f7fe640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b300a57c0 0x7f7b300a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2ffff640 1 -- 172.21.15.71:0/1723656815 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 msgr2=0x7f7b300a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2ffff640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 0x7f7b300a6d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7b200098a0 tx=0x7f7b2002a080 comp rx=0 tx=0).ready entity=mon.4 client_cookie=f8bbf67395762929 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 1 -- 172.21.15.71:0/1723656815 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b20037070 con 0x7f7b300a6950 2024-08-19T11:10:39.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: dump: 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:39.906 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: _finish_auth 0 2024-08-19T11:10:39.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 1 -- 172.21.15.71:0/1723656815 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200307b0 con 0x7f7b300a6950 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b36798640 5 monclient: authenticate success, global_id 4243 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b36798640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b36798640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 1 -- 172.21.15.71:0/1723656815 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b20030e10 con 0x7f7b300a6950 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b36798640 4 set_mon_vals no callback set 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:39.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.894+0000 7f7b2effd640 10 monclient: dump: 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:39.909 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 10 monclient: shutdown 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 -- 172.21.15.71:0/1723656815 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 msgr2=0x7f7b300a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 0x7f7b300a6d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7b200098a0 tx=0x7f7b2002a080 comp rx=0 tx=0).stop 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 -- 172.21.15.71:0/1723656815 shutdown_connections 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b300a57c0 0x7f7b300a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 --2- 172.21.15.71:0/1723656815 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7b300a6950 0x7f7b300a6d30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 -- 172.21.15.71:0/1723656815 >> 172.21.15.71:0/1723656815 conn(0x7f7b300abf50 msgr2=0x7f7b300ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 -- 172.21.15.71:0/1723656815 shutdown_connections 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 1 -- 172.21.15.71:0/1723656815 wait complete. 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.895+0000 7f7b36798640 10 monclient: build_initial_monmap 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 10 monclient: monmap: 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:39.911 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:39.912 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 1 Processor -- start 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 1 -- start start 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 10 monclient: init 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 10 monclient: _add_conns ranks=[8,3,5,0,2,6,1,7,4] 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 0x7f7b301cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 10 monclient(hunting): picked mon.noname-e con 0x7f7b300a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b300a6950 0x7f7b30138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:39.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.896+0000 7f7b36798640 10 monclient(hunting): picked mon.noname-g con 0x7f7b300a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b30139710 0x7f7b301ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 10 monclient(hunting): picked mon.noname-h con 0x7f7b30139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b300a84c0 con 0x7f7b300a6950 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7b300a7d40 con 0x7f7b30139710 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7b300a8700 con 0x7f7b300a57c0 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:39.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b36798640 10 monclient(hunting): authenticate will time out at 697.939058s 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 0x7f7b301cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 0x7f7b301cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59256/0 (socket says 172.21.15.71:59256) 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 -- 172.21.15.71:0/3308261131 learned_addr learned my addr 172.21.15.71:0/3308261131 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): get_auth_request con 0x7f7b300a57c0 auth_method 0 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2f7fe640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b300a6950 0x7f7b30138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:39.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b34d35640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b30139710 0x7f7b301ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2f7fe640 10 monclient(hunting): get_auth_request con 0x7f7b300a6950 auth_method 0 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b34d35640 10 monclient(hunting): get_auth_request con 0x7f7b30139710 auth_method 0 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b34d35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b34d35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b34d35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient(hunting): handle_auth_done global_id 4202 payload 824 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 -- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b30139710 msgr2=0x7f7b301ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b30139710 0x7f7b301ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 -- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b300a6950 msgr2=0x7f7b30138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b300a6950 0x7f7b30138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 monclient: found mon.noname-e 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.897+0000 7f7b2ffff640 1 -- 172.21.15.71:0/3308261131 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b30125d80 con 0x7f7b300a57c0 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2ffff640 1 -- 172.21.15.71:0/3308261131 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 msgr2=0x7f7b301cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2ffff640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 0x7f7b301cadd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b200090b0 tx=0x7f7b200046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b20041030 con 0x7f7b300a57c0 2024-08-19T11:10:39.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: dump: 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:39.918 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:39.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b36798640 5 monclient: authenticate success, global_id 4202 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b20030b70 con 0x7f7b300a57c0 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b20037040 con 0x7f7b300a57c0 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2e7fc640 4 set_mon_vals no callback set 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b2cff9640 10 monclient: dump: 2024-08-19T11:10:39.920 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:39.921 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b36798640 10 monclient: _renew_subs 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b36798640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.899+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b300a1e00 con 0x7f7b300a57c0 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 10 monclient: _renew_subs 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:39.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b30126620 con 0x7f7b300a57c0 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b30139af0 con 0x7f7b300a57c0 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.900+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7b20044070 con 0x7f7b300a57c0 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.901+0000 7f7b2cff9640 1 --2- 172.21.15.71:0/3308261131 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b1c03eab0 0x7f7b1c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.901+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f7b20042070 con 0x7f7b300a57c0 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.901+0000 7f7b2f7fe640 1 --2- 172.21.15.71:0/3308261131 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b1c03eab0 0x7f7b1c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:39.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.901+0000 7f7b2f7fe640 10 monclient: get_auth_request con 0x7f7b1c03eab0 auth_method 0 2024-08-19T11:10:39.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.904+0000 7f7b2f7fe640 1 --2- 172.21.15.71:0/3308261131 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b1c03eab0 0x7f7b1c040f70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b30123f30 tx=0x7f7b24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:39.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.905+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f7b30139af0 con 0x7f7b300a57c0 2024-08-19T11:10:39.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.905+0000 7f7b2cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:39.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:39.905+0000 7f7b2cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.080+0000 7f7b36798640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.080+0000 7f7b36798640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.080+0000 7f7b36798640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.080+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7b30068d30 con 0x7f7b300a57c0 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.080+0000 7f7b2cff9640 1 -- 172.21.15.71:0/3308261131 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f7b30068d30 con 0x7f7b300a57c0 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.081+0000 7f7b2cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.081+0000 7f7b2cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.082+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b1c03eab0 msgr2=0x7f7b1c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.082+0000 7f7b36798640 1 --2- 172.21.15.71:0/3308261131 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b1c03eab0 0x7f7b1c040f70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b30123f30 tx=0x7f7b24008040 comp rx=0 tx=0).stop 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 10 monclient: shutdown 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 msgr2=0x7f7b301cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 0x7f7b301cadd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b200090b0 tx=0x7f7b200046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 shutdown_connections 2024-08-19T11:10:40.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 --2- 172.21.15.71:0/3308261131 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b1c03eab0 0x7f7b1c040f70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7b30139710 0x7f7b301ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b300a6950 0x7f7b30138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 --2- 172.21.15.71:0/3308261131 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b300a57c0 0x7f7b301cadd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 >> 172.21.15.71:0/3308261131 conn(0x7f7b300abf50 msgr2=0x7f7b300aa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:40.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 shutdown_connections 2024-08-19T11:10:40.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.083+0000 7f7b36798640 1 -- 172.21.15.71:0/3308261131 wait complete. 2024-08-19T11:10:40.094 INFO:teuthology.orchestra.run.smithi071.stdout:[{"version":5,"timestamp":"2024-08-19T11:10:28.065067+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"7357.465711"}]}] 2024-08-19T11:10:40.095 INFO:tasks.ceph_manager:config epoch is 5 2024-08-19T11:10:40.095 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-19T11:10:40.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-19T11:10:40.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-19T11:10:40.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.192+0000 7fb6591a0640 10 monclient: get_monmap_and_config 2024-08-19T11:10:40.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.192+0000 7fb6591a0640 10 monclient: build_initial_monmap 2024-08-19T11:10:40.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.192+0000 7fb6591a0640 10 monclient: monmap: 2024-08-19T11:10:40.193 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:40.193 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:40.192865+0000 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:40.192865+0000 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:40.194 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:40.195 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:40.195 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:40.195 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:40.195 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:40.195 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.192+0000 7fb6591a0640 1 Processor -- start 2024-08-19T11:10:40.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 1 -- start start 2024-08-19T11:10:40.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient: init 2024-08-19T11:10:40.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:40.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient: _add_conns ranks=[6,3,1,8,4,0,7,5,9,2,10] 2024-08-19T11:10:40.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb6541378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): picked mon.noname-d con 0x7fb654137500 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540a4cb0 0x7fb65406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): picked mon.noname-g con 0x7fb6540a4cb0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb65406cde0 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb654072ca0 con 0x7fb65406cde0 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb654073a00 con 0x7fb6540a4cb0 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb6540742a0 con 0x7fb654137500 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:40.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6591a0640 10 monclient(hunting): authenticate will time out at 698.234560s 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb6541378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb6541378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44614/0 (socket says 172.21.15.71:44614) 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 -- 172.21.15.71:0/3201313020 learned_addr learned my addr 172.21.15.71:0/3201313020 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): get_auth_request con 0x7fb654137500 auth_method 0 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb6537fe640 1 --2- 172.21.15.71:0/3201313020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540a4cb0 0x7fb65406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient(hunting): handle_auth_done global_id 4254 payload 274 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 -- 172.21.15.71:0/3201313020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540a4cb0 msgr2=0x7fb65406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 --2- 172.21.15.71:0/3201313020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540a4cb0 0x7fb65406c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 -- 172.21.15.71:0/3201313020 >> v1:172.21.15.135:6789/0 conn(0x7fb65406cde0 legacy=0x7fb65413e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 monclient: found mon.noname-d 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.193+0000 7fb653fff640 1 -- 172.21.15.71:0/3201313020 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6540a4720 con 0x7fb654137500 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.196+0000 7fb653fff640 1 -- 172.21.15.71:0/3201313020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 msgr2=0x7fb6541378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.196+0000 7fb653fff640 1 --2- 172.21.15.71:0/3201313020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb6541378e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb6480098a0 tx=0x7fb64802a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=36a4fc2238b744d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.196+0000 7fb652ffd640 1 -- 172.21.15.71:0/3201313020 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb648037070 con 0x7fb654137500 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.196+0000 7fb652ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.196+0000 7fb652ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.196+0000 7fb652ffd640 10 monclient: dump: 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.203 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:40.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 5 monclient: authenticate success, global_id 4254 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 1 -- 172.21.15.71:0/3201313020 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6480307b0 con 0x7fb654137500 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 4 set_mon_vals no callback set 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 1 -- 172.21.15.71:0/3201313020 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb648030dd0 con 0x7fb654137500 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb652ffd640 10 monclient: dump: 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 10 monclient: shutdown 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 -- 172.21.15.71:0/3201313020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 msgr2=0x7fb6541378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3201313020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb6541378e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb6480098a0 tx=0x7fb64802a080 comp rx=0 tx=0).stop 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 -- 172.21.15.71:0/3201313020 shutdown_connections 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3201313020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540a4cb0 0x7fb65406c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3201313020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb6541378e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 -- 172.21.15.71:0/3201313020 >> 172.21.15.71:0/3201313020 conn(0x7fb6540a54e0 msgr2=0x7fb6540a58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 -- 172.21.15.71:0/3201313020 shutdown_connections 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.197+0000 7fb6591a0640 1 -- 172.21.15.71:0/3201313020 wait complete. 2024-08-19T11:10:40.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.198+0000 7fb6591a0640 10 monclient: build_initial_monmap 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.198+0000 7fb6591a0640 10 monclient: monmap: 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:40.208 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.198+0000 7fb6591a0640 1 Processor -- start 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.198+0000 7fb6591a0640 1 -- start start 2024-08-19T11:10:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.198+0000 7fb6591a0640 10 monclient: init 2024-08-19T11:10:40.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:40.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient: _add_conns ranks=[0,6,3,1,4,7,5,2,8] 2024-08-19T11:10:40.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb65406cde0 0x7fb6541cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): picked mon.noname-a con 0x7fb65406cde0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb654135270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): picked mon.noname-d con 0x7fb654137500 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6541357b0 0x7fb654122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): picked mon.noname-g con 0x7fb6541357b0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb654137e20 con 0x7fb65406cde0 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb6540644e0 con 0x7fb6541357b0 2024-08-19T11:10:40.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb654137fa0 con 0x7fb654137500 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6591a0640 10 monclient(hunting): authenticate will time out at 698.240132s 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb654135270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb65406cde0 0x7fb6541cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb654135270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44628/0 (socket says 172.21.15.71:44628) 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 -- 172.21.15.71:0/3559322908 learned_addr learned my addr 172.21.15.71:0/3559322908 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): get_auth_request con 0x7fb654137500 auth_method 0 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): get_auth_request con 0x7fb65406cde0 auth_method 0 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb65899f640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6541357b0 0x7fb654122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb65899f640 10 monclient(hunting): get_auth_request con 0x7fb6541357b0 auth_method 0 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb65899f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb65899f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb65899f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient(hunting): handle_auth_done global_id 4263 payload 824 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 -- 172.21.15.71:0/3559322908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6541357b0 msgr2=0x7fb654122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6541357b0 0x7fb654122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 -- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb65406cde0 msgr2=0x7fb6541cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb65406cde0 0x7fb6541cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 monclient: found mon.noname-d 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.199+0000 7fb6537fe640 1 -- 172.21.15.71:0/3559322908 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb654126c70 con 0x7fb654137500 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6537fe640 1 -- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 msgr2=0x7fb654135270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6537fe640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb654135270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c7f0 tx=0x7fb64400ccb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb644015070 con 0x7fb654137500 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: dump: 2024-08-19T11:10:40.218 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.219 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb644007ca0 con 0x7fb654137500 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6591a0640 5 monclient: authenticate success, global_id 4263 2024-08-19T11:10:40.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb644007e50 con 0x7fb654137500 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6591a0640 10 monclient: _renew_subs 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6591a0640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6541cc570 con 0x7fb654137500 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb6527fc640 4 set_mon_vals no callback set 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.201+0000 7fb650ff9640 10 monclient: dump: 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.222 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 10 monclient: _renew_subs 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6541263d0 con 0x7fb654137500 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb644007830 con 0x7fb654137500 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.202+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65406c8a0 con 0x7fb654137500 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.203+0000 7fb650ff9640 1 --2- 172.21.15.71:0/3559322908 >> v2:172.21.15.135:6800/726754104 conn(0x7fb64003eb50 0x7fb640041010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.203+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fb644051520 con 0x7fb654137500 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.203+0000 7fb653fff640 1 --2- 172.21.15.71:0/3559322908 >> v2:172.21.15.135:6800/726754104 conn(0x7fb64003eb50 0x7fb640041010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.203+0000 7fb653fff640 10 monclient: get_auth_request con 0x7fb64003eb50 auth_method 0 2024-08-19T11:10:40.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.205+0000 7fb653fff640 1 --2- 172.21.15.71:0/3559322908 >> v2:172.21.15.135:6800/726754104 conn(0x7fb64003eb50 0x7fb640041010 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb648031000 tx=0x7fb64802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:40.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.207+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fb64401e070 con 0x7fb654137500 2024-08-19T11:10:40.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.207+0000 7fb650ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:40.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.207+0000 7fb650ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:40.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.430+0000 7fb6591a0640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-08-19T11:10:40.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.430+0000 7fb6591a0640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-08-19T11:10:40.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.430+0000 7fb6591a0640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.430+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb65406e9c0 con 0x7fb654137500 2024-08-19T11:10:40.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.432+0000 7fb650ff9640 1 -- 172.21.15.71:0/3559322908 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+96225 (secure 0 0 0) 0x7fb644011df0 con 0x7fb654137500 2024-08-19T11:10:40.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.432+0000 7fb650ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-08-19T11:10:40.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.432+0000 7fb650ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:40.434 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 >> v2:172.21.15.135:6800/726754104 conn(0x7fb64003eb50 msgr2=0x7fb640041010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3559322908 >> v2:172.21.15.135:6800/726754104 conn(0x7fb64003eb50 0x7fb640041010 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb648031000 tx=0x7fb64802e000 comp rx=0 tx=0).stop 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 10 monclient: shutdown 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 msgr2=0x7fb654135270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb654135270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c7f0 tx=0x7fb64400ccb0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 shutdown_connections 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3559322908 >> v2:172.21.15.135:6800/726754104 conn(0x7fb64003eb50 0x7fb640041010 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6541357b0 0x7fb654122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb654137500 0x7fb654135270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 --2- 172.21.15.71:0/3559322908 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb65406cde0 0x7fb6541cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 >> 172.21.15.71:0/3559322908 conn(0x7fb6540a54e0 msgr2=0x7fb6540a7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:40.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 shutdown_connections 2024-08-19T11:10:40.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.434+0000 7fb6591a0640 1 -- 172.21.15.71:0/3559322908 wait complete. 2024-08-19T11:10:40.446 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":726754104}]},"active_addr":"172.21.15.135:6800/726754104","active_change":"2024-08-19T11:10:19.430015+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3820233474}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2325399427}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1913436346}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":741581405}]}]} 2024-08-19T11:10:40.448 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-19T11:10:40.448 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-19T11:10:40.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.545+0000 7faacf931640 10 monclient: get_monmap_and_config 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.545+0000 7faacf931640 10 monclient: build_initial_monmap 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.545+0000 7faacf931640 10 monclient: monmap: 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:40.545816+0000 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:40.545816+0000 2024-08-19T11:10:40.546 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:40.547 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.545+0000 7faacf931640 1 Processor -- start 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.545+0000 7faacf931640 1 -- start start 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient: init 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient: _add_conns ranks=[6,5,10,2,1,0,7,8,4,3,9] 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 0x7faac80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): picked mon.noname-d con 0x7faac80a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faac80a6e10 0x7faac80a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): picked mon.noname-h con 0x7faac80a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faac8139860 0x7faac8139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): picked mon.noname-f con 0x7faac8139860 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7faac80a4f90 con 0x7faac8139860 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7faac80a6380 con 0x7faac80a6e10 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7faac80a49d0 con 0x7faac80a6a30 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacf931640 10 monclient(hunting): authenticate will time out at 698.587506s 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 0x7faac80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 0x7faac80a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44640/0 (socket says 172.21.15.71:44640) 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 -- 172.21.15.71:0/3393431942 learned_addr learned my addr 172.21.15.71:0/3393431942 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:40.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): get_auth_request con 0x7faac80a6a30 auth_method 0 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacdece640 1 --2- 172.21.15.71:0/3393431942 >> v2:172.21.15.135:3300/0 conn(0x7faac8139860 0x7faac8139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faaccecc640 1 --2- 172.21.15.71:0/3393431942 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faac80a6e10 0x7faac80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacdece640 10 monclient(hunting): get_auth_request con 0x7faac8139860 auth_method 0 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacdece640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacdece640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacdece640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faaccecc640 10 monclient(hunting): get_auth_request con 0x7faac80a6e10 auth_method 0 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faaccecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faaccecc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faaccecc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient(hunting): handle_auth_done global_id 4272 payload 274 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 -- 172.21.15.71:0/3393431942 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faac80a6e10 msgr2=0x7faac80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 --2- 172.21.15.71:0/3393431942 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faac80a6e10 0x7faac80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 -- 172.21.15.71:0/3393431942 >> v2:172.21.15.135:3300/0 conn(0x7faac8139860 msgr2=0x7faac8139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 --2- 172.21.15.71:0/3393431942 >> v2:172.21.15.135:3300/0 conn(0x7faac8139860 0x7faac8139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 monclient: found mon.noname-d 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:40.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.546+0000 7faacd6cd640 1 -- 172.21.15.71:0/3393431942 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac80a46f0 con 0x7faac80a6a30 2024-08-19T11:10:40.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faacd6cd640 1 -- 172.21.15.71:0/3393431942 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 msgr2=0x7faac80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:40.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faacd6cd640 1 --2- 172.21.15.71:0/3393431942 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 0x7faac80a57f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faab8009e50 tx=0x7faab802a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=549b97bd93a132a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 1 -- 172.21.15.71:0/3393431942 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faab8036070 con 0x7faac80a6a30 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: dump: 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.560 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faacf931640 5 monclient: authenticate success, global_id 4272 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 1 -- 172.21.15.71:0/3393431942 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8007a70 con 0x7faac80a6a30 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faacf931640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faacf931640 4 set_mon_vals no callback set 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 1 -- 172.21.15.71:0/3393431942 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faab8007ca0 con 0x7faac80a6a30 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.549+0000 7faac7fff640 10 monclient: dump: 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 10 monclient: shutdown 2024-08-19T11:10:40.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 -- 172.21.15.71:0/3393431942 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 msgr2=0x7faac80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 --2- 172.21.15.71:0/3393431942 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 0x7faac80a57f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faab8009e50 tx=0x7faab802a560 comp rx=0 tx=0).stop 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 -- 172.21.15.71:0/3393431942 shutdown_connections 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 --2- 172.21.15.71:0/3393431942 >> v2:172.21.15.135:3300/0 conn(0x7faac8139860 0x7faac8139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 --2- 172.21.15.71:0/3393431942 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faac80a6e10 0x7faac80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 --2- 172.21.15.71:0/3393431942 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faac80a6a30 0x7faac80a57f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 -- 172.21.15.71:0/3393431942 >> 172.21.15.71:0/3393431942 conn(0x7faac80ac030 msgr2=0x7faac80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 -- 172.21.15.71:0/3393431942 shutdown_connections 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.550+0000 7faacf931640 1 -- 172.21.15.71:0/3393431942 wait complete. 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient: build_initial_monmap 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient: monmap: 2024-08-19T11:10:40.564 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:40.565 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 Processor -- start 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 -- start start 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient: init 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient: _add_conns ranks=[8,0,2,7,1,5,4,6,3] 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faac80a6a30 0x7faac81ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): picked mon.noname-e con 0x7faac80a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 0x7faac8138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): picked mon.noname-a con 0x7faac80a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faac8139860 0x7faac81391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): picked mon.noname-b con 0x7faac8139860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac80a7730 con 0x7faac80a6e10 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7faac813a1a0 con 0x7faac8139860 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7faac80a3ed0 con 0x7faac80a6a30 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.551+0000 7faacf931640 10 monclient(hunting): authenticate will time out at 698.592946s 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faac80a6a30 0x7faac81ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 0x7faac8138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faac8139860 0x7faac81391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faac80a6a30 0x7faac81ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59272/0 (socket says 172.21.15.71:59272) 2024-08-19T11:10:40.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 1 -- 172.21.15.71:0/1701112320 learned_addr learned my addr 172.21.15.71:0/1701112320 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): get_auth_request con 0x7faac80a6a30 auth_method 0 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): get_auth_request con 0x7faac80a6e10 auth_method 0 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): get_auth_request con 0x7faac8139860 auth_method 0 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:40.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacd6cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient(hunting): handle_auth_done global_id 4221 payload 824 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 -- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faac80a6a30 msgr2=0x7faac81ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faac80a6a30 0x7faac81ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 -- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faac8139860 msgr2=0x7faac81391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faac8139860 0x7faac81391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient: _finish_hunting 0 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 monclient: found mon.noname-a 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faaccecc640 1 -- 172.21.15.71:0/1701112320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac8126360 con 0x7faac80a6e10 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.552+0000 7faacdece640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faac8139860 0x7faac81391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faaccecc640 1 -- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 msgr2=0x7faac8138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faaccecc640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 0x7faac8138c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faabc00d5f0 tx=0x7faabc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faabc012c70 con 0x7faac80a6e10 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:40.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: dump: 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc019070 con 0x7faac80a6e10 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faacf931640 5 monclient: authenticate success, global_id 4221 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faabc0148a0 con 0x7faac80a6e10 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faacf931640 10 monclient: _renew_subs 2024-08-19T11:10:40.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faacf931640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac8126640 con 0x7faac80a6e10 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac77fe640 4 set_mon_vals no callback set 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.554+0000 7faac5ffb640 10 monclient: dump: 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:40.573 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.555+0000 7faacf931640 10 monclient: _renew_subs 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.555+0000 7faacf931640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.555+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac8125da0 con 0x7faac80a6e10 2024-08-19T11:10:40.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.555+0000 7faaccecc640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 0x7faac8138c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faabc00d5f0 tx=0x7faabc00dab0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7faabc00f040 osd_map(19..19 src has 1..19) 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.555+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7faabc014430 con 0x7faac80a6e10 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faacf931640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faacf931640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faac5ffb640 1 --2- 172.21.15.71:0/1701112320 >> v2:172.21.15.135:6800/726754104 conn(0x7faab403ea80 0x7faab4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faacf931640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac813a530 con 0x7faac80a6e10 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faacd6cd640 1 --2- 172.21.15.71:0/1701112320 >> v2:172.21.15.135:6800/726754104 conn(0x7faab403ea80 0x7faab4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.556+0000 7faacd6cd640 10 monclient: get_auth_request con 0x7faab403ea80 auth_method 0 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.558+0000 7faacd6cd640 1 --2- 172.21.15.71:0/1701112320 >> v2:172.21.15.135:6800/726754104 conn(0x7faab403ea80 0x7faab4040f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faab8000f80 tx=0x7faab8009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:40.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:40.561+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7faabc00f040 con 0x7faac80a6e10 2024-08-19T11:10:41.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.384+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7faabc050fb0 con 0x7faac80a6e10 2024-08-19T11:10:41.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.384+0000 7faac5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:41.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.384+0000 7faac5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:41.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.564+0000 7faacf931640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:41.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.564+0000 7faacf931640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:41.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.564+0000 7faacf931640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:41.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.564+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faac8125520 con 0x7faac80a6e10 2024-08-19T11:10:41.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.565+0000 7faac5ffb640 1 -- 172.21.15.71:0/1701112320 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10931 (secure 0 0 0) 0x7faabc0129e0 con 0x7faac80a6e10 2024-08-19T11:10:41.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.565+0000 7faac5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:41.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.565+0000 7faac5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:41.566 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:41.566 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:39.654137+0000","last_up_change":"2024-08-19T11:10:28.285326+0000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T11:10:28.605759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-19T11:10:35.665770+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1867070009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1867070009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1867070009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1867070009}]},"public_addr":"172.21.15.71:6800/1867070009","cluster_addr":"172.21.15.71:6801/1867070009","heartbeat_back_addr":"172.21.15.71:6803/1867070009","heartbeat_front_addr":"172.21.15.71:6802/1867070009","state":["exists","up"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":227121352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":227121352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":227121352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":227121352}]},"public_addr":"172.21.15.71:6804/227121352","cluster_addr":"172.21.15.71:6805/227121352","heartbeat_back_addr":"172.21.15.71:6807/227121352","heartbeat_front_addr":"172.21.15.71:6806/227121352","state":["exists","up"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":80758171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":80758171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":80758171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":80758171}]},"public_addr":"172.21.15.71:6808/80758171","cluster_addr":"172.21.15.71:6809/80758171","heartbeat_back_addr":"172.21.15.71:6811/80758171","heartbeat_front_addr":"172.21.15.71:6810/80758171","state":["exists","up"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":3339144447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3339144447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3339144447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6807","nonce":3339144447}]},"public_addr":"172.21.15.135:6805/3339144447","cluster_addr":"172.21.15.135:6806/3339144447","heartbeat_back_addr":"172.21.15.135:6808/3339144447","heartbeat_front_addr":"172.21.15.135:6807/3339144447","state":["exists","up"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":879361358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":879361358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":879361358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6811","nonce":879361358}]},"public_addr":"172.21.15.135:6809/879361358","cluster_addr":"172.21.15.135:6810/879361358","heartbeat_back_addr":"172.21.15.135:6812/879361358","heartbeat_front_addr":"172.21.15.135:6811/879361358","state":["exists","up"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":2277825240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2277825240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2277825240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6803","nonce":2277825240}]},"public_addr":"172.21.15.135:6801/2277825240","cluster_addr":"172.21.15.135:6802/2277825240","heartbeat_back_addr":"172.21.15.135:6804/2277825240","heartbeat_front_addr":"172.21.15.135:6803/2277825240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.215895+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.920536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.414247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.789439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:27.153740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.131984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:41.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 >> v2:172.21.15.135:6800/726754104 conn(0x7faab403ea80 msgr2=0x7faab4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:41.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 --2- 172.21.15.71:0/1701112320 >> v2:172.21.15.135:6800/726754104 conn(0x7faab403ea80 0x7faab4040f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faab8000f80 tx=0x7faab8009000 comp rx=0 tx=0).stop 2024-08-19T11:10:41.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 10 monclient: shutdown 2024-08-19T11:10:41.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 msgr2=0x7faac8138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 0x7faac8138c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faabc00d5f0 tx=0x7faabc00dab0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 shutdown_connections 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 --2- 172.21.15.71:0/1701112320 >> v2:172.21.15.135:6800/726754104 conn(0x7faab403ea80 0x7faab4040f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faac8139860 0x7faac81391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac80a6e10 0x7faac8138c80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 --2- 172.21.15.71:0/1701112320 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faac80a6a30 0x7faac81ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 >> 172.21.15.71:0/1701112320 conn(0x7faac80ac030 msgr2=0x7faac81c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 shutdown_connections 2024-08-19T11:10:41.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.567+0000 7faacf931640 1 -- 172.21.15.71:0/1701112320 wait complete. 2024-08-19T11:10:41.579 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-19T11:10:41.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.674+0000 7f641f3f4640 10 monclient: get_monmap_and_config 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.674+0000 7f641f3f4640 10 monclient: build_initial_monmap 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.674+0000 7f641f3f4640 10 monclient: monmap: 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:41.675361+0000 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:41.675361+0000 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:41.677 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.675+0000 7f641f3f4640 1 Processor -- start 2024-08-19T11:10:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.675+0000 7f641f3f4640 1 -- start start 2024-08-19T11:10:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.675+0000 7f641f3f4640 10 monclient: init 2024-08-19T11:10:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.675+0000 7f641f3f4640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.675+0000 7f641f3f4640 10 monclient: _add_conns ranks=[4,2,3,10,9,6,1,5,8,7,0] 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.675+0000 7f641f3f4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 0x7f64180a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): picked mon.noname-c con 0x7f64180a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 0x7f64180a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): picked mon.noname-b con 0x7f64180a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6418139860 0x7f6418139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): picked mon.noname-g con 0x7f6418139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f64180a4f90 con 0x7f64180a6e10 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f64180a6380 con 0x7f6418139860 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:41.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f64180a49d0 con 0x7f64180a6a30 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641f3f4640 10 monclient(hunting): authenticate will time out at 699.717065s 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 0x7f64180a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 0x7f64180a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 0x7f64180a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46826/0 (socket says 172.21.15.71:46826) 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 1 -- 172.21.15.71:0/3099621155 learned_addr learned my addr 172.21.15.71:0/3099621155 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): get_auth_request con 0x7f64180a6a30 auth_method 0 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): get_auth_request con 0x7f64180a6e10 auth_method 0 2024-08-19T11:10:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d991640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6418139860 0x7f6418139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d991640 10 monclient(hunting): get_auth_request con 0x7f6418139860 auth_method 0 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d991640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient(hunting): handle_auth_done global_id 4304 payload 274 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 -- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 msgr2=0x7f64180a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 0x7f64180a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 -- 172.21.15.71:0/3099621155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6418139860 msgr2=0x7f6418139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6418139860 0x7f6418139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient: _finish_hunting 0 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 monclient: found mon.noname-b 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641c98f640 1 -- 172.21.15.71:0/3099621155 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64180a46f0 con 0x7f64180a6e10 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.676+0000 7f641d190640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 0x7f64180a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641c98f640 1 -- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 msgr2=0x7f64180a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641c98f640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 0x7f64180a71f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6408009800 tx=0x7f6408029fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5860d01916b54ea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 1 -- 172.21.15.71:0/3099621155 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6408037070 con 0x7f64180a6e10 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: dump: 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:41.688 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: _finish_auth 0 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 1 -- 172.21.15.71:0/3099621155 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640802acf0 con 0x7f64180a6e10 2024-08-19T11:10:41.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641f3f4640 5 monclient: authenticate success, global_id 4304 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641f3f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641f3f4640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 1 -- 172.21.15.71:0/3099621155 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6408030c20 con 0x7f64180a6e10 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641f3f4640 4 set_mon_vals no callback set 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f640ffff640 10 monclient: dump: 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:41.691 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.679+0000 7f641f3f4640 10 monclient: shutdown 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 -- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 msgr2=0x7f64180a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 0x7f64180a71f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6408009800 tx=0x7f6408029fd0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 -- 172.21.15.71:0/3099621155 shutdown_connections 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6418139860 0x7f6418139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64180a6e10 0x7f64180a71f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 --2- 172.21.15.71:0/3099621155 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64180a6a30 0x7f64180a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 -- 172.21.15.71:0/3099621155 >> 172.21.15.71:0/3099621155 conn(0x7f64180ac030 msgr2=0x7f64180ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 -- 172.21.15.71:0/3099621155 shutdown_connections 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 1 -- 172.21.15.71:0/3099621155 wait complete. 2024-08-19T11:10:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 10 monclient: build_initial_monmap 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.680+0000 7f641f3f4640 10 monclient: monmap: 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 Processor -- start 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 -- start start 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient: init 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient: _add_conns ranks=[1,6,7,4,3,2,5,0,8] 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64180a6a30 0x7f64181ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): picked mon.noname-f con 0x7f64180a6a30 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:41.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): picked mon.noname-d con 0x7f64180a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6418139860 0x7f6418138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): picked mon.noname-i con 0x7f6418139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64180a7730 con 0x7f64180a6a30 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f641813a1a0 con 0x7f64180a6e10 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f64180a5910 con 0x7f6418139860 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641f3f4640 10 monclient(hunting): authenticate will time out at 699.722549s 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44656/0 (socket says 172.21.15.71:44656) 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 -- 172.21.15.71:0/2517358071 learned_addr learned my addr 172.21.15.71:0/2517358071 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): get_auth_request con 0x7f64180a6e10 auth_method 0 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64180a6a30 0x7f64181ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): get_auth_request con 0x7f64180a6a30 auth_method 0 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:41.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d991640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6418139860 0x7f6418138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d991640 10 monclient(hunting): get_auth_request con 0x7f6418139860 auth_method 0 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d991640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d991640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:41.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d190640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient(hunting): handle_auth_done global_id 4281 payload 824 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 -- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6418139860 msgr2=0x7f6418138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6418139860 0x7f6418138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 -- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64180a6a30 msgr2=0x7f64181ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64180a6a30 0x7f64181ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient: _finish_hunting 0 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 monclient: found mon.noname-d 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641c98f640 1 -- 172.21.15.71:0/2517358071 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6418126460 con 0x7f64180a6e10 2024-08-19T11:10:41.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.681+0000 7f641d991640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6418139860 0x7f6418138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641c98f640 1 -- 172.21.15.71:0/2517358071 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 msgr2=0x7f64181389a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641c98f640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6408035040 tx=0x7f64080046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6408041020 con 0x7f64180a6e10 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: dump: 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6408032440 con 0x7f64180a6e10 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 5 monclient: authenticate success, global_id 4281 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 10 monclient: _renew_subs 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6418139420 con 0x7f64180a6e10 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6408037040 con 0x7f64180a6e10 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640dffb640 10 monclient: dump: 2024-08-19T11:10:41.703 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 10 monclient: _renew_subs 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f6418124100 con 0x7f64180a6e10 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.684+0000 7f640f7fe640 4 set_mon_vals no callback set 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f641f3f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f641f3f4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f641f3f4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f641c98f640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6408035040 tx=0x7f64080046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f6408071d30 osd_map(19..19 src has 1..19) 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641813a500 con 0x7f64180a6e10 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6408044020 con 0x7f64180a6e10 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.685+0000 7f640dffb640 1 --2- 172.21.15.71:0/2517358071 >> v2:172.21.15.135:6800/726754104 conn(0x7f63fc03ea80 0x7f63fc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:41.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.686+0000 7f641d190640 1 --2- 172.21.15.71:0/2517358071 >> v2:172.21.15.135:6800/726754104 conn(0x7f63fc03ea80 0x7f63fc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:41.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.686+0000 7f641d190640 10 monclient: get_auth_request con 0x7f63fc03ea80 auth_method 0 2024-08-19T11:10:41.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.688+0000 7f641d190640 1 --2- 172.21.15.71:0/2517358071 >> v2:172.21.15.135:6800/726754104 conn(0x7f63fc03ea80 0x7f63fc040f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6414006ca0 tx=0x7f6414009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:41.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:41.690+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f6408071d30 con 0x7f64180a6e10 2024-08-19T11:10:42.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.513+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f640804b030 con 0x7f64180a6e10 2024-08-19T11:10:42.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.513+0000 7f640dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:42.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.513+0000 7f640dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:42.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.690+0000 7f641f3f4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:42.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.690+0000 7f641f3f4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:42.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.690+0000 7f641f3f4640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.690+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f641806ca70 con 0x7f64180a6e10 2024-08-19T11:10:42.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.691+0000 7f640dffb640 1 -- 172.21.15.71:0/2517358071 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10931 (secure 0 0 0) 0x7f6408003db0 con 0x7f64180a6e10 2024-08-19T11:10:42.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.691+0000 7f640dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:42.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.691+0000 7f640dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:42.693 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:39.654137+0000","last_up_change":"2024-08-19T11:10:28.285326+0000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T11:10:28.605759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-19T11:10:35.665770+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1867070009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1867070009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1867070009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1867070009}]},"public_addr":"172.21.15.71:6800/1867070009","cluster_addr":"172.21.15.71:6801/1867070009","heartbeat_back_addr":"172.21.15.71:6803/1867070009","heartbeat_front_addr":"172.21.15.71:6802/1867070009","state":["exists","up"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":227121352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":227121352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":227121352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":227121352}]},"public_addr":"172.21.15.71:6804/227121352","cluster_addr":"172.21.15.71:6805/227121352","heartbeat_back_addr":"172.21.15.71:6807/227121352","heartbeat_front_addr":"172.21.15.71:6806/227121352","state":["exists","up"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":80758171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":80758171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":80758171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":80758171}]},"public_addr":"172.21.15.71:6808/80758171","cluster_addr":"172.21.15.71:6809/80758171","heartbeat_back_addr":"172.21.15.71:6811/80758171","heartbeat_front_addr":"172.21.15.71:6810/80758171","state":["exists","up"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":3339144447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3339144447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3339144447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6807","nonce":3339144447}]},"public_addr":"172.21.15.135:6805/3339144447","cluster_addr":"172.21.15.135:6806/3339144447","heartbeat_back_addr":"172.21.15.135:6808/3339144447","heartbeat_front_addr":"172.21.15.135:6807/3339144447","state":["exists","up"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":879361358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":879361358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":879361358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6811","nonce":879361358}]},"public_addr":"172.21.15.135:6809/879361358","cluster_addr":"172.21.15.135:6810/879361358","heartbeat_back_addr":"172.21.15.135:6812/879361358","heartbeat_front_addr":"172.21.15.135:6811/879361358","state":["exists","up"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":2277825240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2277825240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2277825240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6803","nonce":2277825240}]},"public_addr":"172.21.15.135:6801/2277825240","cluster_addr":"172.21.15.135:6802/2277825240","heartbeat_back_addr":"172.21.15.135:6804/2277825240","heartbeat_front_addr":"172.21.15.135:6803/2277825240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.215895+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.920536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.414247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.789439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:27.153740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.131984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 >> v2:172.21.15.135:6800/726754104 conn(0x7f63fc03ea80 msgr2=0x7f63fc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 --2- 172.21.15.71:0/2517358071 >> v2:172.21.15.135:6800/726754104 conn(0x7f63fc03ea80 0x7f63fc040f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6414006ca0 tx=0x7f6414009240 comp rx=0 tx=0).stop 2024-08-19T11:10:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 10 monclient: shutdown 2024-08-19T11:10:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 msgr2=0x7f64181389a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6408035040 tx=0x7f64080046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 shutdown_connections 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 --2- 172.21.15.71:0/2517358071 >> v2:172.21.15.135:6800/726754104 conn(0x7f63fc03ea80 0x7f63fc040f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6418139860 0x7f6418138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f64180a6e10 0x7f64181389a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 --2- 172.21.15.71:0/2517358071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64180a6a30 0x7f64181ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 >> 172.21.15.71:0/2517358071 conn(0x7f64180ac030 msgr2=0x7f64181c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 shutdown_connections 2024-08-19T11:10:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.693+0000 7f641f3f4640 1 -- 172.21.15.71:0/2517358071 wait complete. 2024-08-19T11:10:42.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-19T11:10:42.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-19T11:10:42.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-19T11:10:42.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-19T11:10:42.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-19T11:10:42.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7fd98379a640 10 monclient: get_monmap_and_config 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7fd98379a640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7fd98379a640 10 monclient: monmap: 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:42.821882+0000 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:42.821882+0000 2024-08-19T11:10:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:42.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7f41e928b640 10 monclient: get_monmap_and_config 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7f41e928b640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7f41e928b640 10 monclient: monmap: 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:42.822056+0000 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:42.822056+0000 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.821+0000 7fd98379a640 1 Processor -- start 2024-08-19T11:10:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 Processor -- start 2024-08-19T11:10:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 -- start start 2024-08-19T11:10:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient: init 2024-08-19T11:10:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 1 -- start start 2024-08-19T11:10:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 10 monclient: init 2024-08-19T11:10:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient: _add_conns ranks=[2,6,5,10,1,7,8,0,3,4,9] 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 10 monclient: _add_conns ranks=[9,5,8,7,0,2,1,10,4,3,6] 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd97c09b510 0x7fd97c09b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 10 monclient(hunting): picked mon.noname-a con 0x7fd97c09b510 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd97c0a25c0 0x7fd97c0a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 10 monclient(hunting): picked mon.noname-h con 0x7fd97c0a25c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7fd98379a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c0a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 0x7f41e40a1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): picked mon.noname-b con 0x7f41e40a21f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e40a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): picked mon.noname-d con 0x7f41e40a25d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f41e40a3320 0x7f41e40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): picked mon.noname-h con 0x7f41e40a3320 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40a4a10 con 0x7f41e40a21f0 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f41e40a4620 con 0x7f41e40a3320 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f41e40a0b40 con 0x7f41e40a25d0 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e928b640 10 monclient(hunting): authenticate will time out at 700.863947s 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 0x7f41e40a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 0x7f41e40a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44452/0 (socket says 172.21.15.71:44452) 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e2ffd640 1 -- 172.21.15.71:0/839537873 learned_addr learned my addr 172.21.15.71:0/839537873 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.822+0000 7f41e2ffd640 10 monclient(hunting): get_auth_request con 0x7f41e40a21f0 auth_method 0 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c0a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c0a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59286/0 (socket says 172.21.15.71:59286) 2024-08-19T11:10:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e27fc640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e40a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 1 -- 172.21.15.71:0/2816496800 learned_addr learned my addr 172.21.15.71:0/2816496800 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f41e40a3320 0x7f41e40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 10 monclient(hunting): picked mon.noname-e con 0x7fd97c0a42c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): get_auth_request con 0x7f41e40a3320 auth_method 0 2024-08-19T11:10:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd97c0a1be0 con 0x7fd97c09b510 2024-08-19T11:10:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e27fc640 10 monclient(hunting): get_auth_request con 0x7f41e40a25d0 auth_method 0 2024-08-19T11:10:42.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd97c0a5bd0 con 0x7fd97c0a25c0 2024-08-19T11:10:42.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd97c0a25c0 0x7fd97c0a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd97c0a0f90 con 0x7fd97c0a42c0 2024-08-19T11:10:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd98379a640 10 monclient(hunting): authenticate will time out at 700.864415s 2024-08-19T11:10:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): get_auth_request con 0x7fd97c0a42c0 auth_method 0 2024-08-19T11:10:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981d37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 1 --2- 172.21.15.71:0/2816496800 >> v2:172.21.15.71:3300/0 conn(0x7fd97c09b510 0x7fd97c09b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): get_auth_request con 0x7fd97c09b510 auth_method 0 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): get_auth_request con 0x7fd97c0a25c0 auth_method 0 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd980d35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient(hunting): handle_auth_done global_id 4230 payload 274 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 1 -- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 msgr2=0x7fd97c0a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_done global_id 4313 payload 274 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 1 -- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 msgr2=0x7f41e40a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e40a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 1 -- 172.21.15.71:0/839537873 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f41e40a3320 msgr2=0x7f41e40a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f41e40a3320 0x7f41e40a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 1 monclient: found mon.noname-b 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e2ffd640 1 -- 172.21.15.71:0/839537873 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e40a1780 con 0x7f41e40a21f0 2024-08-19T11:10:42.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7f41e37fe640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f41e40a3320 0x7f41e40a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c0a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 1 -- 172.21.15.71:0/2816496800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd97c0a25c0 msgr2=0x7fd97c0a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd97c0a25c0 0x7fd97c0a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.823+0000 7fd981536640 1 monclient: found mon.noname-a 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.824+0000 7fd981536640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.824+0000 7fd981536640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.824+0000 7fd981536640 1 -- 172.21.15.71:0/2816496800 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c0a1900 con 0x7fd97c09b510 2024-08-19T11:10:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.824+0000 7fd981d37640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c0a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.826+0000 7fd981536640 1 -- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97c09b510 msgr2=0x7fd97c09b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.826+0000 7fd981536640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97c09b510 0x7fd97c09b8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9780097a0 tx=0x7fd97802e3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca138d766b479a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e2ffd640 1 -- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 msgr2=0x7f41e40a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e2ffd640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 0x7f41e40a1240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41d40098a0 tx=0x7f41d402a090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa24b403f6e2c4e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 1 -- 172.21.15.71:0/2816496800 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd97803a070 con 0x7fd97c09b510 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: dump: 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 1 -- 172.21.15.71:0/2816496800 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd978033b90 con 0x7fd97c09b510 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 1 -- 172.21.15.71:0/2816496800 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd978033d40 con 0x7fd97c09b510 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd973fff640 10 monclient: dump: 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.847 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd98379a640 5 monclient: authenticate success, global_id 4230 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd98379a640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:42.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd98379a640 4 set_mon_vals no callback set 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 1 -- 172.21.15.71:0/839537873 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f41d4037070 con 0x7f41e40a21f0 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: dump: 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 1 -- 172.21.15.71:0/839537873 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d402adf0 con 0x7f41e40a21f0 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 1 -- 172.21.15.71:0/839537873 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f41d4030c20 con 0x7f41e40a21f0 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e1ffb640 10 monclient: dump: 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e928b640 5 monclient: authenticate success, global_id 4313 2024-08-19T11:10:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd98379a640 10 monclient: shutdown 2024-08-19T11:10:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd98379a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97c09b510 msgr2=0x7fd97c09b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97c09b510 0x7fd97c09b8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9780097a0 tx=0x7fd97802e3d0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e928b640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.827+0000 7f41e928b640 4 set_mon_vals no callback set 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 shutdown_connections 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c0a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd97c0a25c0 0x7fd97c0a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 --2- 172.21.15.71:0/2816496800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd97c09b510 0x7fd97c09b8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 >> 172.21.15.71:0/2816496800 conn(0x7fd97c0a4e70 msgr2=0x7fd97c0a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 shutdown_connections 2024-08-19T11:10:42.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7fd98379a640 1 -- 172.21.15.71:0/2816496800 wait complete. 2024-08-19T11:10:42.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 10 monclient: shutdown 2024-08-19T11:10:42.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 -- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 msgr2=0x7f41e40a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 0x7f41e40a1240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41d40098a0 tx=0x7f41d402a090 comp rx=0 tx=0).stop 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 -- 172.21.15.71:0/839537873 shutdown_connections 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f41e40a3320 0x7f41e40a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e40a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 --2- 172.21.15.71:0/839537873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e40a21f0 0x7f41e40a1240 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 -- 172.21.15.71:0/839537873 >> 172.21.15.71:0/839537873 conn(0x7f41e40a85c0 msgr2=0x7f41e40a89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 -- 172.21.15.71:0/839537873 shutdown_connections 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.828+0000 7f41e928b640 1 -- 172.21.15.71:0/839537873 wait complete. 2024-08-19T11:10:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.829+0000 7fd98379a640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.829+0000 7fd98379a640 10 monclient: monmap: 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.829+0000 7f41e928b640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.829+0000 7f41e928b640 10 monclient: monmap: 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.859 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.860 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.861 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.829+0000 7fd98379a640 1 Processor -- start 2024-08-19T11:10:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7fd98379a640 1 -- start start 2024-08-19T11:10:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7fd98379a640 10 monclient: init 2024-08-19T11:10:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7f41e928b640 1 Processor -- start 2024-08-19T11:10:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7f41e928b640 1 -- start start 2024-08-19T11:10:42.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7f41e928b640 10 monclient: init 2024-08-19T11:10:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7fd98379a640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7fd98379a640 10 monclient: _add_conns ranks=[6,3,8,5,4,2,7,1,0] 2024-08-19T11:10:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.830+0000 7fd98379a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 0x7fd97c1ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): picked mon.noname-d con 0x7fd97c09b510 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient: _add_conns ranks=[6,1,2,3,4,5,7,8,0] 2024-08-19T11:10:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 0x7fd97c1ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e41ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 0x7fd97c1ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44672/0 (socket says 172.21.15.71:44672) 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 1 -- 172.21.15.71:0/1580639890 learned_addr learned my addr 172.21.15.71:0/1580639890 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97c0a25c0 0x7fd97c1caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): picked mon.noname-g con 0x7fd97c0a25c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): picked mon.noname-d con 0x7f41e40a25d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e41ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e41ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44680/0 (socket says 172.21.15.71:44680) 2024-08-19T11:10:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 1 -- 172.21.15.71:0/3150454438 learned_addr learned my addr 172.21.15.71:0/3150454438 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c08ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e40a3320 0x7f41e409a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): picked mon.noname-f con 0x7f41e40a3320 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:42.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e409ad70 0x7f41e4095370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981d37640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c08ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): picked mon.noname-e con 0x7fd97c0a42c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:42.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd980d35640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97c0a25c0 0x7fd97c1caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e37fe640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e409ad70 0x7f41e4095370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e27fc640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e40a3320 0x7f41e409a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c09c370 con 0x7fd97c0a25c0 2024-08-19T11:10:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): picked mon.noname-b con 0x7f41e409ad70 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd97c09be30 con 0x7fd97c09b510 2024-08-19T11:10:42.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41e40a4c20 con 0x7f41e40a3320 2024-08-19T11:10:42.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd97c09ba80 con 0x7fd97c0a42c0 2024-08-19T11:10:42.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40a0860 con 0x7f41e409ad70 2024-08-19T11:10:42.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd98379a640 10 monclient(hunting): authenticate will time out at 700.872924s 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f41e409fbe0 con 0x7f41e40a25d0 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e928b640 10 monclient(hunting): authenticate will time out at 700.872971s 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 10 monclient(hunting): get_auth_request con 0x7f41e40a25d0 auth_method 0 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7f41e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): get_auth_request con 0x7f41e409ad70 auth_method 0 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): get_auth_request con 0x7f41e40a3320 auth_method 0 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 10 monclient(hunting): handle_auth_done global_id 4308 payload 824 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 1 -- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e409ad70 msgr2=0x7f41e4095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 10 monclient(hunting): get_auth_request con 0x7fd97c09b510 auth_method 0 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.831+0000 7fd981536640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): get_auth_request con 0x7fd97c0a42c0 auth_method 0 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): get_auth_request con 0x7fd97c0a25c0 auth_method 0 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd980d35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e409ad70 0x7f41e4095370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 1 -- 172.21.15.71:0/3150454438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e40a3320 msgr2=0x7f41e409a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e40a3320 0x7f41e409a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 1 monclient: found mon.noname-d 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e2ffd640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e40a57f0 con 0x7f41e40a25d0 2024-08-19T11:10:42.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e27fc640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41e40a3320 0x7f41e409a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 10 monclient(hunting): handle_auth_done global_id 4299 payload 824 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 1 -- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 msgr2=0x7fd97c08ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c08ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 1 -- 172.21.15.71:0/1580639890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97c0a25c0 msgr2=0x7fd97c1caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd97c0a25c0 0x7fd97c1caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 1 monclient: found mon.noname-d 2024-08-19T11:10:42.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981536640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c099250 con 0x7fd97c09b510 2024-08-19T11:10:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7fd981d37640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd97c0a42c0 0x7fd97c08ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.832+0000 7f41e37fe640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f41e409ad70 0x7f41e4095370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd981536640 1 -- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 msgr2=0x7fd97c1ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd981536640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 0x7fd97c1ca590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9780096f0 tx=0x7fd9780046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e2ffd640 1 -- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 msgr2=0x7f41e41ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e2ffd640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e41ce750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f41d402a600 tx=0x7f41d40046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd97803a040 con 0x7fd97c09b510 2024-08-19T11:10:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 10 monclient: dump: 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.881 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd971ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 5 monclient: authenticate success, global_id 4299 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 10 monclient: _renew_subs 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c090580 con 0x7fd97c09b510 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f41d4041020 con 0x7f41e40a25d0 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: dump: 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.883 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d4003bd0 con 0x7f41e40a25d0 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f41d4037040 con 0x7f41e40a25d0 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:42.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 10 monclient: _renew_subs 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41cb7fe640 10 monclient: dump: 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.886 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 5 monclient: authenticate success, global_id 4308 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 10 monclient: _renew_subs 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e40a3a50 con 0x7f41e40a25d0 2024-08-19T11:10:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 10 monclient: _renew_subs 2024-08-19T11:10:42.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e40990d0 con 0x7f41e40a25d0 2024-08-19T11:10:42.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7f41e17fa640 4 set_mon_vals no callback set 2024-08-19T11:10:42.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7f41e928b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41e40a2de0 con 0x7f41e40a25d0 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.835+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c092040 con 0x7fd97c09b510 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd98379a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd978012110 con 0x7fd97c09b510 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd97c0a5f60 con 0x7fd97c09b510 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd971ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd978003610 con 0x7fd97c09b510 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd971ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd971ffb640 10 monclient: dump: 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.836+0000 7fd9737fe640 4 set_mon_vals no callback set 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.837+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd97803e070 con 0x7fd97c09b510 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.837+0000 7fd971ffb640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.135:6800/726754104 conn(0x7fd96003ea80 0x7fd960040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fd978072500 con 0x7fd97c09b510 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd971ffb640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.71:6808/80758171 conn(0x7fd960044520 0x7fd960046960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 --> v2:172.21.15.71:6808/80758171 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd978033b90 con 0x7fd960044520 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd9780728b0 con 0x7fd97c09b510 2024-08-19T11:10:42.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd971ffb640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-19T11:10:42.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f41d4044020 con 0x7f41e40a25d0 2024-08-19T11:10:42.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd980d35640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.135:6800/726754104 conn(0x7fd96003ea80 0x7fd960040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd980d35640 10 monclient: get_auth_request con 0x7fd96003ea80 auth_method 0 2024-08-19T11:10:42.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd981d37640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.71:6808/80758171 conn(0x7fd960044520 0x7fd960046960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7fd981d37640 10 monclient: get_auth_request con 0x7fd960044520 auth_method 0 2024-08-19T11:10:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.135:6800/726754104 conn(0x7f41d003ea80 0x7f41d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f41d4072570 con 0x7f41e40a25d0 2024-08-19T11:10:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.71:6800/1867070009 conn(0x7f41d0044610 0x7f41d0046a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 --> v2:172.21.15.71:6800/1867070009 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41d402be20 con 0x7f41d0044610 2024-08-19T11:10:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f41d4072850 con 0x7f41e40a25d0 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41cb7fe640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41e27fc640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.135:6800/726754104 conn(0x7f41d003ea80 0x7f41d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41e27fc640 10 monclient: get_auth_request con 0x7f41d003ea80 auth_method 0 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41e37fe640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.71:6800/1867070009 conn(0x7f41d0044610 0x7f41d0046a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.838+0000 7f41e37fe640 10 monclient: get_auth_request con 0x7f41d0044610 auth_method 0 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.840+0000 7fd980d35640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.135:6800/726754104 conn(0x7fd96003ea80 0x7fd960040f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0902e0 tx=0x7fd96c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.843+0000 7fd981d37640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.71:6808/80758171 conn(0x7fd960044520 0x7fd960046960 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.843+0000 7f41e27fc640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.135:6800/726754104 conn(0x7f41d003ea80 0x7f41d0040f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41e4096ad0 tx=0x7f41d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.843+0000 7f41e37fe640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.71:6800/1867070009 conn(0x7f41d0044610 0x7f41d0046a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.843+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== osd.2 v2:172.21.15.71:6808/80758171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd978033b90 con 0x7fd960044520 2024-08-19T11:10:42.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.844+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== osd.0 v2:172.21.15.71:6800/1867070009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41d402be20 con 0x7f41d0044610 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.858+0000 7fefc65e6640 10 monclient: get_monmap_and_config 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.858+0000 7fefc65e6640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.858+0000 7fefc65e6640 10 monclient: monmap: 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:42.859132+0000 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:42.859132+0000 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:42.902 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.859+0000 7fefc65e6640 1 Processor -- start 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.859+0000 7fefc65e6640 1 -- start start 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.859+0000 7fefc65e6640 10 monclient: init 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient: _add_conns ranks=[4,3,5,7,8,6,1,9,10,2,0] 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefb802a880 0x7fefb8024f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): picked mon.noname-c con 0x7fefb802a880 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): picked mon.noname-g con 0x7fefb80bcee0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefb80259b0 0x7fefb8026800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): picked mon.noname-h con 0x7fefb80259b0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefb802ac60 con 0x7fefb80bcee0 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fefb80bd8e0 con 0x7fefb802a880 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fefb80288a0 con 0x7fefb80259b0 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc65e6640 10 monclient(hunting): authenticate will time out at 700.901513s 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefb802a880 0x7fefb8024f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefb802a880 0x7fefb8024f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46830/0 (socket says 172.21.15.71:46830) 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 1 -- 172.21.15.71:0/1715775808 learned_addr learned my addr 172.21.15.71:0/1715775808 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 10 monclient(hunting): get_auth_request con 0x7fefb802a880 auth_method 0 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc55e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc4de3640 10 monclient(hunting): get_auth_request con 0x7fefb80bcee0 auth_method 0 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc4de3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc4de3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc4de3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.860+0000 7fefc5de5640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefb80259b0 0x7fefb8026800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc55e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc55e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc55e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc5de5640 10 monclient(hunting): get_auth_request con 0x7fefb80259b0 auth_method 0 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc5de5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc5de5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc5de5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 10 monclient(hunting): handle_auth_done global_id 4305 payload 274 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 1 -- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefb80259b0 msgr2=0x7fefb8026800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefb80259b0 0x7fefb8026800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 1 -- 172.21.15.71:0/1715775808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefb802a880 msgr2=0x7fefb8024f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefb802a880 0x7fefb8024f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 1 monclient: found mon.noname-g 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:10:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc4de3640 1 -- 172.21.15.71:0/1715775808 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb8028b80 con 0x7fefb80bcee0 2024-08-19T11:10:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.861+0000 7fefc5de5640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefb80259b0 0x7fefb8026800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.862+0000 7eff389a3640 10 monclient: get_monmap_and_config 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.862+0000 7eff389a3640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.862+0000 7eff389a3640 10 monclient: monmap: 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:42.863314+0000 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:42.863314+0000 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.863+0000 7eff389a3640 1 Processor -- start 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.863+0000 7eff389a3640 1 -- start start 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.863+0000 7eff389a3640 10 monclient: init 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient: _add_conns ranks=[0,3,4,7,5,9,8,10,6,2,1] 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7eff34132970 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff34132d50 0x7eff3413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): picked mon.noname-g con 0x7eff34132d50 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 0x7eff3413d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 0x7eff3413d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 0x7eff3413d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46844/0 (socket says 172.21.15.71:46844) 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff3259c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7eff34132970 0x7eff340a21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41628/0 (socket says 172.21.15.71:41628) 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): picked mon.noname-c con 0x7eff34133130 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 -- 172.21.15.71:0/2082380667 learned_addr learned my addr 172.21.15.71:0/2082380667 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff34132560 con 0x7eff34132970 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7eff340a5c70 con 0x7eff34132d50 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7eff340a40e0 con 0x7eff34133130 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff389a3640 10 monclient(hunting): authenticate will time out at 700.905480s 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): get_auth_request con 0x7eff34133130 auth_method 0 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 1 --2- 172.21.15.71:0/2082380667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff34132d50 0x7eff3413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7fefc4de3640 1 -- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 msgr2=0x7fefb80262c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80262c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fefb00097d0 tx=0x7fefb002a020 comp rx=0 tx=0).ready entity=mon.3 client_cookie=6ce2411940b85428 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): get_auth_request con 0x7eff34132d50 auth_method 0 2024-08-19T11:10:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff31d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient(hunting): handle_auth_done global_id 4270 payload 274 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 -- 172.21.15.71:0/2082380667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff34132d50 msgr2=0x7eff3413ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 --2- 172.21.15.71:0/2082380667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff34132d50 0x7eff3413ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 -- 172.21.15.71:0/2082380667 >> v1:172.21.15.71:6789/0 conn(0x7eff34132970 legacy=0x7eff340a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 monclient: found mon.noname-c 2024-08-19T11:10:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:42.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7eff32d9d640 1 -- 172.21.15.71:0/2082380667 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff340a1040 con 0x7eff34133130 2024-08-19T11:10:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7fefb7fff640 1 -- 172.21.15.71:0/1715775808 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb0037070 con 0x7fefb80bcee0 2024-08-19T11:10:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7fefb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7fefb7fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:10:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.864+0000 7fefb7fff640 10 monclient: dump: 2024-08-19T11:10:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 1 -- 172.21.15.71:0/1715775808 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb002ad80 con 0x7fefb80bcee0 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 1 -- 172.21.15.71:0/1715775808 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb0030c20 con 0x7fefb80bcee0 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefb7fff640 10 monclient: dump: 2024-08-19T11:10:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 5 monclient: authenticate success, global_id 4305 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 4 set_mon_vals no callback set 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 10 monclient: shutdown 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 -- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 msgr2=0x7fefb80262c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80262c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fefb00097d0 tx=0x7fefb002a020 comp rx=0 tx=0).stop 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 -- 172.21.15.71:0/1715775808 shutdown_connections 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefb80259b0 0x7fefb8026800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80262c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 --2- 172.21.15.71:0/1715775808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefb802a880 0x7fefb8024f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 -- 172.21.15.71:0/1715775808 >> 172.21.15.71:0/1715775808 conn(0x7fefb8007bf0 msgr2=0x7fefb8008000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 -- 172.21.15.71:0/1715775808 shutdown_connections 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.865+0000 7fefc65e6640 1 -- 172.21.15.71:0/1715775808 wait complete. 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.866+0000 7fce43284640 10 monclient: get_monmap_and_config 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.866+0000 7fce43284640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.866+0000 7fce43284640 10 monclient: monmap: 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:42.866894+0000 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:42.866894+0000 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.866+0000 7fefc65e6640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.866+0000 7fefc65e6640 10 monclient: monmap: 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.925 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.866+0000 7fce43284640 1 Processor -- start 2024-08-19T11:10:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7f3662b08640 10 monclient: get_monmap_and_config 2024-08-19T11:10:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7f3662b08640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 -- start start 2024-08-19T11:10:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient: init 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7f3662b08640 10 monclient: monmap: 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:42.867724+0000 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:42.867724+0000 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fefc65e6640 1 Processor -- start 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fefc65e6640 1 -- start start 2024-08-19T11:10:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fefc65e6640 10 monclient: init 2024-08-19T11:10:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient: _add_conns ranks=[3,5,2,1,9,0,10,4,6,7,8] 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0a02b0 0x7fce3c0a0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): picked mon.noname-g con 0x7fce3c0a02b0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce3c0a4da0 0x7fce3c0a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): picked mon.noname-h con 0x7fce3c0a4da0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 0x7fce3c136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): picked mon.noname-b con 0x7fce3c09fbb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0a1110 con 0x7fce3c09fbb0 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0a25e0 con 0x7fce3c0a02b0 2024-08-19T11:10:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fce3c0a1d40 con 0x7fce3c0a4da0 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce43284640 10 monclient(hunting): authenticate will time out at 700.908756s 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 0x7fce3c136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fefc65e6640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 0x7fce3c136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44466/0 (socket says 172.21.15.71:44466) 2024-08-19T11:10:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 1 -- 172.21.15.71:0/2562318247 learned_addr learned my addr 172.21.15.71:0/2562318247 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 10 monclient(hunting): get_auth_request con 0x7fce3c09fbb0 auth_method 0 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fce41821640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce3c0a4da0 0x7fce3c0a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.867+0000 7fefc65e6640 10 monclient: _add_conns ranks=[2,1,3,6,8,0,5,4,7] 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): get_auth_request con 0x7fce3c0a4da0 auth_method 0 2024-08-19T11:10:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 0x7fefb8021430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff32d9d640 1 -- 172.21.15.71:0/2082380667 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 msgr2=0x7eff3413d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff32d9d640 1 --2- 172.21.15.71:0/2082380667 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 0x7eff3413d2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009eb0 tx=0x7eff2c02a5f0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=faf65ed59dc2bf6c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41020640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0a02b0 0x7fce3c0a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41020640 10 monclient(hunting): get_auth_request con 0x7fce3c0a02b0 auth_method 0 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41020640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41020640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41020640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7f3662b08640 1 Processor -- start 2024-08-19T11:10:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): picked mon.noname-b con 0x7fefb80259b0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb802a880 0x7fefb80a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 10 monclient(hunting): handle_auth_done global_id 4331 payload 274 2024-08-19T11:10:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 1 -- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce3c0a4da0 msgr2=0x7fce3c0a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce3c0a4da0 0x7fce3c0a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 0x7fefb8021430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 0x7fefb8021430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44476/0 (socket says 172.21.15.71:44476) 2024-08-19T11:10:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 1 -- 172.21.15.71:0/2082380667 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff2c036070 con 0x7eff34133130 2024-08-19T11:10:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 1 -- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0a02b0 msgr2=0x7fce3c0a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0a02b0 0x7fce3c0a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 1 monclient: found mon.noname-b 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): picked mon.noname-f con 0x7fefb802a880 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce41821640 1 -- 172.21.15.71:0/2562318247 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c0a2ae0 con 0x7fce3c09fbb0 2024-08-19T11:10:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 1 -- 172.21.15.71:0/1373979289 learned_addr learned my addr 172.21.15.71:0/1373979289 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): picked mon.noname-g con 0x7fefb80bcee0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fefb8025600 con 0x7fefb802a880 2024-08-19T11:10:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fefb8025480 con 0x7fefb80259b0 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefb8025780 con 0x7fefb80bcee0 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc65e6640 10 monclient(hunting): authenticate will time out at 700.909564s 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: dump: 2024-08-19T11:10:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.940 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 1 -- 172.21.15.71:0/2082380667 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c007a70 con 0x7eff34133130 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 1 -- 172.21.15.71:0/2082380667 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff2c007c20 con 0x7eff34133130 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff3159a640 10 monclient: dump: 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff389a3640 5 monclient: authenticate success, global_id 4270 2024-08-19T11:10:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff389a3640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7eff389a3640 4 set_mon_vals no callback set 2024-08-19T11:10:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fce4081f640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce3c0a4da0 0x7fce3c0a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): get_auth_request con 0x7fefb80259b0 auth_method 0 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc5de5640 1 --2- 172.21.15.71:0/1373979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc55e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc5de5640 10 monclient(hunting): get_auth_request con 0x7fefb80bcee0 auth_method 0 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc5de5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc5de5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc5de5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1373979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb802a880 0x7fefb80a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc4de3640 10 monclient(hunting): get_auth_request con 0x7fefb802a880 auth_method 0 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc4de3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc4de3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7fefc4de3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 10 monclient(hunting): handle_auth_done global_id 4340 payload 824 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 1 -- 172.21.15.71:0/1373979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 msgr2=0x7fefb80a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 1 --2- 172.21.15.71:0/1373979289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefb80bcee0 0x7fefb80a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 1 -- 172.21.15.71:0/1373979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb802a880 msgr2=0x7fefb80a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 1 --2- 172.21.15.71:0/1373979289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefb802a880 0x7fefb80a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 1 monclient: found mon.noname-b 2024-08-19T11:10:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7fefc55e4640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb80a78a0 con 0x7fefb80259b0 2024-08-19T11:10:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7f3662b08640 1 -- start start 2024-08-19T11:10:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.868+0000 7f3662b08640 10 monclient: init 2024-08-19T11:10:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 10 monclient: shutdown 2024-08-19T11:10:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 msgr2=0x7eff3413d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 --2- 172.21.15.71:0/2082380667 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 0x7eff3413d2d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009eb0 tx=0x7eff2c02a5f0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient: _add_conns ranks=[6,1,5,4,8,3,10,2,9,0,7] 2024-08-19T11:10:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f365c0a47c0 0x7f365c0a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): picked mon.noname-d con 0x7f365c0a47c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 shutdown_connections 2024-08-19T11:10:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f365c0a50e0 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 --2- 172.21.15.71:0/2082380667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff34132d50 0x7eff3413ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 0x7f365c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): picked mon.noname-h con 0x7f365c136c80 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365c0743e0 con 0x7f365c0a50e0 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f365c0a0650 con 0x7f365c136c80 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f365c0a2650 con 0x7f365c0a47c0 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 --2- 172.21.15.71:0/2082380667 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7eff34133130 0x7eff3413d2d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f3662b08640 10 monclient(hunting): authenticate will time out at 700.910709s 2024-08-19T11:10:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 >> 172.21.15.71:0/2082380667 conn(0x7eff340a4e70 msgr2=0x7eff340a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 shutdown_connections 2024-08-19T11:10:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7eff389a3640 1 -- 172.21.15.71:0/2082380667 wait complete. 2024-08-19T11:10:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f365bfff640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f365c0a50e0 0x7f365c136570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:42174/0 (socket says 172.21.15.71:42174) 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36610a5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 0x7f365c13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f365bfff640 1 -- 172.21.15.71:0/4269670490 learned_addr learned my addr 172.21.15.71:0/4269670490 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36608a4640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f365c0a47c0 0x7f365c0a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36610a5640 10 monclient(hunting): get_auth_request con 0x7f365c136c80 auth_method 0 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36610a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36610a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36610a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36608a4640 10 monclient(hunting): get_auth_request con 0x7f365c0a47c0 auth_method 0 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36608a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36608a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.869+0000 7f36608a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36608a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36608a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36608a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 10 monclient(hunting): handle_auth_done global_id 14288 payload 274 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 1 -- 172.21.15.71:0/4269670490 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f365c0a47c0 msgr2=0x7f365c0a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f365c0a47c0 0x7f365c0a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 1 -- 172.21.15.71:0/4269670490 >> v1:172.21.15.135:6789/0 conn(0x7f365c0a50e0 legacy=0x7f365c136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 1 monclient: found mon.noname-h 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36610a5640 1 -- 172.21.15.71:0/4269670490 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c0a62f0 con 0x7f365c136c80 2024-08-19T11:10:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7f36608a4640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f365c0a47c0 0x7f365c0a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7eff389a3640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.870+0000 7eff389a3640 10 monclient: monmap: 2024-08-19T11:10:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 1 Processor -- start 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 1 -- start start 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 10 monclient: init 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7fefc55e4640 1 -- 172.21.15.71:0/1373979289 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 msgr2=0x7fefb8021430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7fefc55e4640 1 --2- 172.21.15.71:0/1373979289 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 0x7fefb8021430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0136e0 tx=0x7fefbc009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 10 monclient: _add_conns ranks=[2,1,6,4,5,7,8,3,0] 2024-08-19T11:10:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 0x7eff341c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 10 monclient(hunting): picked mon.noname-b con 0x7eff34132970 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.871+0000 7eff389a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff34132d50 0x7eff34131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): picked mon.noname-f con 0x7eff34132d50 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7eff34133130 0x7eff341c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 0x7eff341c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): picked mon.noname-d con 0x7eff34133130 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 0x7eff341c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44492/0 (socket says 172.21.15.71:44492) 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff34069040 con 0x7eff34132d50 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 -- 172.21.15.71:0/1869229741 learned_addr learned my addr 172.21.15.71:0/1869229741 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7eff340a1600 con 0x7eff34132970 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7eff340691c0 con 0x7eff34133130 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff389a3640 10 monclient(hunting): authenticate will time out at 700.913149s 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): get_auth_request con 0x7eff34132970 auth_method 0 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 1 --2- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7eff34133130 0x7eff341c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): get_auth_request con 0x7eff34133130 auth_method 0 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 1 --2- 172.21.15.71:0/1869229741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff34132d50 0x7eff34131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): get_auth_request con 0x7eff34132d50 auth_method 0 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff32d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff31d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient(hunting): handle_auth_done global_id 4349 payload 824 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 -- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7eff34133130 msgr2=0x7eff341c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 --2- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7eff34133130 0x7eff341c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 -- 172.21.15.71:0/1869229741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff34132d50 msgr2=0x7eff34131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 --2- 172.21.15.71:0/1869229741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff34132d50 0x7eff34131ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 monclient: found mon.noname-b 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.872+0000 7eff3259c640 1 -- 172.21.15.71:0/1869229741 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff34072df0 con 0x7eff34132970 2024-08-19T11:10:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f36610a5640 1 -- 172.21.15.71:0/4269670490 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 msgr2=0x7f365c13ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f36610a5640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 0x7f365c13ea50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3654009dc0 tx=0x7f365402a490 comp rx=0 tx=0).ready entity=mon.5 client_cookie=f98fe75846fefb35 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 1 -- 172.21.15.71:0/4269670490 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3654007bc0 con 0x7f365c136c80 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: dump: 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 1 -- 172.21.15.71:0/4269670490 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654007d80 con 0x7f365c136c80 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f3662b08640 5 monclient: authenticate success, global_id 14288 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f3662b08640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 1 -- 172.21.15.71:0/4269670490 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3654031870 con 0x7f365c136c80 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f3662b08640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f3662b08640 4 set_mon_vals no callback set 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7f365b7fe640 10 monclient: dump: 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce41821640 1 -- 172.21.15.71:0/2562318247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 msgr2=0x7fce3c136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce41821640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 0x7fce3c136570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e80 tx=0x7fce3402a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b032199c9198fd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefbc0137d0 con 0x7fefb80259b0 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: dump: 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc021070 con 0x7fefb80259b0 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefbc01bc10 con 0x7fefb80259b0 2024-08-19T11:10:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb5ffb640 10 monclient: dump: 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefb77fe640 4 set_mon_vals no callback set 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fefc65e6640 5 monclient: authenticate success, global_id 4340 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fefc65e6640 10 monclient: _renew_subs 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fefc65e6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fefc65e6640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb80227f0 con 0x7fefb80259b0 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 1 -- 172.21.15.71:0/2562318247 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce34036070 con 0x7fce3c09fbb0 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: dump: 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fefc65e6640 10 monclient: _renew_subs 2024-08-19T11:10:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fefc65e6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fefc65e6640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb80a75c0 con 0x7fefb80259b0 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 1 -- 172.21.15.71:0/2562318247 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce34007a70 con 0x7fce3c09fbb0 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce43284640 5 monclient: authenticate success, global_id 4331 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce43284640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce43284640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce43284640 4 set_mon_vals no callback set 2024-08-19T11:10:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 1 -- 172.21.15.71:0/2562318247 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce34007ca0 con 0x7fce3c09fbb0 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.873+0000 7fce33fff640 10 monclient: dump: 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 10 monclient: shutdown 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 1 -- 172.21.15.71:0/4269670490 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 msgr2=0x7f365c13ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 0x7f365c13ea50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3654009dc0 tx=0x7f365402a490 comp rx=0 tx=0).stop 2024-08-19T11:10:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 --> v2:172.21.15.71:6808/80758171 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd97c0a5f60 con 0x7fd960044520 2024-08-19T11:10:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 1 -- 172.21.15.71:0/4269670490 shutdown_connections 2024-08-19T11:10:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f365c136c80 0x7f365c13ea50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 1 --2- 172.21.15.71:0/4269670490 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f365c0a47c0 0x7f365c0a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7f3662b08640 1 -- 172.21.15.71:0/4269670490 >> 172.21.15.71:0/4269670490 conn(0x7f365c0a9470 msgr2=0x7f365c0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 10 monclient: shutdown 2024-08-19T11:10:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 -- 172.21.15.71:0/2562318247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 msgr2=0x7fce3c136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7eff3259c640 1 -- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 msgr2=0x7eff341c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7eff3259c640 1 --2- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 0x7eff341c7f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c450 tx=0x7eff2400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 0x7fce3c136570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e80 tx=0x7fce3402a530 comp rx=0 tx=0).stop 2024-08-19T11:10:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 -- 172.21.15.71:0/2562318247 shutdown_connections 2024-08-19T11:10:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce3c0a4da0 0x7fce3c0a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce3c09fbb0 0x7fce3c136570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd971ffb640 1 -- 172.21.15.71:0/1580639890 <== osd.2 v2:172.21.15.71:6808/80758171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd97c0a5f60 con 0x7fd960044520 2024-08-19T11:10:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 --2- 172.21.15.71:0/2562318247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c0a02b0 0x7fce3c0a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.874+0000 7fce43284640 1 -- 172.21.15.71:0/2562318247 >> 172.21.15.71:0/2562318247 conn(0x7fce3c0a58b0 msgr2=0x7fce3c0a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fce43284640 1 -- 172.21.15.71:0/2562318247 shutdown_connections 2024-08-19T11:10:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7f3662b08640 1 -- 172.21.15.71:0/4269670490 shutdown_connections 2024-08-19T11:10:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fce43284640 1 -- 172.21.15.71:0/2562318247 wait complete. 2024-08-19T11:10:42.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 >> v2:172.21.15.71:6808/80758171 conn(0x7fd960044520 msgr2=0x7fd960046960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.71:6808/80758171 conn(0x7fd960044520 0x7fd960046960 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7f3662b08640 1 -- 172.21.15.71:0/4269670490 wait complete. 2024-08-19T11:10:42.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fefa37fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff24017070 con 0x7eff34132970 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: dump: 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.984 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:42.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef9c000f80 con 0x7fefb80259b0 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff24007490 con 0x7eff34132970 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7eff24007640 con 0x7eff34132970 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff22ffd640 10 monclient: dump: 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff30d99640 4 set_mon_vals no callback set 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 >> v2:172.21.15.135:6800/726754104 conn(0x7fd96003ea80 msgr2=0x7fd960040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 --2- 172.21.15.71:0/1580639890 >> v2:172.21.15.135:6800/726754104 conn(0x7fd96003ea80 0x7fd960040f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0902e0 tx=0x7fd96c009190 comp rx=0 tx=0).stop 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 10 monclient: shutdown 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 msgr2=0x7fd97c1ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 --2- 172.21.15.71:0/1580639890 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd97c09b510 0x7fd97c1ca590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9780096f0 tx=0x7fd9780046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd981d37640 1 -- 172.21.15.71:0/1580639890 reap_dead start 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 shutdown_connections 2024-08-19T11:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 >> 172.21.15.71:0/1580639890 conn(0x7fd97c0a4e70 msgr2=0x7fd97c09dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7f3662b08640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fce43284640 10 monclient: build_initial_monmap 2024-08-19T11:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff389a3640 5 monclient: authenticate success, global_id 4349 2024-08-19T11:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff389a3640 10 monclient: _renew_subs 2024-08-19T11:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7eff389a3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff34074600 con 0x7eff34132970 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7f3662b08640 10 monclient: monmap: 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7eff389a3640 10 monclient: _renew_subs 2024-08-19T11:10:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 --> v2:172.21.15.71:6800/1867070009 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41e406a4d0 con 0x7f41d0044610 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7eff389a3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3412d560 con 0x7eff34132970 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fce43284640 10 monclient: monmap: 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.875+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 shutdown_connections 2024-08-19T11:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fd98379a640 1 -- 172.21.15.71:0/1580639890 wait complete. 2024-08-19T11:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fefbc01b7a0 con 0x7fefb80259b0 2024-08-19T11:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7f3662b08640 1 Processor -- start 2024-08-19T11:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7f3662b08640 1 -- start start 2024-08-19T11:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7f3662b08640 10 monclient: init 2024-08-19T11:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7f41cb7fe640 1 -- 172.21.15.71:0/3150454438 <== osd.0 v2:172.21.15.71:6800/1867070009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41e406a4d0 con 0x7f41d0044610 2024-08-19T11:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fce43284640 1 Processor -- start 2024-08-19T11:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa403ea80 0x7fefa4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fefbc05a3c0 con 0x7fefb80259b0 2024-08-19T11:10:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6805/3339144447 conn(0x7fefa4044610 0x7fefa4046a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fce43284640 1 -- start start 2024-08-19T11:10:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient: init 2024-08-19T11:10:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 --> v2:172.21.15.135:6805/3339144447 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefa40470e0 con 0x7fefa4044610 2024-08-19T11:10:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fefbc061050 con 0x7fefb80259b0 2024-08-19T11:10:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefb5ffb640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-19T11:10:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa403ea80 0x7fefa4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.876+0000 7fefc4de3640 10 monclient: get_auth_request con 0x7fefa403ea80 auth_method 0 2024-08-19T11:10:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 >> v2:172.21.15.71:6800/1867070009 conn(0x7f41d0044610 msgr2=0x7f41d0046a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.71:6800/1867070009 conn(0x7f41d0044610 0x7f41d0046a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7eff389a3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff340a75b0 con 0x7eff34132970 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient: _add_conns ranks=[8,1,0,3,4,7,6,5,2] 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f365c0a47c0 0x7f365c136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): picked mon.noname-e con 0x7f365c0a47c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 0x7f365c072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): picked mon.noname-f con 0x7f365c0a50e0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 >> v2:172.21.15.135:6800/726754104 conn(0x7f41d003ea80 msgr2=0x7f41d0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 --2- 172.21.15.71:0/3150454438 >> v2:172.21.15.135:6800/726754104 conn(0x7f41d003ea80 0x7f41d0040f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f41e4096ad0 tx=0x7f41d8008040 comp rx=0 tx=0).stop 2024-08-19T11:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 10 monclient: shutdown 2024-08-19T11:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 msgr2=0x7f41e41ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 --2- 172.21.15.71:0/3150454438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f41e40a25d0 0x7f41e41ce750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f41d402a600 tx=0x7f41d40046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e37fe640 1 -- 172.21.15.71:0/3150454438 reap_dead start 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 shutdown_connections 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 >> 172.21.15.71:0/3150454438 conn(0x7f41e40a85c0 msgr2=0x7f41e409d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fefc5de5640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6805/3339144447 conn(0x7fefa4044610 0x7fefa4046a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fefc5de5640 10 monclient: get_auth_request con 0x7fefa4044610 auth_method 0 2024-08-19T11:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 0x7f365c072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 shutdown_connections 2024-08-19T11:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f41e928b640 1 -- 172.21.15.71:0/3150454438 wait complete. 2024-08-19T11:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f365c136c80 0x7f365c072670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): picked mon.noname-a con 0x7f365c136c80 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0a0990 con 0x7f365c136c80 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0a5520 con 0x7f365c0a50e0 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f365c0a3030 con 0x7f365c0a47c0 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f3662b08640 10 monclient(hunting): authenticate will time out at 700.918869s 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 0x7f365c072130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:36860/0 (socket says 172.21.15.71:36860) 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 1 -- 172.21.15.71:0/4142486427 learned_addr learned my addr 172.21.15.71:0/4142486427 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 10 monclient(hunting): get_auth_request con 0x7f365c0a50e0 auth_method 0 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7f365bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient: _add_conns ranks=[0,8,3,1,4,7,5,2,6] 2024-08-19T11:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 0x7fce3c1ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): picked mon.noname-a con 0x7fce3c09fbb0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce3c0a02b0 0x7fce3c1ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): picked mon.noname-e con 0x7fce3c0a02b0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c1cac30 0x7fce3c071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): picked mon.noname-g con 0x7fce3c1cac30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c136c30 con 0x7fce3c09fbb0 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c136ab0 con 0x7fce3c1cac30 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fce3c136db0 con 0x7fce3c0a02b0 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce43284640 10 monclient(hunting): authenticate will time out at 700.918934s 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7fce41020640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 0x7fce3c1ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 0x7fce3c1ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47638/0 (socket says 172.21.15.71:47638) 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 -- 172.21.15.71:0/599124726 learned_addr learned my addr 172.21.15.71:0/599124726 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): get_auth_request con 0x7fce3c09fbb0 auth_method 0 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.877+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7eff240057f0 con 0x7eff34132970 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce4081f640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce3c0a02b0 0x7fce3c1ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce4081f640 10 monclient(hunting): get_auth_request con 0x7fce3c0a02b0 auth_method 0 2024-08-19T11:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce4081f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce4081f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce4081f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 1 --2- 172.21.15.71:0/4142486427 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f365c0a47c0 0x7f365c136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): get_auth_request con 0x7f365c0a47c0 auth_method 0 2024-08-19T11:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 1 --2- 172.21.15.71:0/4142486427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f365c136c80 0x7f365c072670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): get_auth_request con 0x7f365c136c80 auth_method 0 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36608a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff22ffd640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6800/726754104 conn(0x7eff14042eb0 0x7eff14045370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f36610a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 10 monclient(hunting): handle_auth_done global_id 4285 payload 824 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 1 -- 172.21.15.71:0/4142486427 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f365c0a47c0 msgr2=0x7f365c136300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 1 --2- 172.21.15.71:0/4142486427 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f365c0a47c0 0x7f365c136300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 1 -- 172.21.15.71:0/4142486427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f365c136c80 msgr2=0x7f365c072670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 1 --2- 172.21.15.71:0/4142486427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f365c136c80 0x7f365c072670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 1 monclient: found mon.noname-f 2024-08-19T11:10:43.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7f365bfff640 1 -- 172.21.15.71:0/4142486427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c0a4ba0 con 0x7f365c0a50e0 2024-08-19T11:10:43.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7eff24050e70 con 0x7eff34132970 2024-08-19T11:10:43.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41821640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c1cac30 0x7fce3c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41821640 10 monclient(hunting): get_auth_request con 0x7fce3c1cac30 auth_method 0 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41821640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41821640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41821640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient(hunting): handle_auth_done global_id 4239 payload 824 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff22ffd640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6801/2277825240 conn(0x7eff140489c0 0x7eff1404ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 --> v2:172.21.15.135:6801/2277825240 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff1404b490 con 0x7eff140489c0 2024-08-19T11:10:43.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7eff24053440 con 0x7eff34132970 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff22ffd640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 -- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce3c0a02b0 msgr2=0x7fce3c1ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce3c0a02b0 0x7fce3c1ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 -- 172.21.15.71:0/599124726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c1cac30 msgr2=0x7fce3c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fce3c1cac30 0x7fce3c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 monclient: found mon.noname-a 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce41020640 1 -- 172.21.15.71:0/599124726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c09dbb0 con 0x7fce3c09fbb0 2024-08-19T11:10:43.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7fce4081f640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce3c0a02b0 0x7fce3c1ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:43.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff32d9d640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6801/2277825240 conn(0x7eff140489c0 0x7eff1404ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.878+0000 7eff32d9d640 10 monclient: get_auth_request con 0x7eff140489c0 auth_method 0 2024-08-19T11:10:43.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.879+0000 7fefc4de3640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa403ea80 0x7fefa4040f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefb8025eb0 tx=0x7fefb002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.879+0000 7eff31d9b640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6800/726754104 conn(0x7eff14042eb0 0x7eff14045370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.880+0000 7eff31d9b640 10 monclient: get_auth_request con 0x7eff14042eb0 auth_method 0 2024-08-19T11:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.880+0000 7f365bfff640 1 -- 172.21.15.71:0/4142486427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 msgr2=0x7f365c072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.880+0000 7f365bfff640 1 --2- 172.21.15.71:0/4142486427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 0x7f365c072130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f364800c430 tx=0x7f364800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce41020640 1 -- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 msgr2=0x7fce3c1ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce41020640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 0x7fce3c1ca1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce3800d990 tx=0x7fce3800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3648017070 con 0x7f365c0a50e0 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: dump: 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3648005cf0 con 0x7f365c0a50e0 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 5 monclient: authenticate success, global_id 4285 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 10 monclient: _renew_subs 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c0737a0 con 0x7f365c0a50e0 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3648007540 con 0x7f365c0a50e0 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f36597fa640 10 monclient: dump: 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f365affd640 4 set_mon_vals no callback set 2024-08-19T11:10:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 10 monclient: _renew_subs 2024-08-19T11:10:43.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c13ef90 con 0x7f365c0a50e0 2024-08-19T11:10:43.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce38015070 con 0x7fce3c09fbb0 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: dump: 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38010470 con 0x7fce3c09fbb0 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce38010a90 con 0x7fce3c09fbb0 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce31ffb640 10 monclient: dump: 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce43284640 5 monclient: authenticate success, global_id 4239 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.881+0000 7fce43284640 10 monclient: _renew_subs 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fce43284640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c09de90 con 0x7fce3c09fbb0 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fefc5de5640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6805/3339144447 conn(0x7fefa4044610 0x7fefa4046a50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7eff31d9b640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6800/726754104 conn(0x7eff14042eb0 0x7eff14045370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff34072ac0 tx=0x7eff2800f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fce32ffd640 4 set_mon_vals no callback set 2024-08-19T11:10:43.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7f3662b08640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3648007070 con 0x7f365c0a50e0 2024-08-19T11:10:43.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f365c137560 con 0x7f365c0a50e0 2024-08-19T11:10:43.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fce43284640 10 monclient: _renew_subs 2024-08-19T11:10:43.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fce43284640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.882+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c0a6dd0 con 0x7fce3c09fbb0 2024-08-19T11:10:43.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36597fa640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6800/726754104 conn(0x7f364003eae0 0x7f3640040fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7fce43284640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce3c09d320 con 0x7fce3c09fbb0 2024-08-19T11:10:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f3648050ea0 con 0x7f365c0a50e0 2024-08-19T11:10:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7eff32d9d640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6801/2277825240 conn(0x7eff140489c0 0x7eff1404ae00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36597fa640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6809/879361358 conn(0x7f3640044580 0x7f36400469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 --> v2:172.21.15.135:6809/879361358 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3640047050 con 0x7f3640044580 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3648056430 con 0x7f365c0a50e0 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36597fa640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36608a4640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6800/726754104 conn(0x7f364003eae0 0x7f3640040fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36608a4640 10 monclient: get_auth_request con 0x7f364003eae0 auth_method 0 2024-08-19T11:10:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== osd.3 v2:172.21.15.135:6805/3339144447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fefa40470e0 con 0x7fefa4044610 2024-08-19T11:10:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36610a5640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6809/879361358 conn(0x7f3640044580 0x7f36400469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7f36610a5640 10 monclient: get_auth_request con 0x7f3640044580 auth_method 0 2024-08-19T11:10:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.883+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fce38018070 con 0x7fce3c09fbb0 2024-08-19T11:10:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce31ffb640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2003ea80 0x7fce20040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== osd.5 v2:172.21.15.135:6801/2277825240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff1404b490 con 0x7eff140489c0 2024-08-19T11:10:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fce38051a20 con 0x7fce3c09fbb0 2024-08-19T11:10:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce31ffb640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.71:6804/227121352 conn(0x7fce200445a0 0x7fce200469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 --> v2:172.21.15.71:6804/227121352 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce38010e50 con 0x7fce200445a0 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce38056220 con 0x7fce3c09fbb0 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce31ffb640 10 monclient: handle_get_version_reply finishing 1 version 19 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce41821640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.71:6804/227121352 conn(0x7fce200445a0 0x7fce200469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.884+0000 7fce41821640 10 monclient: get_auth_request con 0x7fce200445a0 auth_method 0 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.886+0000 7f36608a4640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6800/726754104 conn(0x7f364003eae0 0x7f3640040fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3650009560 tx=0x7f3650009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.886+0000 7fce4081f640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2003ea80 0x7fce20040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.886+0000 7fce4081f640 10 monclient: get_auth_request con 0x7fce2003ea80 auth_method 0 2024-08-19T11:10:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.888+0000 7f36610a5640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6809/879361358 conn(0x7f3640044580 0x7f36400469c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.888+0000 7fce41821640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.71:6804/227121352 conn(0x7fce200445a0 0x7fce200469e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.889+0000 7fce4081f640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2003ea80 0x7fce20040f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce3c073e90 tx=0x7fce2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.889+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== osd.1 v2:172.21.15.71:6804/227121352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce38010e50 con 0x7fce200445a0 2024-08-19T11:10:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.890+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== osd.4 v2:172.21.15.135:6809/879361358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3640047050 con 0x7f3640044580 2024-08-19T11:10:43.033 INFO:teuthology.orchestra.run.smithi071.stdout:51539607557 2024-08-19T11:10:43.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-19T11:10:43.034 INFO:teuthology.orchestra.run.smithi071.stdout:51539607557 2024-08-19T11:10:43.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-19T11:10:43.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.899+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 --> v2:172.21.15.135:6805/3339144447 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef9c002c70 con 0x7fefa4044610 2024-08-19T11:10:43.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.899+0000 7fefb5ffb640 1 -- 172.21.15.71:0/1373979289 <== osd.3 v2:172.21.15.135:6805/3339144447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef9c002c70 con 0x7fefa4044610 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6805/3339144447 conn(0x7fefa4044610 msgr2=0x7fefa4046a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6805/3339144447 conn(0x7fefa4044610 0x7fefa4046a50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa403ea80 msgr2=0x7fefa4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 --2- 172.21.15.71:0/1373979289 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa403ea80 0x7fefa4040f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefb8025eb0 tx=0x7fefb002e000 comp rx=0 tx=0).stop 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 10 monclient: shutdown 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 msgr2=0x7fefb8021430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 --2- 172.21.15.71:0/1373979289 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefb80259b0 0x7fefb8021430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0136e0 tx=0x7fefbc009750 comp rx=0 tx=0).stop 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefc5de5640 1 -- 172.21.15.71:0/1373979289 reap_dead start 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 shutdown_connections 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 >> 172.21.15.71:0/1373979289 conn(0x7fefb8007bf0 msgr2=0x7fefb8023820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 shutdown_connections 2024-08-19T11:10:43.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.900+0000 7fefa37fe640 1 -- 172.21.15.71:0/1373979289 wait complete. 2024-08-19T11:10:43.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 --> v2:172.21.15.135:6801/2277825240 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff340736a0 con 0x7eff140489c0 2024-08-19T11:10:43.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff22ffd640 1 -- 172.21.15.71:0/1869229741 <== osd.5 v2:172.21.15.135:6801/2277825240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff340736a0 con 0x7eff140489c0 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6801/2277825240 conn(0x7eff140489c0 msgr2=0x7eff1404ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6801/2277825240 conn(0x7eff140489c0 0x7eff1404ae00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6800/726754104 conn(0x7eff14042eb0 msgr2=0x7eff14045370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 --2- 172.21.15.71:0/1869229741 >> v2:172.21.15.135:6800/726754104 conn(0x7eff14042eb0 0x7eff14045370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff34072ac0 tx=0x7eff2800f040 comp rx=0 tx=0).stop 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 10 monclient: shutdown 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 msgr2=0x7eff341c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.902+0000 7eff389a3640 1 --2- 172.21.15.71:0/1869229741 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7eff34132970 0x7eff341c7f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c450 tx=0x7eff2400c910 comp rx=0 tx=0).stop 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.903+0000 7eff32d9d640 1 -- 172.21.15.71:0/1869229741 reap_dead start 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.903+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 shutdown_connections 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.903+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 >> 172.21.15.71:0/1869229741 conn(0x7eff340a4e70 msgr2=0x7eff3409f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.903+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 shutdown_connections 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.903+0000 7eff389a3640 1 -- 172.21.15.71:0/1869229741 wait complete. 2024-08-19T11:10:43.040 INFO:teuthology.orchestra.run.smithi071.stdout:51539607557 2024-08-19T11:10:43.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-19T11:10:43.041 INFO:teuthology.orchestra.run.smithi071.stdout:47244640261 2024-08-19T11:10:43.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-19T11:10:43.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 --> v2:172.21.15.71:6804/227121352 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce3c073b30 con 0x7fce200445a0 2024-08-19T11:10:43.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 --> v2:172.21.15.135:6809/879361358 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f365c137560 con 0x7f3640044580 2024-08-19T11:10:43.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce31ffb640 1 -- 172.21.15.71:0/599124726 <== osd.1 v2:172.21.15.71:6804/227121352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce3c073b30 con 0x7fce200445a0 2024-08-19T11:10:43.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7f36597fa640 1 -- 172.21.15.71:0/4142486427 <== osd.4 v2:172.21.15.135:6809/879361358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f365c137560 con 0x7f3640044580 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 >> v2:172.21.15.71:6804/227121352 conn(0x7fce200445a0 msgr2=0x7fce200469e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.71:6804/227121352 conn(0x7fce200445a0 0x7fce200469e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2003ea80 msgr2=0x7fce20040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 --2- 172.21.15.71:0/599124726 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2003ea80 0x7fce20040f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce3c073e90 tx=0x7fce2c008040 comp rx=0 tx=0).stop 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 10 monclient: shutdown 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 msgr2=0x7fce3c1ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 --2- 172.21.15.71:0/599124726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce3c09fbb0 0x7fce3c1ca1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce3800d990 tx=0x7fce3800dd90 comp rx=0 tx=0).stop 2024-08-19T11:10:43.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6809/879361358 conn(0x7f3640044580 msgr2=0x7f36400469c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7f3662b08640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6809/879361358 conn(0x7f3640044580 0x7f36400469c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce41821640 1 -- 172.21.15.71:0/599124726 reap_dead start 2024-08-19T11:10:43.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 shutdown_connections 2024-08-19T11:10:43.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.921+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 >> 172.21.15.71:0/599124726 conn(0x7fce3c0a58b0 msgr2=0x7fce3c1bc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6800/726754104 conn(0x7f364003eae0 msgr2=0x7f3640040fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 --2- 172.21.15.71:0/4142486427 >> v2:172.21.15.135:6800/726754104 conn(0x7f364003eae0 0x7f3640040fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3650009560 tx=0x7f3650009190 comp rx=0 tx=0).stop 2024-08-19T11:10:43.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 10 monclient: shutdown 2024-08-19T11:10:43.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 shutdown_connections 2024-08-19T11:10:43.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 msgr2=0x7f365c072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 --2- 172.21.15.71:0/4142486427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f365c0a50e0 0x7f365c072130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f364800c430 tx=0x7f364800c8f0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f36610a5640 1 -- 172.21.15.71:0/4142486427 reap_dead start 2024-08-19T11:10:43.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7fce43284640 1 -- 172.21.15.71:0/599124726 wait complete. 2024-08-19T11:10:43.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 shutdown_connections 2024-08-19T11:10:43.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 >> 172.21.15.71:0/4142486427 conn(0x7f365c0a9470 msgr2=0x7f365c0a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 shutdown_connections 2024-08-19T11:10:43.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:42.922+0000 7f3662b08640 1 -- 172.21.15.71:0/4142486427 wait complete. 2024-08-19T11:10:43.048 INFO:teuthology.orchestra.run.smithi071.stdout:51539607557 2024-08-19T11:10:43.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-19T11:10:43.049 INFO:teuthology.orchestra.run.smithi071.stdout:51539607556 2024-08-19T11:10:43.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-19T11:10:43.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.186+0000 7fd9d646e640 10 monclient: get_monmap_and_config 2024-08-19T11:10:43.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.186+0000 7f7cb4314640 10 monclient: get_monmap_and_config 2024-08-19T11:10:43.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.186+0000 7f7cb4314640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.186+0000 7f7cb4314640 10 monclient: monmap: 2024-08-19T11:10:43.188 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.188 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.188 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:43.187249+0000 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:43.187249+0000 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.189 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.186+0000 7fd9d646e640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.186+0000 7fd9d646e640 10 monclient: monmap: 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:43.187248+0000 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:43.187248+0000 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.191 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.187+0000 7f7cb4314640 1 Processor -- start 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.187+0000 7f7cb4314640 1 -- start start 2024-08-19T11:10:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.187+0000 7f7cb4314640 10 monclient: init 2024-08-19T11:10:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.187+0000 7fd9d646e640 1 Processor -- start 2024-08-19T11:10:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.187+0000 7fd9d646e640 1 -- start start 2024-08-19T11:10:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.187+0000 7fd9d646e640 10 monclient: init 2024-08-19T11:10:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient: _add_conns ranks=[0,9,5,4,7,3,2,8,6,10,1] 2024-08-19T11:10:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd9d00a6a30 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:43.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9d00a6e10 0x7fd9d00a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): picked mon.noname-a con 0x7fd9d00a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:43.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 0x7fd9d0140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient: _add_conns ranks=[7,2,8,4,0,3,5,6,1,10,9] 2024-08-19T11:10:43.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): picked mon.noname-h con 0x7fd9d013eb10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d00a4f90 con 0x7fd9d00a6a30 2024-08-19T11:10:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): picked mon.noname-i con 0x7f7cac0a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 0x7f7cac0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d00a3650 con 0x7fd9d00a6e10 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd9d00a6380 con 0x7fd9d013eb10 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cffff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd9d00a6a30 0x7fd9d00a57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41638/0 (socket says 172.21.15.71:41638) 2024-08-19T11:10:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d646e640 10 monclient(hunting): authenticate will time out at 701.229331s 2024-08-19T11:10:43.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cffff640 1 -- 172.21.15.71:0/4063518650 learned_addr learned my addr 172.21.15.71:0/4063518650 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:43.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): picked mon.noname-b con 0x7f7cac0a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:43.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7cac139860 0x7f7cac139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): picked mon.noname-e con 0x7f7cac139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:43.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 1 --2- 172.21.15.71:0/4063518650 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 0x7fd9d0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 1 --2- 172.21.15.71:0/4063518650 >> v2:172.21.15.71:3300/0 conn(0x7fd9d00a6e10 0x7fd9d00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): get_auth_request con 0x7fd9d013eb10 auth_method 0 2024-08-19T11:10:43.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): get_auth_request con 0x7fd9d00a6e10 auth_method 0 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac0a4f90 con 0x7f7cac0a6e10 2024-08-19T11:10:43.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7cac0a6380 con 0x7f7cac0a6a30 2024-08-19T11:10:43.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7cac0a49d0 con 0x7f7cac139860 2024-08-19T11:10:43.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_done global_id 14297 payload 274 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 1 -- 172.21.15.71:0/4063518650 >> v2:172.21.15.71:3300/0 conn(0x7fd9d00a6e10 msgr2=0x7fd9d00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 1 --2- 172.21.15.71:0/4063518650 >> v2:172.21.15.71:3300/0 conn(0x7fd9d00a6e10 0x7fd9d00a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 1 -- 172.21.15.71:0/4063518650 >> v1:172.21.15.71:6789/0 conn(0x7fd9d00a6a30 legacy=0x7fd9d00a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 1 monclient: found mon.noname-h 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:43.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7fd9d4a0b640 1 -- 172.21.15.71:0/4063518650 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d00a49d0 con 0x7fd9d013eb10 2024-08-19T11:10:43.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb4314640 10 monclient(hunting): authenticate will time out at 701.229201s 2024-08-19T11:10:43.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb20b0640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 0x7f7cac0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb28b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7cac139860 0x7f7cac139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 0x7f7cac0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44504/0 (socket says 172.21.15.71:44504) 2024-08-19T11:10:43.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 1 -- 172.21.15.71:0/2602115389 learned_addr learned my addr 172.21.15.71:0/2602115389 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 10 monclient(hunting): get_auth_request con 0x7f7cac0a6e10 auth_method 0 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.188+0000 7f7cb18af640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): get_auth_request con 0x7f7cac0a6a30 auth_method 0 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): get_auth_request con 0x7f7cac139860 auth_method 0 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb28b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb20b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 10 monclient(hunting): handle_auth_done global_id 4358 payload 274 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 1 -- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7cac139860 msgr2=0x7f7cac139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7cac139860 0x7f7cac139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 1 -- 172.21.15.71:0/2602115389 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 msgr2=0x7f7cac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 1 monclient: found mon.noname-b 2024-08-19T11:10:43.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:43.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.189+0000 7f7cb18af640 1 -- 172.21.15.71:0/2602115389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac0a46f0 con 0x7f7cac0a6e10 2024-08-19T11:10:43.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.190+0000 7f7cb28b1640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7cac139860 0x7f7cac139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.191+0000 7fd9d4a0b640 1 -- 172.21.15.71:0/4063518650 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 msgr2=0x7fd9d0140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.191+0000 7fd9d4a0b640 1 --2- 172.21.15.71:0/4063518650 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 0x7fd9d0140f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009d90 tx=0x7fd9c802a490 comp rx=0 tx=0).ready entity=mon.5 client_cookie=a145dacd5d2a55a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 1 -- 172.21.15.71:0/4063518650 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9c8007bc0 con 0x7fd9d013eb10 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: dump: 2024-08-19T11:10:43.210 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.211 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 1 -- 172.21.15.71:0/4063518650 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c8007d80 con 0x7fd9d013eb10 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 1 -- 172.21.15.71:0/4063518650 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9c8031870 con 0x7fd9d013eb10 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9ceffd640 10 monclient: dump: 2024-08-19T11:10:43.212 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.213 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9d646e640 5 monclient: authenticate success, global_id 14297 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9d646e640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.192+0000 7fd9d646e640 4 set_mon_vals no callback set 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 10 monclient: shutdown 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 -- 172.21.15.71:0/4063518650 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 msgr2=0x7fd9d0140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 --2- 172.21.15.71:0/4063518650 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 0x7fd9d0140f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009d90 tx=0x7fd9c802a490 comp rx=0 tx=0).stop 2024-08-19T11:10:43.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb18af640 1 -- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 msgr2=0x7f7cac0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 -- 172.21.15.71:0/4063518650 shutdown_connections 2024-08-19T11:10:43.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 --2- 172.21.15.71:0/4063518650 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9d013eb10 0x7fd9d0140f00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 --2- 172.21.15.71:0/4063518650 >> v2:172.21.15.71:3300/0 conn(0x7fd9d00a6e10 0x7fd9d00a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 -- 172.21.15.71:0/4063518650 >> 172.21.15.71:0/4063518650 conn(0x7fd9d00ac030 msgr2=0x7fd9d00ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb18af640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 0x7f7cac0a71f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009b30 tx=0x7f7c9c02a310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e5083c456b4fb3b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 -- 172.21.15.71:0/4063518650 shutdown_connections 2024-08-19T11:10:43.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 1 -- 172.21.15.71:0/4063518650 wait complete. 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 1 -- 172.21.15.71:0/2602115389 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c9c037070 con 0x7f7cac0a6e10 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: dump: 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.217 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 1 -- 172.21.15.71:0/2602115389 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c02ae20 con 0x7f7cac0a6e10 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 1 -- 172.21.15.71:0/2602115389 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c9c030c20 con 0x7f7cac0a6e10 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb10ae640 10 monclient: dump: 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.219 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb4314640 5 monclient: authenticate success, global_id 4358 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb4314640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:43.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7f7cb4314640 4 set_mon_vals no callback set 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.193+0000 7fd9d646e640 10 monclient: monmap: 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:43.221 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7fd9d646e640 1 Processor -- start 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 10 monclient: shutdown 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 -- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 msgr2=0x7f7cac0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 0x7f7cac0a71f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009b30 tx=0x7f7c9c02a310 comp rx=0 tx=0).stop 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 -- 172.21.15.71:0/2602115389 shutdown_connections 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7cac139860 0x7f7cac139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7cac0a6e10 0x7f7cac0a71f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7fd9d646e640 1 -- start start 2024-08-19T11:10:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7fd9d646e640 10 monclient: init 2024-08-19T11:10:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 --2- 172.21.15.71:0/2602115389 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac0a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 -- 172.21.15.71:0/2602115389 >> 172.21.15.71:0/2602115389 conn(0x7f7cac0ac030 msgr2=0x7f7cac0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 -- 172.21.15.71:0/2602115389 shutdown_connections 2024-08-19T11:10:43.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7f7cb4314640 1 -- 172.21.15.71:0/2602115389 wait complete. 2024-08-19T11:10:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7fd9d646e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.194+0000 7fd9d646e640 10 monclient: _add_conns ranks=[1,2,7,0,5,6,4,3,8] 2024-08-19T11:10:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 0x7fd9d013ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): picked mon.noname-f con 0x7fd9d00a6a30 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:43.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9d00a6e10 0x7fd9d0123940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): picked mon.noname-b con 0x7fd9d00a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd9d013eb10 0x7fd9d0123e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): picked mon.noname-i con 0x7fd9d013eb10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00a7730 con 0x7fd9d00a6a30 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d0141440 con 0x7fd9d00a6e10 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd9d0125ad0 con 0x7fd9d013eb10 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d646e640 10 monclient(hunting): authenticate will time out at 701.236093s 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 0x7fd9d013ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 0x7fd9d013ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:36866/0 (socket says 172.21.15.71:36866) 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 -- 172.21.15.71:0/2581830293 learned_addr learned my addr 172.21.15.71:0/2581830293 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): get_auth_request con 0x7fd9d00a6a30 auth_method 0 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd9d013eb10 0x7fd9d0123e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9d00a6e10 0x7fd9d0123940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): get_auth_request con 0x7fd9d013eb10 auth_method 0 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): get_auth_request con 0x7fd9d00a6e10 auth_method 0 2024-08-19T11:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9d4a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7f7cb4314640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7f7cb4314640 10 monclient: monmap: 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient(hunting): handle_auth_done global_id 4294 payload 824 2024-08-19T11:10:43.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 -- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd9d013eb10 msgr2=0x7fd9d0123e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd9d013eb10 0x7fd9d0123e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 -- 172.21.15.71:0/2581830293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9d00a6e10 msgr2=0x7fd9d0123940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7f7cb4314640 1 Processor -- start 2024-08-19T11:10:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9d00a6e10 0x7fd9d0123940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7f7cb4314640 1 -- start start 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7f7cb4314640 10 monclient: init 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 1 monclient: found mon.noname-f 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.195+0000 7fd9cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7fd9cffff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7fd9cffff640 1 -- 172.21.15.71:0/2581830293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d0126ee0 con 0x7fd9d00a6a30 2024-08-19T11:10:43.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7fd9cf7fe640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9d00a6e10 0x7fd9d0123940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient: _add_conns ranks=[7,0,3,1,8,5,4,2,6] 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac127460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): picked mon.noname-i con 0x7f7cac0a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 0x7f7cac124f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): picked mon.noname-a con 0x7f7cac0a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cac139860 0x7f7cac125470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): picked mon.noname-g con 0x7f7cac139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac0a7730 con 0x7f7cac0a6e10 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac13a1a0 con 0x7f7cac139860 2024-08-19T11:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7cac128c60 con 0x7f7cac0a6a30 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb4314640 10 monclient(hunting): authenticate will time out at 701.237557s 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 0x7f7cac124f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 0x7f7cac124f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47674/0 (socket says 172.21.15.71:47674) 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 1 -- 172.21.15.71:0/677584156 learned_addr learned my addr 172.21.15.71:0/677584156 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): get_auth_request con 0x7f7cac0a6e10 auth_method 0 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac127460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): get_auth_request con 0x7f7cac0a6a30 auth_method 0 2024-08-19T11:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb28b1640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cac139860 0x7f7cac125470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb28b1640 10 monclient(hunting): get_auth_request con 0x7f7cac139860 auth_method 0 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb28b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb28b1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb28b1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb20b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 10 monclient(hunting): handle_auth_done global_id 4266 payload 824 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 1 -- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 msgr2=0x7f7cac127460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.196+0000 7f7cb18af640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac127460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 1 -- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cac139860 msgr2=0x7f7cac125470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cac139860 0x7f7cac125470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 1 monclient: found mon.noname-a 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.197+0000 7f7cb18af640 1 -- 172.21.15.71:0/677584156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac0a21f0 con 0x7f7cac0a6e10 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9cffff640 1 -- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 msgr2=0x7fd9d013ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9cffff640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 0x7fd9d013ca40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000c490 tx=0x7fd9c000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9c0005cf0 con 0x7fd9d00a6a30 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: dump: 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.241 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c00074e0 con 0x7fd9d00a6a30 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9c0007690 con 0x7fd9d00a6a30 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ccff9640 10 monclient: dump: 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 5 monclient: authenticate success, global_id 4294 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 10 monclient: _renew_subs 2024-08-19T11:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d01271c0 con 0x7fd9d00a6a30 2024-08-19T11:10:43.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9ce7fc640 4 set_mon_vals no callback set 2024-08-19T11:10:43.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 10 monclient: _renew_subs 2024-08-19T11:10:43.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.198+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d0125ca0 con 0x7fd9d00a6a30 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7cb18af640 1 -- 172.21.15.71:0/677584156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 msgr2=0x7f7cac124f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7cb18af640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 0x7f7cac124f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c02a830 tx=0x7f7c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c9c041020 con 0x7f7cac0a6e10 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: dump: 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.247 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c0044b0 con 0x7f7cac0a6e10 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7c9c037040 con 0x7f7cac0a6e10 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7ca2ffd640 10 monclient: dump: 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.199+0000 7f7cb08ad640 4 set_mon_vals no callback set 2024-08-19T11:10:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 5 monclient: authenticate success, global_id 4266 2024-08-19T11:10:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd9c0007070 con 0x7fd9d00a6a30 2024-08-19T11:10:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9d646e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9d646e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9d646e640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 10 monclient: _renew_subs 2024-08-19T11:10:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9ccff9640 1 --2- 172.21.15.71:0/2581830293 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9bc03eab0 0x7fd9bc040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fd9c0051740 con 0x7fd9d00a6a30 2024-08-19T11:10:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d0125820 con 0x7fd9d00a6a30 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac127df0 con 0x7f7cac0a6e10 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 10 monclient: _renew_subs 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.200+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac138720 con 0x7f7cac0a6e10 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7fd9cf7fe640 1 --2- 172.21.15.71:0/2581830293 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9bc03eab0 0x7fd9bc040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7fd9cf7fe640 10 monclient: get_auth_request con 0x7fd9bc03eab0 auth_method 0 2024-08-19T11:10:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7f7cb4314640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7f7cb4314640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7f7cb4314640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac13a500 con 0x7f7cac0a6e10 2024-08-19T11:10:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.201+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7c9c044020 con 0x7f7cac0a6e10 2024-08-19T11:10:43.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.202+0000 7f7ca2ffd640 1 --2- 172.21.15.71:0/677584156 >> v2:172.21.15.135:6800/726754104 conn(0x7f7c9003eab0 0x7f7c90040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.202+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f7c9c071f00 con 0x7f7cac0a6e10 2024-08-19T11:10:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.203+0000 7fd9cf7fe640 1 --2- 172.21.15.71:0/2581830293 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9bc03eab0 0x7fd9bc040f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00778a0 tx=0x7fd9c4018040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.203+0000 7f7cb20b0640 1 --2- 172.21.15.71:0/677584156 >> v2:172.21.15.135:6800/726754104 conn(0x7f7c9003eab0 0x7f7c90040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.203+0000 7f7cb20b0640 10 monclient: get_auth_request con 0x7f7c9003eab0 auth_method 0 2024-08-19T11:10:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.206+0000 7f7cb20b0640 1 --2- 172.21.15.71:0/677584156 >> v2:172.21.15.135:6800/726754104 conn(0x7f7c9003eab0 0x7f7c90040f70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009b40 tx=0x7f7ca8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.206+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fd9c0010d10 con 0x7fd9d00a6a30 2024-08-19T11:10:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.206+0000 7fd9ccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.206+0000 7fd9ccff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.207+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f7c9c02ae20 con 0x7f7cac0a6e10 2024-08-19T11:10:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.207+0000 7f7ca2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.207+0000 7f7ca2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.225+0000 7f71af59a640 10 monclient: get_monmap_and_config 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.225+0000 7f71af59a640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.225+0000 7f71af59a640 10 monclient: monmap: 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:43.226572+0000 2024-08-19T11:10:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:43.226572+0000 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.226+0000 7f71af59a640 1 Processor -- start 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.226+0000 7f71af59a640 1 -- start start 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.226+0000 7f71af59a640 10 monclient: init 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient: _add_conns ranks=[7,1,5,0,2,8,9,6,10,3,4] 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 0x7f71a80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): picked mon.noname-i con 0x7f71a80a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f71a80a6e10 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f71a813eb10 0x7f71a8140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): picked mon.noname-h con 0x7f71a813eb10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:43.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a80a4f90 con 0x7f71a80a6e10 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f71a80a3650 con 0x7f71a813eb10 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f71a80a6380 con 0x7f71a80a6a30 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71af59a640 10 monclient(hunting): authenticate will time out at 701.268550s 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 0x7f71a80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71acb35640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f71a80a6e10 0x7f71a80a71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:42186/0 (socket says 172.21.15.71:42186) 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71adb37640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f71a813eb10 0x7f71a8140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71acb35640 1 -- 172.21.15.71:0/3074244468 learned_addr learned my addr 172.21.15.71:0/3074244468 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): get_auth_request con 0x7f71a80a6a30 auth_method 0 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71adb37640 10 monclient(hunting): get_auth_request con 0x7f71a813eb10 auth_method 0 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71adb37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71adb37640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71adb37640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71ad336640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.227+0000 7f71adb37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71adb37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71adb37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 10 monclient(hunting): handle_auth_done global_id 4237 payload 274 2024-08-19T11:10:43.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 1 -- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f71a813eb10 msgr2=0x7f71a8140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 1 --2- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f71a813eb10 0x7f71a8140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 1 -- 172.21.15.71:0/3074244468 >> v1:172.21.15.135:6789/0 conn(0x7f71a80a6e10 legacy=0x7f71a80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 1 monclient: found mon.noname-i 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.228+0000 7f71ad336640 1 -- 172.21.15.71:0/3074244468 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a80a49d0 con 0x7f71a80a6a30 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.230+0000 7fcc44ad5640 10 monclient: get_monmap_and_config 2024-08-19T11:10:43.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.230+0000 7fcc44ad5640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.230+0000 7fcc44ad5640 10 monclient: monmap: 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:43.231352+0000 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:43.231352+0000 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.265 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7fc40ec36640 10 monclient: get_monmap_and_config 2024-08-19T11:10:43.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7fc40ec36640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7fc40ec36640 10 monclient: monmap: 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:43.231809+0000 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:43.231809+0000 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.267 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7fcc44ad5640 1 Processor -- start 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7fcc44ad5640 1 -- start start 2024-08-19T11:10:43.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7fcc44ad5640 10 monclient: init 2024-08-19T11:10:43.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7f71ad336640 1 -- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 msgr2=0x7f71a80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7f71ad336640 1 --2- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 0x7f71a80a57f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71a40097d0 tx=0x7f71a4029fb0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=aa95acc4e6af7c1d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7ff944498640 10 monclient: get_monmap_and_config 2024-08-19T11:10:43.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7ff944498640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7ff944498640 10 monclient: monmap: 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:43.232266+0000 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:43.232266+0000 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.270 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fc40ec36640 1 Processor -- start 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7f719ffff640 1 -- 172.21.15.71:0/3074244468 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a4037070 con 0x7f71a80a6a30 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7f719ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7f719ffff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.231+0000 7f719ffff640 10 monclient: dump: 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.272 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f71af59a640 5 monclient: authenticate success, global_id 4237 2024-08-19T11:10:43.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f71af59a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:43.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 1 -- 172.21.15.71:0/3074244468 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a402ad10 con 0x7f71a80a6a30 2024-08-19T11:10:43.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fc40ec36640 1 -- start start 2024-08-19T11:10:43.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fc40ec36640 10 monclient: init 2024-08-19T11:10:43.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f71af59a640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:43.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 1 -- 172.21.15.71:0/3074244468 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a4030c20 con 0x7f71a80a6a30 2024-08-19T11:10:43.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient: _add_conns ranks=[9,10,4,2,0,1,6,5,3,7,8] 2024-08-19T11:10:43.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc4009b3a0 0x7fcc400a2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): picked mon.noname-a con 0x7fcc4009b3a0 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f719ffff640 10 monclient: dump: 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.276 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7f71af59a640 4 set_mon_vals no callback set 2024-08-19T11:10:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc4009b780 0x7fcc4009f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): picked mon.noname-f con 0x7fcc4009b780 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 0x7fcc4009fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): picked mon.noname-c con 0x7fcc4009bba0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcc400a44b0 con 0x7fcc4009b3a0 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcc400a0fd0 con 0x7fcc4009b780 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcc400a12b0 con 0x7fcc4009bba0 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc44ad5640 10 monclient(hunting): authenticate will time out at 701.273375s 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 0x7fcc4009fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 0x7fcc4009fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46846/0 (socket says 172.21.15.71:46846) 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/3459189273 learned_addr learned my addr 172.21.15.71:0/3459189273 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): get_auth_request con 0x7fcc4009bba0 auth_method 0 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3e59c640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.71:3300/0 conn(0x7fcc4009b3a0 0x7fcc400a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.135:3300/0 conn(0x7fcc4009b780 0x7fcc4009f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): get_auth_request con 0x7fcc4009b780 auth_method 0 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3e59c640 10 monclient(hunting): get_auth_request con 0x7fcc4009b3a0 auth_method 0 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fc40ec36640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_done global_id 4279 payload 274 2024-08-19T11:10:43.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7ff944498640 1 Processor -- start 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7ff944498640 1 -- start start 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7ff944498640 10 monclient: init 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/3459189273 >> v2:172.21.15.135:3300/0 conn(0x7fcc4009b780 msgr2=0x7fcc4009f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.135:3300/0 conn(0x7fcc4009b780 0x7fcc4009f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/3459189273 >> v2:172.21.15.71:3300/0 conn(0x7fcc4009b3a0 msgr2=0x7fcc400a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.71:3300/0 conn(0x7fcc4009b3a0 0x7fcc400a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.232+0000 7fcc3ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fcc3ed9d640 1 monclient: found mon.noname-c 2024-08-19T11:10:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fcc3ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fcc3ed9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/3459189273 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc400a1590 con 0x7fcc4009bba0 2024-08-19T11:10:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient: _add_conns ranks=[4,2,3,8,1,10,9,7,0,5,6] 2024-08-19T11:10:43.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fcc3e59c640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.71:3300/0 conn(0x7fcc4009b3a0 0x7fcc400a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 0x7fc4080a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): picked mon.noname-c con 0x7fc4080a4750 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40806d1e0 0x7fc4080a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): picked mon.noname-b con 0x7fc40806d1e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc408139900 0x7fc408139d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): picked mon.noname-g con 0x7fc408139900 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc4080a1420 con 0x7fc40806d1e0 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc4080a0e60 con 0x7fc408139900 2024-08-19T11:10:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc4080a02b0 con 0x7fc4080a4750 2024-08-19T11:10:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 10 monclient: shutdown 2024-08-19T11:10:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40ec36640 10 monclient(hunting): authenticate will time out at 701.274136s 2024-08-19T11:10:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 -- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 msgr2=0x7f71a80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 --2- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 0x7f71a80a57f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71a40097d0 tx=0x7f71a4029fb0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 0x7fc4080a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 0x7fc4080a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46862/0 (socket says 172.21.15.71:46862) 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 -- 172.21.15.71:0/3074244468 shutdown_connections 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 --2- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f71a813eb10 0x7f71a8140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 -- 172.21.15.71:0/1276526540 learned_addr learned my addr 172.21.15.71:0/1276526540 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): get_auth_request con 0x7fc4080a4750 auth_method 0 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 --2- 172.21.15.71:0/3074244468 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f71a80a6a30 0x7f71a80a57f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc408139900 0x7fc408139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): get_auth_request con 0x7fc408139900 auth_method 0 2024-08-19T11:10:43.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 -- 172.21.15.71:0/3074244468 >> 172.21.15.71:0/3074244468 conn(0x7f71a80ac030 msgr2=0x7f71a80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc407fff640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40806d1e0 0x7fc4080a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc407fff640 10 monclient(hunting): get_auth_request con 0x7fc40806d1e0 auth_method 0 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc407fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc407fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc407fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_done global_id 4288 payload 274 2024-08-19T11:10:43.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 -- 172.21.15.71:0/1276526540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc408139900 msgr2=0x7fc408139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc408139900 0x7fc408139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 -- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40806d1e0 msgr2=0x7fc4080a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40806d1e0 0x7fc4080a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 monclient: found mon.noname-c 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc40c9d2640 1 -- 172.21.15.71:0/1276526540 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40806d6e0 con 0x7fc4080a4750 2024-08-19T11:10:43.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 -- 172.21.15.71:0/3074244468 shutdown_connections 2024-08-19T11:10:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7fc407fff640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40806d1e0 0x7fc4080a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:43.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7f71af59a640 1 -- 172.21.15.71:0/3074244468 wait complete. 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.233+0000 7ff944498640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient: _add_conns ranks=[7,9,1,6,4,5,2,10,8,3,0] 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 0x7ff93c0a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): picked mon.noname-i con 0x7ff93c0a47c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff93c074300 0x7ff93c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): picked mon.noname-a con 0x7ff93c074300 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff93c142160 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c09fd50 con 0x7ff93c142160 2024-08-19T11:10:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff93c0a5620 con 0x7ff93c074300 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7f71af59a640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7f71af59a640 10 monclient: monmap: 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.295 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7ff93c06d2a0 con 0x7ff93c0a47c0 2024-08-19T11:10:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff944498640 10 monclient(hunting): authenticate will time out at 701.275105s 2024-08-19T11:10:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 0x7ff93c0a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7f71af59a640 1 Processor -- start 2024-08-19T11:10:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 0x7ff93c0a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:39892/0 (socket says 172.21.15.71:39892) 2024-08-19T11:10:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7f71af59a640 1 -- start start 2024-08-19T11:10:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7f71af59a640 10 monclient: init 2024-08-19T11:10:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 -- 172.21.15.71:0/1397379686 learned_addr learned my addr 172.21.15.71:0/1397379686 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): get_auth_request con 0x7ff93c0a47c0 auth_method 0 2024-08-19T11:10:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 1 --2- 172.21.15.71:0/1397379686 >> v2:172.21.15.71:3300/0 conn(0x7ff93c074300 0x7ff93c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient: _add_conns ranks=[6,3,4,0,8,5,2,7,1] 2024-08-19T11:10:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 0x7f71a81d2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): picked mon.noname-d con 0x7f71a80a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a80a6e10 0x7f71a81d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): picked mon.noname-g con 0x7f71a80a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f71a813eb10 0x7f71a806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): picked mon.noname-c con 0x7f71a813eb10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f71a8141440 con 0x7f71a80a6e10 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f71a80a5d30 con 0x7f71a813eb10 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f71a81415c0 con 0x7f71a80a6a30 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71af59a640 10 monclient(hunting): authenticate will time out at 701.276481s 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 0x7f71a81d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a80a6e10 0x7f71a81d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 0x7f71a81d2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:44698/0 (socket says 172.21.15.71:44698) 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 -- 172.21.15.71:0/3039459640 learned_addr learned my addr 172.21.15.71:0/3039459640 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): get_auth_request con 0x7f71a80a6a30 auth_method 0 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): get_auth_request con 0x7f71a80a6e10 auth_method 0 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): get_auth_request con 0x7ff93c074300 auth_method 0 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient(hunting): handle_auth_done global_id 4246 payload 274 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 -- 172.21.15.71:0/1397379686 >> v2:172.21.15.71:3300/0 conn(0x7ff93c074300 msgr2=0x7ff93c0a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 --2- 172.21.15.71:0/1397379686 >> v2:172.21.15.71:3300/0 conn(0x7ff93c074300 0x7ff93c0a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 -- 172.21.15.71:0/1397379686 >> v1:172.21.15.135:6789/0 conn(0x7ff93c142160 legacy=0x7ff93c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 monclient: found mon.noname-i 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff942234640 1 -- 172.21.15.71:0/1397379686 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c06cdd0 con 0x7ff93c0a47c0 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.234+0000 7ff941a33640 1 --2- 172.21.15.71:0/1397379686 >> v2:172.21.15.71:3300/0 conn(0x7ff93c074300 0x7ff93c0a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71acb35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient(hunting): handle_auth_done global_id 4335 payload 824 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 -- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f71a813eb10 msgr2=0x7f71a806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f71a813eb10 0x7f71a806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 -- 172.21.15.71:0/3039459640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a80a6e10 msgr2=0x7f71a81d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a80a6e10 0x7f71a81d2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 monclient: found mon.noname-d 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.235+0000 7f71ad336640 1 -- 172.21.15.71:0/3039459640 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a8073310 con 0x7f71a80a6a30 2024-08-19T11:10:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.236+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/3459189273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 msgr2=0x7fcc4009fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.236+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/3459189273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 0x7fcc4009fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc400704d0 tx=0x7fcc3802c780 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2121e3f4eb72a775 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff942234640 1 -- 172.21.15.71:0/1397379686 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 msgr2=0x7ff93c0a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff942234640 1 --2- 172.21.15.71:0/1397379686 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 0x7ff93c0a4ba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff93402a550 comp rx=0 tx=0).ready entity=mon.7 client_cookie=78d10cf7e6126bdc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 1 -- 172.21.15.71:0/1397379686 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff934036070 con 0x7ff93c0a47c0 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 10 monclient: dump: 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff944498640 5 monclient: authenticate success, global_id 4246 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff944498640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 1 -- 172.21.15.71:0/1397379686 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934007a70 con 0x7ff93c0a47c0 2024-08-19T11:10:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff941232640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff944498640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.237+0000 7ff944498640 4 set_mon_vals no callback set 2024-08-19T11:10:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71ad336640 1 -- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 msgr2=0x7f71a81d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71ad336640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 0x7f71a81d2580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71a40097a0 tx=0x7f71a40046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a4037070 con 0x7f71a80a6a30 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: dump: 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff941232640 1 -- 172.21.15.71:0/1397379686 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff934007c60 con 0x7ff93c0a47c0 2024-08-19T11:10:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff941232640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7fc40c9d2640 1 -- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 msgr2=0x7fc4080a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7fc40c9d2640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 0x7fc4080a4b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009900 tx=0x7fc3fc02a0e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6bab01a7a148e79a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff941232640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a4041070 con 0x7f71a80a6a30 2024-08-19T11:10:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f71a4006e10 con 0x7f71a80a6a30 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7fcc3d59a640 1 -- 172.21.15.71:0/3459189273 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc38007a70 con 0x7fcc4009bba0 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7fcc3d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7fcc3d59a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7fcc3d59a640 10 monclient: dump: 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.315 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 1 -- 172.21.15.71:0/3459189273 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc38007c30 con 0x7fcc4009bba0 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc44ad5640 5 monclient: authenticate success, global_id 4279 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 1 -- 172.21.15.71:0/3459189273 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc38007de0 con 0x7fcc4009bba0 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719f7fe640 4 set_mon_vals no callback set 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f719dffb640 10 monclient: dump: 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 5 monclient: authenticate success, global_id 4335 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 10 monclient: _renew_subs 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a80ac630 con 0x7f71a80a6a30 2024-08-19T11:10:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc3d59a640 10 monclient: dump: 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc44ad5640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc44ad5640 4 set_mon_vals no callback set 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 10 monclient: _renew_subs 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a8141110 con 0x7f71a80a6a30 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff941232640 10 monclient: dump: 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff944498640 10 monclient: shutdown 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff944498640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff944498640 1 -- 172.21.15.71:0/1397379686 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 msgr2=0x7ff93c0a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.238+0000 7ff944498640 1 --2- 172.21.15.71:0/1397379686 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 0x7ff93c0a4ba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff93402a550 comp rx=0 tx=0).stop 2024-08-19T11:10:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 1 -- 172.21.15.71:0/1276526540 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3fc037070 con 0x7fc4080a4750 2024-08-19T11:10:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: dump: 2024-08-19T11:10:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 1 -- 172.21.15.71:0/1276526540 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3fc02ae00 con 0x7fc4080a4750 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 1 -- 172.21.15.71:0/1276526540 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3fc030c20 con 0x7fc4080a4750 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc4077fe640 10 monclient: dump: 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.327 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc40ec36640 5 monclient: authenticate success, global_id 4288 2024-08-19T11:10:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc40ec36640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fc40ec36640 4 set_mon_vals no callback set 2024-08-19T11:10:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7ff944498640 1 -- 172.21.15.71:0/1397379686 shutdown_connections 2024-08-19T11:10:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7ff944498640 1 --2- 172.21.15.71:0/1397379686 >> v2:172.21.15.71:3300/0 conn(0x7ff93c074300 0x7ff93c0a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7ff944498640 1 --2- 172.21.15.71:0/1397379686 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff93c0a47c0 0x7ff93c0a4ba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7ff944498640 1 -- 172.21.15.71:0/1397379686 >> 172.21.15.71:0/1397379686 conn(0x7ff93c0a93e0 msgr2=0x7ff93c0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7f71af59a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7f71af59a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7f71af59a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a80a57f0 con 0x7f71a80a6a30 2024-08-19T11:10:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc44ad5640 10 monclient: shutdown 2024-08-19T11:10:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc44ad5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7ff944498640 1 -- 172.21.15.71:0/1397379686 shutdown_connections 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.239+0000 7fcc44ad5640 1 -- 172.21.15.71:0/3459189273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 msgr2=0x7fcc4009fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/3459189273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 0x7fcc4009fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc400704d0 tx=0x7fcc3802c780 comp rx=0 tx=0).stop 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 -- 172.21.15.71:0/3459189273 shutdown_connections 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/3459189273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009bba0 0x7fcc4009fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.135:3300/0 conn(0x7fcc4009b780 0x7fcc4009f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/3459189273 >> v2:172.21.15.71:3300/0 conn(0x7fcc4009b3a0 0x7fcc400a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 -- 172.21.15.71:0/3459189273 >> 172.21.15.71:0/3459189273 conn(0x7fcc400a4e70 msgr2=0x7fcc400a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 -- 172.21.15.71:0/3459189273 shutdown_connections 2024-08-19T11:10:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7ff944498640 1 -- 172.21.15.71:0/1397379686 wait complete. 2024-08-19T11:10:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fcc44ad5640 1 -- 172.21.15.71:0/3459189273 wait complete. 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 10 monclient: shutdown 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 -- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 msgr2=0x7fc4080a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 0x7fc4080a4b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009900 tx=0x7fc3fc02a0e0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 -- 172.21.15.71:0/1276526540 shutdown_connections 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc408139900 0x7fc408139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc40806d1e0 0x7fc4080a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 --2- 172.21.15.71:0/1276526540 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4080a4750 0x7fc4080a4b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 -- 172.21.15.71:0/1276526540 >> 172.21.15.71:0/1276526540 conn(0x7fc4080a9370 msgr2=0x7fc4080a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f71a4046460 con 0x7f71a80a6a30 2024-08-19T11:10:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 -- 172.21.15.71:0/1276526540 shutdown_connections 2024-08-19T11:10:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.240+0000 7fc40ec36640 1 -- 172.21.15.71:0/1276526540 wait complete. 2024-08-19T11:10:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7ff944498640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7ff944498640 10 monclient: monmap: 2024-08-19T11:10:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7f719dffb640 1 --2- 172.21.15.71:0/3039459640 >> v2:172.21.15.135:6800/726754104 conn(0x7f718c03ea80 0x7f718c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f71a4071ed0 con 0x7f71a80a6a30 2024-08-19T11:10:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7fcc44ad5640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7fcc44ad5640 10 monclient: monmap: 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7f71acb35640 1 --2- 172.21.15.71:0/3039459640 >> v2:172.21.15.135:6800/726754104 conn(0x7f718c03ea80 0x7f718c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7ff944498640 1 Processor -- start 2024-08-19T11:10:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7f71acb35640 10 monclient: get_auth_request con 0x7f718c03ea80 auth_method 0 2024-08-19T11:10:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7ff944498640 1 -- start start 2024-08-19T11:10:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7ff944498640 10 monclient: init 2024-08-19T11:10:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.241+0000 7fcc44ad5640 1 Processor -- start 2024-08-19T11:10:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 1 -- start start 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 10 monclient: init 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fc40ec36640 10 monclient: build_initial_monmap 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fc40ec36640 10 monclient: monmap: 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:43.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient: _add_conns ranks=[1,2,0,8,5,3,4,6,7] 2024-08-19T11:10:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c0a47c0 0x7ff93c12cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): picked mon.noname-f con 0x7ff93c0a47c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 0x7ff93c1d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): picked mon.noname-b con 0x7ff93c142160 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 0x7ff93c140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): picked mon.noname-a con 0x7ff93c140880 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c06d4e0 con 0x7ff93c140880 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c0a62c0 con 0x7ff93c0a47c0 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff93c06d660 con 0x7ff93c142160 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff944498640 10 monclient(hunting): authenticate will time out at 701.283353s 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c0a47c0 0x7ff93c12cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 0x7ff93c1d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 0x7ff93c1d2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44540/0 (socket says 172.21.15.71:44540) 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 0x7ff93c140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 1 -- 172.21.15.71:0/623521564 learned_addr learned my addr 172.21.15.71:0/623521564 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 10 monclient(hunting): get_auth_request con 0x7ff93c142160 auth_method 0 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff941a33640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): get_auth_request con 0x7ff93c140880 auth_method 0 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942a35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): get_auth_request con 0x7ff93c0a47c0 auth_method 0 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 10 monclient: _add_conns ranks=[4,5,8,3,0,6,7,1,2] 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7ff942234640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009b3a0 0x7fcc401306d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 10 monclient(hunting): picked mon.noname-c con 0x7fcc4009b3a0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:43.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 0x7fcc40130c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 10 monclient(hunting): handle_auth_done global_id 4293 payload 824 2024-08-19T11:10:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.242+0000 7fcc44ad5640 10 monclient(hunting): picked mon.noname-h con 0x7fcc4009b780 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fc40ec36640 1 Processor -- start 2024-08-19T11:10:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 1 -- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 msgr2=0x7ff93c1d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 0x7ff93c1d2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 1 -- 172.21.15.71:0/623521564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c0a47c0 msgr2=0x7ff93c12cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c0a47c0 0x7ff93c12cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 1 monclient: found mon.noname-a 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff942a35640 1 -- 172.21.15.71:0/623521564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c12d4d0 con 0x7ff93c140880 2024-08-19T11:10:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 0x7fcc40130c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fc40ec36640 1 -- start start 2024-08-19T11:10:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fc40ec36640 10 monclient: init 2024-08-19T11:10:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7ff941a33640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 0x7ff93c1d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 0x7fcc40130c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:50088/0 (socket says 172.21.15.71:50088) 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 1 -- 172.21.15.71:0/4014786179 learned_addr learned my addr 172.21.15.71:0/4014786179 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 0x7fcc40131150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3e59c640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009b3a0 0x7fcc401306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 0x7fcc40131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 10 monclient(hunting): picked mon.noname-e con 0x7fcc4009bba0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcc400a0b90 con 0x7fcc4009b3a0 2024-08-19T11:10:43.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcc400a0a10 con 0x7fcc4009b780 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcc400a02f0 con 0x7fcc4009bba0 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc44ad5640 10 monclient(hunting): authenticate will time out at 701.284829s 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 10 monclient(hunting): get_auth_request con 0x7fcc4009b780 auth_method 0 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7f71acb35640 1 --2- 172.21.15.71:0/3039459640 >> v2:172.21.15.135:6800/726754104 conn(0x7f718c03ea80 0x7f718c040f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7198007c90 tx=0x7f7198007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 10 monclient: _add_conns ranks=[1,7,8,2,6,0,5,4,3] 2024-08-19T11:10:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40806d1e0 0x7fc4081ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 10 monclient(hunting): picked mon.noname-f con 0x7fc40806d1e0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 0x7fc4081cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3e59c640 10 monclient(hunting): get_auth_request con 0x7fcc4009b3a0 auth_method 0 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3ed9d640 10 monclient(hunting): get_auth_request con 0x7fcc4009bba0 auth_method 0 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.243+0000 7fcc3ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 10 monclient(hunting): handle_auth_done global_id 4265 payload 824 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/4014786179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 msgr2=0x7fcc40130c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 0x7fcc40130c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009b3a0 msgr2=0x7fcc401306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009b3a0 0x7fcc401306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 1 monclient: found mon.noname-e 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc400a23e0 con 0x7fcc4009bba0 2024-08-19T11:10:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 10 monclient(hunting): picked mon.noname-i con 0x7fc4080a4750 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc408139900 0x7fc4081cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fcc3dd9b640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 0x7fcc40130c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 10 monclient(hunting): picked mon.noname-e con 0x7fc408139900 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40c9d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40806d1e0 0x7fc4081ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc407fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 0x7fc4081cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40c9d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40806d1e0 0x7fc4081ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:36904/0 (socket says 172.21.15.71:36904) 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.244+0000 7fc40c9d2640 1 -- 172.21.15.71:0/2080345712 learned_addr learned my addr 172.21.15.71:0/2080345712 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc40806ce20 con 0x7fc40806d1e0 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc4080a0b80 con 0x7fc4080a4750 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc40806cfa0 con 0x7fc408139900 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff942a35640 1 -- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 msgr2=0x7ff93c140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff942a35640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 0x7ff93c140ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0a5880 tx=0x7ff92c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40ec36640 10 monclient(hunting): authenticate will time out at 701.286412s 2024-08-19T11:10:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): get_auth_request con 0x7fc40806d1e0 auth_method 0 2024-08-19T11:10:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff92c010c30 con 0x7ff93c140880 2024-08-19T11:10:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: dump: 2024-08-19T11:10:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.360 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c016070 con 0x7ff93c140880 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 5 monclient: authenticate success, global_id 4293 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 10 monclient: _renew_subs 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c12e340 con 0x7ff93c140880 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff92c010df0 con 0x7ff93c140880 2024-08-19T11:10:43.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff932ffd640 10 monclient: dump: 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.362 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 10 monclient: _renew_subs 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93c1cf690 con 0x7ff93c140880 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7ff940a31640 4 set_mon_vals no callback set 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): get_auth_request con 0x7fc4080a4750 auth_method 0 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc40c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient(hunting): handle_auth_done global_id 4255 payload 824 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 1 -- 172.21.15.71:0/2080345712 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc408139900 msgr2=0x7fc4081cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc408139900 0x7fc4081cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 1 -- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40806d1e0 msgr2=0x7fc4081ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40806d1e0 0x7fc4081ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 1 monclient: found mon.noname-i 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.245+0000 7fc407fff640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc408139df0 con 0x7fc4080a4750 2024-08-19T11:10:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.246+0000 7fcc3ed9d640 1 -- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 msgr2=0x7fcc40131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.246+0000 7fcc3ed9d640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 0x7fcc40131150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc38035000 tx=0x7fcc38004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7ff944498640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7ff944498640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7ff944498640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93c0a7a40 con 0x7ff93c140880 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc38042020 con 0x7fcc4009bba0 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: dump: 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.368 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc380046c0 con 0x7fcc4009bba0 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc3803d440 con 0x7fcc4009bba0 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc3cd99640 4 set_mon_vals no callback set 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc2effd640 10 monclient: dump: 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.370 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 5 monclient: authenticate success, global_id 4265 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 10 monclient: _renew_subs 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4008e2e0 con 0x7fcc4009bba0 2024-08-19T11:10:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 10 monclient: _renew_subs 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.247+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc400a3630 con 0x7fcc4009bba0 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff92c0107c0 con 0x7ff93c140880 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7ff932ffd640 1 --2- 172.21.15.71:0/623521564 >> v2:172.21.15.135:6800/726754104 conn(0x7ff92003eae0 0x7ff920040fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcc38045020 con 0x7fcc4009bba0 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7fcc44ad5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7fcc44ad5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7fcc44ad5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:43.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7ff92c0512e0 con 0x7ff93c140880 2024-08-19T11:10:43.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc401324d0 con 0x7fcc4009bba0 2024-08-19T11:10:43.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.248+0000 7fcc2effd640 1 --2- 172.21.15.71:0/4014786179 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc2003ea80 0x7fcc20040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc407fff640 1 -- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 msgr2=0x7fc4081cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:43.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc407fff640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 0x7fc4081cee60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4006fd0 tx=0x7fc3f400ebb0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fcc38072890 con 0x7fcc4009bba0 2024-08-19T11:10:43.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3f400f040 con 0x7fc4080a4750 2024-08-19T11:10:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7ff942234640 1 --2- 172.21.15.71:0/623521564 >> v2:172.21.15.135:6800/726754104 conn(0x7ff92003eae0 0x7ff920040fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7ff942234640 10 monclient: get_auth_request con 0x7ff92003eae0 auth_method 0 2024-08-19T11:10:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: dump: 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f71a4030940 con 0x7f71a80a6a30 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7f719dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7f719dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f40044a0 con 0x7fc4080a4750 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3f4017e10 con 0x7fc4080a4750 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc406ffd640 4 set_mon_vals no callback set 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc4057fa640 10 monclient: dump: 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:43.378 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:43.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fcc3e59c640 1 --2- 172.21.15.71:0/4014786179 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc2003ea80 0x7fcc20040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fcc3e59c640 10 monclient: get_auth_request con 0x7fcc2003ea80 auth_method 0 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc40ec36640 5 monclient: authenticate success, global_id 4255 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc40ec36640 10 monclient: _renew_subs 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc40ec36640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.249+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40812a350 con 0x7fc4080a4750 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.250+0000 7fc40ec36640 10 monclient: _renew_subs 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.250+0000 7fc40ec36640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.250+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc408129030 con 0x7fc4080a4750 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc40ec36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc40ec36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc40ec36640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4080a4b30 con 0x7fc4080a4750 2024-08-19T11:10:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc3f4004030 con 0x7fc4080a4750 2024-08-19T11:10:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc4057fa640 1 --2- 172.21.15.71:0/2080345712 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3ec03eab0 0x7fc3ec040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.251+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fc3f4059a60 con 0x7fc4080a4750 2024-08-19T11:10:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.252+0000 7ff942234640 1 --2- 172.21.15.71:0/623521564 >> v2:172.21.15.135:6800/726754104 conn(0x7ff92003eae0 0x7ff920040fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff934009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.252+0000 7fcc3e59c640 1 --2- 172.21.15.71:0/4014786179 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc2003ea80 0x7fcc20040f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.252+0000 7fc40c9d2640 1 --2- 172.21.15.71:0/2080345712 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3ec03eab0 0x7fc3ec040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:43.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.252+0000 7fc40c9d2640 10 monclient: get_auth_request con 0x7fc3ec03eab0 auth_method 0 2024-08-19T11:10:43.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.254+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7ff93c0a7a40 con 0x7ff93c140880 2024-08-19T11:10:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.254+0000 7ff932ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.254+0000 7ff932ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.255+0000 7fc40c9d2640 1 --2- 172.21.15.71:0/2080345712 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3ec03eab0 0x7fc3ec040f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0090b0 tx=0x7fc3fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.256+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc3f4026d20 con 0x7fc4080a4750 2024-08-19T11:10:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.256+0000 7fc4057fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.256+0000 7fc4057fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.258+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fcc3804c070 con 0x7fcc4009bba0 2024-08-19T11:10:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.258+0000 7fcc2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.258+0000 7fcc2effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.486+0000 7ff944498640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-19T11:10:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.486+0000 7ff944498640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-19T11:10:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.486+0000 7ff944498640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.486+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff93c06a590 con 0x7ff93c140880 2024-08-19T11:10:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.487+0000 7ff932ffd640 1 -- 172.21.15.71:0/623521564 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff92c011620 con 0x7ff93c140880 2024-08-19T11:10:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.487+0000 7ff932ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-19T11:10:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.487+0000 7ff932ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:43.489 INFO:teuthology.orchestra.run.smithi071.stdout:47244640260 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc40ec36640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc40ec36640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc40ec36640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc40806ecf0 con 0x7fc4080a4750 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc4057fa640 1 -- 172.21.15.71:0/2080345712 <== mon.7 v2:172.21.15.135:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3f400cb90 con 0x7fc4080a4750 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc4057fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-19T11:10:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.489+0000 7fc4057fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:43.491 INFO:teuthology.orchestra.run.smithi071.stdout:51539607556 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 >> v2:172.21.15.135:6800/726754104 conn(0x7ff92003eae0 msgr2=0x7ff920040fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 --2- 172.21.15.71:0/623521564 >> v2:172.21.15.135:6800/726754104 conn(0x7ff92003eae0 0x7ff920040fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff934009e50 tx=0x7ff934009000 comp rx=0 tx=0).stop 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 10 monclient: shutdown 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 msgr2=0x7ff93c140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 0x7ff93c140ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0a5880 tx=0x7ff92c009850 comp rx=0 tx=0).stop 2024-08-19T11:10:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 shutdown_connections 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 --2- 172.21.15.71:0/623521564 >> v2:172.21.15.135:6800/726754104 conn(0x7ff92003eae0 0x7ff920040fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff93c140880 0x7ff93c140ce0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff93c142160 0x7ff93c1d2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 --2- 172.21.15.71:0/623521564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff93c0a47c0 0x7ff93c12cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 >> 172.21.15.71:0/623521564 conn(0x7ff93c0a93e0 msgr2=0x7ff93c1414a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 shutdown_connections 2024-08-19T11:10:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.490+0000 7ff944498640 1 -- 172.21.15.71:0/623521564 wait complete. 2024-08-19T11:10:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3ec03eab0 msgr2=0x7fc3ec040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 --2- 172.21.15.71:0/2080345712 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3ec03eab0 0x7fc3ec040f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0090b0 tx=0x7fc3fc02e000 comp rx=0 tx=0).stop 2024-08-19T11:10:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 10 monclient: shutdown 2024-08-19T11:10:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 msgr2=0x7fc4081cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 0x7fc4081cee60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4006fd0 tx=0x7fc3f400ebb0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 shutdown_connections 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 --2- 172.21.15.71:0/2080345712 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3ec03eab0 0x7fc3ec040f70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc408139900 0x7fc4081cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc4080a4750 0x7fc4081cee60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 --2- 172.21.15.71:0/2080345712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc40806d1e0 0x7fc4081ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 >> 172.21.15.71:0/2080345712 conn(0x7fc4080a9370 msgr2=0x7fc40809f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 shutdown_connections 2024-08-19T11:10:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.492+0000 7fc40ec36640 1 -- 172.21.15.71:0/2080345712 wait complete. 2024-08-19T11:10:43.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.5 2024-08-19T11:10:43.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.2 2024-08-19T11:10:43.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7cb4314640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-19T11:10:43.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7cb4314640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-19T11:10:43.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7cb4314640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:43.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7cac0a1200 con 0x7f7cac0a6e10 2024-08-19T11:10:43.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7ca2ffd640 1 -- 172.21.15.71:0/677584156 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c9c046410 con 0x7f7cac0a6e10 2024-08-19T11:10:43.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7ca2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-19T11:10:43.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.561+0000 7f7ca2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:43.563 INFO:teuthology.orchestra.run.smithi071.stdout:51539607556 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 >> v2:172.21.15.135:6800/726754104 conn(0x7f7c9003eab0 msgr2=0x7f7c90040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 --2- 172.21.15.71:0/677584156 >> v2:172.21.15.135:6800/726754104 conn(0x7f7c9003eab0 0x7f7c90040f70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009b40 tx=0x7f7ca8009190 comp rx=0 tx=0).stop 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 10 monclient: shutdown 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 msgr2=0x7f7cac124f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 0x7f7cac124f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c02a830 tx=0x7f7c9c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 shutdown_connections 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 --2- 172.21.15.71:0/677584156 >> v2:172.21.15.135:6800/726754104 conn(0x7f7c9003eab0 0x7f7c90040f70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7cac139860 0x7f7cac125470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7cac0a6e10 0x7f7cac124f30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 --2- 172.21.15.71:0/677584156 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7cac0a6a30 0x7f7cac127460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.563+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 >> 172.21.15.71:0/677584156 conn(0x7f7cac0ac030 msgr2=0x7f7cac1390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.564+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 shutdown_connections 2024-08-19T11:10:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.564+0000 7f7cb4314640 1 -- 172.21.15.71:0/677584156 wait complete. 2024-08-19T11:10:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.566+0000 7fd9d646e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-19T11:10:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.566+0000 7fd9d646e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-19T11:10:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.566+0000 7fd9d646e640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:10:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.566+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd9d006ca70 con 0x7fd9d00a6a30 2024-08-19T11:10:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.567+0000 7fd9ccff9640 1 -- 172.21.15.71:0/2581830293 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd9c0012400 con 0x7fd9d00a6a30 2024-08-19T11:10:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.567+0000 7fd9ccff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-19T11:10:43.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.567+0000 7fd9ccff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:43.568 INFO:teuthology.orchestra.run.smithi071.stdout:51539607556 2024-08-19T11:10:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9bc03eab0 msgr2=0x7fd9bc040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 --2- 172.21.15.71:0/2581830293 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9bc03eab0 0x7fd9bc040f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00778a0 tx=0x7fd9c4018040 comp rx=0 tx=0).stop 2024-08-19T11:10:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 10 monclient: shutdown 2024-08-19T11:10:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 msgr2=0x7fd9d013ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 0x7fd9d013ca40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000c490 tx=0x7fd9c000c950 comp rx=0 tx=0).stop 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 shutdown_connections 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 --2- 172.21.15.71:0/2581830293 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9bc03eab0 0x7fd9bc040f70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd9d013eb10 0x7fd9d0123e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd9d00a6e10 0x7fd9d0123940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 --2- 172.21.15.71:0/2581830293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9d00a6a30 0x7fd9d013ca40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 >> 172.21.15.71:0/2581830293 conn(0x7fd9d00ac030 msgr2=0x7fd9d013fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 shutdown_connections 2024-08-19T11:10:43.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.570+0000 7fd9d646e640 1 -- 172.21.15.71:0/2581830293 wait complete. 2024-08-19T11:10:43.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.4 2024-08-19T11:10:43.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.0 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.593+0000 7fcc44ad5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.593+0000 7fcc44ad5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.593+0000 7fcc44ad5640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.593+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcc40133430 con 0x7fcc4009bba0 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.594+0000 7fcc2effd640 1 -- 172.21.15.71:0/4014786179 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc400a23e0 con 0x7fcc4009bba0 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.594+0000 7fcc2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.594+0000 7fcc2effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:43.595 INFO:teuthology.orchestra.run.smithi071.stdout:51539607555 2024-08-19T11:10:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc2003ea80 msgr2=0x7fcc20040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc2003ea80 0x7fcc20040f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30008040 comp rx=0 tx=0).stop 2024-08-19T11:10:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 10 monclient: shutdown 2024-08-19T11:10:43.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 msgr2=0x7fcc40131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 0x7fcc40131150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc38035000 tx=0x7fcc38004a40 comp rx=0 tx=0).stop 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 shutdown_connections 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc2003ea80 0x7fcc20040f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc4009b780 0x7fcc40130c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc4009bba0 0x7fcc40131150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 --2- 172.21.15.71:0/4014786179 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc4009b3a0 0x7fcc401306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 >> 172.21.15.71:0/4014786179 conn(0x7fcc400a4e70 msgr2=0x7fcc4009e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 shutdown_connections 2024-08-19T11:10:43.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.596+0000 7fcc44ad5640 1 -- 172.21.15.71:0/4014786179 wait complete. 2024-08-19T11:10:43.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.601+0000 7f71af59a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-19T11:10:43.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.601+0000 7f71af59a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-19T11:10:43.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.601+0000 7f71af59a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:43.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.601+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f71a8071e10 con 0x7f71a80a6a30 2024-08-19T11:10:43.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.601+0000 7f719dffb640 1 -- 172.21.15.71:0/3039459640 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71a4003de0 con 0x7f71a80a6a30 2024-08-19T11:10:43.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.602+0000 7f719dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-19T11:10:43.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.602+0000 7f719dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:43.603 INFO:teuthology.orchestra.run.smithi071.stdout:51539607556 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 >> v2:172.21.15.135:6800/726754104 conn(0x7f718c03ea80 msgr2=0x7f718c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 --2- 172.21.15.71:0/3039459640 >> v2:172.21.15.135:6800/726754104 conn(0x7f718c03ea80 0x7f718c040f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7198007c90 tx=0x7f7198007be0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 10 monclient: shutdown 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 msgr2=0x7f71a81d2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 0x7f71a81d2580 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71a40097a0 tx=0x7f71a40046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 shutdown_connections 2024-08-19T11:10:43.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 --2- 172.21.15.71:0/3039459640 >> v2:172.21.15.135:6800/726754104 conn(0x7f718c03ea80 0x7f718c040f40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f71a813eb10 0x7f71a806fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f71a80a6e10 0x7f71a81d2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 --2- 172.21.15.71:0/3039459640 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f71a80a6a30 0x7f71a81d2580 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 >> 172.21.15.71:0/3039459640 conn(0x7f71a80ac030 msgr2=0x7f71a813fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 shutdown_connections 2024-08-19T11:10:43.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:43.604+0000 7f71af59a640 1 -- 172.21.15.71:0/3039459640 wait complete. 2024-08-19T11:10:43.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.1 2024-08-19T11:10:43.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.3 2024-08-19T11:10:44.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-19T11:10:44.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-19T11:10:44.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-19T11:10:44.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-19T11:10:44.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-19T11:10:44.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-19T11:10:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.620+0000 7f9be0741640 10 monclient: get_monmap_and_config 2024-08-19T11:10:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.620+0000 7f9be0741640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.620+0000 7f9be0741640 10 monclient: monmap: 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:44.621328+0000 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:44.621328+0000 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.620+0000 7f380179f640 10 monclient: get_monmap_and_config 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.620+0000 7f380179f640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.620+0000 7f380179f640 10 monclient: monmap: 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:44.621379+0000 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:44.621379+0000 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:44.625 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.621+0000 7f9be0741640 1 Processor -- start 2024-08-19T11:10:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.621+0000 7f9be0741640 1 -- start start 2024-08-19T11:10:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.621+0000 7f9be0741640 10 monclient: init 2024-08-19T11:10:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.621+0000 7f380179f640 1 Processor -- start 2024-08-19T11:10:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.621+0000 7f380179f640 1 -- start start 2024-08-19T11:10:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.621+0000 7f380179f640 10 monclient: init 2024-08-19T11:10:44.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient: _add_conns ranks=[2,6,7,4,1,10,8,5,3,0,9] 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 0x7f9bd80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): picked mon.noname-b con 0x7f9bd80a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9bd80a6e10 0x7f9bd80a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): picked mon.noname-d con 0x7f9bd80a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): picked mon.noname-i con 0x7f9bd8139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd80a4f90 con 0x7f9bd80a6a30 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9bd80a6380 con 0x7f9bd80a6e10 2024-08-19T11:10:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9bd80a49d0 con 0x7f9bd8139860 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9be0741640 10 monclient(hunting): authenticate will time out at 702.663346s 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 0x7f9bd80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 0x7f9bd80a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44548/0 (socket says 172.21.15.71:44548) 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 1 -- 172.21.15.71:0/3033596268 learned_addr learned my addr 172.21.15.71:0/3033596268 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): get_auth_request con 0x7f9bd80a6a30 auth_method 0 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9bd80a6e10 0x7f9bd80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): get_auth_request con 0x7f9bd8139860 auth_method 0 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): get_auth_request con 0x7f9bd80a6e10 auth_method 0 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bdecde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f9bddcdc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 10 monclient(hunting): handle_auth_done global_id 4264 payload 274 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 1 -- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9bd80a6e10 msgr2=0x7f9bd80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9bd80a6e10 0x7f9bd80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 1 -- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 msgr2=0x7f9bd80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 0x7f9bd80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 1 monclient: found mon.noname-i 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bdecde640 1 -- 172.21.15.71:0/3033596268 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd80a46f0 con 0x7f9bd8139860 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bddcdc640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9bd80a6e10 0x7f9bd80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f9bde4dd640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 0x7f9bd80a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient: _add_conns ranks=[10,5,2,3,4,0,6,8,1,9,7] 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37fc0a47c0 0x7f37fc0a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): picked mon.noname-f con 0x7f37fc0a47c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f37fc0a1f40 0x7f37fc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): picked mon.noname-h con 0x7f37fc0a1f40 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 0x7f37fc139e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): picked mon.noname-b con 0x7f37fc1399e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f37fc06d2a0 con 0x7f37fc0a47c0 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0a12c0 con 0x7f37fc1399e0 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f37fc0a5620 con 0x7f37fc0a1f40 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f380179f640 10 monclient(hunting): authenticate will time out at 702.663284s 2024-08-19T11:10:44.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 0x7f37fc139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 0x7f37fc139e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44544/0 (socket says 172.21.15.71:44544) 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 1 -- 172.21.15.71:0/1355816985 learned_addr learned my addr 172.21.15.71:0/1355816985 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): get_auth_request con 0x7f37fc1399e0 auth_method 0 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 1 --2- 172.21.15.71:0/1355816985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f37fc0a1f40 0x7f37fc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): get_auth_request con 0x7f37fc0a1f40 auth_method 0 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 1 --2- 172.21.15.71:0/1355816985 >> v2:172.21.15.135:3300/0 conn(0x7f37fc0a47c0 0x7f37fc0a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): get_auth_request con 0x7f37fc0a47c0 auth_method 0 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.622+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_done global_id 4394 payload 274 2024-08-19T11:10:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 1 -- 172.21.15.71:0/1355816985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f37fc0a1f40 msgr2=0x7f37fc0a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/1355816985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f37fc0a1f40 0x7f37fc0a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 1 -- 172.21.15.71:0/1355816985 >> v2:172.21.15.135:3300/0 conn(0x7f37fc0a47c0 msgr2=0x7f37fc0a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/1355816985 >> v2:172.21.15.135:3300/0 conn(0x7f37fc0a47c0 0x7f37fc0a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 1 monclient: found mon.noname-b 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.623+0000 7f37fb7fe640 1 -- 172.21.15.71:0/1355816985 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc0a0c70 con 0x7f37fc1399e0 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37fb7fe640 1 -- 172.21.15.71:0/1355816985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 msgr2=0x7f37fc139e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/1355816985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 0x7f37fc139e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009e50 tx=0x7f37f402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f1103b32fe8274 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdecde640 1 -- 172.21.15.71:0/3033596268 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 msgr2=0x7f9bd8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdecde640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009dc0 tx=0x7f9bd002a480 comp rx=0 tx=0).ready entity=mon.7 client_cookie=ffc13a8a4ed3a403 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 1 -- 172.21.15.71:0/1355816985 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37f4036070 con 0x7f37fc1399e0 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: dump: 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 1 -- 172.21.15.71:0/1355816985 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4007a70 con 0x7f37fc1399e0 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 1 -- 172.21.15.71:0/1355816985 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37f4007c20 con 0x7f37fc1399e0 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f380179f640 5 monclient: authenticate success, global_id 4394 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f37f9ffb640 10 monclient: dump: 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.639 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f380179f640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f380179f640 4 set_mon_vals no callback set 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 1 -- 172.21.15.71:0/3033596268 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bd0007bc0 con 0x7f9bd8139860 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: dump: 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.642 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9be0741640 5 monclient: authenticate success, global_id 4264 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9be0741640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 1 -- 172.21.15.71:0/3033596268 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0007d60 con 0x7f9bd8139860 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 1 -- 172.21.15.71:0/3033596268 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bd0031400 con 0x7f9bd8139860 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9be0741640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9be0741640 4 set_mon_vals no callback set 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.626+0000 7f9bdd4db640 10 monclient: dump: 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.645 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 10 monclient: shutdown 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 -- 172.21.15.71:0/1355816985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 msgr2=0x7f37fc139e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 --2- 172.21.15.71:0/1355816985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 0x7f37fc139e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009e50 tx=0x7f37f402a5f0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 -- 172.21.15.71:0/1355816985 shutdown_connections 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 --2- 172.21.15.71:0/1355816985 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc1399e0 0x7f37fc139e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 --2- 172.21.15.71:0/1355816985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f37fc0a1f40 0x7f37fc0a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 --2- 172.21.15.71:0/1355816985 >> v2:172.21.15.135:3300/0 conn(0x7f37fc0a47c0 0x7f37fc0a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 -- 172.21.15.71:0/1355816985 >> 172.21.15.71:0/1355816985 conn(0x7f37fc0a93e0 msgr2=0x7f37fc0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f9be0741640 10 monclient: shutdown 2024-08-19T11:10:44.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f9be0741640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f9be0741640 1 -- 172.21.15.71:0/3033596268 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 msgr2=0x7f9bd8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f9be0741640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009dc0 tx=0x7f9bd002a480 comp rx=0 tx=0).stop 2024-08-19T11:10:44.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 -- 172.21.15.71:0/1355816985 shutdown_connections 2024-08-19T11:10:44.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.627+0000 7f380179f640 1 -- 172.21.15.71:0/1355816985 wait complete. 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 -- 172.21.15.71:0/3033596268 shutdown_connections 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139c60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9bd80a6e10 0x7f9bd80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 --2- 172.21.15.71:0/3033596268 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6a30 0x7f9bd80a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 -- 172.21.15.71:0/3033596268 >> 172.21.15.71:0/3033596268 conn(0x7f9bd80ac030 msgr2=0x7f9bd80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 -- 172.21.15.71:0/3033596268 shutdown_connections 2024-08-19T11:10:44.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f9be0741640 1 -- 172.21.15.71:0/3033596268 wait complete. 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f380179f640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.628+0000 7f380179f640 10 monclient: monmap: 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f9be0741640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f9be0741640 10 monclient: monmap: 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.652 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.652 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.652 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f380179f640 1 Processor -- start 2024-08-19T11:10:44.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f380179f640 1 -- start start 2024-08-19T11:10:44.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f380179f640 10 monclient: init 2024-08-19T11:10:44.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f9be0741640 1 Processor -- start 2024-08-19T11:10:44.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient: _add_conns ranks=[7,2,0,1,6,5,4,3,8] 2024-08-19T11:10:44.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f37fc0a1f40 0x7f37fc073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): picked mon.noname-i con 0x7f37fc0a1f40 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:44.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.629+0000 7f9be0741640 1 -- start start 2024-08-19T11:10:44.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 0x7f37fc11f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): picked mon.noname-b con 0x7f37fc0a47c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 0x7f37fc11f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f9be0741640 10 monclient: init 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): picked mon.noname-a con 0x7f37fc1399e0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc06d4e0 con 0x7f37fc1399e0 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0a62c0 con 0x7f37fc0a47c0 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 0x7f37fc11f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 0x7f37fc11f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44552/0 (socket says 172.21.15.71:44552) 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 1 -- 172.21.15.71:0/2742793792 learned_addr learned my addr 172.21.15.71:0/2742793792 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f37fc06d660 con 0x7f37fc0a1f40 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f380179f640 10 monclient(hunting): authenticate will time out at 702.671388s 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): get_auth_request con 0x7f37fc0a47c0 auth_method 0 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 0x7f37fc11f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): get_auth_request con 0x7f37fc1399e0 auth_method 0 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37faffd640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f37fc0a1f40 0x7f37fc073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37faffd640 10 monclient(hunting): get_auth_request con 0x7f37fc0a1f40 auth_method 0 2024-08-19T11:10:44.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37faffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f9be0741640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f9be0741640 10 monclient: _add_conns ranks=[4,2,7,6,3,1,8,5,0] 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f9be0741640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 0x7f9bd81ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f9be0741640 10 monclient(hunting): picked mon.noname-c con 0x7f9bd80a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f9be0741640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6e10 0x7f9bd8138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.630+0000 7f37fa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): picked mon.noname-b con 0x7f9bd80a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 10 monclient(hunting): handle_auth_done global_id 4302 payload 824 2024-08-19T11:10:44.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 1 -- 172.21.15.71:0/2742793792 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f37fc0a1f40 msgr2=0x7f37fc073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f37fc0a1f40 0x7f37fc073360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 1 -- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 msgr2=0x7f37fc11f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): picked mon.noname-i con 0x7f9bd8139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd80a7730 con 0x7f9bd80a6e10 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9bd813a1a0 con 0x7f9bd80a6a30 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9bd80a1f50 con 0x7f9bd8139860 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9be0741640 10 monclient(hunting): authenticate will time out at 702.672210s 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 0x7f9bd81ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 0x7f37fc11f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 0x7f9bd81ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46888/0 (socket says 172.21.15.71:46888) 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 -- 172.21.15.71:0/2105778928 learned_addr learned my addr 172.21.15.71:0/2105778928 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): get_auth_request con 0x7f9bd80a6a30 auth_method 0 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 1 monclient: found mon.noname-a 2024-08-19T11:10:44.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:44.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fb7fe640 1 -- 172.21.15.71:0/2742793792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc1224f0 con 0x7f37fc1399e0 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bdecde640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bddcdc640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6e10 0x7f9bd8138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bddcdc640 10 monclient(hunting): get_auth_request con 0x7f9bd80a6e10 auth_method 0 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bddcdc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bddcdc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bddcdc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient(hunting): handle_auth_done global_id 4306 payload 824 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 -- 172.21.15.71:0/2105778928 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 msgr2=0x7f9bd8139210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 -- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6e10 msgr2=0x7f9bd8138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6e10 0x7f9bd8138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 monclient: found mon.noname-c 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bde4dd640 1 -- 172.21.15.71:0/2105778928 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd8125df0 con 0x7f9bd80a6a30 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bdecde640 10 monclient: get_auth_request con 0x7f9bd8139860 auth_method 0 2024-08-19T11:10:44.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f9bdecde640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.631+0000 7f37fa7fc640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 0x7f37fc11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f37fb7fe640 1 -- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 msgr2=0x7f37fc11f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f37fb7fe640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 0x7f37fc11f940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37f4033000 tx=0x7f37f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bde4dd640 1 -- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 msgr2=0x7f9bd81ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bde4dd640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 0x7f9bd81ce110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400ea00 tx=0x7f9bd400eec0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bd4017070 con 0x7f9bd80a6a30 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: dump: 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.669 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd400cc70 con 0x7f9bd80a6a30 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 5 monclient: authenticate success, global_id 4306 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 10 monclient: _renew_subs 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd80a7280 con 0x7f9bd80a6a30 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9bd400ce20 con 0x7f9bd80a6a30 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bceffd640 10 monclient: dump: 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.672 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9bdccda640 4 set_mon_vals no callback set 2024-08-19T11:10:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 10 monclient: _renew_subs 2024-08-19T11:10:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.634+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd8126690 con 0x7f9bd80a6a30 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37f403f030 con 0x7f37fc1399e0 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: dump: 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4003ba0 con 0x7f37fc1399e0 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f37f4036040 con 0x7f37fc1399e0 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f37e37fe640 10 monclient: dump: 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 5 monclient: authenticate success, global_id 4302 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 10 monclient: _renew_subs 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc0a86c0 con 0x7f37fc1399e0 2024-08-19T11:10:44.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 10 monclient: _renew_subs 2024-08-19T11:10:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.635+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc122210 con 0x7f37fc1399e0 2024-08-19T11:10:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.636+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9bd401a070 con 0x7f9bd80a6a30 2024-08-19T11:10:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.636+0000 7f37f97fa640 4 set_mon_vals no callback set 2024-08-19T11:10:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.636+0000 7f9be0741640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.636+0000 7f9be0741640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.636+0000 7f9be0741640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.636+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd81ce650 con 0x7f9bd80a6a30 2024-08-19T11:10:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f37f4042070 con 0x7f37fc1399e0 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f9bceffd640 1 --2- 172.21.15.71:0/2105778928 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bbc03ea80 0x7f9bbc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f9bd400f040 con 0x7f9bd80a6a30 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f37e37fe640 1 --2- 172.21.15.71:0/2742793792 >> v2:172.21.15.135:6800/726754104 conn(0x7f37e803eae0 0x7f37e8040fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f37f4040070 con 0x7f37fc1399e0 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f380179f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f380179f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f380179f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f37faffd640 1 --2- 172.21.15.71:0/2742793792 >> v2:172.21.15.135:6800/726754104 conn(0x7f37e803eae0 0x7f37e8040fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.637+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc005080 con 0x7f37fc1399e0 2024-08-19T11:10:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.638+0000 7f37faffd640 10 monclient: get_auth_request con 0x7f37e803eae0 auth_method 0 2024-08-19T11:10:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.638+0000 7f9bddcdc640 1 --2- 172.21.15.71:0/2105778928 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bbc03ea80 0x7f9bbc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.638+0000 7f9bddcdc640 10 monclient: get_auth_request con 0x7f9bbc03ea80 auth_method 0 2024-08-19T11:10:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.640+0000 7f37faffd640 1 --2- 172.21.15.71:0/2742793792 >> v2:172.21.15.135:6800/726754104 conn(0x7f37e803eae0 0x7f37e8040fa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009a50 tx=0x7f37ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.643+0000 7f9bddcdc640 1 --2- 172.21.15.71:0/2105778928 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bbc03ea80 0x7f9bbc040f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bd81249a0 tx=0x7f9bc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.643+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f37f4049020 con 0x7f37fc1399e0 2024-08-19T11:10:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.643+0000 7f37e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.643+0000 7f37e37fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.646+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9bd4021070 con 0x7f9bd80a6a30 2024-08-19T11:10:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.646+0000 7f9bceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.646+0000 7f9bceffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.718+0000 7f4d53c30640 10 monclient: get_monmap_and_config 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.718+0000 7f4d53c30640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.718+0000 7f4d53c30640 10 monclient: monmap: 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:44.719552+0000 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:44.719552+0000 2024-08-19T11:10:44.720 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:44.721 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.719+0000 7f4d53c30640 1 Processor -- start 2024-08-19T11:10:44.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.720+0000 7f4d53c30640 1 -- start start 2024-08-19T11:10:44.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.720+0000 7f4d53c30640 10 monclient: init 2024-08-19T11:10:44.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient: _add_conns ranks=[10,7,8,6,0,4,1,3,9,2,5] 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d4c0a6a30 0x7f4d4c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): picked mon.noname-f con 0x7f4d4c0a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): picked mon.noname-i con 0x7f4d4c0a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4d4c139860 0x7f4d4c139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): picked mon.noname-e con 0x7f4d4c139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4c0a4f90 con 0x7f4d4c0a6a30 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4d4c0a6380 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4d4c0a49d0 con 0x7f4d4c139860 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d53c30640 10 monclient(hunting): authenticate will time out at 702.762525s 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:55296/0 (socket says 172.21.15.71:55296) 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 1 -- 172.21.15.71:0/3449121055 learned_addr learned my addr 172.21.15.71:0/3449121055 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): get_auth_request con 0x7f4d4c0a6e10 auth_method 0 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 1 --2- 172.21.15.71:0/3449121055 >> v2:172.21.15.135:3300/0 conn(0x7f4d4c0a6a30 0x7f4d4c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): get_auth_request con 0x7f4d4c0a6a30 auth_method 0 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d511cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.721+0000 7f4d519cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d521cd640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4d4c139860 0x7f4d4c139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d521cd640 10 monclient(hunting): get_auth_request con 0x7f4d4c139860 auth_method 0 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d521cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d521cd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d521cd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 10 monclient(hunting): handle_auth_done global_id 4282 payload 274 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 1 -- 172.21.15.71:0/3449121055 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4d4c139860 msgr2=0x7f4d4c139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4d4c139860 0x7f4d4c139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 1 -- 172.21.15.71:0/3449121055 >> v2:172.21.15.135:3300/0 conn(0x7f4d4c0a6a30 msgr2=0x7f4d4c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 1 --2- 172.21.15.71:0/3449121055 >> v2:172.21.15.135:3300/0 conn(0x7f4d4c0a6a30 0x7f4d4c0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 1 monclient: found mon.noname-i 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d511cb640 1 -- 172.21.15.71:0/3449121055 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c0a46f0 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d521cd640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4d4c139860 0x7f4d4c139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.722+0000 7f4d519cc640 1 --2- 172.21.15.71:0/3449121055 >> v2:172.21.15.135:3300/0 conn(0x7f4d4c0a6a30 0x7f4d4c0a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.725+0000 7f4d511cb640 1 -- 172.21.15.71:0/3449121055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 msgr2=0x7f4d4c0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.725+0000 7f4d511cb640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c0a71f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0098a0 tx=0x7f4d3c02a0c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=cbff4ed39d266560 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 1 -- 172.21.15.71:0/3449121055 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d3c037070 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: dump: 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.736 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.737 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 1 -- 172.21.15.71:0/3449121055 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c02ade0 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d53c30640 5 monclient: authenticate success, global_id 4282 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d53c30640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d53c30640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:44.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 1 -- 172.21.15.71:0/3449121055 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d3c030c20 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d53c30640 4 set_mon_vals no callback set 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.726+0000 7f4d509ca640 10 monclient: dump: 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.739 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 10 monclient: shutdown 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 -- 172.21.15.71:0/3449121055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 msgr2=0x7f4d4c0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c0a71f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0098a0 tx=0x7f4d3c02a0c0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 -- 172.21.15.71:0/3449121055 shutdown_connections 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4d4c139860 0x7f4d4c139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 --2- 172.21.15.71:0/3449121055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c0a71f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 --2- 172.21.15.71:0/3449121055 >> v2:172.21.15.135:3300/0 conn(0x7f4d4c0a6a30 0x7f4d4c0a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.727+0000 7f4d53c30640 1 -- 172.21.15.71:0/3449121055 >> 172.21.15.71:0/3449121055 conn(0x7f4d4c0ac030 msgr2=0x7f4d4c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.731+0000 7f4d53c30640 1 -- 172.21.15.71:0/3449121055 shutdown_connections 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.731+0000 7f4d53c30640 1 -- 172.21.15.71:0/3449121055 wait complete. 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.732+0000 7f4d53c30640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.732+0000 7f4d53c30640 10 monclient: monmap: 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:44.748 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.749 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.732+0000 7f4d53c30640 1 Processor -- start 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.732+0000 7f4d53c30640 1 -- start start 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.732+0000 7f4d53c30640 10 monclient: init 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.733+0000 7f4d53c30640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.733+0000 7f4d53c30640 10 monclient: _add_conns ranks=[7,6,2,8,3,1,0,4,5] 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.733+0000 7f4d53c30640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 0x7f4d4c1ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.733+0000 7f4d53c30640 10 monclient(hunting): picked mon.noname-i con 0x7f4d4c0a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): picked mon.noname-d con 0x7f4d4c0a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:44.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 0x7f4d4c139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c138ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55740/0 (socket says 172.21.15.71:55740) 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 0x7f4d4c139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 0x7f4d4c139010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34648/0 (socket says 172.21.15.71:34648) 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d519cc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 0x7f4d4c1ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d519cc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 0x7f4d4c1ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:55308/0 (socket says 172.21.15.71:55308) 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): picked mon.noname-b con 0x7f4d4c139860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 1 -- 172.21.15.71:0/4151991202 learned_addr learned my addr 172.21.15.71:0/4151991202 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c0a7730 con 0x7f4d4c139860 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4d4c13a200 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4d4c0a2150 con 0x7f4d4c0a6a30 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d53c30640 10 monclient(hunting): authenticate will time out at 702.775741s 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): get_auth_request con 0x7f4d4c0a6e10 auth_method 0 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): get_auth_request con 0x7f4d4c139860 auth_method 0 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d521cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.734+0000 7f4d511cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 10 monclient(hunting): handle_auth_done global_id 4353 payload 824 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 1 -- 172.21.15.71:0/4151991202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 msgr2=0x7f4d4c1ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 0x7f4d4c1ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 1 -- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 msgr2=0x7f4d4c139010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 0x7f4d4c139010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 1 monclient: found mon.noname-d 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d511cb640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c124130 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d519cc640 10 monclient: get_auth_request con 0x7f4d4c0a6a30 auth_method 0 2024-08-19T11:10:44.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d519cc640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 0x7f4d4c1ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:44.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.735+0000 7f4d521cd640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 0x7f4d4c139010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7fe43c43f640 10 monclient: get_monmap_and_config 2024-08-19T11:10:44.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d511cb640 1 -- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 msgr2=0x7f4d4c138ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d511cb640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c138ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0097c0 tx=0x7f4d3c004730 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7fe43c43f640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7fe43c43f640 10 monclient: monmap: 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:44.738243+0000 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:44.738243+0000 2024-08-19T11:10:44.756 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:44.757 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d3c037040 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:44.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 10 monclient: dump: 2024-08-19T11:10:44.759 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.760 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d53c30640 5 monclient: authenticate success, global_id 4353 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d53c30640 10 monclient: _renew_subs 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d53c30640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.737+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c139ee0 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7fe43c43f640 1 Processor -- start 2024-08-19T11:10:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c042070 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d427fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d3c003ca0 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d427fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:44.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d427fc640 10 monclient: dump: 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d43fff640 4 set_mon_vals no callback set 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d53c30640 10 monclient: _renew_subs 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d53c30640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c125bf0 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7fe43c43f640 1 -- start start 2024-08-19T11:10:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.738+0000 7fe43c43f640 10 monclient: init 2024-08-19T11:10:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4d3c047460 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient: _add_conns ranks=[10,0,8,4,9,3,2,5,6,1,7] 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe4340a6a30 0x7fe4340a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): picked mon.noname-f con 0x7fe4340a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe4340a6e10 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 0x7fe434140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): picked mon.noname-e con 0x7fe43413eb10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4340a4f90 con 0x7fe4340a6e10 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe4340a3650 con 0x7fe4340a6a30 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe4340a6380 con 0x7fe43413eb10 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.739+0000 7fe43c43f640 10 monclient(hunting): authenticate will time out at 702.780976s 2024-08-19T11:10:44.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7f4d427fc640 1 --2- 172.21.15.71:0/4151991202 >> v2:172.21.15.135:6800/726754104 conn(0x7f4d3003ea80 0x7f4d30040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f4d3c075120 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 0x7fe434140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe4399da640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe4340a6e10 0x7fe4340a71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36886/0 (socket says 172.21.15.71:36886) 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe4399da640 1 -- 172.21.15.71:0/3828775026 learned_addr learned my addr 172.21.15.71:0/3828775026 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): get_auth_request con 0x7fe43413eb10 auth_method 0 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7f4d53c30640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7f4d53c30640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7f4d53c30640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 1 --2- 172.21.15.71:0/3828775026 >> v2:172.21.15.135:3300/0 conn(0x7fe4340a6a30 0x7fe4340a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): get_auth_request con 0x7fe4340a6a30 auth_method 0 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c0a1c90 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2024-08-19T11:10:44.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 1 -- 172.21.15.71:0/3828775026 >> v2:172.21.15.135:3300/0 conn(0x7fe4340a6a30 msgr2=0x7fe4340a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 1 --2- 172.21.15.71:0/3828775026 >> v2:172.21.15.135:3300/0 conn(0x7fe4340a6a30 0x7fe4340a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 1 -- 172.21.15.71:0/3828775026 >> v1:172.21.15.71:6789/0 conn(0x7fe4340a6e10 legacy=0x7fe4340a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 1 monclient: found mon.noname-e 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a9dc640 1 -- 172.21.15.71:0/3828775026 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4340a49d0 con 0x7fe43413eb10 2024-08-19T11:10:44.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.740+0000 7fe43a1db640 1 --2- 172.21.15.71:0/3828775026 >> v2:172.21.15.135:3300/0 conn(0x7fe4340a6a30 0x7fe4340a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.741+0000 7f4d519cc640 1 --2- 172.21.15.71:0/4151991202 >> v2:172.21.15.135:6800/726754104 conn(0x7f4d3003ea80 0x7f4d30040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.741+0000 7f4d519cc640 10 monclient: get_auth_request con 0x7f4d3003ea80 auth_method 0 2024-08-19T11:10:44.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe43a9dc640 1 -- 172.21.15.71:0/3828775026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 msgr2=0x7fe434140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe43a9dc640 1 --2- 172.21.15.71:0/3828775026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 0x7fe434140f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009d90 tx=0x7fe42c02a490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1c122ef7eb4ada22 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 1 -- 172.21.15.71:0/3828775026 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe42c007bc0 con 0x7fe43413eb10 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: dump: 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.777 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe43c43f640 5 monclient: authenticate success, global_id 4283 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe43c43f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 1 -- 172.21.15.71:0/3828775026 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42c007d60 con 0x7fe43413eb10 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7f4d519cc640 1 --2- 172.21.15.71:0/4151991202 >> v2:172.21.15.135:6800/726754104 conn(0x7f4d3003ea80 0x7f4d30040f40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009ac0 tx=0x7f4d48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 1 -- 172.21.15.71:0/3828775026 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe42c031400 con 0x7fe43413eb10 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe4391d9640 10 monclient: dump: 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.785 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe43c43f640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.744+0000 7fe43c43f640 4 set_mon_vals no callback set 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 10 monclient: shutdown 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 -- 172.21.15.71:0/3828775026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 msgr2=0x7fe434140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 --2- 172.21.15.71:0/3828775026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 0x7fe434140f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009d90 tx=0x7fe42c02a490 comp rx=0 tx=0).stop 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 -- 172.21.15.71:0/3828775026 shutdown_connections 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 --2- 172.21.15.71:0/3828775026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe43413eb10 0x7fe434140f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 --2- 172.21.15.71:0/3828775026 >> v2:172.21.15.135:3300/0 conn(0x7fe4340a6a30 0x7fe4340a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 -- 172.21.15.71:0/3828775026 >> 172.21.15.71:0/3828775026 conn(0x7fe4340ac030 msgr2=0x7fe4340ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 -- 172.21.15.71:0/3828775026 shutdown_connections 2024-08-19T11:10:44.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.745+0000 7fe43c43f640 1 -- 172.21.15.71:0/3828775026 wait complete. 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.746+0000 7fe43c43f640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.746+0000 7fe43c43f640 10 monclient: monmap: 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:44.788 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.746+0000 7fe43c43f640 1 Processor -- start 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.746+0000 7fe43c43f640 1 -- start start 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.746+0000 7fe43c43f640 10 monclient: init 2024-08-19T11:10:44.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient: _add_conns ranks=[5,7,4,0,3,2,6,8,1] 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe4340a6a30 0x7fe4341259f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): picked mon.noname-h con 0x7fe4340a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe4340a6e10 0x7fe4341ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): picked mon.noname-i con 0x7fe4340a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 0x7fe4341ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): picked mon.noname-c con 0x7fe43413eb10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe434141440 con 0x7fe43413eb10 2024-08-19T11:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe4340a5d30 con 0x7fe4340a6a30 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe4341415c0 con 0x7fe4340a6e10 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43c43f640 10 monclient(hunting): authenticate will time out at 702.788346s 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 0x7fe4341ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 0x7fe4341ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53122/0 (socket says 172.21.15.71:53122) 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 1 -- 172.21.15.71:0/1812024095 learned_addr learned my addr 172.21.15.71:0/1812024095 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): get_auth_request con 0x7fe43413eb10 auth_method 0 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a1db640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe4340a6a30 0x7fe4341259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a1db640 10 monclient(hunting): get_auth_request con 0x7fe4340a6a30 auth_method 0 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a1db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a1db640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe43a1db640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe4399da640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe4340a6e10 0x7fe4341ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe4399da640 10 monclient(hunting): get_auth_request con 0x7fe4340a6e10 auth_method 0 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe4399da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe4399da640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.747+0000 7fe4399da640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 10 monclient(hunting): handle_auth_done global_id 4315 payload 824 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 1 -- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe4340a6e10 msgr2=0x7fe4341ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe4340a6e10 0x7fe4341ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 1 -- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe4340a6a30 msgr2=0x7fe4341259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe4340a6a30 0x7fe4341259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 1 monclient: found mon.noname-c 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a9dc640 1 -- 172.21.15.71:0/1812024095 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe434126f10 con 0x7fe43413eb10 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.748+0000 7fe43a1db640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe4340a6a30 0x7fe4341259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.749+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f4d4c0a1c90 con 0x7f4d4c0a6e10 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.749+0000 7f4d427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.749+0000 7f4d427fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:44.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43a9dc640 1 -- 172.21.15.71:0/1812024095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 msgr2=0x7fe4341ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43a9dc640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 0x7fe4341ceed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe42c02a9b0 tx=0x7fe42c004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe42c0046c0 con 0x7fe43413eb10 2024-08-19T11:10:44.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 10 monclient: dump: 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.799 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.800 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42c03b410 con 0x7fe43413eb10 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe42c03ba30 con 0x7fe43413eb10 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 5 monclient: authenticate success, global_id 4315 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 10 monclient: _renew_subs 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4341271f0 con 0x7fe43413eb10 2024-08-19T11:10:44.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe4389d8640 4 set_mon_vals no callback set 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 10 monclient: _renew_subs 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.750+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe434141150 con 0x7fe43413eb10 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.751+0000 7fe42affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.751+0000 7fe42affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.751+0000 7fe42affd640 10 monclient: dump: 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.802 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.752+0000 7fe43c43f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.752+0000 7fe43c43f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.752+0000 7fe43c43f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.752+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4340a57f0 con 0x7fe43413eb10 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.753+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe42c007c80 con 0x7fe43413eb10 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.753+0000 7fe42affd640 1 --2- 172.21.15.71:0/1812024095 >> v2:172.21.15.135:6800/726754104 conn(0x7fe41803ea80 0x7fe418040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.753+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fe42c073250 con 0x7fe43413eb10 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.753+0000 7fe43a1db640 1 --2- 172.21.15.71:0/1812024095 >> v2:172.21.15.135:6800/726754104 conn(0x7fe41803ea80 0x7fe418040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.753+0000 7fe43a1db640 10 monclient: get_auth_request con 0x7fe41803ea80 auth_method 0 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.756+0000 7fe43a1db640 1 --2- 172.21.15.71:0/1812024095 >> v2:172.21.15.135:6800/726754104 conn(0x7fe41803ea80 0x7fe418040f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe430009ba0 tx=0x7fe430008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.759+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fe42c048070 con 0x7fe43413eb10 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.759+0000 7fe42affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.759+0000 7fe42affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.761+0000 7f8448b53640 10 monclient: get_monmap_and_config 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.761+0000 7f8448b53640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.761+0000 7f8448b53640 10 monclient: monmap: 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:44.761992+0000 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:44.761992+0000 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.814 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.815 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:44.815 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:44.815 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.815 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.815 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.818 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.818 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 1 Processor -- start 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 1 -- start start 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 10 monclient: init 2024-08-19T11:10:44.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 10 monclient: _add_conns ranks=[6,5,0,2,8,9,1,10,4,3,7] 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6a30 0x7f84440a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 10 monclient(hunting): picked mon.noname-d con 0x7f84440a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 0x7f84440a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 10 monclient(hunting): picked mon.noname-h con 0x7f84440a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8444139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.762+0000 7f8448b53640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84440a4f90 con 0x7f8444139860 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8448b53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8448b53640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f84440a6380 con 0x7f84440a6e10 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8448b53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8448b53640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f84440a49d0 con 0x7f84440a6a30 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8448b53640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8448b53640 10 monclient(hunting): authenticate will time out at 702.804046s 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8442d9d640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8444139860 0x7f8444139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36888/0 (socket says 172.21.15.71:36888) 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8442d9d640 1 -- 172.21.15.71:0/4037283687 learned_addr learned my addr 172.21.15.71:0/4037283687 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6a30 0x7f84440a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 0x7f84440a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): get_auth_request con 0x7f84440a6a30 auth_method 0 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): get_auth_request con 0x7f84440a6e10 auth_method 0 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient(hunting): handle_auth_done global_id 14333 payload 274 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 1 -- 172.21.15.71:0/4037283687 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6a30 msgr2=0x7f84440a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6a30 0x7f84440a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 1 -- 172.21.15.71:0/4037283687 >> v1:172.21.15.71:6789/0 conn(0x7f8444139860 legacy=0x7f8444139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 1 monclient: found mon.noname-h 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f8441d9b640 1 -- 172.21.15.71:0/4037283687 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84440a46f0 con 0x7f84440a6e10 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.763+0000 7f844259c640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6a30 0x7f84440a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f8441d9b640 1 -- 172.21.15.71:0/4037283687 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 msgr2=0x7f84440a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f8441d9b640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 0x7f84440a71f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84380097d0 tx=0x7f8438029fb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=4d21ba378e0b9042 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 1 -- 172.21.15.71:0/4037283687 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8438037070 con 0x7f84440a6e10 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: dump: 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 1 -- 172.21.15.71:0/4037283687 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843802ad10 con 0x7f84440a6e10 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 1 -- 172.21.15.71:0/4037283687 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8438030c20 con 0x7f84440a6e10 2024-08-19T11:10:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f844159a640 10 monclient: dump: 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f8448b53640 5 monclient: authenticate success, global_id 14333 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f8448b53640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.767+0000 7f8448b53640 4 set_mon_vals no callback set 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 10 monclient: shutdown 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 -- 172.21.15.71:0/4037283687 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 msgr2=0x7f84440a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 0x7f84440a71f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84380097d0 tx=0x7f8438029fb0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 -- 172.21.15.71:0/4037283687 shutdown_connections 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6e10 0x7f84440a71f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 --2- 172.21.15.71:0/4037283687 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6a30 0x7f84440a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 -- 172.21.15.71:0/4037283687 >> 172.21.15.71:0/4037283687 conn(0x7f84440ac030 msgr2=0x7f84440ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 -- 172.21.15.71:0/4037283687 shutdown_connections 2024-08-19T11:10:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.768+0000 7f8448b53640 1 -- 172.21.15.71:0/4037283687 wait complete. 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.769+0000 7f8448b53640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.769+0000 7f8448b53640 10 monclient: monmap: 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.770+0000 7f8448b53640 1 Processor -- start 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.770+0000 7f8448b53640 1 -- start start 2024-08-19T11:10:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.770+0000 7f8448b53640 10 monclient: init 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.771+0000 7f8448b53640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.771+0000 7f8448b53640 10 monclient: _add_conns ranks=[5,6,8,2,3,0,7,4,1] 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.771+0000 7f8448b53640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6a30 0x7f84441ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f8448b53640 10 monclient(hunting): picked mon.noname-h con 0x7f84440a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f8448b53640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 0x7f84441389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f844259c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6a30 0x7f84441ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f844259c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6a30 0x7f84441ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:42792/0 (socket says 172.21.15.71:42792) 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f8441d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 0x7f84441389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f8441d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 0x7f84441389f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55768/0 (socket says 172.21.15.71:55768) 2024-08-19T11:10:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f844259c640 1 -- 172.21.15.71:0/3381760072 learned_addr learned my addr 172.21.15.71:0/3381760072 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.772+0000 7f8448b53640 10 monclient(hunting): picked mon.noname-d con 0x7f84440a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8444139860 0x7f8444138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8442d9d640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8444139860 0x7f8444138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 10 monclient(hunting): picked mon.noname-e con 0x7f8444139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f84440a7730 con 0x7f84440a6a30 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f844413a370 con 0x7f84440a6e10 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f84440a20f0 con 0x7f8444139860 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8448b53640 10 monclient(hunting): authenticate will time out at 702.814829s 2024-08-19T11:10:44.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f289f420640 10 monclient: get_monmap_and_config 2024-08-19T11:10:44.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f289f420640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f289f420640 10 monclient: monmap: 2024-08-19T11:10:44.833 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.833 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:44.774877+0000 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:44.774877+0000 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.834 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.835 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.835 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.835 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.835 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:44.835 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:44.835 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f844259c640 10 monclient(hunting): get_auth_request con 0x7f84440a6a30 auth_method 0 2024-08-19T11:10:44.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f844259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f844259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f844259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8441d9b640 10 monclient(hunting): get_auth_request con 0x7f84440a6e10 auth_method 0 2024-08-19T11:10:44.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8441d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8441d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.773+0000 7f8441d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f289f420640 1 Processor -- start 2024-08-19T11:10:44.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): get_auth_request con 0x7f8444139860 auth_method 0 2024-08-19T11:10:44.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 -- start start 2024-08-19T11:10:44.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient: init 2024-08-19T11:10:44.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8442d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 10 monclient(hunting): handle_auth_done global_id 4371 payload 824 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 1 -- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8444139860 msgr2=0x7f8444138f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8444139860 0x7f8444138f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 1 -- 172.21.15.71:0/3381760072 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6a30 msgr2=0x7f84441ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6a30 0x7f84441ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 1 monclient: found mon.noname-d 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.774+0000 7f8441d9b640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84440a57c0 con 0x7f84440a6e10 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient: _add_conns ranks=[2,10,5,8,6,3,0,7,9,4,1] 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f28980a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): picked mon.noname-b con 0x7f28980a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28980a6e10 0x7f28980a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): picked mon.noname-f con 0x7f28980a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 0x7f2898139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): picked mon.noname-h con 0x7f2898139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f28980a4f90 con 0x7f28980a6e10 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f28980a6380 con 0x7f28980a6a30 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f28980a49d0 con 0x7f2898139860 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289d1bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f28980a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.775+0000 7f289f420640 10 monclient(hunting): authenticate will time out at 702.816944s 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f28980a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34656/0 (socket says 172.21.15.71:34656) 2024-08-19T11:10:44.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 1 -- 172.21.15.71:0/2624426431 learned_addr learned my addr 172.21.15.71:0/2624426431 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): get_auth_request con 0x7f28980a6a30 auth_method 0 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 --2- 172.21.15.71:0/2624426431 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 0x7f2898139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 1 --2- 172.21.15.71:0/2624426431 >> v2:172.21.15.135:3300/0 conn(0x7f28980a6e10 0x7f28980a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): get_auth_request con 0x7f2898139860 auth_method 0 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): get_auth_request con 0x7f28980a6e10 auth_method 0 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d1bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient(hunting): handle_auth_done global_id 14351 payload 274 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 -- 172.21.15.71:0/2624426431 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 msgr2=0x7f28980a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 --2- 172.21.15.71:0/2624426431 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f28980a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 -- 172.21.15.71:0/2624426431 >> v2:172.21.15.135:3300/0 conn(0x7f28980a6e10 msgr2=0x7f28980a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 --2- 172.21.15.71:0/2624426431 >> v2:172.21.15.135:3300/0 conn(0x7f28980a6e10 0x7f28980a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 monclient: found mon.noname-h 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:44.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289d9bd640 1 -- 172.21.15.71:0/2624426431 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28980a46f0 con 0x7f2898139860 2024-08-19T11:10:44.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.776+0000 7f289c9bb640 1 --2- 172.21.15.71:0/2624426431 >> v2:172.21.15.135:3300/0 conn(0x7f28980a6e10 0x7f28980a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8441d9b640 1 -- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 msgr2=0x7f84441389f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8441d9b640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 0x7f84441389f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8438031000 tx=0x7f84380046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8438041020 con 0x7f84440a6e10 2024-08-19T11:10:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:44.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: dump: 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.852 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84380044c0 con 0x7f84440a6e10 2024-08-19T11:10:44.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 5 monclient: authenticate success, global_id 4371 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 10 monclient: _renew_subs 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8444124050 con 0x7f84440a6e10 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8438037040 con 0x7f84440a6e10 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8432ffd640 10 monclient: dump: 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.854 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.855 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8440d99640 4 set_mon_vals no callback set 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 10 monclient: _renew_subs 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.777+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f84441ce600 con 0x7f84440a6e10 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f8448b53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f8448b53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f8448b53640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:44.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84440ad0c0 con 0x7f84440a6e10 2024-08-19T11:10:44.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f289d9bd640 1 -- 172.21.15.71:0/2624426431 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 msgr2=0x7f2898139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f289d9bd640 1 --2- 172.21.15.71:0/2624426431 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 0x7f2898139cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2890009d90 tx=0x7f289002a490 comp rx=0 tx=0).ready entity=mon.5 client_cookie=24fd9f7c79ed78bb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 1 -- 172.21.15.71:0/2624426431 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2890007bc0 con 0x7f2898139860 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: dump: 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.859 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 1 -- 172.21.15.71:0/2624426431 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2890007d80 con 0x7f2898139860 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 1 -- 172.21.15.71:0/2624426431 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2890031870 con 0x7f2898139860 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8438044020 con 0x7f84440a6e10 2024-08-19T11:10:44.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f8432ffd640 1 --2- 172.21.15.71:0/3381760072 >> v2:172.21.15.135:6800/726754104 conn(0x7f842403ea80 0x7f8424040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f8438071ed0 con 0x7f84440a6e10 2024-08-19T11:10:44.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f844259c640 1 --2- 172.21.15.71:0/3381760072 >> v2:172.21.15.135:6800/726754104 conn(0x7f842403ea80 0x7f8424040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f844259c640 10 monclient: get_auth_request con 0x7f842403ea80 auth_method 0 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f288ffff640 10 monclient: dump: 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.867 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f289f420640 5 monclient: authenticate success, global_id 14351 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f289f420640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:44.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.779+0000 7f289f420640 4 set_mon_vals no callback set 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 10 monclient: shutdown 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 -- 172.21.15.71:0/2624426431 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 msgr2=0x7f2898139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 --2- 172.21.15.71:0/2624426431 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 0x7f2898139cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2890009d90 tx=0x7f289002a490 comp rx=0 tx=0).stop 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 -- 172.21.15.71:0/2624426431 shutdown_connections 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 --2- 172.21.15.71:0/2624426431 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2898139860 0x7f2898139cc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 --2- 172.21.15.71:0/2624426431 >> v2:172.21.15.135:3300/0 conn(0x7f28980a6e10 0x7f28980a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 --2- 172.21.15.71:0/2624426431 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f28980a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 -- 172.21.15.71:0/2624426431 >> 172.21.15.71:0/2624426431 conn(0x7f28980ac030 msgr2=0x7f28980ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 -- 172.21.15.71:0/2624426431 shutdown_connections 2024-08-19T11:10:44.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.780+0000 7f289f420640 1 -- 172.21.15.71:0/2624426431 wait complete. 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.781+0000 7f289f420640 10 monclient: build_initial_monmap 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.781+0000 7f289f420640 10 monclient: monmap: 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:44.870 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.781+0000 7f289f420640 1 Processor -- start 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.781+0000 7f289f420640 1 -- start start 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.781+0000 7f289f420640 10 monclient: init 2024-08-19T11:10:44.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient: _add_conns ranks=[2,5,8,6,3,1,0,4,7] 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f289812ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): picked mon.noname-b con 0x7f28980a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28980a6e10 0x7f289812b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): picked mon.noname-h con 0x7f28980a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 0x7f289812b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): picked mon.noname-e con 0x7f2898139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f28980a7730 con 0x7f28980a6a30 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f289813a200 con 0x7f28980a6e10 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f28980a25b0 con 0x7f2898139860 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289f420640 10 monclient(hunting): authenticate will time out at 702.823600s 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f289812ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f289812ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34664/0 (socket says 172.21.15.71:34664) 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 1 -- 172.21.15.71:0/3663822235 learned_addr learned my addr 172.21.15.71:0/3663822235 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): get_auth_request con 0x7f28980a6a30 auth_method 0 2024-08-19T11:10:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 0x7f289812b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): get_auth_request con 0x7f2898139860 auth_method 0 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d1bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f289d9bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 10 monclient(hunting): handle_auth_done global_id 4301 payload 824 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 1 -- 172.21.15.71:0/3663822235 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28980a6e10 msgr2=0x7f289812b3d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28980a6e10 0x7f289812b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.782+0000 7f844259c640 1 --2- 172.21.15.71:0/3381760072 >> v2:172.21.15.135:6800/726754104 conn(0x7f842403ea80 0x7f8424040f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8434009ba0 tx=0x7f8434008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 1 -- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 msgr2=0x7f289812ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f289812ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:44.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 1 monclient: found mon.noname-e 2024-08-19T11:10:44.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:44.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.783+0000 7f289d9bd640 1 -- 172.21.15.71:0/3663822235 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289812d580 con 0x7f2898139860 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f289d9bd640 1 -- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 msgr2=0x7f289812b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f289d9bd640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 0x7f289812b910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28980a5760 tx=0x7f2890004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28900044b0 con 0x7f2898139860 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 10 monclient: dump: 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.879 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.880 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f288dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f289f420640 5 monclient: authenticate success, global_id 4301 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f289f420640 10 monclient: _renew_subs 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f289f420640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.785+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28980a20f0 con 0x7f2898139860 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f289f420640 10 monclient: _renew_subs 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f289f420640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:44.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f28980a0e90 con 0x7f2898139860 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2890004650 con 0x7f2898139860 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2890004800 con 0x7f2898139860 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288dffb640 10 monclient: dump: 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:44.882 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:44.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.786+0000 7f288f7fe640 4 set_mon_vals no callback set 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.787+0000 7f289f420640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.787+0000 7f289f420640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.787+0000 7f289f420640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.787+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2878005080 con 0x7f2898139860 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.787+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2890004040 con 0x7f2898139860 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.787+0000 7f288dffb640 1 --2- 172.21.15.71:0/3663822235 >> v2:172.21.15.135:6800/726754104 conn(0x7f287c03ea80 0x7f287c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.788+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f2890072dd0 con 0x7f2898139860 2024-08-19T11:10:44.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.788+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f843804b030 con 0x7f84440a6e10 2024-08-19T11:10:44.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.788+0000 7f289d1bc640 1 --2- 172.21.15.71:0/3663822235 >> v2:172.21.15.135:6800/726754104 conn(0x7f287c03ea80 0x7f287c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:44.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.788+0000 7f289d1bc640 10 monclient: get_auth_request con 0x7f287c03ea80 auth_method 0 2024-08-19T11:10:44.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.788+0000 7f8432ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.788+0000 7f8432ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:44.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.790+0000 7f289d1bc640 1 --2- 172.21.15.71:0/3663822235 >> v2:172.21.15.135:6800/726754104 conn(0x7f287c03ea80 0x7f287c040f40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f28940094a0 tx=0x7f2894009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:44.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.797+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f2890051020 con 0x7f2898139860 2024-08-19T11:10:44.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.797+0000 7f288dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:44.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.797+0000 7f288dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:44.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f380179f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-19T11:10:44.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f380179f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-19T11:10:44.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f380179f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:44.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f37dc005370 con 0x7f37fc1399e0 2024-08-19T11:10:44.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f37e37fe640 1 -- 172.21.15.71:0/2742793792 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37f4004040 con 0x7f37fc1399e0 2024-08-19T11:10:44.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f37e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-08-19T11:10:44.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.930+0000 7f37e37fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:44.932 INFO:teuthology.orchestra.run.smithi071.stdout:51539607558 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.932+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 >> v2:172.21.15.135:6800/726754104 conn(0x7f37e803eae0 msgr2=0x7f37e8040fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.932+0000 7f380179f640 1 --2- 172.21.15.71:0/2742793792 >> v2:172.21.15.135:6800/726754104 conn(0x7f37e803eae0 0x7f37e8040fa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009a50 tx=0x7f37ec008040 comp rx=0 tx=0).stop 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.932+0000 7f380179f640 10 monclient: shutdown 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.932+0000 7f380179f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.932+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 msgr2=0x7f37fc11f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.932+0000 7f380179f640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 0x7f37fc11f940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37f4033000 tx=0x7f37f4004a40 comp rx=0 tx=0).stop 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 shutdown_connections 2024-08-19T11:10:44.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 --2- 172.21.15.71:0/2742793792 >> v2:172.21.15.135:6800/726754104 conn(0x7f37e803eae0 0x7f37e8040fa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37fc1399e0 0x7f37fc11f940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f37fc0a47c0 0x7f37fc11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 --2- 172.21.15.71:0/2742793792 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f37fc0a1f40 0x7f37fc073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 >> 172.21.15.71:0/2742793792 conn(0x7f37fc0a93e0 msgr2=0x7f37fc0a2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 shutdown_connections 2024-08-19T11:10:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:44.933+0000 7f380179f640 1 -- 172.21.15.71:0/2742793792 wait complete. 2024-08-19T11:10:44.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607558 for osd.2 2024-08-19T11:10:44.945 DEBUG:teuthology.parallel:result is None 2024-08-19T11:10:45.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.028+0000 7f9be0741640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.028+0000 7f9be0741640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.028+0000 7f9be0741640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.028+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9bd806ca70 con 0x7f9bd80a6a30 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.028+0000 7f9bceffd640 1 -- 172.21.15.71:0/2105778928 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bd8125df0 con 0x7f9bd80a6a30 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.029+0000 7f9bceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.029+0000 7f9bceffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:45.030 INFO:teuthology.orchestra.run.smithi071.stdout:47244640262 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bbc03ea80 msgr2=0x7f9bbc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 --2- 172.21.15.71:0/2105778928 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bbc03ea80 0x7f9bbc040f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9bd81249a0 tx=0x7f9bc8008040 comp rx=0 tx=0).stop 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 10 monclient: shutdown 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 msgr2=0x7f9bd81ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 0x7f9bd81ce110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400ea00 tx=0x7f9bd400eec0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 shutdown_connections 2024-08-19T11:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 --2- 172.21.15.71:0/2105778928 >> v2:172.21.15.135:6800/726754104 conn(0x7f9bbc03ea80 0x7f9bbc040f40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9bd8139860 0x7f9bd8139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9bd80a6e10 0x7f9bd8138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 --2- 172.21.15.71:0/2105778928 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9bd80a6a30 0x7f9bd81ce110 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 >> 172.21.15.71:0/2105778928 conn(0x7f9bd80ac030 msgr2=0x7f9bd80ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 shutdown_connections 2024-08-19T11:10:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.032+0000 7f9be0741640 1 -- 172.21.15.71:0/2105778928 wait complete. 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.040+0000 7f289f420640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.040+0000 7f289f420640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.040+0000 7f289f420640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.040+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2878005370 con 0x7f2898139860 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.041+0000 7f288dffb640 1 -- 172.21.15.71:0/3663822235 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f289003f030 con 0x7f2898139860 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.041+0000 7f288dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.041+0000 7f288dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:45.042 INFO:teuthology.orchestra.run.smithi071.stdout:51539607557 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 >> v2:172.21.15.135:6800/726754104 conn(0x7f287c03ea80 msgr2=0x7f287c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 --2- 172.21.15.71:0/3663822235 >> v2:172.21.15.135:6800/726754104 conn(0x7f287c03ea80 0x7f287c040f40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f28940094a0 tx=0x7f2894009240 comp rx=0 tx=0).stop 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 10 monclient: shutdown 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 msgr2=0x7f289812b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 0x7f289812b910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28980a5760 tx=0x7f2890004a40 comp rx=0 tx=0).stop 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 shutdown_connections 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 --2- 172.21.15.71:0/3663822235 >> v2:172.21.15.135:6800/726754104 conn(0x7f287c03ea80 0x7f287c040f40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2898139860 0x7f289812b910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28980a6e10 0x7f289812b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 --2- 172.21.15.71:0/3663822235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28980a6a30 0x7f289812ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 >> 172.21.15.71:0/3663822235 conn(0x7f28980ac030 msgr2=0x7f289806fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 shutdown_connections 2024-08-19T11:10:45.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.043+0000 7f289f420640 1 -- 172.21.15.71:0/3663822235 wait complete. 2024-08-19T11:10:45.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.5 2024-08-19T11:10:45.047 DEBUG:teuthology.parallel:result is None 2024-08-19T11:10:45.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607557 for osd.1 2024-08-19T11:10:45.055 DEBUG:teuthology.parallel:result is None 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe43c43f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe43c43f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe43c43f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe434126380 con 0x7fe43413eb10 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe42affd640 1 -- 172.21.15.71:0/1812024095 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe42c03f030 con 0x7fe43413eb10 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe42affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.084+0000 7fe42affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:45.086 INFO:teuthology.orchestra.run.smithi071.stdout:51539607558 2024-08-19T11:10:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 >> v2:172.21.15.135:6800/726754104 conn(0x7fe41803ea80 msgr2=0x7fe418040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 --2- 172.21.15.71:0/1812024095 >> v2:172.21.15.135:6800/726754104 conn(0x7fe41803ea80 0x7fe418040f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe430009ba0 tx=0x7fe430008040 comp rx=0 tx=0).stop 2024-08-19T11:10:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 10 monclient: shutdown 2024-08-19T11:10:45.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 msgr2=0x7fe4341ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 0x7fe4341ceed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe42c02a9b0 tx=0x7fe42c004a40 comp rx=0 tx=0).stop 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 shutdown_connections 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 --2- 172.21.15.71:0/1812024095 >> v2:172.21.15.135:6800/726754104 conn(0x7fe41803ea80 0x7fe418040f40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe43413eb10 0x7fe4341ceed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe4340a6e10 0x7fe4341ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 --2- 172.21.15.71:0/1812024095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe4340a6a30 0x7fe4341259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 >> 172.21.15.71:0/1812024095 conn(0x7fe4340ac030 msgr2=0x7fe4340a9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 shutdown_connections 2024-08-19T11:10:45.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.088+0000 7fe43c43f640 1 -- 172.21.15.71:0/1812024095 wait complete. 2024-08-19T11:10:45.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.095+0000 7f4d53c30640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.095+0000 7f4d53c30640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.095+0000 7f4d53c30640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.095+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4d4c0ad120 con 0x7f4d4c0a6e10 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.096+0000 7f4d427fc640 1 -- 172.21.15.71:0/4151991202 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d3c047750 con 0x7f4d4c0a6e10 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.096+0000 7f4d427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.096+0000 7f4d427fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:45.097 INFO:teuthology.orchestra.run.smithi071.stdout:51539607558 2024-08-19T11:10:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.098+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 >> v2:172.21.15.135:6800/726754104 conn(0x7f4d3003ea80 msgr2=0x7f4d30040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.098+0000 7f4d53c30640 1 --2- 172.21.15.71:0/4151991202 >> v2:172.21.15.135:6800/726754104 conn(0x7f4d3003ea80 0x7f4d30040f40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009ac0 tx=0x7f4d48008040 comp rx=0 tx=0).stop 2024-08-19T11:10:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.098+0000 7f4d53c30640 10 monclient: shutdown 2024-08-19T11:10:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.098+0000 7f4d53c30640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.098+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 msgr2=0x7f4d4c138ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.098+0000 7f4d53c30640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c138ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0097c0 tx=0x7f4d3c004730 comp rx=0 tx=0).stop 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 shutdown_connections 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 --2- 172.21.15.71:0/4151991202 >> v2:172.21.15.135:6800/726754104 conn(0x7f4d3003ea80 0x7f4d30040f40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d4c139860 0x7f4d4c139010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4d4c0a6e10 0x7f4d4c138ad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 --2- 172.21.15.71:0/4151991202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4d4c0a6a30 0x7f4d4c1ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 >> 172.21.15.71:0/4151991202 conn(0x7f4d4c0ac030 msgr2=0x7f4d4c0ab570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 shutdown_connections 2024-08-19T11:10:45.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.099+0000 7f4d53c30640 1 -- 172.21.15.71:0/4151991202 wait complete. 2024-08-19T11:10:45.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607558 for osd.0 2024-08-19T11:10:45.102 DEBUG:teuthology.parallel:result is None 2024-08-19T11:10:45.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607558 for osd.4 2024-08-19T11:10:45.110 DEBUG:teuthology.parallel:result is None 2024-08-19T11:10:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8448b53640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-19T11:10:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8448b53640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-19T11:10:45.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8448b53640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f844406ca70 con 0x7f84440a6e10 2024-08-19T11:10:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8432ffd640 1 -- 172.21.15.71:0/3381760072 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8438032b50 con 0x7f84440a6e10 2024-08-19T11:10:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8432ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-08-19T11:10:45.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.111+0000 7f8432ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:45.113 INFO:teuthology.orchestra.run.smithi071.stdout:51539607558 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.113+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 >> v2:172.21.15.135:6800/726754104 conn(0x7f842403ea80 msgr2=0x7f8424040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.113+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> v2:172.21.15.135:6800/726754104 conn(0x7f842403ea80 0x7f8424040f40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8434009ba0 tx=0x7f8434008040 comp rx=0 tx=0).stop 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.113+0000 7f8448b53640 10 monclient: shutdown 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.113+0000 7f8448b53640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.113+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 msgr2=0x7f84441389f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.113+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 0x7f84441389f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8438031000 tx=0x7f84380046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 shutdown_connections 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> v2:172.21.15.135:6800/726754104 conn(0x7f842403ea80 0x7f8424040f40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8444139860 0x7f8444138f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f84440a6e10 0x7f84441389f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 --2- 172.21.15.71:0/3381760072 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f84440a6a30 0x7f84441ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 >> 172.21.15.71:0/3381760072 conn(0x7f84440ac030 msgr2=0x7f84441c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 shutdown_connections 2024-08-19T11:10:45.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.114+0000 7f8448b53640 1 -- 172.21.15.71:0/3381760072 wait complete. 2024-08-19T11:10:45.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607558 for osd.3 2024-08-19T11:10:45.126 DEBUG:teuthology.parallel:result is None 2024-08-19T11:10:45.126 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T11:10:45.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:10:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.262+0000 7f6689a20640 10 monclient: get_monmap_and_config 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.262+0000 7f6689a20640 10 monclient: build_initial_monmap 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.262+0000 7f6689a20640 10 monclient: monmap: 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:45.263346+0000 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:45.263346+0000 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:45.265 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 Processor -- start 2024-08-19T11:10:45.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 -- start start 2024-08-19T11:10:45.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient: init 2024-08-19T11:10:45.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:45.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient: _add_conns ranks=[0,3,7,5,6,8,4,1,9,10,2] 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f66840a6a30 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66840a6e10 0x7f66840a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): picked mon.noname-g con 0x7f66840a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 0x7f6684140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): picked mon.noname-i con 0x7f668413eb10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66840a4f90 con 0x7f66840a6a30 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f66840a3650 con 0x7f66840a6e10 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f66840a6380 con 0x7f668413eb10 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:45.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6689a20640 10 monclient(hunting): authenticate will time out at 703.304838s 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6682ffd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f66840a6a30 0x7f66840a57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36896/0 (socket says 172.21.15.71:36896) 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.263+0000 7f6682ffd640 1 -- 172.21.15.71:0/2792528157 learned_addr learned my addr 172.21.15.71:0/2792528157 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 0x7f6684140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66840a6e10 0x7f66840a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): get_auth_request con 0x7f668413eb10 auth_method 0 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): get_auth_request con 0x7f66840a6e10 auth_method 0 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient(hunting): handle_auth_done global_id 4300 payload 274 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 1 -- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66840a6e10 msgr2=0x7f66840a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66840a6e10 0x7f66840a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 1 -- 172.21.15.71:0/2792528157 >> v1:172.21.15.71:6789/0 conn(0x7f66840a6a30 legacy=0x7f66840a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 1 monclient: found mon.noname-i 2024-08-19T11:10:45.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:45.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:45.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f66837fe640 1 -- 172.21.15.71:0/2792528157 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66840a49d0 con 0x7f668413eb10 2024-08-19T11:10:45.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.264+0000 7f667a7fc640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66840a6e10 0x7f66840a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66837fe640 1 -- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 msgr2=0x7f6684140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66837fe640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 0x7f6684140f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f667c009dc0 tx=0x7f667c02a480 comp rx=0 tx=0).ready entity=mon.7 client_cookie=a114d9c5bb79b602 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 1 -- 172.21.15.71:0/2792528157 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f667c007bc0 con 0x7f668413eb10 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: dump: 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f6689a20640 5 monclient: authenticate success, global_id 4300 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 1 -- 172.21.15.71:0/2792528157 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667c007d80 con 0x7f668413eb10 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f6689a20640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f6689a20640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 1 -- 172.21.15.71:0/2792528157 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f667c031870 con 0x7f668413eb10 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f6689a20640 4 set_mon_vals no callback set 2024-08-19T11:10:45.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.267+0000 7f66827fc640 10 monclient: dump: 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 10 monclient: shutdown 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 -- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 msgr2=0x7f6684140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 0x7f6684140f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f667c009dc0 tx=0x7f667c02a480 comp rx=0 tx=0).stop 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 -- 172.21.15.71:0/2792528157 shutdown_connections 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f668413eb10 0x7f6684140f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 --2- 172.21.15.71:0/2792528157 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66840a6e10 0x7f66840a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 -- 172.21.15.71:0/2792528157 >> 172.21.15.71:0/2792528157 conn(0x7f66840ac030 msgr2=0x7f66840ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 -- 172.21.15.71:0/2792528157 shutdown_connections 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 1 -- 172.21.15.71:0/2792528157 wait complete. 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 10 monclient: build_initial_monmap 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.268+0000 7f6689a20640 10 monclient: monmap: 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 Processor -- start 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 -- start start 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient: init 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient: _add_conns ranks=[4,2,3,8,1,6,5,0,7] 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 0x7f6684123d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): picked mon.noname-c con 0x7f66840a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 0x7f6684125e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): picked mon.noname-b con 0x7f66840a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f668413eb10 0x7f668413ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): picked mon.noname-g con 0x7f668413eb10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f66840a7730 con 0x7f66840a6e10 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6684141440 con 0x7f668413eb10 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f66840a9280 con 0x7f66840a6a30 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6689a20640 10 monclient(hunting): authenticate will time out at 703.310848s 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 0x7f6684123d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f667a7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 0x7f6684125e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 0x7f6684123d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53136/0 (socket says 172.21.15.71:53136) 2024-08-19T11:10:45.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 1 -- 172.21.15.71:0/1115510552 learned_addr learned my addr 172.21.15.71:0/1115510552 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 10 monclient(hunting): get_auth_request con 0x7f66840a6a30 auth_method 0 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f6682ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f667a7fc640 10 monclient(hunting): get_auth_request con 0x7f66840a6e10 auth_method 0 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f667a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f667a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.269+0000 7f667a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f6682ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f6682ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f6682ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f66837fe640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f668413eb10 0x7f668413ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f66837fe640 10 monclient(hunting): get_auth_request con 0x7f668413eb10 auth_method 0 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f66837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f66837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f66837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 10 monclient(hunting): handle_auth_done global_id 4457 payload 824 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 1 -- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 msgr2=0x7f6684123d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 0x7f6684123d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 1 -- 172.21.15.71:0/1115510552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f668413eb10 msgr2=0x7f668413ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f668413eb10 0x7f668413ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 1 monclient: found mon.noname-b 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:45.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f667a7fc640 1 -- 172.21.15.71:0/1115510552 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668413d950 con 0x7f66840a6e10 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.270+0000 7f6682ffd640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 0x7f6684123d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f667a7fc640 1 -- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 msgr2=0x7f6684125e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f667a7fc640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 0x7f6684125e40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f666c00e8b0 tx=0x7f666c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f666c004030 con 0x7f66840a6e10 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: dump: 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.286 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666c0041d0 con 0x7f66840a6e10 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 5 monclient: authenticate success, global_id 4457 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 10 monclient: _renew_subs 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66841252e0 con 0x7f66840a6e10 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f666c004380 con 0x7f66840a6e10 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6680ff9640 10 monclient: dump: 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.288 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6681ffb640 4 set_mon_vals no callback set 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 10 monclient: _renew_subs 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.272+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6684126da0 con 0x7f66840a6e10 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f666c00caf0 con 0x7f66840a6e10 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6689a20640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6689a20640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6689a20640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66840a71f0 con 0x7f66840a6e10 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6680ff9640 1 --2- 172.21.15.71:0/1115510552 >> v2:172.21.15.135:6800/726754104 conn(0x7f666403ea80 0x7f6664040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.273+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f666c00f040 con 0x7f66840a6e10 2024-08-19T11:10:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.274+0000 7f6682ffd640 1 --2- 172.21.15.71:0/1115510552 >> v2:172.21.15.135:6800/726754104 conn(0x7f666403ea80 0x7f6664040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.274+0000 7f6682ffd640 10 monclient: get_auth_request con 0x7f666403ea80 auth_method 0 2024-08-19T11:10:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.276+0000 7f6682ffd640 1 --2- 172.21.15.71:0/1115510552 >> v2:172.21.15.135:6800/726754104 conn(0x7f666403ea80 0x7f6664040f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6674007d50 tx=0x7f6674007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.278+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f666c053e20 con 0x7f66840a6e10 2024-08-19T11:10:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.278+0000 7f6680ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.278+0000 7f6680ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:45.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.453+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6684127180 con 0x7f666403ea80 2024-08-19T11:10:45.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.454+0000 7f6680ff9640 1 -- 172.21.15.71:0/1115510552 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34179 (secure 0 0 0) 0x7f6684127180 con 0x7f666403ea80 2024-08-19T11:10:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:45.456 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:10:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 >> v2:172.21.15.135:6800/726754104 conn(0x7f666403ea80 msgr2=0x7f6664040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 --2- 172.21.15.71:0/1115510552 >> v2:172.21.15.135:6800/726754104 conn(0x7f666403ea80 0x7f6664040f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6674007d50 tx=0x7f6674007ca0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 10 monclient: shutdown 2024-08-19T11:10:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 msgr2=0x7f6684125e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 0x7f6684125e40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f666c00e8b0 tx=0x7f666c00ed70 comp rx=0 tx=0).stop 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 shutdown_connections 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 --2- 172.21.15.71:0/1115510552 >> v2:172.21.15.135:6800/726754104 conn(0x7f666403ea80 0x7f6664040f40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f668413eb10 0x7f668413ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66840a6e10 0x7f6684125e40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 --2- 172.21.15.71:0/1115510552 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f66840a6a30 0x7f6684123d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 >> 172.21.15.71:0/1115510552 conn(0x7f66840ac030 msgr2=0x7f668413fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 shutdown_connections 2024-08-19T11:10:45.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.457+0000 7f6689a20640 1 -- 172.21.15.71:0/1115510552 wait complete. 2024-08-19T11:10:45.468 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-19T11:10:44.175155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163284,"kb_used_data":1088,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067756,"statfs":{"total":579820584960,"available":579653382144,"internally_reserved":0,"allocated":1114112,"data_stored":1368658,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.520549"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666514+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:10:39.666514+0000","last_peered":"2024-08-19T11:10:39.666514+0000","last_clean":"2024-08-19T11:10:39.666514+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:10:39.666514+0000","last_undegraded":"2024-08-19T11:10:39.666514+0000","last_fullsized":"2024-08-19T11:10:39.666514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.663675+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:10:39.663675+0000","last_peered":"2024-08-19T11:10:39.663675+0000","last_clean":"2024-08-19T11:10:39.663675+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:10:39.663675+0000","last_undegraded":"2024-08-19T11:10:39.663675+0000","last_fullsized":"2024-08-19T11:10:39.663675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666232+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:10:39.666232+0000","last_peered":"2024-08-19T11:10:39.666232+0000","last_clean":"2024-08-19T11:10:39.666232+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:10:39.666232+0000","last_undegraded":"2024-08-19T11:10:39.666232+0000","last_fullsized":"2024-08-19T11:10:39.666232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664544+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:10:39.664544+0000","last_peered":"2024-08-19T11:10:39.664544+0000","last_clean":"2024-08-19T11:10:39.664544+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:10:39.664544+0000","last_undegraded":"2024-08-19T11:10:39.664544+0000","last_fullsized":"2024-08-19T11:10:39.664544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665250+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:10:39.665250+0000","last_peered":"2024-08-19T11:10:39.665250+0000","last_clean":"2024-08-19T11:10:39.665250+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:10:39.665250+0000","last_undegraded":"2024-08-19T11:10:39.665250+0000","last_fullsized":"2024-08-19T11:10:39.665250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664351+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:10:39.664351+0000","last_peered":"2024-08-19T11:10:39.664351+0000","last_clean":"2024-08-19T11:10:39.664351+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:10:39.664351+0000","last_undegraded":"2024-08-19T11:10:39.664351+0000","last_fullsized":"2024-08-19T11:10:39.664351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.737928+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:10:39.737928+0000","last_peered":"2024-08-19T11:10:39.737928+0000","last_clean":"2024-08-19T11:10:39.737928+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:10:39.737928+0000","last_undegraded":"2024-08-19T11:10:39.737928+0000","last_fullsized":"2024-08-19T11:10:39.737928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666278+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:10:39.666278+0000","last_peered":"2024-08-19T11:10:39.666278+0000","last_clean":"2024-08-19T11:10:39.666278+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:10:39.666278+0000","last_undegraded":"2024-08-19T11:10:39.666278+0000","last_fullsized":"2024-08-19T11:10:39.666278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665969+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:10:39.665969+0000","last_peered":"2024-08-19T11:10:39.665969+0000","last_clean":"2024-08-19T11:10:39.665969+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:10:39.665969+0000","last_undegraded":"2024-08-19T11:10:39.665969+0000","last_fullsized":"2024-08-19T11:10:39.665969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:10:45.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:10:45.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.565+0000 7f2ee6108640 10 monclient: get_monmap_and_config 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.565+0000 7f2ee6108640 10 monclient: build_initial_monmap 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.565+0000 7f2ee6108640 10 monclient: monmap: 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:45.566238+0000 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:45.566238+0000 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:45.567 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:45.568 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 Processor -- start 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 -- start start 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient: init 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient: _add_conns ranks=[8,6,0,1,5,10,4,3,9,7,2] 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2ee00a6a30 0x7f2ee00a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): picked mon.noname-e con 0x7f2ee00a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 0x7f2ee00a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): picked mon.noname-d con 0x7f2ee00a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2ee0139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00a4f90 con 0x7f2ee0139860 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2ee00a6380 con 0x7f2ee00a6e10 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f2ee00a49d0 con 0x7f2ee00a6a30 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2ee6108640 10 monclient(hunting): authenticate will time out at 703.607875s 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2edeffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 0x7f2ee00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.566+0000 7f2edffff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2ee0139860 0x7f2ee0139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36900/0 (socket says 172.21.15.71:36900) 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edffff640 1 -- 172.21.15.71:0/2880701825 learned_addr learned my addr 172.21.15.71:0/2880701825 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): get_auth_request con 0x7f2ee00a6e10 auth_method 0 2024-08-19T11:10:45.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 1 --2- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2ee00a6a30 0x7f2ee00a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): get_auth_request con 0x7f2ee00a6a30 auth_method 0 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient(hunting): handle_auth_done global_id 4380 payload 274 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 1 -- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2ee00a6a30 msgr2=0x7f2ee00a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 1 --2- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2ee00a6a30 0x7f2ee00a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 1 -- 172.21.15.71:0/2880701825 >> v1:172.21.15.71:6789/0 conn(0x7f2ee0139860 legacy=0x7f2ee0139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 1 monclient: found mon.noname-d 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.567+0000 7f2edeffd640 1 -- 172.21.15.71:0/2880701825 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee00a46f0 con 0x7f2ee00a6e10 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2edeffd640 1 -- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 msgr2=0x7f2ee00a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:45.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2edeffd640 1 --2- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 0x7f2ee00a71f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40097d0 tx=0x7f2ed4029fb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=318195929effe9ed server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 1 -- 172.21.15.71:0/2880701825 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ed4037070 con 0x7f2ee00a6e10 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: dump: 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 5 monclient: authenticate success, global_id 4380 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 1 -- 172.21.15.71:0/2880701825 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed402ad10 con 0x7f2ee00a6e10 2024-08-19T11:10:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 4 set_mon_vals no callback set 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 1 -- 172.21.15.71:0/2880701825 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ed4030c20 con 0x7f2ee00a6e10 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ede7fc640 10 monclient: dump: 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 10 monclient: shutdown 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 -- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 msgr2=0x7f2ee00a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 --2- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 0x7f2ee00a71f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40097d0 tx=0x7f2ed4029fb0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 -- 172.21.15.71:0/2880701825 shutdown_connections 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 --2- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2ee00a6e10 0x7f2ee00a71f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 --2- 172.21.15.71:0/2880701825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2ee00a6a30 0x7f2ee00a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 -- 172.21.15.71:0/2880701825 >> 172.21.15.71:0/2880701825 conn(0x7f2ee00ac030 msgr2=0x7f2ee00ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 -- 172.21.15.71:0/2880701825 shutdown_connections 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.570+0000 7f2ee6108640 1 -- 172.21.15.71:0/2880701825 wait complete. 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.571+0000 7f2ee6108640 10 monclient: build_initial_monmap 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.571+0000 7f2ee6108640 10 monclient: monmap: 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.571+0000 7f2ee6108640 1 Processor -- start 2024-08-19T11:10:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.571+0000 7f2ee6108640 1 -- start start 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.571+0000 7f2ee6108640 10 monclient: init 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient: _add_conns ranks=[7,0,5,2,4,6,1,3,8] 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2ee00a6a30 0x7f2ee0122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): picked mon.noname-i con 0x7f2ee00a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 0x7f2ee0123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): picked mon.noname-a con 0x7f2ee00a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2ee0139860 0x7f2ee0123850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): picked mon.noname-h con 0x7f2ee0139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00a7730 con 0x7f2ee00a6e10 2024-08-19T11:10:45.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f2ee013a370 con 0x7f2ee0139860 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f2ee00a2280 con 0x7f2ee00a6a30 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2ee6108640 10 monclient(hunting): authenticate will time out at 703.613356s 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 0x7f2ee0123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 0x7f2ee0123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36726/0 (socket says 172.21.15.71:36726) 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 -- 172.21.15.71:0/3445688925 learned_addr learned my addr 172.21.15.71:0/3445688925 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): get_auth_request con 0x7f2ee00a6e10 auth_method 0 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient(hunting): handle_auth_done global_id 4311 payload 824 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edf7fe640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2ee00a6a30 0x7f2ee0122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 -- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2ee00a6a30 msgr2=0x7f2ee0122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2ee00a6a30 0x7f2ee0122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 -- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2ee0139860 msgr2=0x7f2ee0123850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2ee0139860 0x7f2ee0123850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 monclient: found mon.noname-a 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.572+0000 7f2edeffd640 1 -- 172.21.15.71:0/3445688925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0126bf0 con 0x7f2ee00a6e10 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.574+0000 7f2edeffd640 1 -- 172.21.15.71:0/3445688925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 msgr2=0x7f2ee0123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.574+0000 7f2edeffd640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 0x7f2ee0123310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4035040 tx=0x7f2ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.574+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ed4041020 con 0x7f2ee00a6e10 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: dump: 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: _finish_auth 0 2024-08-19T11:10:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4003cb0 con 0x7f2ee00a6e10 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 5 monclient: authenticate success, global_id 4311 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 10 monclient: _renew_subs 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee00a3ed0 con 0x7f2ee00a6e10 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2ed4037040 con 0x7f2ee00a6e10 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ec7fff640 10 monclient: dump: 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2eddffb640 4 set_mon_vals no callback set 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 10 monclient: _renew_subs 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.577+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee0126910 con 0x7f2ee00a6e10 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2ed4044020 con 0x7f2ee00a6e10 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ee6108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ee6108640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ee6108640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee009f900 con 0x7f2ee00a6e10 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ec7fff640 1 --2- 172.21.15.71:0/3445688925 >> v2:172.21.15.135:6800/726754104 conn(0x7f2ecc03ea80 0x7f2ecc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f2ed4071f60 con 0x7f2ee00a6e10 2024-08-19T11:10:45.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2edf7fe640 1 --2- 172.21.15.71:0/3445688925 >> v2:172.21.15.135:6800/726754104 conn(0x7f2ecc03ea80 0x7f2ecc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.578+0000 7f2edf7fe640 10 monclient: get_auth_request con 0x7f2ecc03ea80 auth_method 0 2024-08-19T11:10:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.581+0000 7f2edf7fe640 1 --2- 172.21.15.71:0/3445688925 >> v2:172.21.15.135:6800/726754104 conn(0x7f2ecc03ea80 0x7f2ecc040f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009a10 tx=0x7f2ed0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.583+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f2ed404b030 con 0x7f2ee00a6e10 2024-08-19T11:10:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.583+0000 7f2ec7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.583+0000 7f2ec7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:45.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.755+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ee00008d0 con 0x7f2ecc03ea80 2024-08-19T11:10:45.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.756+0000 7f2ec7fff640 1 -- 172.21.15.71:0/3445688925 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34179 (secure 0 0 0) 0x7f2ee00008d0 con 0x7f2ecc03ea80 2024-08-19T11:10:45.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:45.758 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:10:45.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 >> v2:172.21.15.135:6800/726754104 conn(0x7f2ecc03ea80 msgr2=0x7f2ecc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 --2- 172.21.15.71:0/3445688925 >> v2:172.21.15.135:6800/726754104 conn(0x7f2ecc03ea80 0x7f2ecc040f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009a10 tx=0x7f2ed0008040 comp rx=0 tx=0).stop 2024-08-19T11:10:45.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 10 monclient: shutdown 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 msgr2=0x7f2ee0123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 0x7f2ee0123310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4035040 tx=0x7f2ed40046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 shutdown_connections 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 --2- 172.21.15.71:0/3445688925 >> v2:172.21.15.135:6800/726754104 conn(0x7f2ecc03ea80 0x7f2ecc040f40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2ee0139860 0x7f2ee0123850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ee00a6e10 0x7f2ee0123310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 --2- 172.21.15.71:0/3445688925 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2ee00a6a30 0x7f2ee0122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 >> 172.21.15.71:0/3445688925 conn(0x7f2ee00ac030 msgr2=0x7f2ee009cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 shutdown_connections 2024-08-19T11:10:45.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.758+0000 7f2ee6108640 1 -- 172.21.15.71:0/3445688925 wait complete. 2024-08-19T11:10:45.769 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-19T11:10:44.175155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163284,"kb_used_data":1088,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067756,"statfs":{"total":579820584960,"available":579653382144,"internally_reserved":0,"allocated":1114112,"data_stored":1368658,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.520549"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666514+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:10:39.666514+0000","last_peered":"2024-08-19T11:10:39.666514+0000","last_clean":"2024-08-19T11:10:39.666514+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:10:39.666514+0000","last_undegraded":"2024-08-19T11:10:39.666514+0000","last_fullsized":"2024-08-19T11:10:39.666514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.663675+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:10:39.663675+0000","last_peered":"2024-08-19T11:10:39.663675+0000","last_clean":"2024-08-19T11:10:39.663675+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:10:39.663675+0000","last_undegraded":"2024-08-19T11:10:39.663675+0000","last_fullsized":"2024-08-19T11:10:39.663675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666232+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:10:39.666232+0000","last_peered":"2024-08-19T11:10:39.666232+0000","last_clean":"2024-08-19T11:10:39.666232+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:10:39.666232+0000","last_undegraded":"2024-08-19T11:10:39.666232+0000","last_fullsized":"2024-08-19T11:10:39.666232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664544+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:10:39.664544+0000","last_peered":"2024-08-19T11:10:39.664544+0000","last_clean":"2024-08-19T11:10:39.664544+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:10:39.664544+0000","last_undegraded":"2024-08-19T11:10:39.664544+0000","last_fullsized":"2024-08-19T11:10:39.664544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665250+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:10:39.665250+0000","last_peered":"2024-08-19T11:10:39.665250+0000","last_clean":"2024-08-19T11:10:39.665250+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:10:39.665250+0000","last_undegraded":"2024-08-19T11:10:39.665250+0000","last_fullsized":"2024-08-19T11:10:39.665250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664351+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:10:39.664351+0000","last_peered":"2024-08-19T11:10:39.664351+0000","last_clean":"2024-08-19T11:10:39.664351+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:10:39.664351+0000","last_undegraded":"2024-08-19T11:10:39.664351+0000","last_fullsized":"2024-08-19T11:10:39.664351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.737928+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:10:39.737928+0000","last_peered":"2024-08-19T11:10:39.737928+0000","last_clean":"2024-08-19T11:10:39.737928+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:10:39.737928+0000","last_undegraded":"2024-08-19T11:10:39.737928+0000","last_fullsized":"2024-08-19T11:10:39.737928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666278+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:10:39.666278+0000","last_peered":"2024-08-19T11:10:39.666278+0000","last_clean":"2024-08-19T11:10:39.666278+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:10:39.666278+0000","last_undegraded":"2024-08-19T11:10:39.666278+0000","last_fullsized":"2024-08-19T11:10:39.666278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665969+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:10:39.665969+0000","last_peered":"2024-08-19T11:10:39.665969+0000","last_clean":"2024-08-19T11:10:39.665969+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:10:39.665969+0000","last_undegraded":"2024-08-19T11:10:39.665969+0000","last_fullsized":"2024-08-19T11:10:39.665969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:10:45.770 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T11:10:45.770 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-19T11:10:45.771 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-19T11:10:45.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-19T11:10:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.865+0000 7f4563a1e640 10 monclient: get_monmap_and_config 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.865+0000 7f4563a1e640 10 monclient: build_initial_monmap 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.865+0000 7f4563a1e640 10 monclient: monmap: 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:45.865914+0000 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:45.865914+0000 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.865+0000 7f4563a1e640 1 Processor -- start 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 1 -- start start 2024-08-19T11:10:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient: init 2024-08-19T11:10:45.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient: _add_conns ranks=[6,3,0,5,7,10,2,1,9,4,8] 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 0x7f455c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): picked mon.noname-d con 0x7f455c0a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0a6e10 0x7f455c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): picked mon.noname-g con 0x7f455c0a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f455c139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c0a4f90 con 0x7f455c139860 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f455c0a6380 con 0x7f455c0a6e10 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f455c0a49d0 con 0x7f455c0a6a30 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:45.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4563a1e640 10 monclient(hunting): authenticate will time out at 703.907566s 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 0x7f455c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4561fbb640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f455c139860 0x7f455c139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36904/0 (socket says 172.21.15.71:36904) 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4561fbb640 1 -- 172.21.15.71:0/2473041391 learned_addr learned my addr 172.21.15.71:0/2473041391 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): get_auth_request con 0x7f455c0a6a30 auth_method 0 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4560fb9640 1 --2- 172.21.15.71:0/2473041391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0a6e10 0x7f455c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4560fb9640 10 monclient(hunting): get_auth_request con 0x7f455c0a6e10 auth_method 0 2024-08-19T11:10:45.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4560fb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4560fb9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f4560fb9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 1 -- 172.21.15.71:0/2473041391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0a6e10 msgr2=0x7f455c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 1 --2- 172.21.15.71:0/2473041391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0a6e10 0x7f455c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 1 -- 172.21.15.71:0/2473041391 >> v1:172.21.15.71:6789/0 conn(0x7f455c139860 legacy=0x7f455c139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient: _finish_hunting 0 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 1 monclient: found mon.noname-d 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.866+0000 7f45617ba640 1 -- 172.21.15.71:0/2473041391 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c0a46f0 con 0x7f455c0a6a30 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f45617ba640 1 -- 172.21.15.71:0/2473041391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 msgr2=0x7f455c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:45.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f45617ba640 1 --2- 172.21.15.71:0/2473041391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 0x7f455c0a57f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45540097d0 tx=0x7f4554029fb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=58ee5949ac980f36 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 1 -- 172.21.15.71:0/2473041391 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4554037070 con 0x7f455c0a6a30 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: dump: 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.878 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: _finish_auth 0 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f4563a1e640 5 monclient: authenticate success, global_id 4389 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 1 -- 172.21.15.71:0/2473041391 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455402ad10 con 0x7f455c0a6a30 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f4563a1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:45.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f4563a1e640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f4563a1e640 4 set_mon_vals no callback set 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 1 -- 172.21.15.71:0/2473041391 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4554030c20 con 0x7f455c0a6a30 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.869+0000 7f455bfff640 10 monclient: dump: 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.880 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 10 monclient: shutdown 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 -- 172.21.15.71:0/2473041391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 msgr2=0x7f455c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 --2- 172.21.15.71:0/2473041391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 0x7f455c0a57f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45540097d0 tx=0x7f4554029fb0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 -- 172.21.15.71:0/2473041391 shutdown_connections 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 --2- 172.21.15.71:0/2473041391 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c0a6e10 0x7f455c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 --2- 172.21.15.71:0/2473041391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6a30 0x7f455c0a57f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 -- 172.21.15.71:0/2473041391 >> 172.21.15.71:0/2473041391 conn(0x7f455c0ac030 msgr2=0x7f455c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 -- 172.21.15.71:0/2473041391 shutdown_connections 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.870+0000 7f4563a1e640 1 -- 172.21.15.71:0/2473041391 wait complete. 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 10 monclient: build_initial_monmap 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 10 monclient: monmap: 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:45.882 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 1 Processor -- start 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 1 -- start start 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 10 monclient: init 2024-08-19T11:10:45.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 10 monclient: _add_conns ranks=[0,6,3,5,7,2,4,8,1] 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 0x7f455c1cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.871+0000 7f4563a1e640 10 monclient(hunting): picked mon.noname-a con 0x7f455c0a6a30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6e10 0x7f455c1cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): picked mon.noname-d con 0x7f455c0a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c139860 0x7f455c123030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): picked mon.noname-g con 0x7f455c139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0a7730 con 0x7f455c0a6a30 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f455c13a370 con 0x7f455c139860 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f455c1363c0 con 0x7f455c0a6e10 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4563a1e640 10 monclient(hunting): authenticate will time out at 703.913080s 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 0x7f455c1cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 0x7f455c1cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36736/0 (socket says 172.21.15.71:36736) 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 -- 172.21.15.71:0/3729211878 learned_addr learned my addr 172.21.15.71:0/3729211878 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): get_auth_request con 0x7f455c0a6a30 auth_method 0 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6e10 0x7f455c1cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): get_auth_request con 0x7f455c0a6e10 auth_method 0 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c139860 0x7f455c123030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): get_auth_request con 0x7f455c139860 auth_method 0 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:45.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4561fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient(hunting): handle_auth_done global_id 4320 payload 824 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 -- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6e10 msgr2=0x7f455c1cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6e10 0x7f455c1cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 -- 172.21.15.71:0/3729211878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c139860 msgr2=0x7f455c123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c139860 0x7f455c123030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient: _finish_hunting 0 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 monclient: found mon.noname-a 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f45617ba640 1 -- 172.21.15.71:0/3729211878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c126e00 con 0x7f455c0a6a30 2024-08-19T11:10:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.872+0000 7f4560fb9640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6e10 0x7f455c1cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f45617ba640 1 -- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 msgr2=0x7f455c1cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f45617ba640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 0x7f455c1cebf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45540096f0 tx=0x7f45540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4554041020 con 0x7f455c0a6a30 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: dump: 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.890 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4563a1e640 5 monclient: authenticate success, global_id 4320 2024-08-19T11:10:45.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554003c70 con 0x7f455c0a6a30 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4563a1e640 10 monclient: _renew_subs 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4563a1e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c0a3ed0 con 0x7f455c0a6a30 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4554037040 con 0x7f455c0a6a30 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f4559ffb640 10 monclient: dump: 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:45.892 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.874+0000 7f455b7fe640 4 set_mon_vals no callback set 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.875+0000 7f4563a1e640 10 monclient: _renew_subs 2024-08-19T11:10:45.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.875+0000 7f4563a1e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.875+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c124aa0 con 0x7f455c0a6a30 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.875+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4554044020 con 0x7f455c0a6a30 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4563a1e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4563a1e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4563a1e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c125600 con 0x7f455c0a6a30 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4559ffb640 1 --2- 172.21.15.71:0/3729211878 >> v2:172.21.15.135:6800/726754104 conn(0x7f454803ea80 0x7f4548040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f4554071e20 con 0x7f455c0a6a30 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4560fb9640 1 --2- 172.21.15.71:0/3729211878 >> v2:172.21.15.135:6800/726754104 conn(0x7f454803ea80 0x7f4548040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.876+0000 7f4560fb9640 10 monclient: get_auth_request con 0x7f454803ea80 auth_method 0 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.879+0000 7f4560fb9640 1 --2- 172.21.15.71:0/3729211878 >> v2:172.21.15.135:6800/726754104 conn(0x7f454803ea80 0x7f4548040f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f455c125110 tx=0x7f45500098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.880+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f455404b030 con 0x7f455c0a6a30 2024-08-19T11:10:45.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.880+0000 7f4559ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:45.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:45.880+0000 7f4559ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.091+0000 7f4563a1e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.091+0000 7f4563a1e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.091+0000 7f4563a1e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.091+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f455c0a57f0 con 0x7f455c0a6a30 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.092+0000 7f4559ffb640 1 -- 172.21.15.71:0/3729211878 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4554003e20 con 0x7f455c0a6a30 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.092+0000 7f4559ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-08-19T11:10:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.092+0000 7f4559ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:46.094 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:46.094 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-19T11:10:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 >> v2:172.21.15.135:6800/726754104 conn(0x7f454803ea80 msgr2=0x7f4548040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 --2- 172.21.15.71:0/3729211878 >> v2:172.21.15.135:6800/726754104 conn(0x7f454803ea80 0x7f4548040f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f455c125110 tx=0x7f45500098d0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 10 monclient: shutdown 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 msgr2=0x7f455c1cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 0x7f455c1cebf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45540096f0 tx=0x7f45540046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 shutdown_connections 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 --2- 172.21.15.71:0/3729211878 >> v2:172.21.15.135:6800/726754104 conn(0x7f454803ea80 0x7f4548040f40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f455c139860 0x7f455c123030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f455c0a6e10 0x7f455c1cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 --2- 172.21.15.71:0/3729211878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f455c0a6a30 0x7f455c1cebf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 >> 172.21.15.71:0/3729211878 conn(0x7f455c0ac030 msgr2=0x7f455c09cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 shutdown_connections 2024-08-19T11:10:46.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.094+0000 7f4563a1e640 1 -- 172.21.15.71:0/3729211878 wait complete. 2024-08-19T11:10:46.105 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-19T11:10:46.106 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-08-19T11:10:46.119 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-08-19T11:10:46.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T11:10:46.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.216+0000 7fac3a26e640 10 monclient: get_monmap_and_config 2024-08-19T11:10:46.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.216+0000 7fac3a26e640 10 monclient: build_initial_monmap 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.216+0000 7fac3a26e640 10 monclient: monmap: 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:46.216708+0000 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:46.216708+0000 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.216+0000 7fac3a26e640 1 Processor -- start 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.216+0000 7fac3a26e640 1 -- start start 2024-08-19T11:10:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.216+0000 7fac3a26e640 10 monclient: init 2024-08-19T11:10:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient: _add_conns ranks=[0,4,7,6,8,5,3,10,1,9,2] 2024-08-19T11:10:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fac3406c8a0 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 0x7fac3413c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): picked mon.noname-c con 0x7fac3406d390 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac3413cd00 0x7fac3413f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): picked mon.noname-i con 0x7fac3413cd00 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac3409cb20 con 0x7fac3406c8a0 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fac3409feb0 con 0x7fac3406d390 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fac34074430 con 0x7fac3413cd00 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3a26e640 10 monclient(hunting): authenticate will time out at 704.258403s 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 0x7fac3413c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 0x7fac3413c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53148/0 (socket says 172.21.15.71:53148) 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 -- 172.21.15.71:0/2391508769 learned_addr learned my addr 172.21.15.71:0/2391508769 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): get_auth_request con 0x7fac3406d390 auth_method 0 2024-08-19T11:10:46.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3880b640 1 --2- 172.21.15.71:0/2391508769 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac3413cd00 0x7fac3413f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3880b640 10 monclient(hunting): get_auth_request con 0x7fac3413cd00 auth_method 0 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3880b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3880b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac3880b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient(hunting): handle_auth_done global_id 4333 payload 274 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 -- 172.21.15.71:0/2391508769 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac3413cd00 msgr2=0x7fac3413f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:46.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 --2- 172.21.15.71:0/2391508769 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac3413cd00 0x7fac3413f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 -- 172.21.15.71:0/2391508769 >> v1:172.21.15.71:6789/0 conn(0x7fac3406c8a0 legacy=0x7fac3406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 monclient: found mon.noname-c 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.217+0000 7fac337fe640 1 -- 172.21.15.71:0/2391508769 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac340a3d60 con 0x7fac3406d390 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac337fe640 1 -- 172.21.15.71:0/2391508769 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 msgr2=0x7fac3413c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac337fe640 1 --2- 172.21.15.71:0/2391508769 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 0x7fac3413c7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fac280098a0 tx=0x7fac2802a080 comp rx=0 tx=0).ready entity=mon.4 client_cookie=f209046113dcb171 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 1 -- 172.21.15.71:0/2391508769 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac28037070 con 0x7fac3406d390 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: dump: 2024-08-19T11:10:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.229 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 1 -- 172.21.15.71:0/2391508769 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2802ade0 con 0x7fac3406d390 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac3a26e640 5 monclient: authenticate success, global_id 4333 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac3a26e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac3a26e640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 1 -- 172.21.15.71:0/2391508769 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac28030c20 con 0x7fac3406d390 2024-08-19T11:10:46.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac3a26e640 4 set_mon_vals no callback set 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.220+0000 7fac32ffd640 10 monclient: dump: 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.231 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 10 monclient: shutdown 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 -- 172.21.15.71:0/2391508769 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 msgr2=0x7fac3413c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 --2- 172.21.15.71:0/2391508769 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 0x7fac3413c7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fac280098a0 tx=0x7fac2802a080 comp rx=0 tx=0).stop 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 -- 172.21.15.71:0/2391508769 shutdown_connections 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 --2- 172.21.15.71:0/2391508769 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac3413cd00 0x7fac3413f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 --2- 172.21.15.71:0/2391508769 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac3406d390 0x7fac3413c7c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 -- 172.21.15.71:0/2391508769 >> 172.21.15.71:0/2391508769 conn(0x7fac340a91d0 msgr2=0x7fac340a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 -- 172.21.15.71:0/2391508769 shutdown_connections 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.221+0000 7fac3a26e640 1 -- 172.21.15.71:0/2391508769 wait complete. 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.222+0000 7fac3a26e640 10 monclient: build_initial_monmap 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.222+0000 7fac3a26e640 10 monclient: monmap: 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.222+0000 7fac3a26e640 1 Processor -- start 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.222+0000 7fac3a26e640 1 -- start start 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.222+0000 7fac3a26e640 10 monclient: init 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient: _add_conns ranks=[2,3,8,7,0,1,5,6,4] 2024-08-19T11:10:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 0x7fac341cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): picked mon.noname-b con 0x7fac3406c8a0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac3406d390 0x7fac341379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): picked mon.noname-g con 0x7fac3406d390 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 0x7fac34137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): picked mon.noname-e con 0x7fac3413cd00 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fac3409d4f0 con 0x7fac3406c8a0 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac340a27f0 con 0x7fac3406d390 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fac3409d670 con 0x7fac3413cd00 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:46.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3a26e640 10 monclient(hunting): authenticate will time out at 704.264158s 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 0x7fac341cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 0x7fac34137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 0x7fac34137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53470/0 (socket says 172.21.15.71:53470) 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 0x7fac341cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34696/0 (socket says 172.21.15.71:34696) 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 -- 172.21.15.71:0/1285080974 learned_addr learned my addr 172.21.15.71:0/1285080974 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): get_auth_request con 0x7fac3413cd00 auth_method 0 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): get_auth_request con 0x7fac3406c8a0 auth_method 0 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient(hunting): handle_auth_done global_id 4319 payload 824 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 -- 172.21.15.71:0/1285080974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac3406d390 msgr2=0x7fac341379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac3406d390 0x7fac341379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 -- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 msgr2=0x7fac341cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 0x7fac341cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient: _finish_hunting 0 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 monclient: found mon.noname-e 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac3880b640 1 -- 172.21.15.71:0/1285080974 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac340a86d0 con 0x7fac3413cd00 2024-08-19T11:10:46.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.223+0000 7fac33fff640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 0x7fac341cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac3880b640 1 -- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 msgr2=0x7fac34137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac3880b640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 0x7fac34137f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007e90 tx=0x7fac2c00e4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac2c014890 con 0x7fac3413cd00 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: dump: 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.240 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac3a26e640 5 monclient: authenticate success, global_id 4319 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c019070 con 0x7fac3413cd00 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac2c013380 con 0x7fac3413cd00 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac30ff9640 10 monclient: dump: 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.242 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac327fc640 4 set_mon_vals no callback set 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac3a26e640 10 monclient: _renew_subs 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac3a26e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.225+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac341cc830 con 0x7fac3413cd00 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 10 monclient: _renew_subs 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fac34122020 con 0x7fac3413cd00 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fac2c014420 con 0x7fac3413cd00 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.226+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac340a83d0 con 0x7fac3413cd00 2024-08-19T11:10:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.227+0000 7fac30ff9640 1 --2- 172.21.15.71:0/1285080974 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2003ea80 0x7fac20040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.227+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fac2c0522e0 con 0x7fac3413cd00 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.227+0000 7fac33fff640 1 --2- 172.21.15.71:0/1285080974 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2003ea80 0x7fac20040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.227+0000 7fac33fff640 10 monclient: get_auth_request con 0x7fac2003ea80 auth_method 0 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.230+0000 7fac33fff640 1 --2- 172.21.15.71:0/1285080974 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2003ea80 0x7fac20040f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac24004320 tx=0x7fac24007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.231+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fac340a83d0 con 0x7fac3413cd00 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.231+0000 7fac30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.231+0000 7fac30ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:46.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac3a26e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:46.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac3a26e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:46.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac3a26e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac3406cc80 con 0x7fac3413cd00 2024-08-19T11:10:46.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac30ff9640 1 -- 172.21.15.71:0/1285080974 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10931 (secure 0 0 0) 0x7fac340a86d0 con 0x7fac3413cd00 2024-08-19T11:10:46.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac30ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:10:46.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.408+0000 7fac30ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:46.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:46.410 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:10:39.654137+0000","last_up_change":"2024-08-19T11:10:28.285326+0000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T11:10:28.605759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-19T11:10:35.665770+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1867070009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1867070009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1867070009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1867070009}]},"public_addr":"172.21.15.71:6800/1867070009","cluster_addr":"172.21.15.71:6801/1867070009","heartbeat_back_addr":"172.21.15.71:6803/1867070009","heartbeat_front_addr":"172.21.15.71:6802/1867070009","state":["exists","up"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":227121352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":227121352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":227121352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":227121352}]},"public_addr":"172.21.15.71:6804/227121352","cluster_addr":"172.21.15.71:6805/227121352","heartbeat_back_addr":"172.21.15.71:6807/227121352","heartbeat_front_addr":"172.21.15.71:6806/227121352","state":["exists","up"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":80758171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":80758171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":80758171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":80758171}]},"public_addr":"172.21.15.71:6808/80758171","cluster_addr":"172.21.15.71:6809/80758171","heartbeat_back_addr":"172.21.15.71:6811/80758171","heartbeat_front_addr":"172.21.15.71:6810/80758171","state":["exists","up"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":3339144447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3339144447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3339144447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6807","nonce":3339144447}]},"public_addr":"172.21.15.135:6805/3339144447","cluster_addr":"172.21.15.135:6806/3339144447","heartbeat_back_addr":"172.21.15.135:6808/3339144447","heartbeat_front_addr":"172.21.15.135:6807/3339144447","state":["exists","up"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":879361358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":879361358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":879361358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6811","nonce":879361358}]},"public_addr":"172.21.15.135:6809/879361358","cluster_addr":"172.21.15.135:6810/879361358","heartbeat_back_addr":"172.21.15.135:6812/879361358","heartbeat_front_addr":"172.21.15.135:6811/879361358","state":["exists","up"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":2277825240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2277825240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2277825240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6803","nonce":2277825240}]},"public_addr":"172.21.15.135:6801/2277825240","cluster_addr":"172.21.15.135:6802/2277825240","heartbeat_back_addr":"172.21.15.135:6804/2277825240","heartbeat_front_addr":"172.21.15.135:6803/2277825240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.215895+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.920536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.414247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.789439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:27.153740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.131984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:10:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2003ea80 msgr2=0x7fac20040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 --2- 172.21.15.71:0/1285080974 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2003ea80 0x7fac20040f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac24004320 tx=0x7fac24007e30 comp rx=0 tx=0).stop 2024-08-19T11:10:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 10 monclient: shutdown 2024-08-19T11:10:46.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 msgr2=0x7fac34137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 0x7fac34137f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007e90 tx=0x7fac2c00e4b0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 shutdown_connections 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 --2- 172.21.15.71:0/1285080974 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2003ea80 0x7fac20040f40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac3413cd00 0x7fac34137f10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac3406d390 0x7fac341379d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 --2- 172.21.15.71:0/1285080974 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac3406c8a0 0x7fac341cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 >> 172.21.15.71:0/1285080974 conn(0x7fac340a91d0 msgr2=0x7fac3413bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 shutdown_connections 2024-08-19T11:10:46.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.411+0000 7fac3a26e640 1 -- 172.21.15.71:0/1285080974 wait complete. 2024-08-19T11:10:46.422 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T11:10:28.605759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-08-19T11:10:35.665770+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 19, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T11:10:46.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T11:10:46.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.522+0000 7f66b2e6e640 10 monclient: get_monmap_and_config 2024-08-19T11:10:46.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.522+0000 7f66b2e6e640 10 monclient: build_initial_monmap 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.522+0000 7f66b2e6e640 10 monclient: monmap: 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:46.523169+0000 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:46.523169+0000 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:46.524 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:46.525 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:46.525 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:46.525 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:46.525 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 Processor -- start 2024-08-19T11:10:46.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 -- start start 2024-08-19T11:10:46.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient: init 2024-08-19T11:10:46.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:46.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient: _add_conns ranks=[9,0,2,5,3,4,7,10,1,8,6] 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66ac0a69c0 0x7f66ac139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): picked mon.noname-a con 0x7f66ac0a69c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f66ac139cc0 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66ac13a100 0x7f66ac0a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): picked mon.noname-b con 0x7f66ac13a100 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac09c9f0 con 0x7f66ac139cc0 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f66ac13a570 con 0x7f66ac0a69c0 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f66ac0a5840 con 0x7f66ac13a100 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b2e6e640 10 monclient(hunting): authenticate will time out at 704.564880s 2024-08-19T11:10:46.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.523+0000 7f66b0c0a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66ac0a69c0 0x7f66ac139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66ac0a69c0 0x7f66ac139780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36744/0 (socket says 172.21.15.71:36744) 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66abfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f66ac139cc0 0x7f66ac0a6da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36922/0 (socket says 172.21.15.71:36922) 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 -- 172.21.15.71:0/1491953450 learned_addr learned my addr 172.21.15.71:0/1491953450 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): get_auth_request con 0x7f66ac0a69c0 auth_method 0 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 1 --2- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66ac13a100 0x7f66ac0a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): get_auth_request con 0x7f66ac13a100 auth_method 0 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b140b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient(hunting): handle_auth_done global_id 4329 payload 274 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 -- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66ac13a100 msgr2=0x7f66ac0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 --2- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66ac13a100 0x7f66ac0a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 -- 172.21.15.71:0/1491953450 >> v1:172.21.15.71:6789/0 conn(0x7f66ac139cc0 legacy=0x7f66ac0a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient: _finish_hunting 0 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 monclient: found mon.noname-a 2024-08-19T11:10:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:46.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:46.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.524+0000 7f66b0c0a640 1 -- 172.21.15.71:0/1491953450 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac0a4740 con 0x7f66ac0a69c0 2024-08-19T11:10:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66b0c0a640 1 -- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66ac0a69c0 msgr2=0x7f66ac139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66b0c0a640 1 --2- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66ac0a69c0 0x7f66ac139780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009870 tx=0x7f66a002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9affcfdbb58edad server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 1 -- 172.21.15.71:0/1491953450 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f66a0037070 con 0x7f66ac0a69c0 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: dump: 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66b2e6e640 5 monclient: authenticate success, global_id 4329 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66b2e6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 1 -- 172.21.15.71:0/1491953450 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a002ae00 con 0x7f66ac0a69c0 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66b2e6e640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66b2e6e640 4 set_mon_vals no callback set 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 1 -- 172.21.15.71:0/1491953450 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f66a0030c20 con 0x7f66ac0a69c0 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.527+0000 7f66ab7fe640 10 monclient: dump: 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 10 monclient: shutdown 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 -- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66ac0a69c0 msgr2=0x7f66ac139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66ac0a69c0 0x7f66ac139780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009870 tx=0x7f66a002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 -- 172.21.15.71:0/1491953450 shutdown_connections 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f66ac13a100 0x7f66ac0a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/1491953450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66ac0a69c0 0x7f66ac139780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 -- 172.21.15.71:0/1491953450 >> 172.21.15.71:0/1491953450 conn(0x7f66ac0abfc0 msgr2=0x7f66ac0ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 -- 172.21.15.71:0/1491953450 shutdown_connections 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 1 -- 172.21.15.71:0/1491953450 wait complete. 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 10 monclient: build_initial_monmap 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.528+0000 7f66b2e6e640 10 monclient: monmap: 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:46.541 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 Processor -- start 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 -- start start 2024-08-19T11:10:46.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient: init 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient: _add_conns ranks=[7,5,8,3,0,4,6,1,2] 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f66ac0a69c0 0x7f66ac1ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): picked mon.noname-i con 0x7f66ac0a69c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f66ac139cc0 0x7f66ac1ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): picked mon.noname-h con 0x7f66ac139cc0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 0x7f66ac1cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): picked mon.noname-e con 0x7f66ac13a100 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f66ac0a79f0 con 0x7f66ac139cc0 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f66ac0a4d00 con 0x7f66ac0a69c0 2024-08-19T11:10:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f66ac0a7b70 con 0x7f66ac13a100 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b2e6e640 10 monclient(hunting): authenticate will time out at 704.570722s 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 0x7f66ac1cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 0x7f66ac1cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53476/0 (socket says 172.21.15.71:53476) 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 1 -- 172.21.15.71:0/3948192647 learned_addr learned my addr 172.21.15.71:0/3948192647 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): get_auth_request con 0x7f66ac13a100 auth_method 0 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.529+0000 7f66b140b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b0c0a640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f66ac0a69c0 0x7f66ac1ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66abfff640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f66ac139cc0 0x7f66ac1ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b0c0a640 10 monclient(hunting): get_auth_request con 0x7f66ac0a69c0 auth_method 0 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b0c0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b0c0a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b0c0a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 10 monclient(hunting): handle_auth_done global_id 4328 payload 824 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 1 -- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f66ac0a69c0 msgr2=0x7f66ac1ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f66ac0a69c0 0x7f66ac1ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 1 -- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f66ac139cc0 msgr2=0x7f66ac1ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f66ac139cc0 0x7f66ac1ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 10 monclient: _finish_hunting 0 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 1 monclient: found mon.noname-e 2024-08-19T11:10:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66b140b640 1 -- 172.21.15.71:0/3948192647 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac06a220 con 0x7f66ac13a100 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66abfff640 10 monclient: get_auth_request con 0x7f66ac139cc0 auth_method 0 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.530+0000 7f66abfff640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f66ac139cc0 0x7f66ac1ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b140b640 1 -- 172.21.15.71:0/3948192647 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 msgr2=0x7f66ac1cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b140b640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 0x7f66ac1cf430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f66a400efc0 tx=0x7f66a400c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f66a4018020 con 0x7f66ac13a100 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: dump: 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.546 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 5 monclient: authenticate success, global_id 4328 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a40148f0 con 0x7f66ac13a100 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 10 monclient: _renew_subs 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac128af0 con 0x7f66ac13a100 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f66a40133e0 con 0x7f66ac13a100 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66a97fa640 10 monclient: dump: 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.548 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66aaffd640 4 set_mon_vals no callback set 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 10 monclient: _renew_subs 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.532+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac128dd0 con 0x7f66ac13a100 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66b2e6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f66a4005d10 con 0x7f66ac13a100 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66b2e6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66b2e6e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac0a2810 con 0x7f66ac13a100 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66a97fa640 1 --2- 172.21.15.71:0/3948192647 >> v2:172.21.15.135:6800/726754104 conn(0x7f669003eab0 0x7f6690040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.533+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f66a40526b0 con 0x7f66ac13a100 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.534+0000 7f66b0c0a640 1 --2- 172.21.15.71:0/3948192647 >> v2:172.21.15.135:6800/726754104 conn(0x7f669003eab0 0x7f6690040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.534+0000 7f66b0c0a640 10 monclient: get_auth_request con 0x7f669003eab0 auth_method 0 2024-08-19T11:10:46.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.536+0000 7f66b0c0a640 1 --2- 172.21.15.71:0/3948192647 >> v2:172.21.15.135:6800/726754104 conn(0x7f669003eab0 0x7f6690040f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66a0034000 tx=0x7f66a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.538+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f66a4022070 con 0x7f66ac13a100 2024-08-19T11:10:46.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.538+0000 7f66a97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.538+0000 7f66a97fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.711+0000 7f66b2e6e640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-08-19T11:10:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.711+0000 7f66b2e6e640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-08-19T11:10:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.711+0000 7f66b2e6e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.711+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66ac139780 con 0x7f66ac13a100 2024-08-19T11:10:46.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.715+0000 7f66a97fa640 1 -- 172.21.15.71:0/3948192647 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f66ac06a220 con 0x7f66ac13a100 2024-08-19T11:10:46.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.715+0000 7f66a97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-08-19T11:10:46.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.715+0000 7f66a97fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:46.716 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 >> v2:172.21.15.135:6800/726754104 conn(0x7f669003eab0 msgr2=0x7f6690040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/3948192647 >> v2:172.21.15.135:6800/726754104 conn(0x7f669003eab0 0x7f6690040f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66a0034000 tx=0x7f66a002e000 comp rx=0 tx=0).stop 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 10 monclient: shutdown 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 msgr2=0x7f66ac1cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 0x7f66ac1cf430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f66a400efc0 tx=0x7f66a400c490 comp rx=0 tx=0).stop 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 shutdown_connections 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/3948192647 >> v2:172.21.15.135:6800/726754104 conn(0x7f669003eab0 0x7f6690040f70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f66ac13a100 0x7f66ac1cf430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f66ac139cc0 0x7f66ac1ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 --2- 172.21.15.71:0/3948192647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f66ac0a69c0 0x7f66ac1ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 >> 172.21.15.71:0/3948192647 conn(0x7f66ac0abfc0 msgr2=0x7f66ac138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:46.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 shutdown_connections 2024-08-19T11:10:46.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.717+0000 7f66b2e6e640 1 -- 172.21.15.71:0/3948192647 wait complete. 2024-08-19T11:10:46.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.828+0000 7f6525dba640 10 monclient: get_monmap_and_config 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.828+0000 7f6525dba640 10 monclient: build_initial_monmap 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.828+0000 7f6525dba640 10 monclient: monmap: 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:46.829527+0000 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:46.829527+0000 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:46.831 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.829+0000 7f6525dba640 1 Processor -- start 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.829+0000 7f6525dba640 1 -- start start 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.829+0000 7f6525dba640 10 monclient: init 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient: _add_conns ranks=[4,1,7,6,2,3,9,10,8,0,5] 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 0x7f6520139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): picked mon.noname-c con 0x7f65200a69c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6520139cc0 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f652013a100 0x7f65200a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): picked mon.noname-i con 0x7f652013a100 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:46.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652009c9f0 con 0x7f6520139cc0 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f65200a5840 con 0x7f65200a69c0 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f65200a4740 con 0x7f652013a100 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f6525dba640 10 monclient(hunting): authenticate will time out at 704.871268s 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 0x7f6520139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 0x7f6520139780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53150/0 (socket says 172.21.15.71:53150) 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 -- 172.21.15.71:0/3360090897 learned_addr learned my addr 172.21.15.71:0/3360090897 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): get_auth_request con 0x7f65200a69c0 auth_method 0 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651ffff640 1 --2- 172.21.15.71:0/3360090897 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f652013a100 0x7f65200a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651ffff640 10 monclient(hunting): get_auth_request con 0x7f652013a100 auth_method 0 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient(hunting): handle_auth_done global_id 4342 payload 274 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 -- 172.21.15.71:0/3360090897 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f652013a100 msgr2=0x7f65200a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 --2- 172.21.15.71:0/3360090897 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f652013a100 0x7f65200a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 -- 172.21.15.71:0/3360090897 >> v1:172.21.15.135:6789/0 conn(0x7f6520139cc0 legacy=0x7f65200a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:46.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:46.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 monclient: found mon.noname-c 2024-08-19T11:10:46.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:46.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:46.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.830+0000 7f651f7fe640 1 -- 172.21.15.71:0/3360090897 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65200a4a20 con 0x7f65200a69c0 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651f7fe640 1 -- 172.21.15.71:0/3360090897 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 msgr2=0x7f6520139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651f7fe640 1 --2- 172.21.15.71:0/3360090897 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 0x7f6520139780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65100098a0 tx=0x7f651002a080 comp rx=0 tx=0).ready entity=mon.4 client_cookie=99edde6237911969 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 1 -- 172.21.15.71:0/3360090897 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6510037070 con 0x7f65200a69c0 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: dump: 2024-08-19T11:10:46.842 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.843 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: _finish_auth 0 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 1 -- 172.21.15.71:0/3360090897 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651002ade0 con 0x7f65200a69c0 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f6525dba640 5 monclient: authenticate success, global_id 4342 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f6525dba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 1 -- 172.21.15.71:0/3360090897 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6510030c20 con 0x7f65200a69c0 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f651effd640 10 monclient: dump: 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.845 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f6525dba640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.833+0000 7f6525dba640 4 set_mon_vals no callback set 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 10 monclient: shutdown 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 -- 172.21.15.71:0/3360090897 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 msgr2=0x7f6520139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 --2- 172.21.15.71:0/3360090897 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 0x7f6520139780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65100098a0 tx=0x7f651002a080 comp rx=0 tx=0).stop 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 -- 172.21.15.71:0/3360090897 shutdown_connections 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 --2- 172.21.15.71:0/3360090897 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f652013a100 0x7f65200a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 --2- 172.21.15.71:0/3360090897 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f65200a69c0 0x7f6520139780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 -- 172.21.15.71:0/3360090897 >> 172.21.15.71:0/3360090897 conn(0x7f65200abfc0 msgr2=0x7f65200ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 -- 172.21.15.71:0/3360090897 shutdown_connections 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 1 -- 172.21.15.71:0/3360090897 wait complete. 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.834+0000 7f6525dba640 10 monclient: build_initial_monmap 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient: monmap: 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 Processor -- start 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 -- start start 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient: init 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient: _add_conns ranks=[0,1,5,4,8,3,6,2,7] 2024-08-19T11:10:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 0x7f65201ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): picked mon.noname-a con 0x7f65200a69c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6520139cc0 0x7f65201ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): picked mon.noname-f con 0x7f6520139cc0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f652013a100 0x7f65201cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): picked mon.noname-h con 0x7f652013a100 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f65200a79f0 con 0x7f65200a69c0 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f652013a540 con 0x7f6520139cc0 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f65200a7b70 con 0x7f652013a100 2024-08-19T11:10:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.835+0000 7f6525dba640 10 monclient(hunting): authenticate will time out at 704.876985s 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 0x7f65201ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 0x7f65201ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36760/0 (socket says 172.21.15.71:36760) 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 -- 172.21.15.71:0/3217367253 learned_addr learned my addr 172.21.15.71:0/3217367253 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): get_auth_request con 0x7f65200a69c0 auth_method 0 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient(hunting): handle_auth_done global_id 4338 payload 824 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651ffff640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f652013a100 0x7f65201cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f6516ffd640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6520139cc0 0x7f65201ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 -- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f652013a100 msgr2=0x7f65201cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f652013a100 0x7f65201cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 -- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6520139cc0 msgr2=0x7f65201ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6520139cc0 0x7f65201ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 monclient: found mon.noname-a 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651f7fe640 1 -- 172.21.15.71:0/3217367253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65200a28d0 con 0x7f65200a69c0 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651ffff640 10 monclient: get_auth_request con 0x7f652013a100 auth_method 0 2024-08-19T11:10:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f6516ffd640 10 monclient: get_auth_request con 0x7f6520139cc0 auth_method 0 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f651ffff640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f652013a100 0x7f65201cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.836+0000 7f6516ffd640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6520139cc0 0x7f65201ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651f7fe640 1 -- 172.21.15.71:0/3217367253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 msgr2=0x7f65201ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651f7fe640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 0x7f65201ce9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65100090b0 tx=0x7f6510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6510042070 con 0x7f65200a69c0 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: dump: 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.852 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 5 monclient: authenticate success, global_id 4338 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6510003cb0 con 0x7f65200a69c0 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6510037040 con 0x7f65200a69c0 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651e7fc640 4 set_mon_vals no callback set 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f651cff9640 10 monclient: dump: 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 10 monclient: _renew_subs 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652012a0f0 con 0x7f65200a69c0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 10 monclient: _renew_subs 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.838+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65200a2380 con 0x7f65200a69c0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6510032440 con 0x7f65200a69c0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f6525dba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f6525dba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f6525dba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652006a220 con 0x7f65200a69c0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f651cff9640 1 --2- 172.21.15.71:0/3217367253 >> v2:172.21.15.135:6800/726754104 conn(0x7f650003ea80 0x7f6500040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.839+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f6510071410 con 0x7f65200a69c0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.840+0000 7f6516ffd640 1 --2- 172.21.15.71:0/3217367253 >> v2:172.21.15.135:6800/726754104 conn(0x7f650003ea80 0x7f6500040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:46.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.840+0000 7f6516ffd640 10 monclient: get_auth_request con 0x7f650003ea80 auth_method 0 2024-08-19T11:10:46.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.842+0000 7f6516ffd640 1 --2- 172.21.15.71:0/3217367253 >> v2:172.21.15.135:6800/726754104 conn(0x7f650003ea80 0x7f6500040f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65201276e0 tx=0x7f6508009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:46.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.844+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f65200a28d0 con 0x7f65200a69c0 2024-08-19T11:10:46.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.844+0000 7f651cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:46.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:46.844+0000 7f651cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f6525dba640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-08-19T11:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f6525dba640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-08-19T11:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f6525dba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f6520128dd0 con 0x7f65200a69c0 2024-08-19T11:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f651cff9640 1 -- 172.21.15.71:0/3217367253 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) ==== 92+0+10 (secure 0 0 0) 0x7f65100702d0 con 0x7f65200a69c0 2024-08-19T11:10:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f651cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-08-19T11:10:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.017+0000 7f651cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:47.019 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2024-08-19T11:10:47.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 >> v2:172.21.15.135:6800/726754104 conn(0x7f650003ea80 msgr2=0x7f6500040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 --2- 172.21.15.71:0/3217367253 >> v2:172.21.15.135:6800/726754104 conn(0x7f650003ea80 0x7f6500040f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65201276e0 tx=0x7f6508009040 comp rx=0 tx=0).stop 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 10 monclient: shutdown 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 msgr2=0x7f65201ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 0x7f65201ce9b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65100090b0 tx=0x7f6510004730 comp rx=0 tx=0).stop 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 shutdown_connections 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 --2- 172.21.15.71:0/3217367253 >> v2:172.21.15.135:6800/726754104 conn(0x7f650003ea80 0x7f6500040f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f652013a100 0x7f65201cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6520139cc0 0x7f65201ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 --2- 172.21.15.71:0/3217367253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65200a69c0 0x7f65201ce9b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 >> 172.21.15.71:0/3217367253 conn(0x7f65200abfc0 msgr2=0x7f652009d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 shutdown_connections 2024-08-19T11:10:47.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.019+0000 7f6525dba640 1 -- 172.21.15.71:0/3217367253 wait complete. 2024-08-19T11:10:47.031 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-08-19T11:10:47.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:10:47.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.127+0000 7f183a256640 10 monclient: get_monmap_and_config 2024-08-19T11:10:47.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.127+0000 7f183a256640 10 monclient: build_initial_monmap 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.127+0000 7f183a256640 10 monclient: monmap: 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:47.128034+0000 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:47.128034+0000 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:47.129 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:47.130 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:47.130 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:47.130 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:47.130 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:47.130 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:47.130 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 Processor -- start 2024-08-19T11:10:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 -- start start 2024-08-19T11:10:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient: init 2024-08-19T11:10:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient: _add_conns ranks=[0,8,5,7,2,1,4,9,6,3,10] 2024-08-19T11:10:47.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f18340a6a30 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 0x7f18340a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): picked mon.noname-e con 0x7f18340a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f183413eb10 0x7f1834140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): picked mon.noname-h con 0x7f183413eb10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18340a4f90 con 0x7f18340a6a30 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f18340a3650 con 0x7f183413eb10 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f18340a6380 con 0x7f18340a6e10 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f183a256640 10 monclient(hunting): authenticate will time out at 705.169711s 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 0x7f18340a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f18337fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f18340a6a30 0x7f18340a57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36926/0 (socket says 172.21.15.71:36926) 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f18337fe640 1 -- 172.21.15.71:0/2896149139 learned_addr learned my addr 172.21.15.71:0/2896149139 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): get_auth_request con 0x7f18340a6e10 auth_method 0 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.128+0000 7f1832ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1833fff640 1 --2- 172.21.15.71:0/2896149139 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f183413eb10 0x7f1834140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1833fff640 10 monclient(hunting): get_auth_request con 0x7f183413eb10 auth_method 0 2024-08-19T11:10:47.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1833fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1833fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1833fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 10 monclient(hunting): handle_auth_done global_id 4337 payload 274 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 1 -- 172.21.15.71:0/2896149139 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f183413eb10 msgr2=0x7f1834140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 1 --2- 172.21.15.71:0/2896149139 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f183413eb10 0x7f1834140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 1 -- 172.21.15.71:0/2896149139 >> v1:172.21.15.71:6789/0 conn(0x7f18340a6a30 legacy=0x7f18340a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 1 monclient: found mon.noname-e 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.129+0000 7f1832ffd640 1 -- 172.21.15.71:0/2896149139 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18340a49d0 con 0x7f18340a6e10 2024-08-19T11:10:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.131+0000 7f1832ffd640 1 -- 172.21.15.71:0/2896149139 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 msgr2=0x7f18340a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.131+0000 7f1832ffd640 1 --2- 172.21.15.71:0/2896149139 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 0x7f18340a71f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f18280097d0 tx=0x7f1828029fb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f7f3c484ea0aadeb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 1 -- 172.21.15.71:0/2896149139 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1828037070 con 0x7f18340a6e10 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: dump: 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 5 monclient: authenticate success, global_id 4337 2024-08-19T11:10:47.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 1 -- 172.21.15.71:0/2896149139 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182802ad10 con 0x7f18340a6e10 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 4 set_mon_vals no callback set 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 1 -- 172.21.15.71:0/2896149139 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1828030c20 con 0x7f18340a6e10 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f18327fc640 10 monclient: dump: 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.140 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 10 monclient: shutdown 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 -- 172.21.15.71:0/2896149139 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 msgr2=0x7f18340a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 --2- 172.21.15.71:0/2896149139 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 0x7f18340a71f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f18280097d0 tx=0x7f1828029fb0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 -- 172.21.15.71:0/2896149139 shutdown_connections 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 --2- 172.21.15.71:0/2896149139 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f183413eb10 0x7f1834140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 --2- 172.21.15.71:0/2896149139 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f18340a6e10 0x7f18340a71f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 -- 172.21.15.71:0/2896149139 >> 172.21.15.71:0/2896149139 conn(0x7f18340ac030 msgr2=0x7f18340ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 -- 172.21.15.71:0/2896149139 shutdown_connections 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.132+0000 7f183a256640 1 -- 172.21.15.71:0/2896149139 wait complete. 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.133+0000 7f183a256640 10 monclient: build_initial_monmap 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.133+0000 7f183a256640 10 monclient: monmap: 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:47.143 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.133+0000 7f183a256640 1 Processor -- start 2024-08-19T11:10:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.133+0000 7f183a256640 1 -- start start 2024-08-19T11:10:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.133+0000 7f183a256640 10 monclient: init 2024-08-19T11:10:47.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient: _add_conns ranks=[7,3,4,6,2,8,5,1,0] 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18340a6a30 0x7f18341ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): picked mon.noname-i con 0x7f18340a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18340a6e10 0x7f18341ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): picked mon.noname-g con 0x7f18340a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 0x7f18341ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): picked mon.noname-c con 0x7f183413eb10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18340a7730 con 0x7f18340a6e10 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1834141440 con 0x7f183413eb10 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f183413c410 con 0x7f18340a6a30 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f183a256640 10 monclient(hunting): authenticate will time out at 705.175201s 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 0x7f18341ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 0x7f18341ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53162/0 (socket says 172.21.15.71:53162) 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 -- 172.21.15.71:0/3694721055 learned_addr learned my addr 172.21.15.71:0/3694721055 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): get_auth_request con 0x7f183413eb10 auth_method 0 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18340a6a30 0x7f18341ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18340a6e10 0x7f18341ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): get_auth_request con 0x7f18340a6a30 auth_method 0 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): get_auth_request con 0x7f18340a6e10 auth_method 0 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1832ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f18337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient(hunting): handle_auth_done global_id 4351 payload 824 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 -- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18340a6a30 msgr2=0x7f18341ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18340a6a30 0x7f18341ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 -- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18340a6e10 msgr2=0x7f18341ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18340a6e10 0x7f18341ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 monclient: found mon.noname-c 2024-08-19T11:10:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.134+0000 7f1833fff640 1 -- 172.21.15.71:0/3694721055 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18340a9760 con 0x7f183413eb10 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.136+0000 7f1833fff640 1 -- 172.21.15.71:0/3694721055 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 msgr2=0x7f18341ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.136+0000 7f1833fff640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 0x7f18341ceeb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f182c007ec0 tx=0x7f182c00e4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.136+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f182c00ee90 con 0x7f183413eb10 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.136+0000 7f181bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.136+0000 7f181bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.136+0000 7f181bfff640 10 monclient: dump: 2024-08-19T11:10:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 10 monclient: _finish_auth 0 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182c019070 con 0x7f183413eb10 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 5 monclient: authenticate success, global_id 4351 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 10 monclient: _renew_subs 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183413dd20 con 0x7f183413eb10 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f182c014420 con 0x7f183413eb10 2024-08-19T11:10:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 10 monclient: dump: 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 10 monclient: _renew_subs 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f1831ffb640 4 set_mon_vals no callback set 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f183413c130 con 0x7f183413eb10 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.137+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f182c0145c0 con 0x7f183413eb10 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f181bfff640 1 --2- 172.21.15.71:0/3694721055 >> v2:172.21.15.135:6800/726754104 conn(0x7f182003ec50 0x7f1820041110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f182c0522f0 con 0x7f183413eb10 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f183a256640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f183a256640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f183a256640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183413ac70 con 0x7f183413eb10 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f18337fe640 1 --2- 172.21.15.71:0/3694721055 >> v2:172.21.15.135:6800/726754104 conn(0x7f182003ec50 0x7f1820041110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.138+0000 7f18337fe640 10 monclient: get_auth_request con 0x7f182003ec50 auth_method 0 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.140+0000 7f18337fe640 1 --2- 172.21.15.71:0/3694721055 >> v2:172.21.15.135:6800/726754104 conn(0x7f182003ec50 0x7f1820041110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1824007c90 tx=0x7f1824007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.142+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f182c052070 con 0x7f183413eb10 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.142+0000 7f181bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.142+0000 7f181bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:47.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.311+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18340a71f0 con 0x7f182003ec50 2024-08-19T11:10:47.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.312+0000 7f181bfff640 1 -- 172.21.15.71:0/3694721055 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34179 (secure 0 0 0) 0x7f18340a71f0 con 0x7f182003ec50 2024-08-19T11:10:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:10:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 >> v2:172.21.15.135:6800/726754104 conn(0x7f182003ec50 msgr2=0x7f1820041110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 --2- 172.21.15.71:0/3694721055 >> v2:172.21.15.135:6800/726754104 conn(0x7f182003ec50 0x7f1820041110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1824007c90 tx=0x7f1824007be0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 10 monclient: shutdown 2024-08-19T11:10:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 msgr2=0x7f18341ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 0x7f18341ceeb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f182c007ec0 tx=0x7f182c00e4b0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 shutdown_connections 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 --2- 172.21.15.71:0/3694721055 >> v2:172.21.15.135:6800/726754104 conn(0x7f182003ec50 0x7f1820041110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f183413eb10 0x7f18341ceeb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18340a6e10 0x7f18341ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 --2- 172.21.15.71:0/3694721055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18340a6a30 0x7f18341ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 >> 172.21.15.71:0/3694721055 conn(0x7f18340ac030 msgr2=0x7f183413ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 shutdown_connections 2024-08-19T11:10:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.314+0000 7f183a256640 1 -- 172.21.15.71:0/3694721055 wait complete. 2024-08-19T11:10:47.326 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-19T11:10:46.175628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163284,"kb_used_data":1088,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067756,"statfs":{"total":579820584960,"available":579653382144,"internally_reserved":0,"allocated":1114112,"data_stored":1368658,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001884"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666514+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:10:39.666514+0000","last_peered":"2024-08-19T11:10:39.666514+0000","last_clean":"2024-08-19T11:10:39.666514+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:10:39.666514+0000","last_undegraded":"2024-08-19T11:10:39.666514+0000","last_fullsized":"2024-08-19T11:10:39.666514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.663675+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:10:39.663675+0000","last_peered":"2024-08-19T11:10:39.663675+0000","last_clean":"2024-08-19T11:10:39.663675+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:10:39.663675+0000","last_undegraded":"2024-08-19T11:10:39.663675+0000","last_fullsized":"2024-08-19T11:10:39.663675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666232+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:10:39.666232+0000","last_peered":"2024-08-19T11:10:39.666232+0000","last_clean":"2024-08-19T11:10:39.666232+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:10:39.666232+0000","last_undegraded":"2024-08-19T11:10:39.666232+0000","last_fullsized":"2024-08-19T11:10:39.666232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664544+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:10:39.664544+0000","last_peered":"2024-08-19T11:10:39.664544+0000","last_clean":"2024-08-19T11:10:39.664544+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:10:39.664544+0000","last_undegraded":"2024-08-19T11:10:39.664544+0000","last_fullsized":"2024-08-19T11:10:39.664544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665250+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:10:39.665250+0000","last_peered":"2024-08-19T11:10:39.665250+0000","last_clean":"2024-08-19T11:10:39.665250+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:10:39.665250+0000","last_undegraded":"2024-08-19T11:10:39.665250+0000","last_fullsized":"2024-08-19T11:10:39.665250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664351+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:10:39.664351+0000","last_peered":"2024-08-19T11:10:39.664351+0000","last_clean":"2024-08-19T11:10:39.664351+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:10:39.664351+0000","last_undegraded":"2024-08-19T11:10:39.664351+0000","last_fullsized":"2024-08-19T11:10:39.664351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.737928+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:10:39.737928+0000","last_peered":"2024-08-19T11:10:39.737928+0000","last_clean":"2024-08-19T11:10:39.737928+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:10:39.737928+0000","last_undegraded":"2024-08-19T11:10:39.737928+0000","last_fullsized":"2024-08-19T11:10:39.737928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666278+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:10:39.666278+0000","last_peered":"2024-08-19T11:10:39.666278+0000","last_clean":"2024-08-19T11:10:39.666278+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:10:39.666278+0000","last_undegraded":"2024-08-19T11:10:39.666278+0000","last_fullsized":"2024-08-19T11:10:39.666278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665969+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:10:39.665969+0000","last_peered":"2024-08-19T11:10:39.665969+0000","last_clean":"2024-08-19T11:10:39.665969+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:10:39.665969+0000","last_undegraded":"2024-08-19T11:10:39.665969+0000","last_fullsized":"2024-08-19T11:10:39.665969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:10:47.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:10:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.424+0000 7fbd2051b640 10 monclient: get_monmap_and_config 2024-08-19T11:10:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.424+0000 7fbd2051b640 10 monclient: build_initial_monmap 2024-08-19T11:10:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.424+0000 7fbd2051b640 10 monclient: monmap: 2024-08-19T11:10:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:47.425 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:47.424901+0000 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:47.424901+0000 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.424+0000 7fbd2051b640 1 Processor -- start 2024-08-19T11:10:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.424+0000 7fbd2051b640 1 -- start start 2024-08-19T11:10:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.424+0000 7fbd2051b640 10 monclient: init 2024-08-19T11:10:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient: _add_conns ranks=[1,9,8,7,4,2,5,10,3,6,0] 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbd180a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 0x7fbd180a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): picked mon.noname-a con 0x7fbd180a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 0x7fbd18140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): picked mon.noname-e con 0x7fbd1813eb10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd180a4f90 con 0x7fbd180a6a30 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbd180a3650 con 0x7fbd180a6e10 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbd180a6380 con 0x7fbd1813eb10 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd2051b640 10 monclient(hunting): authenticate will time out at 705.466595s 2024-08-19T11:10:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 0x7fbd180a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 0x7fbd18140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 0x7fbd180a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36774/0 (socket says 172.21.15.71:36774) 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 1 -- 172.21.15.71:0/316550044 learned_addr learned my addr 172.21.15.71:0/316550044 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): get_auth_request con 0x7fbd180a6e10 auth_method 0 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): get_auth_request con 0x7fbd1813eb10 auth_method 0 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1dab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_done global_id 4346 payload 274 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 1 -- 172.21.15.71:0/316550044 >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 msgr2=0x7fbd180a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 1 --2- 172.21.15.71:0/316550044 >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 0x7fbd180a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 1 -- 172.21.15.71:0/316550044 >> v1:172.21.15.135:6789/0 conn(0x7fbd180a6a30 legacy=0x7fbd180a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 10 monclient: _finish_hunting 0 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 1 monclient: found mon.noname-e 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.425+0000 7fbd1eab8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.426+0000 7fbd1eab8640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.426+0000 7fbd1eab8640 1 -- 172.21.15.71:0/316550044 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd180a49d0 con 0x7fbd1813eb10 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.426+0000 7fbd1dab6640 1 --2- 172.21.15.71:0/316550044 >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 0x7fbd180a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1eab8640 1 -- 172.21.15.71:0/316550044 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 msgr2=0x7fbd18140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:47.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1eab8640 1 --2- 172.21.15.71:0/316550044 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 0x7fbd18140f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009d90 tx=0x7fbd1002a490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5f3f6ff27ea0dbe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 1 -- 172.21.15.71:0/316550044 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd10007bc0 con 0x7fbd1813eb10 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: dump: 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: _finish_auth 0 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: _check_auth_tickets 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd2051b640 5 monclient: authenticate success, global_id 4346 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 1 -- 172.21.15.71:0/316550044 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd10007d80 con 0x7fbd1813eb10 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd2051b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd2051b640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd2051b640 4 set_mon_vals no callback set 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 1 -- 172.21.15.71:0/316550044 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd10031870 con 0x7fbd1813eb10 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.428+0000 7fbd1d2b5640 10 monclient: dump: 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.443 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 10 monclient: shutdown 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 -- 172.21.15.71:0/316550044 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 msgr2=0x7fbd18140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 --2- 172.21.15.71:0/316550044 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 0x7fbd18140f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009d90 tx=0x7fbd1002a490 comp rx=0 tx=0).stop 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 -- 172.21.15.71:0/316550044 shutdown_connections 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 --2- 172.21.15.71:0/316550044 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd1813eb10 0x7fbd18140f00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 --2- 172.21.15.71:0/316550044 >> v2:172.21.15.71:3300/0 conn(0x7fbd180a6e10 0x7fbd180a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 -- 172.21.15.71:0/316550044 >> 172.21.15.71:0/316550044 conn(0x7fbd180ac030 msgr2=0x7fbd180ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 -- 172.21.15.71:0/316550044 shutdown_connections 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.429+0000 7fbd2051b640 1 -- 172.21.15.71:0/316550044 wait complete. 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient: build_initial_monmap 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient: monmap: 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:47.445 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 Processor -- start 2024-08-19T11:10:47.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 -- start start 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient: init 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient: _add_conns ranks=[8,1,2,0,5,6,7,4,3] 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 0x7fbd18125d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): picked mon.noname-e con 0x7fbd180a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd180a6e10 0x7fbd1813cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): picked mon.noname-f con 0x7fbd180a6e10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd1813eb10 0x7fbd181237e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): picked mon.noname-b con 0x7fbd1813eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd180a7730 con 0x7fbd180a6e10 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbd18141440 con 0x7fbd1813eb10 2024-08-19T11:10:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbd180ac780 con 0x7fbd180a6a30 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd2051b640 10 monclient(hunting): authenticate will time out at 705.471923s 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.430+0000 7fbd1e2b7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 0x7fbd18125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd1813eb10 0x7fbd181237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 0x7fbd18125d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53508/0 (socket says 172.21.15.71:53508) 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 -- 172.21.15.71:0/353481736 learned_addr learned my addr 172.21.15.71:0/353481736 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): get_auth_request con 0x7fbd180a6a30 auth_method 0 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd1813eb10 0x7fbd181237e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34710/0 (socket says 172.21.15.71:34710) 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): get_auth_request con 0x7fbd1813eb10 auth_method 0 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1eab8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1dab6640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd180a6e10 0x7fbd1813cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1dab6640 10 monclient(hunting): get_auth_request con 0x7fbd180a6e10 auth_method 0 2024-08-19T11:10:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1dab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1dab6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1dab6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient(hunting): handle_auth_done global_id 4355 payload 824 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 -- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd1813eb10 msgr2=0x7fbd181237e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd1813eb10 0x7fbd181237e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 -- 172.21.15.71:0/353481736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd180a6e10 msgr2=0x7fbd1813cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd180a6e10 0x7fbd1813cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient: _finish_hunting 0 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 monclient: found mon.noname-e 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.431+0000 7fbd1e2b7640 1 -- 172.21.15.71:0/353481736 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd18127540 con 0x7fbd180a6a30 2024-08-19T11:10:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd1e2b7640 1 -- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 msgr2=0x7fbd18125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd1e2b7640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 0x7fbd18125d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c430 tx=0x7fbd1400c8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd14003860 con 0x7fbd180a6a30 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: dump: 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.451 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: _finish_auth 0 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 5 monclient: authenticate success, global_id 4355 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd14017070 con 0x7fbd180a6a30 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd14011cd0 con 0x7fbd180a6a30 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 10 monclient: _renew_subs 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd18141210 con 0x7fbd180a6a30 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd1cab4640 4 set_mon_vals no callback set 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd0effd640 10 monclient: dump: 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.453 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.454 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 10 monclient: _renew_subs 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.433+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd181251e0 con 0x7fbd180a6a30 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbd140117a0 con 0x7fbd180a6a30 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd2051b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd2051b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd2051b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd180a71f0 con 0x7fbd180a6a30 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd0effd640 1 --2- 172.21.15.71:0/353481736 >> v2:172.21.15.135:6800/726754104 conn(0x7fbcfc03ea80 0x7fbcfc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.434+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7fbd140518f0 con 0x7fbd180a6a30 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.435+0000 7fbd1dab6640 1 --2- 172.21.15.71:0/353481736 >> v2:172.21.15.135:6800/726754104 conn(0x7fbcfc03ea80 0x7fbcfc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.435+0000 7fbd1dab6640 10 monclient: get_auth_request con 0x7fbcfc03ea80 auth_method 0 2024-08-19T11:10:47.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.437+0000 7fbd1dab6640 1 --2- 172.21.15.71:0/353481736 >> v2:172.21.15.135:6800/726754104 conn(0x7fbcfc03ea80 0x7fbcfc040f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd18124f40 tx=0x7fbd08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.439+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fbd140507b0 con 0x7fbd180a6a30 2024-08-19T11:10:47.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.439+0000 7fbd0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.439+0000 7fbd0effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:47.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.609+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd181cf1e0 con 0x7fbcfc03ea80 2024-08-19T11:10:47.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.610+0000 7fbd0effd640 1 -- 172.21.15.71:0/353481736 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34179 (secure 0 0 0) 0x7fbd181cf1e0 con 0x7fbcfc03ea80 2024-08-19T11:10:47.611 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:10:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:10:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 >> v2:172.21.15.135:6800/726754104 conn(0x7fbcfc03ea80 msgr2=0x7fbcfc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 --2- 172.21.15.71:0/353481736 >> v2:172.21.15.135:6800/726754104 conn(0x7fbcfc03ea80 0x7fbcfc040f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd18124f40 tx=0x7fbd08008040 comp rx=0 tx=0).stop 2024-08-19T11:10:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 10 monclient: shutdown 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 msgr2=0x7fbd18125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 0x7fbd18125d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c430 tx=0x7fbd1400c8f0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 shutdown_connections 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 --2- 172.21.15.71:0/353481736 >> v2:172.21.15.135:6800/726754104 conn(0x7fbcfc03ea80 0x7fbcfc040f40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd1813eb10 0x7fbd181237e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd180a6e10 0x7fbd1813cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 --2- 172.21.15.71:0/353481736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd180a6a30 0x7fbd18125d40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 >> 172.21.15.71:0/353481736 conn(0x7fbd180ac030 msgr2=0x7fbd1813fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 shutdown_connections 2024-08-19T11:10:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.612+0000 7fbd2051b640 1 -- 172.21.15.71:0/353481736 wait complete. 2024-08-19T11:10:47.624 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-19T11:10:46.175628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163284,"kb_used_data":1088,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067756,"statfs":{"total":579820584960,"available":579653382144,"internally_reserved":0,"allocated":1114112,"data_stored":1368658,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001884"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666514+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:10:39.666514+0000","last_peered":"2024-08-19T11:10:39.666514+0000","last_clean":"2024-08-19T11:10:39.666514+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:10:39.666514+0000","last_undegraded":"2024-08-19T11:10:39.666514+0000","last_fullsized":"2024-08-19T11:10:39.666514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.663675+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:10:39.663675+0000","last_peered":"2024-08-19T11:10:39.663675+0000","last_clean":"2024-08-19T11:10:39.663675+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:10:39.663675+0000","last_undegraded":"2024-08-19T11:10:39.663675+0000","last_fullsized":"2024-08-19T11:10:39.663675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666232+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:10:39.666232+0000","last_peered":"2024-08-19T11:10:39.666232+0000","last_clean":"2024-08-19T11:10:39.666232+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:10:39.666232+0000","last_undegraded":"2024-08-19T11:10:39.666232+0000","last_fullsized":"2024-08-19T11:10:39.666232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664544+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:10:39.664544+0000","last_peered":"2024-08-19T11:10:39.664544+0000","last_clean":"2024-08-19T11:10:39.664544+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:10:39.664544+0000","last_undegraded":"2024-08-19T11:10:39.664544+0000","last_fullsized":"2024-08-19T11:10:39.664544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665250+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:10:39.665250+0000","last_peered":"2024-08-19T11:10:39.665250+0000","last_clean":"2024-08-19T11:10:39.665250+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:10:39.665250+0000","last_undegraded":"2024-08-19T11:10:39.665250+0000","last_fullsized":"2024-08-19T11:10:39.665250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.664351+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:10:39.664351+0000","last_peered":"2024-08-19T11:10:39.664351+0000","last_clean":"2024-08-19T11:10:39.664351+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:10:39.664351+0000","last_undegraded":"2024-08-19T11:10:39.664351+0000","last_fullsized":"2024-08-19T11:10:39.664351+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.737928+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:10:39.737928+0000","last_peered":"2024-08-19T11:10:39.737928+0000","last_clean":"2024-08-19T11:10:39.737928+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:10:39.737928+0000","last_undegraded":"2024-08-19T11:10:39.737928+0000","last_fullsized":"2024-08-19T11:10:39.737928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.666278+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:10:39.666278+0000","last_peered":"2024-08-19T11:10:39.666278+0000","last_clean":"2024-08-19T11:10:39.666278+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:10:39.666278+0000","last_undegraded":"2024-08-19T11:10:39.666278+0000","last_fullsized":"2024-08-19T11:10:39.666278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-19T11:10:39.665969+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:10:39.665969+0000","last_peered":"2024-08-19T11:10:39.665969+0000","last_clean":"2024-08-19T11:10:39.665969+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:10:39.665969+0000","last_undegraded":"2024-08-19T11:10:39.665969+0000","last_fullsized":"2024-08-19T11:10:39.665969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":51794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":580722,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607558,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:10:47.625 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-08-19T11:10:47.625 DEBUG:tasks.mon_thrash:Yielding 2024-08-19T11:10:47.625 INFO:teuthology.run_tasks:Running task exec... 2024-08-19T11:10:47.636 INFO:teuthology.task.exec:Executing custom commands... 2024-08-19T11:10:47.637 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:10:47.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:10:47.637 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-08-19T11:10:47.637 INFO:tasks.mon_thrash.mon_thrasher:seed: 1724065847, revive delay: 20.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-08-19T11:10:47.638 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:10:47.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.735+0000 7f1ea096b640 10 monclient: get_monmap_and_config 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.735+0000 7f1ea096b640 10 monclient: build_initial_monmap 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.735+0000 7f1ea096b640 10 monclient: monmap: 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:47.736422+0000 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:47.736422+0000 2024-08-19T11:10:47.749 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.736+0000 7f1ea096b640 1 Processor -- start 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.736+0000 7f1ea096b640 1 -- start start 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.736+0000 7f1ea096b640 10 monclient: init 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient: _add_conns ranks=[6,2,7,4,3,0,10,8,9,5,1] 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): picked mon.noname-d con 0x7f1e9c0a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 0x7f1e9c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): picked mon.noname-b con 0x7f1e9c0a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1e9c139860 0x7f1e9c139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): picked mon.noname-i con 0x7f1e9c139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:47.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c0a4f90 con 0x7f1e9c0a6e10 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1e9c0a6380 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1e9c0a49d0 con 0x7f1e9c139860 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1ea096b640 10 monclient(hunting): authenticate will time out at 705.778110s 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 0x7f1e9c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c0a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55812/0 (socket says 172.21.15.71:55812) 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 0x7f1e9c0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34720/0 (socket says 172.21.15.71:34720) 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 -- 172.21.15.71:0/3020091562 learned_addr learned my addr 172.21.15.71:0/3020091562 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:47.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): get_auth_request con 0x7f1e9c0a6a30 auth_method 0 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): get_auth_request con 0x7f1e9c0a6e10 auth_method 0 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9ad9d640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1e9c139860 0x7f1e9c139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9ad9d640 10 monclient(hunting): get_auth_request con 0x7f1e9c139860 auth_method 0 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_done global_id 4416 payload 274 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 -- 172.21.15.71:0/3020091562 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1e9c139860 msgr2=0x7f1e9c139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1e9c139860 0x7f1e9c139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 -- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 msgr2=0x7f1e9c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 0x7f1e9c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:47.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 monclient: found mon.noname-d 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e9a59c640 1 -- 172.21.15.71:0/3020091562 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c0a46f0 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.737+0000 7f1e99d9b640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 0x7f1e9c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9a59c640 1 -- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 msgr2=0x7f1e9c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9a59c640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c0a57f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009eb0 tx=0x7f1e8c02a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b62857134c3aee2d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 1 -- 172.21.15.71:0/3020091562 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1e8c036070 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: dump: 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.755 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.756 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: _finish_auth 0 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: _check_auth_tickets 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 1 -- 172.21.15.71:0/3020091562 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c007a70 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 5 monclient: authenticate success, global_id 4416 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 1 -- 172.21.15.71:0/3020091562 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1e8c007c60 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 4 set_mon_vals no callback set 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1e9959a640 10 monclient: dump: 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.758 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 10 monclient: shutdown 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 1 -- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 msgr2=0x7f1e9c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.740+0000 7f1ea096b640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c0a57f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009eb0 tx=0x7f1e8c02a560 comp rx=0 tx=0).stop 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 -- 172.21.15.71:0/3020091562 shutdown_connections 2024-08-19T11:10:47.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1e9c139860 0x7f1e9c139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e9c0a6e10 0x7f1e9c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 --2- 172.21.15.71:0/3020091562 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c0a57f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 -- 172.21.15.71:0/3020091562 >> 172.21.15.71:0/3020091562 conn(0x7f1e9c0ac030 msgr2=0x7f1e9c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 -- 172.21.15.71:0/3020091562 shutdown_connections 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 1 -- 172.21.15.71:0/3020091562 wait complete. 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 10 monclient: build_initial_monmap 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.741+0000 7f1ea096b640 10 monclient: monmap: 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:47.760 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 Processor -- start 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 -- start start 2024-08-19T11:10:47.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient: init 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient: _add_conns ranks=[6,5,3,7,0,8,2,4,1] 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c124f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): picked mon.noname-d con 0x7f1e9c0a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1e9c0a6e10 0x7f1e9c125440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): picked mon.noname-h con 0x7f1e9c0a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e9c139860 0x7f1e9c125980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): picked mon.noname-g con 0x7f1e9c139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c0a7730 con 0x7f1e9c139860 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1e9c13a1a0 con 0x7f1e9c0a6e10 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1e9c128a30 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1ea096b640 10 monclient(hunting): authenticate will time out at 705.783688s 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c124f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c124f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55820/0 (socket says 172.21.15.71:55820) 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 1 -- 172.21.15.71:0/699573055 learned_addr learned my addr 172.21.15.71:0/699573055 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): get_auth_request con 0x7f1e9c0a6a30 auth_method 0 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:47.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e99d9b640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1e9c0a6e10 0x7f1e9c125440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.742+0000 7f1e9ad9d640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e9c139860 0x7f1e9c125980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 10 monclient(hunting): handle_auth_done global_id 4425 payload 824 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 1 -- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1e9c0a6e10 msgr2=0x7f1e9c125440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1e9c0a6e10 0x7f1e9c125440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 1 -- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e9c139860 msgr2=0x7f1e9c125980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e9c139860 0x7f1e9c125980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 1 monclient: found mon.noname-d 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9a59c640 1 -- 172.21.15.71:0/699573055 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c128d10 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e99d9b640 10 monclient: get_auth_request con 0x7f1e9c0a6e10 auth_method 0 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9ad9d640 10 monclient: get_auth_request con 0x7f1e9c139860 auth_method 0 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e99d9b640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1e9c0a6e10 0x7f1e9c125440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.743+0000 7f1e9ad9d640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e9c139860 0x7f1e9c125980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e9a59c640 1 -- 172.21.15.71:0/699573055 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 msgr2=0x7f1e9c124f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e9a59c640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c124f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c008fd0 tx=0x7f1e8c004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1e8c036050 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: dump: 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.765 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.766 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 5 monclient: authenticate success, global_id 4425 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c042070 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 10 monclient: _renew_subs 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1e8c003db0 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c0a26b0 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:47.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e98d99640 4 set_mon_vals no callback set 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1e92ffd640 10 monclient: dump: 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:47.768 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 10 monclient: _renew_subs 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.745+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c0a57f0 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1e8c004040 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1ea096b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1ea096b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1ea096b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9c13a500 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1e92ffd640 1 --2- 172.21.15.71:0/699573055 >> v2:172.21.15.135:6800/726754104 conn(0x7f1e7c03ea80 0x7f1e7c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:47.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f1e8c072920 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.746+0000 7f1e99d9b640 1 --2- 172.21.15.71:0/699573055 >> v2:172.21.15.135:6800/726754104 conn(0x7f1e7c03ea80 0x7f1e7c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.747+0000 7f1e99d9b640 10 monclient: get_auth_request con 0x7f1e7c03ea80 auth_method 0 2024-08-19T11:10:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.749+0000 7f1e99d9b640 1 --2- 172.21.15.71:0/699573055 >> v2:172.21.15.135:6800/726754104 conn(0x7f1e7c03ea80 0x7f1e7c040f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c126620 tx=0x7f1e84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.751+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f1e8c007a40 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.751+0000 7f1e92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:47.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.751+0000 7f1e92ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1ea096b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:10:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1ea096b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:10:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1ea096b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1e9c0a1200 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1e92ffd640 1 -- 172.21.15.71:0/699573055 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f1e8c0717e0 con 0x7f1e9c0a6a30 2024-08-19T11:10:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1e92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:10:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.997+0000 7f1e92ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:47.999 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":32,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:10:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 >> v2:172.21.15.135:6800/726754104 conn(0x7f1e7c03ea80 msgr2=0x7f1e7c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 --2- 172.21.15.71:0/699573055 >> v2:172.21.15.135:6800/726754104 conn(0x7f1e7c03ea80 0x7f1e7c040f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c126620 tx=0x7f1e84008040 comp rx=0 tx=0).stop 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 10 monclient: shutdown 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 msgr2=0x7f1e9c124f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c124f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c008fd0 tx=0x7f1e8c004a40 comp rx=0 tx=0).stop 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 shutdown_connections 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 --2- 172.21.15.71:0/699573055 >> v2:172.21.15.135:6800/726754104 conn(0x7f1e7c03ea80 0x7f1e7c040f40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1e9c139860 0x7f1e9c125980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1e9c0a6e10 0x7f1e9c125440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 --2- 172.21.15.71:0/699573055 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1e9c0a6a30 0x7f1e9c124f00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 >> 172.21.15.71:0/699573055 conn(0x7f1e9c0ac030 msgr2=0x7f1e9c1390b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 shutdown_connections 2024-08-19T11:10:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:47.999+0000 7f1ea096b640 1 -- 172.21.15.71:0/699573055 wait complete. 2024-08-19T11:10:48.011 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:10:48.011 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:10:48.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:10:48.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:10:48.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.108+0000 7f7658c84640 10 monclient: get_monmap_and_config 2024-08-19T11:10:48.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.108+0000 7f7658c84640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.108+0000 7f7658c84640 10 monclient: monmap: 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:48.109182+0000 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:48.109182+0000 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:48.111 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 Processor -- start 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 -- start start 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient: init 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient: _add_conns ranks=[7,10,5,0,2,8,3,4,6,1,9] 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 0x7f76540a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): picked mon.noname-i con 0x7f76540a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f76540a57c0 0x7f76540a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): picked mon.noname-f con 0x7f76540a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7654139710 0x7f7654139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): picked mon.noname-h con 0x7f7654139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f76540a5020 con 0x7f76540a57c0 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f76540a77b0 con 0x7f7654139710 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f76540a7d40 con 0x7f76540a6950 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.109+0000 7f7658c84640 10 monclient(hunting): authenticate will time out at 706.150911s 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 0x7f76540a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 0x7f76540a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:55376/0 (socket says 172.21.15.71:55376) 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7654139710 0x7f7654139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 -- 172.21.15.71:0/601541374 learned_addr learned my addr 172.21.15.71:0/601541374 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): get_auth_request con 0x7f76540a6950 auth_method 0 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): get_auth_request con 0x7f7654139710 auth_method 0 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 1 --2- 172.21.15.71:0/601541374 >> v2:172.21.15.135:3300/0 conn(0x7f76540a57c0 0x7f76540a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): get_auth_request con 0x7f76540a57c0 auth_method 0 2024-08-19T11:10:48.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient(hunting): handle_auth_done global_id 4363 payload 274 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 -- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7654139710 msgr2=0x7f7654139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 --2- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7654139710 0x7f7654139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 -- 172.21.15.71:0/601541374 >> v2:172.21.15.135:3300/0 conn(0x7f76540a57c0 msgr2=0x7f76540a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 --2- 172.21.15.71:0/601541374 >> v2:172.21.15.135:3300/0 conn(0x7f76540a57c0 0x7f76540a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 monclient: found mon.noname-i 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f765259c640 1 -- 172.21.15.71:0/601541374 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76540a6380 con 0x7f76540a6950 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.110+0000 7f7652d9d640 1 --2- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7654139710 0x7f7654139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f765259c640 1 -- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 msgr2=0x7f76540a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f765259c640 1 --2- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 0x7f76540a6d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76440098a0 tx=0x7f764402a0d0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=714279cec18ddf42 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 1 -- 172.21.15.71:0/601541374 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7644037070 con 0x7f76540a6950 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: dump: 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.121 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 1 -- 172.21.15.71:0/601541374 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764402adf0 con 0x7f76540a6950 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 1 -- 172.21.15.71:0/601541374 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7644030c20 con 0x7f76540a6950 2024-08-19T11:10:48.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7658c84640 5 monclient: authenticate success, global_id 4363 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7658c84640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7658c84640 4 set_mon_vals no callback set 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.113+0000 7f7651d9b640 10 monclient: dump: 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 10 monclient: shutdown 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 -- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 msgr2=0x7f76540a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 --2- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 0x7f76540a6d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76440098a0 tx=0x7f764402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 -- 172.21.15.71:0/601541374 shutdown_connections 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 --2- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7654139710 0x7f7654139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 --2- 172.21.15.71:0/601541374 >> v2:172.21.15.135:3300/0 conn(0x7f76540a57c0 0x7f76540a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 --2- 172.21.15.71:0/601541374 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76540a6950 0x7f76540a6d30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 -- 172.21.15.71:0/601541374 >> 172.21.15.71:0/601541374 conn(0x7f76540abf50 msgr2=0x7f76540ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 -- 172.21.15.71:0/601541374 shutdown_connections 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.114+0000 7f7658c84640 1 -- 172.21.15.71:0/601541374 wait complete. 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient: monmap: 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:48.125 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 1 Processor -- start 2024-08-19T11:10:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 1 -- start start 2024-08-19T11:10:48.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient: init 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient: _add_conns ranks=[2,3,1,6,5,4,8,7,0] 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 0x7f76541ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient(hunting): picked mon.noname-b con 0x7f76540a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a6950 0x7f7654138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 10 monclient(hunting): picked mon.noname-g con 0x7f76540a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.115+0000 7f7658c84640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7654139710 0x7f7654138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 10 monclient(hunting): picked mon.noname-f con 0x7f7654139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f76540a84c0 con 0x7f7654139710 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f76540a3650 con 0x7f76540a57c0 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f76540a8700 con 0x7f76540a6950 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7658c84640 10 monclient(hunting): authenticate will time out at 706.157033s 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 0x7f76541ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 0x7f76541ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34730/0 (socket says 172.21.15.71:34730) 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 -- 172.21.15.71:0/1915649476 learned_addr learned my addr 172.21.15.71:0/1915649476 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): get_auth_request con 0x7f76540a57c0 auth_method 0 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7654139710 0x7f7654138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a6950 0x7f7654138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): get_auth_request con 0x7f7654139710 auth_method 0 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): get_auth_request con 0x7f76540a6950 auth_method 0 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f7652d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient(hunting): handle_auth_done global_id 4511 payload 824 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a6950 msgr2=0x7f7654138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76540a6950 0x7f7654138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7654139710 msgr2=0x7f7654138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7654139710 0x7f7654138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 monclient: found mon.noname-b 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.116+0000 7f765259c640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7654123f90 con 0x7f76540a57c0 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f765259c640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 msgr2=0x7f76541ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f765259c640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 0x7f76541ce110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76440090b0 tx=0x7f76440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7644037040 con 0x7f76540a57c0 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: dump: 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7644004490 con 0x7f76540a57c0 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f7658c84640 5 monclient: authenticate success, global_id 4511 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7644032d20 con 0x7f76540a57c0 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f7658c84640 10 monclient: _renew_subs 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f7658c84640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765413a230 con 0x7f76540a57c0 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f765159a640 4 set_mon_vals no callback set 2024-08-19T11:10:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.118+0000 7f764affd640 10 monclient: dump: 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 10 monclient: _renew_subs 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76541ce650 con 0x7f76540a57c0 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 0x7f765402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f765406a590 con 0x7f7654122fc0 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7644044030 con 0x7f76540a57c0 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.119+0000 7f764bfff640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 0x7f765402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient: get_auth_request con 0x7f7654122fc0 auth_method 0 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764affd640 1 --2- 172.21.15.71:0/1915649476 >> v2:172.21.15.135:6800/726754104 conn(0x7f763403ea80 0x7f7634040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f7644042020 con 0x7f76540a57c0 2024-08-19T11:10:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 10 monclient(hunting): handle_auth_done global_id 4383 payload 824 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f764bfff640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76540a1de0 con 0x7f7654122fc0 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f7652d9d640 1 --2- 172.21.15.71:0/1915649476 >> v2:172.21.15.135:6800/726754104 conn(0x7f763403ea80 0x7f7634040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.120+0000 7f7652d9d640 10 monclient: get_auth_request con 0x7f763403ea80 auth_method 0 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764bfff640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 msgr2=0x7f765402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764bfff640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 0x7f765402d1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f763c0118b0 tx=0x7f763c011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f763c019070 con 0x7f7654122fc0 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 10 monclient: dump: 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f763c00f890 con 0x7f7654122fc0 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 msgr2=0x7f765402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 0x7f765402d1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f763c0118b0 tx=0x7f763c011d70 comp rx=0 tx=0).stop 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 msgr2=0x7f765402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f764affd640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7654122fc0 0x7f765402d1c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.122+0000 7f7652d9d640 1 --2- 172.21.15.71:0/1915649476 >> v2:172.21.15.135:6800/726754104 conn(0x7f763403ea80 0x7f7634040f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f764c009c10 tx=0x7f764c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.128+0000 7f7658c84640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.128+0000 7f7658c84640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 0x7f765402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.128+0000 7f7658c84640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.128+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7654076c60 con 0x7f76541233a0 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 0x7f765402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient: get_auth_request con 0x7f76541233a0 auth_method 0 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 10 monclient(hunting): handle_auth_done global_id 4392 payload 824 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.129+0000 7f764bfff640 1 -- 172.21.15.71:0/1915649476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f76541261a0 con 0x7f76541233a0 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764bfff640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 msgr2=0x7f765402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764bfff640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 0x7f765402d700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f763c0118b0 tx=0x7f763c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f763c019040 con 0x7f76541233a0 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 10 monclient: dump: 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9436 (secure 0 0 0) 0x7f763c01e660 con 0x7f76541233a0 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 msgr2=0x7f765402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 0x7f765402d700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f763c0118b0 tx=0x7f763c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 msgr2=0x7f765402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.131+0000 7f764affd640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76541233a0 0x7f765402d700 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f763c0118b0 tx=0x7f763c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45009, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:48.150 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 32, 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.151 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.152 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:48.153 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.154 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.155 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:48.159 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.162 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.164 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.171 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.172 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.173 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:48.174 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 >> v2:172.21.15.135:6800/726754104 conn(0x7f763403ea80 msgr2=0x7f7634040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 --2- 172.21.15.71:0/1915649476 >> v2:172.21.15.135:6800/726754104 conn(0x7f763403ea80 0x7f7634040f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f764c009c10 tx=0x7f764c00b040 comp rx=0 tx=0).stop 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 10 monclient: shutdown 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 msgr2=0x7f76541ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 --2- 172.21.15.71:0/1915649476 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f76540a57c0 0x7f76541ce110 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76440090b0 tx=0x7f76440046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7652d9d640 1 -- 172.21.15.71:0/1915649476 reap_dead start 2024-08-19T11:10:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7652d9d640 1 -- 172.21.15.71:0/1915649476 reap_dead start 2024-08-19T11:10:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 shutdown_connections 2024-08-19T11:10:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 >> 172.21.15.71:0/1915649476 conn(0x7f76540abf50 msgr2=0x7f76540aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 shutdown_connections 2024-08-19T11:10:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.132+0000 7f7658c84640 1 -- 172.21.15.71:0/1915649476 wait complete. 2024-08-19T11:10:48.176 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:48.176 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:10:48.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.274+0000 7f8857141640 10 monclient: get_monmap_and_config 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.274+0000 7f8857141640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.274+0000 7f8857141640 10 monclient: monmap: 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:48.274760+0000 2024-08-19T11:10:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:48.274760+0000 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:48.276 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.274+0000 7f8857141640 1 Processor -- start 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.274+0000 7f8857141640 1 -- start start 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.274+0000 7f8857141640 10 monclient: init 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient: _add_conns ranks=[5,4,2,3,10,7,6,0,9,8,1] 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f88500a6950 0x7f88500a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): picked mon.noname-h con 0x7f88500a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88500a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): picked mon.noname-c con 0x7f88500a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8850139710 0x7f8850139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): picked mon.noname-b con 0x7f8850139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f88500a5020 con 0x7f8850139710 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f88500a77b0 con 0x7f88500a57c0 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f88500a7d40 con 0x7f88500a6950 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f8857141640 10 monclient(hunting): authenticate will time out at 706.316477s 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88500a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8850139710 0x7f8850139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88500a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53168/0 (socket says 172.21.15.71:53168) 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 -- 172.21.15.71:0/1793241823 learned_addr learned my addr 172.21.15.71:0/1793241823 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): get_auth_request con 0x7f88500a57c0 auth_method 0 2024-08-19T11:10:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): get_auth_request con 0x7f8850139710 auth_method 0 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient(hunting): handle_auth_done global_id 4360 payload 274 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 -- 172.21.15.71:0/1793241823 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f88500a6950 msgr2=0x7f88500a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f88500a6950 0x7f88500a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 -- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8850139710 msgr2=0x7f8850139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8850139710 0x7f8850139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 monclient: found mon.noname-c 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f884ffff640 1 -- 172.21.15.71:0/1793241823 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88500a6380 con 0x7f88500a57c0 2024-08-19T11:10:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.275+0000 7f88556de640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8850139710 0x7f8850139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884ffff640 1 -- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 msgr2=0x7f88500a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884ffff640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88500a7270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88440098d0 tx=0x7f884402a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8141f17a1ba38b65 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 1 -- 172.21.15.71:0/1793241823 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8844037070 con 0x7f88500a57c0 2024-08-19T11:10:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: dump: 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f8857141640 5 monclient: authenticate success, global_id 4360 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 1 -- 172.21.15.71:0/1793241823 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884402adc0 con 0x7f88500a57c0 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f8857141640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f8857141640 4 set_mon_vals no callback set 2024-08-19T11:10:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 1 -- 172.21.15.71:0/1793241823 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8844030c20 con 0x7f88500a57c0 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.278+0000 7f884f7fe640 10 monclient: dump: 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 10 monclient: shutdown 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 -- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 msgr2=0x7f88500a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88500a7270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88440098d0 tx=0x7f884402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 -- 172.21.15.71:0/1793241823 shutdown_connections 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8850139710 0x7f8850139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88500a7270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 --2- 172.21.15.71:0/1793241823 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f88500a6950 0x7f88500a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 -- 172.21.15.71:0/1793241823 >> 172.21.15.71:0/1793241823 conn(0x7f88500abf50 msgr2=0x7f88500ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 -- 172.21.15.71:0/1793241823 shutdown_connections 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 1 -- 172.21.15.71:0/1793241823 wait complete. 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.279+0000 7f8857141640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient: monmap: 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.294 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 Processor -- start 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 -- start start 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient: init 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient: _add_conns ranks=[4,7,0,8,1,3,5,2,6] 2024-08-19T11:10:48.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88501cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): picked mon.noname-c con 0x7f88500a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:48.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f88500a6950 0x7f8850125460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): picked mon.noname-i con 0x7f88500a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8850139710 0x7f88501259a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): picked mon.noname-a con 0x7f8850139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f88500a84c0 con 0x7f8850139710 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f88500a3650 con 0x7f88500a57c0 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f88500a8700 con 0x7f88500a6950 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.280+0000 7f8857141640 10 monclient(hunting): authenticate will time out at 706.321995s 2024-08-19T11:10:48.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88501cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88501cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53180/0 (socket says 172.21.15.71:53180) 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 1 -- 172.21.15.71:0/2839620797 learned_addr learned my addr 172.21.15.71:0/2839620797 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): get_auth_request con 0x7f88500a57c0 auth_method 0 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8850139710 0x7f88501259a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): get_auth_request con 0x7f8850139710 auth_method 0 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f88500a6950 0x7f8850125460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): get_auth_request con 0x7f88500a6950 auth_method 0 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f884ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient(hunting): handle_auth_done global_id 4401 payload 824 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f88500a6950 msgr2=0x7f8850125460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f88500a6950 0x7f8850125460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 msgr2=0x7f88501cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88501cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 monclient: found mon.noname-a 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f88556de640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8850128b60 con 0x7f8850139710 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.281+0000 7f8854edd640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f88500a57c0 0x7f88501cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f88556de640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8850139710 msgr2=0x7f88501259a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f88556de640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8850139710 0x7f88501259a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f884800efc0 tx=0x7f884800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8848018020 con 0x7f8850139710 2024-08-19T11:10:48.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: dump: 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.302 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 5 monclient: authenticate success, global_id 4401 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88480148f0 con 0x7f8850139710 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 10 monclient: _renew_subs 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:48.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8850127260 con 0x7f8850139710 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f88480133e0 con 0x7f8850139710 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884d7fa640 10 monclient: dump: 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 10 monclient: _renew_subs 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f884effd640 4 set_mon_vals no callback set 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.283+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8850128e40 con 0x7f8850139710 2024-08-19T11:10:48.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8857141640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8857141640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 0x7f885002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8850076c60 con 0x7f88501cf4a0 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 0x7f885002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient: get_auth_request con 0x7f88501cf4a0 auth_method 0 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8848005d10 con 0x7f8850139710 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.284+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.285+0000 7f8854edd640 10 monclient(hunting): handle_auth_done global_id 4529 payload 824 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.285+0000 7f8854edd640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88500a20a0 con 0x7f88501cf4a0 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.285+0000 7f884d7fa640 1 --2- 172.21.15.71:0/2839620797 >> v2:172.21.15.135:6800/726754104 conn(0x7f883c03eab0 0x7f883c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.285+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3562+0+0 (secure 0 0 0) 0x7f8848052690 con 0x7f8850139710 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.285+0000 7f884ffff640 1 --2- 172.21.15.71:0/2839620797 >> v2:172.21.15.135:6800/726754104 conn(0x7f883c03eab0 0x7f883c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.285+0000 7f884ffff640 10 monclient: get_auth_request con 0x7f883c03eab0 auth_method 0 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f8854edd640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 msgr2=0x7f885002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f8854edd640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 0x7f885002d1c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f884000eb10 tx=0x7f884000c150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8840017070 con 0x7f88501cf4a0 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 10 monclient: dump: 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.307 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f884000ce70 con 0x7f88501cf4a0 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 msgr2=0x7f885002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 0x7f885002d1c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f884000eb10 tx=0x7f884000c150 comp rx=0 tx=0).stop 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 msgr2=0x7f885002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884d7fa640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f88501cf4a0 0x7f885002d1c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.287+0000 7f884ffff640 1 --2- 172.21.15.71:0/2839620797 >> v2:172.21.15.135:6800/726754104 conn(0x7f883c03eab0 0x7f883c040f70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f88440098a0 tx=0x7f884402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8857141640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8857141640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 0x7f885002db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8857141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f88500a6d30 con 0x7f885002d700 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 0x7f885002db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient: get_auth_request con 0x7f885002d700 auth_method 0 2024-08-19T11:10:48.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 10 monclient(hunting): handle_auth_done global_id 4538 payload 824 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.293+0000 7f8854edd640 1 -- 172.21.15.71:0/2839620797 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88500a23a0 con 0x7f885002d700 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8854edd640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 msgr2=0x7f885002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8854edd640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 0x7f885002db10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8840019000 tx=0x7f88400047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8840017070 con 0x7f885002d700 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 10 monclient: dump: 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.313 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f8840006890 con 0x7f885002d700 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 msgr2=0x7f885002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 0x7f885002db10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8840019000 tx=0x7f88400047d0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 msgr2=0x7f885002db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f884d7fa640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f885002d700 0x7f885002db10 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8840019000 tx=0x7f88400047d0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.314 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45176, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:48.315 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 32, 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.316 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.317 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:48.318 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.319 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:48.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.322 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.323 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:48.324 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:48.326 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:48.327 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.330 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.332 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.333 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.335 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.338 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:48.338 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 >> v2:172.21.15.135:6800/726754104 conn(0x7f883c03eab0 msgr2=0x7f883c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8857141640 1 --2- 172.21.15.71:0/2839620797 >> v2:172.21.15.135:6800/726754104 conn(0x7f883c03eab0 0x7f883c040f70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f88440098a0 tx=0x7f884402e000 comp rx=0 tx=0).stop 2024-08-19T11:10:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8857141640 10 monclient: shutdown 2024-08-19T11:10:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8857141640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8850139710 msgr2=0x7f88501259a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f8857141640 1 --2- 172.21.15.71:0/2839620797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8850139710 0x7f88501259a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f884800efc0 tx=0x7f884800c490 comp rx=0 tx=0).stop 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f88556de640 1 -- 172.21.15.71:0/2839620797 reap_dead start 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.296+0000 7f88556de640 1 -- 172.21.15.71:0/2839620797 reap_dead start 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.297+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 shutdown_connections 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.297+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 >> 172.21.15.71:0/2839620797 conn(0x7f88500abf50 msgr2=0x7f885009ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.297+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 shutdown_connections 2024-08-19T11:10:48.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.297+0000 7f8857141640 1 -- 172.21.15.71:0/2839620797 wait complete. 2024-08-19T11:10:48.340 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:48.340 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:10:48.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:10:48.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.446+0000 7fce4ea70640 10 monclient: get_monmap_and_config 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.446+0000 7fce4ea70640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.446+0000 7fce4ea70640 10 monclient: monmap: 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:48.447260+0000 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:48.447260+0000 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.448 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.449 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:48.450 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:48.450 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 Processor -- start 2024-08-19T11:10:48.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 -- start start 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient: init 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient: _add_conns ranks=[2,4,10,6,8,9,0,3,5,1,7] 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce480a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): picked mon.noname-b con 0x7fce480a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce480a57c0 0x7fce480a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): picked mon.noname-c con 0x7fce480a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce48139710 0x7fce48139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): picked mon.noname-f con 0x7fce48139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce480a5020 con 0x7fce48139710 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fce480a77b0 con 0x7fce480a6950 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fce480a7d40 con 0x7fce480a57c0 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.447+0000 7fce4ea70640 10 monclient(hunting): authenticate will time out at 706.488935s 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce480a57c0 0x7fce480a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce480a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce480a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34758/0 (socket says 172.21.15.71:34758) 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce480a57c0 0x7fce480a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53192/0 (socket says 172.21.15.71:53192) 2024-08-19T11:10:48.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 -- 172.21.15.71:0/842707331 learned_addr learned my addr 172.21.15.71:0/842707331 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): get_auth_request con 0x7fce480a6950 auth_method 0 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): get_auth_request con 0x7fce480a57c0 auth_method 0 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4d00d640 1 --2- 172.21.15.71:0/842707331 >> v2:172.21.15.135:3300/0 conn(0x7fce48139710 0x7fce48139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4d00d640 10 monclient(hunting): get_auth_request con 0x7fce48139710 auth_method 0 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4d00d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4d00d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4d00d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient(hunting): handle_auth_done global_id 4547 payload 274 2024-08-19T11:10:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 -- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce480a57c0 msgr2=0x7fce480a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 --2- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce480a57c0 0x7fce480a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 -- 172.21.15.71:0/842707331 >> v2:172.21.15.135:3300/0 conn(0x7fce48139710 msgr2=0x7fce48139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 --2- 172.21.15.71:0/842707331 >> v2:172.21.15.135:3300/0 conn(0x7fce48139710 0x7fce48139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 monclient: found mon.noname-b 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4c80c640 1 -- 172.21.15.71:0/842707331 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce480a6380 con 0x7fce480a6950 2024-08-19T11:10:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.448+0000 7fce4d00d640 1 --2- 172.21.15.71:0/842707331 >> v2:172.21.15.135:3300/0 conn(0x7fce48139710 0x7fce48139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4c80c640 1 -- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 msgr2=0x7fce480a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4c80c640 1 --2- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce480a6d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0098a0 tx=0x7fce3c02a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c0eb49a42af4a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 1 -- 172.21.15.71:0/842707331 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce3c037070 con 0x7fce480a6950 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: dump: 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 1 -- 172.21.15.71:0/842707331 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c02adf0 con 0x7fce480a6950 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 5 monclient: authenticate success, global_id 4547 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 1 -- 172.21.15.71:0/842707331 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce3c030c20 con 0x7fce480a6950 2024-08-19T11:10:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 4 set_mon_vals no callback set 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce477fe640 10 monclient: dump: 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 10 monclient: shutdown 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 -- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 msgr2=0x7fce480a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 --2- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce480a6d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0098a0 tx=0x7fce3c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 -- 172.21.15.71:0/842707331 shutdown_connections 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 --2- 172.21.15.71:0/842707331 >> v2:172.21.15.135:3300/0 conn(0x7fce48139710 0x7fce48139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 --2- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce480a57c0 0x7fce480a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 --2- 172.21.15.71:0/842707331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce480a6d30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 -- 172.21.15.71:0/842707331 >> 172.21.15.71:0/842707331 conn(0x7fce480abf50 msgr2=0x7fce480ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 -- 172.21.15.71:0/842707331 shutdown_connections 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.451+0000 7fce4ea70640 1 -- 172.21.15.71:0/842707331 wait complete. 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.452+0000 7fce4ea70640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.452+0000 7fce4ea70640 10 monclient: monmap: 2024-08-19T11:10:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.452+0000 7fce4ea70640 1 Processor -- start 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.452+0000 7fce4ea70640 1 -- start start 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.452+0000 7fce4ea70640 10 monclient: init 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient: _add_conns ranks=[0,2,6,5,8,3,1,7,4] 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480a57c0 0x7fce481ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): picked mon.noname-a con 0x7fce480a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce48138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): picked mon.noname-b con 0x7fce480a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fce48139710 0x7fce481228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): picked mon.noname-d con 0x7fce48139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fce480a84c0 con 0x7fce480a57c0 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fce480a3650 con 0x7fce480a6950 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fce480a8700 con 0x7fce48139710 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4ea70640 10 monclient(hunting): authenticate will time out at 706.494357s 2024-08-19T11:10:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce48138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480a57c0 0x7fce481ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce48138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34772/0 (socket says 172.21.15.71:34772) 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 -- 172.21.15.71:0/3818004753 learned_addr learned my addr 172.21.15.71:0/3818004753 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): get_auth_request con 0x7fce480a57c0 auth_method 0 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): get_auth_request con 0x7fce480a6950 auth_method 0 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fce48139710 0x7fce481228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): get_auth_request con 0x7fce48139710 auth_method 0 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce4d00d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient(hunting): handle_auth_done global_id 4556 payload 824 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fce48139710 msgr2=0x7fce481228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fce48139710 0x7fce481228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480a57c0 msgr2=0x7fce481ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480a57c0 0x7fce481ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 monclient: found mon.noname-b 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.453+0000 7fce47fff640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce480a1e90 con 0x7fce480a6950 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.455+0000 7fce47fff640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 msgr2=0x7fce48138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.455+0000 7fce47fff640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce48138a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fce3400e9e0 tx=0x7fce3400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce34017070 con 0x7fce480a6950 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: dump: 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3400cbe0 con 0x7fce480a6950 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce3400cd90 con 0x7fce480a6950 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce457fa640 10 monclient: dump: 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 5 monclient: authenticate success, global_id 4556 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 10 monclient: _renew_subs 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce46ffd640 4 set_mon_vals no callback set 2024-08-19T11:10:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce48125b60 con 0x7fce480a6950 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 10 monclient: _renew_subs 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce481cf190 con 0x7fce480a6950 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.456+0000 7fce4ea70640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4ea70640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 0x7fce4802d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fce48076c60 con 0x7fce4802d1c0 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fce3401a070 con 0x7fce480a6950 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 0x7fce4802d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient: get_auth_request con 0x7fce4802d1c0 auth_method 0 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce457fa640 1 --2- 172.21.15.71:0/3818004753 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2c03ea80 0x7fce2c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 10 monclient(hunting): handle_auth_done global_id 4387 payload 824 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3926+0+0 (secure 0 0 0) 0x7fce3400f040 con 0x7fce480a6950 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4c80c640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce48126460 con 0x7fce4802d1c0 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4d00d640 1 --2- 172.21.15.71:0/3818004753 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2c03ea80 0x7fce2c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.457+0000 7fce4d00d640 10 monclient: get_auth_request con 0x7fce2c03ea80 auth_method 0 2024-08-19T11:10:48.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.459+0000 7fce4c80c640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 msgr2=0x7fce4802d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.459+0000 7fce4c80c640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 0x7fce4802d5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce48074f90 tx=0x7fce3c0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.459+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce3c042070 con 0x7fce4802d1c0 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.459+0000 7fce457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.459+0000 7fce457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.459+0000 7fce457fa640 10 monclient: dump: 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce4d00d640 1 --2- 172.21.15.71:0/3818004753 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2c03ea80 0x7fce2c040f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce48124b90 tx=0x7fce400097b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fce3c003820 con 0x7fce4802d1c0 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 msgr2=0x7fce4802d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 0x7fce4802d5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce48074f90 tx=0x7fce3c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 msgr2=0x7fce4802d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.460+0000 7fce457fa640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802d1c0 0x7fce4802d5a0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce48074f90 tx=0x7fce3c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4ea70640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4ea70640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 0x7fce4802def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4ea70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fce481240a0 con 0x7fce4802dae0 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 0x7fce4802def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient: get_auth_request con 0x7fce4802dae0 auth_method 0 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 10 monclient(hunting): handle_auth_done global_id 4396 payload 824 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.466+0000 7fce4c80c640 1 -- 172.21.15.71:0/3818004753 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fce480a20c0 con 0x7fce4802dae0 2024-08-19T11:10:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.468+0000 7fce4c80c640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 msgr2=0x7fce4802def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.468+0000 7fce4c80c640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 0x7fce4802def0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce3c02bfd0 tx=0x7fce3c008030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.468+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce3c037040 con 0x7fce4802dae0 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.468+0000 7fce457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.468+0000 7fce457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.468+0000 7fce457fa640 10 monclient: dump: 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fce3c0308b0 con 0x7fce4802dae0 2024-08-19T11:10:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 msgr2=0x7fce4802def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 0x7fce4802def0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce3c02bfd0 tx=0x7fce3c008030 comp rx=0 tx=0).stop 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 msgr2=0x7fce4802def0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce457fa640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fce4802dae0 0x7fce4802def0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce3c02bfd0 tx=0x7fce3c008030 comp rx=0 tx=0).stop 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:48.493 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45339, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:48.494 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 33, 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:48.496 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.497 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.498 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.499 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:48.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.502 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:48.503 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:48.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:48.506 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.510 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.512 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:48.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.523 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:48.523 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2c03ea80 msgr2=0x7fce2c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 --2- 172.21.15.71:0/3818004753 >> v2:172.21.15.135:6800/726754104 conn(0x7fce2c03ea80 0x7fce2c040f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce48124b90 tx=0x7fce400097b0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 10 monclient: shutdown 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 msgr2=0x7fce48138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce48138a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fce3400e9e0 tx=0x7fce3400eea0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4d00d640 1 -- 172.21.15.71:0/3818004753 reap_dead start 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 shutdown_connections 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 --2- 172.21.15.71:0/3818004753 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce480a6950 0x7fce48138a20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 >> 172.21.15.71:0/3818004753 conn(0x7fce480abf50 msgr2=0x7fce480aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 shutdown_connections 2024-08-19T11:10:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.469+0000 7fce4ea70640 1 -- 172.21.15.71:0/3818004753 wait complete. 2024-08-19T11:10:48.526 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:48.526 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:10:48.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:10:48.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.623+0000 7f5815284640 10 monclient: get_monmap_and_config 2024-08-19T11:10:48.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.623+0000 7f5815284640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.623+0000 7f5815284640 10 monclient: monmap: 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:48.624173+0000 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:48.624173+0000 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.625 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:48.626 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 Processor -- start 2024-08-19T11:10:48.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 -- start start 2024-08-19T11:10:48.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient: init 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient: _add_conns ranks=[5,8,10,3,1,6,2,4,0,9,7] 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f58100a6950 0x7f58100a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): picked mon.noname-h con 0x7f58100a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 0x7f58100a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): picked mon.noname-e con 0x7f58100a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5810139710 0x7f5810139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): picked mon.noname-f con 0x7f5810139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f58100a5020 con 0x7f5810139710 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f58100a77b0 con 0x7f58100a6950 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f58100a7d40 con 0x7f58100a57c0 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5815284640 10 monclient(hunting): authenticate will time out at 706.665820s 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 0x7f58100a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 0x7f58100a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53510/0 (socket says 172.21.15.71:53510) 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 1 -- 172.21.15.71:0/3898089535 learned_addr learned my addr 172.21.15.71:0/3898089535 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 10 monclient(hunting): get_auth_request con 0x7f58100a57c0 auth_method 0 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.624+0000 7f5807fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 1 --2- 172.21.15.71:0/3898089535 >> v2:172.21.15.135:3300/0 conn(0x7f5810139710 0x7f5810139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 1 --2- 172.21.15.71:0/3898089535 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f58100a6950 0x7f58100a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): get_auth_request con 0x7f58100a6950 auth_method 0 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): get_auth_request con 0x7f5810139710 auth_method 0 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f580f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 10 monclient(hunting): handle_auth_done global_id 4364 payload 274 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 1 -- 172.21.15.71:0/3898089535 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f58100a6950 msgr2=0x7f58100a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 1 --2- 172.21.15.71:0/3898089535 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f58100a6950 0x7f58100a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 1 -- 172.21.15.71:0/3898089535 >> v2:172.21.15.135:3300/0 conn(0x7f5810139710 msgr2=0x7f5810139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 1 --2- 172.21.15.71:0/3898089535 >> v2:172.21.15.135:3300/0 conn(0x7f5810139710 0x7f5810139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 1 monclient: found mon.noname-e 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.625+0000 7f5807fff640 1 -- 172.21.15.71:0/3898089535 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58100a6380 con 0x7f58100a57c0 2024-08-19T11:10:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5807fff640 1 -- 172.21.15.71:0/3898089535 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 msgr2=0x7f58100a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5807fff640 1 --2- 172.21.15.71:0/3898089535 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 0x7f58100a7270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009870 tx=0x7f57f802a0a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2b6d7aac936c6b35 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 1 -- 172.21.15.71:0/3898089535 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57f8037070 con 0x7f58100a57c0 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: dump: 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 5 monclient: authenticate success, global_id 4364 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 1 -- 172.21.15.71:0/3898089535 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f802ae00 con 0x7f58100a57c0 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 1 -- 172.21.15.71:0/3898089535 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57f8030c20 con 0x7f58100a57c0 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 4 set_mon_vals no callback set 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f580e7fc640 10 monclient: dump: 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 10 monclient: shutdown 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 -- 172.21.15.71:0/3898089535 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 msgr2=0x7f58100a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 --2- 172.21.15.71:0/3898089535 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 0x7f58100a7270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009870 tx=0x7f57f802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 -- 172.21.15.71:0/3898089535 shutdown_connections 2024-08-19T11:10:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 --2- 172.21.15.71:0/3898089535 >> v2:172.21.15.135:3300/0 conn(0x7f5810139710 0x7f5810139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 --2- 172.21.15.71:0/3898089535 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f58100a57c0 0x7f58100a7270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 --2- 172.21.15.71:0/3898089535 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f58100a6950 0x7f58100a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 -- 172.21.15.71:0/3898089535 >> 172.21.15.71:0/3898089535 conn(0x7f58100abf50 msgr2=0x7f58100ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 -- 172.21.15.71:0/3898089535 shutdown_connections 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.628+0000 7f5815284640 1 -- 172.21.15.71:0/3898089535 wait complete. 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.629+0000 7f5815284640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.629+0000 7f5815284640 10 monclient: monmap: 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:48.647 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.629+0000 7f5815284640 1 Processor -- start 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.629+0000 7f5815284640 1 -- start start 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.629+0000 7f5815284640 10 monclient: init 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient: _add_conns ranks=[1,2,7,4,3,6,0,8,5] 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58100a57c0 0x7f58101cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): picked mon.noname-f con 0x7f58100a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 0x7f5810138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): picked mon.noname-b con 0x7f58100a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5810139710 0x7f5810138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): picked mon.noname-i con 0x7f5810139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:48.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f58100a84c0 con 0x7f58100a57c0 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f58100a3650 con 0x7f58100a6950 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f58100a8700 con 0x7f5810139710 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5815284640 10 monclient(hunting): authenticate will time out at 706.671206s 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 0x7f5810138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 0x7f5810138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34782/0 (socket says 172.21.15.71:34782) 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 -- 172.21.15.71:0/38368363 learned_addr learned my addr 172.21.15.71:0/38368363 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): get_auth_request con 0x7f58100a6950 auth_method 0 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58100a57c0 0x7f58101cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5810139710 0x7f5810138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): get_auth_request con 0x7f58100a57c0 auth_method 0 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): get_auth_request con 0x7f5810139710 auth_method 0 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f580f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient(hunting): handle_auth_done global_id 4565 payload 824 2024-08-19T11:10:48.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5810139710 msgr2=0x7f5810138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5810139710 0x7f5810138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58100a57c0 msgr2=0x7f58101cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58100a57c0 0x7f58101cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 monclient: found mon.noname-b 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.630+0000 7f5807fff640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5810123ec0 con 0x7f58100a6950 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.632+0000 7f5807fff640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 msgr2=0x7f5810138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.632+0000 7f5807fff640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 0x7f5810138860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57f80097c0 tx=0x7f57f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.632+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57f8041030 con 0x7f58100a6950 2024-08-19T11:10:48.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.632+0000 7f58077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: dump: 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.654 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f8003dd0 con 0x7f58100a6950 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 5 monclient: authenticate success, global_id 4565 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 10 monclient: _renew_subs 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f57f8037040 con 0x7f58100a6950 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58100a1d20 con 0x7f58100a6950 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f58077fe640 10 monclient: dump: 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.657 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f580d7fa640 4 set_mon_vals no callback set 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 10 monclient: _renew_subs 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5810125f40 con 0x7f58100a6950 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 0x7f5810122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.633+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f581006a590 con 0x7f5810125980 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f57f8044070 con 0x7f58100a6950 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 0x7f5810122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient: get_auth_request con 0x7f5810125980 auth_method 0 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f58077fe640 1 --2- 172.21.15.71:0/38368363 >> v2:172.21.15.135:6800/726754104 conn(0x7f57f003ea80 0x7f57f0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 10 monclient(hunting): handle_auth_done global_id 4443 payload 824 2024-08-19T11:10:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580effd640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58100a6d30 con 0x7f5810125980 2024-08-19T11:10:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3926+0+0 (secure 0 0 0) 0x7f57f8042070 con 0x7f58100a6950 2024-08-19T11:10:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580f7fe640 1 --2- 172.21.15.71:0/38368363 >> v2:172.21.15.135:6800/726754104 conn(0x7f57f003ea80 0x7f57f0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.634+0000 7f580f7fe640 10 monclient: get_auth_request con 0x7f57f003ea80 auth_method 0 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.636+0000 7f580effd640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 msgr2=0x7f5810122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.636+0000 7f580effd640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 0x7f5810122d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58000118e0 tx=0x7f5800011da0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.636+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5800019070 con 0x7f5810125980 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.636+0000 7f58077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.636+0000 7f58077fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.636+0000 7f58077fe640 10 monclient: dump: 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.663 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.664 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f580000f950 con 0x7f5810125980 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 msgr2=0x7f5810122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 0x7f5810122d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58000118e0 tx=0x7f5800011da0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 msgr2=0x7f5810122d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f58077fe640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5810125980 0x7f5810122d60 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58000118e0 tx=0x7f5800011da0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.637+0000 7f580f7fe640 1 --2- 172.21.15.71:0/38368363 >> v2:172.21.15.135:6800/726754104 conn(0x7f57f003ea80 0x7f57f0040f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58101cf0a0 tx=0x7f580800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f5815284640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:48.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f5815284640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 0x7f581002d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f5815284640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5810124a20 con 0x7f581002d1c0 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 0x7f581002d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient: get_auth_request con 0x7f581002d1c0 auth_method 0 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 10 monclient(hunting): handle_auth_done global_id 4452 payload 824 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.643+0000 7f580effd640 1 -- 172.21.15.71:0/38368363 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f581009e100 con 0x7f581002d1c0 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f580effd640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 msgr2=0x7f581002d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f580effd640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 0x7f581002d5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f58000118e0 tx=0x7f58000046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5800019040 con 0x7f581002d1c0 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 10 monclient: dump: 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.667 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.668 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f5800003e00 con 0x7f581002d1c0 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.645+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 msgr2=0x7f581002d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f58077fe640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 0x7f581002d5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f58000118e0 tx=0x7f58000046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f58077fe640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 msgr2=0x7f581002d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f58077fe640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f581002d1c0 0x7f581002d5a0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f58000118e0 tx=0x7f58000046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.669 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45523, 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:48.670 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 33, 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.671 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.672 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.673 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.674 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.682 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.684 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.686 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.688 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.690 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.694 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:48.696 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 >> v2:172.21.15.135:6800/726754104 conn(0x7f57f003ea80 msgr2=0x7f57f0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 --2- 172.21.15.71:0/38368363 >> v2:172.21.15.135:6800/726754104 conn(0x7f57f003ea80 0x7f57f0040f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58101cf0a0 tx=0x7f580800b040 comp rx=0 tx=0).stop 2024-08-19T11:10:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 10 monclient: shutdown 2024-08-19T11:10:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 msgr2=0x7f5810138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 --2- 172.21.15.71:0/38368363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58100a6950 0x7f5810138860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57f80097c0 tx=0x7f57f80046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f580f7fe640 1 -- 172.21.15.71:0/38368363 reap_dead start 2024-08-19T11:10:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f580f7fe640 1 -- 172.21.15.71:0/38368363 reap_dead start 2024-08-19T11:10:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 shutdown_connections 2024-08-19T11:10:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 >> 172.21.15.71:0/38368363 conn(0x7f58100abf50 msgr2=0x7f58100aa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 shutdown_connections 2024-08-19T11:10:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.646+0000 7f5815284640 1 -- 172.21.15.71:0/38368363 wait complete. 2024-08-19T11:10:48.699 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:48.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:10:48.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:10:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.797+0000 7f6c0a788640 10 monclient: get_monmap_and_config 2024-08-19T11:10:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.797+0000 7f6c0a788640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.797+0000 7f6c0a788640 10 monclient: monmap: 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:48.797978+0000 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:48.797978+0000 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:48.800 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 Processor -- start 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 -- start start 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient: init 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient: _add_conns ranks=[2,1,6,9,5,8,7,4,3,10,0] 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 0x7f6c040a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): picked mon.noname-b con 0x7f6c040a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:10:48.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6c040a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6c040a7270 0x7f6c04139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): picked mon.noname-d con 0x7f6c040a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c040a6380 con 0x7f6c040a57c0 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6c040a5020 con 0x7f6c040a6950 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f6c040a7d40 con 0x7f6c040a7270 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c0a788640 10 monclient(hunting): authenticate will time out at 706.839776s 2024-08-19T11:10:48.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 0x7f6c040a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 0x7f6c040a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34788/0 (socket says 172.21.15.71:34788) 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 1 -- 172.21.15.71:0/1643250251 learned_addr learned my addr 172.21.15.71:0/1643250251 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): get_auth_request con 0x7f6c040a6950 auth_method 0 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c08d25640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6c040a7270 0x7f6c04139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c08d25640 10 monclient(hunting): get_auth_request con 0x7f6c040a7270 auth_method 0 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c08d25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c08d25640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c08d25640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.798+0000 7f6c03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c08d25640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c08d25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c08d25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 10 monclient(hunting): handle_auth_done global_id 4574 payload 274 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 1 -- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6c040a7270 msgr2=0x7f6c04139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6c040a7270 0x7f6c04139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 1 -- 172.21.15.71:0/1643250251 >> v1:172.21.15.135:6789/0 conn(0x7f6c040a57c0 legacy=0x7f6c04139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 1 monclient: found mon.noname-b 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c03fff640 1 -- 172.21.15.71:0/1643250251 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c040a3650 con 0x7f6c040a6950 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.799+0000 7f6c08d25640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6c040a7270 0x7f6c04139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.801+0000 7f6c03fff640 1 -- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 msgr2=0x7f6c040a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.801+0000 7f6c03fff640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 0x7f6c040a6d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098d0 tx=0x7f6bf402a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95af4a4bf7b2c30d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 1 -- 172.21.15.71:0/1643250251 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bf4037070 con 0x7f6c040a6950 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: dump: 2024-08-19T11:10:48.816 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 5 monclient: authenticate success, global_id 4574 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 1 -- 172.21.15.71:0/1643250251 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf402adc0 con 0x7f6c040a6950 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 4 set_mon_vals no callback set 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 1 -- 172.21.15.71:0/1643250251 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bf4030c20 con 0x7f6c040a6950 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c02ffd640 10 monclient: dump: 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 10 monclient: shutdown 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 -- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 msgr2=0x7f6c040a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 0x7f6c040a6d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098d0 tx=0x7f6bf402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 -- 172.21.15.71:0/1643250251 shutdown_connections 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6c040a7270 0x7f6c04139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1643250251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c040a6950 0x7f6c040a6d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 -- 172.21.15.71:0/1643250251 >> 172.21.15.71:0/1643250251 conn(0x7f6c040abf50 msgr2=0x7f6c040ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 -- 172.21.15.71:0/1643250251 shutdown_connections 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.802+0000 7f6c0a788640 1 -- 172.21.15.71:0/1643250251 wait complete. 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.803+0000 7f6c0a788640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.803+0000 7f6c0a788640 10 monclient: monmap: 2024-08-19T11:10:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.803+0000 7f6c0a788640 1 Processor -- start 2024-08-19T11:10:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.803+0000 7f6c0a788640 1 -- start start 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.803+0000 7f6c0a788640 10 monclient: init 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient: _add_conns ranks=[8,7,3,0,2,5,6,1,4] 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 0x7f6c04139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): picked mon.noname-e con 0x7f6c040a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6c040a6950 0x7f6c04139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): picked mon.noname-i con 0x7f6c040a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c040a7270 0x7f6c04123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): picked mon.noname-g con 0x7f6c040a7270 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6c040a8700 con 0x7f6c040a7270 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6c040a84c0 con 0x7f6c040a6950 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6c040a7690 con 0x7f6c040a57c0 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c0a788640 10 monclient(hunting): authenticate will time out at 706.845203s 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 0x7f6c04139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 0x7f6c04139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53522/0 (socket says 172.21.15.71:53522) 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 -- 172.21.15.71:0/1761564278 learned_addr learned my addr 172.21.15.71:0/1761564278 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): get_auth_request con 0x7f6c040a57c0 auth_method 0 2024-08-19T11:10:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c08d25640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c040a7270 0x7f6c04123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c037fe640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6c040a6950 0x7f6c04139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c037fe640 10 monclient(hunting): get_auth_request con 0x7f6c040a6950 auth_method 0 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c08d25640 10 monclient(hunting): get_auth_request con 0x7f6c040a7270 auth_method 0 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c08d25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c08d25640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c08d25640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient(hunting): handle_auth_done global_id 4373 payload 824 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6c040a6950 msgr2=0x7f6c04139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6c040a6950 0x7f6c04139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c040a7270 msgr2=0x7f6c04123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c040a7270 0x7f6c04123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 monclient: found mon.noname-e 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.804+0000 7f6c03fff640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c04124ec0 con 0x7f6c040a57c0 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.806+0000 7f6c03fff640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 msgr2=0x7f6c04139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.806+0000 7f6c03fff640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 0x7f6c04139860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40097c0 tx=0x7f6bf40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.806+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bf4037040 con 0x7f6c040a57c0 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.806+0000 7f6c00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.806+0000 7f6c00ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.806+0000 7f6c00ff9640 10 monclient: dump: 2024-08-19T11:10:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf4042070 con 0x7f6c040a57c0 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 5 monclient: authenticate success, global_id 4373 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 10 monclient: _renew_subs 2024-08-19T11:10:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c04126980 con 0x7f6c040a57c0 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bf403dd30 con 0x7f6c040a57c0 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c00ff9640 10 monclient: dump: 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 10 monclient: _renew_subs 2024-08-19T11:10:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c041ce400 con 0x7f6c040a57c0 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c027fc640 4 set_mon_vals no callback set 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 0x7f6c04123d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6c0406a590 con 0x7f6c04123940 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c037fe640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 0x7f6c04123d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c037fe640 10 monclient: get_auth_request con 0x7f6c04123940 auth_method 0 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.807+0000 7f6c037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6bf4003c50 con 0x7f6c040a57c0 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c037fe640 10 monclient(hunting): handle_auth_done global_id 4382 payload 824 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c037fe640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c041cf0a0 con 0x7f6c04123940 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c00ff9640 1 --2- 172.21.15.71:0/1761564278 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bf003ea80 0x7f6bf0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(20..20 src has 1..20) ==== 3926+0+0 (secure 0 0 0) 0x7f6bf40720a0 con 0x7f6c040a57c0 2024-08-19T11:10:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c08d25640 1 --2- 172.21.15.71:0/1761564278 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bf003ea80 0x7f6bf0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.808+0000 7f6c08d25640 10 monclient: get_auth_request con 0x7f6bf003ea80 auth_method 0 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c037fe640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 msgr2=0x7f6c04123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c037fe640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 0x7f6c04123d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c04124b80 tx=0x7f6bf800e960 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bf8006c40 con 0x7f6c04123940 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 10 monclient: dump: 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.835 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6bf8007450 con 0x7f6c04123940 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 msgr2=0x7f6c04123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 0x7f6c04123d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c04124b80 tx=0x7f6bf800e960 comp rx=0 tx=0).stop 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 msgr2=0x7f6c04123d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c00ff9640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04123940 0x7f6c04123d20 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c04124b80 tx=0x7f6bf800e960 comp rx=0 tx=0).stop 2024-08-19T11:10:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.810+0000 7f6c08d25640 1 --2- 172.21.15.71:0/1761564278 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bf003ea80 0x7f6bf0040f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc007440 tx=0x7f6bfc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.816+0000 7f6c0a788640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.816+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 0x7f6c0409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.816+0000 7f6c0a788640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.816+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6c04076c60 con 0x7f6c04124260 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 0x7f6c0409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient: get_auth_request con 0x7f6c04124260 auth_method 0 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 10 monclient(hunting): handle_auth_done global_id 4391 payload 824 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.817+0000 7f6c037fe640 1 -- 172.21.15.71:0/1761564278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c041270d0 con 0x7f6c04124260 2024-08-19T11:10:48.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c037fe640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 msgr2=0x7f6c0409e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c037fe640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 0x7f6c0409e6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800efd0 tx=0x7f6bf8003760 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bf801ede0 con 0x7f6c04124260 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 10 monclient: dump: 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.841 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f6bf801e970 con 0x7f6c04124260 2024-08-19T11:10:48.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 msgr2=0x7f6c0409e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 0x7f6c0409e6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800efd0 tx=0x7f6bf8003760 comp rx=0 tx=0).stop 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 msgr2=0x7f6c0409e6f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.819+0000 7f6c00ff9640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c04124260 0x7f6c0409e6f0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800efd0 tx=0x7f6bf8003760 comp rx=0 tx=0).stop 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:48.843 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45690, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:48.844 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 33, 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.845 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.846 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:48.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:48.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.854 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:48.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:48.857 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.857 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.857 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:48.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.862 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:48.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:48.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:48.870 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:48.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:48.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:48.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:48.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:48.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:48.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:48.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:48.874 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:48.874 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:48.874 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:48.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.875 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:48.875 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:48.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:48.876 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:48.877 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:10:48.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:48.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:48.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:48.877 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:48.877 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:48.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bf003ea80 msgr2=0x7f6bf0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1761564278 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bf003ea80 0x7f6bf0040f40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc007440 tx=0x7f6bfc00b040 comp rx=0 tx=0).stop 2024-08-19T11:10:48.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 10 monclient: shutdown 2024-08-19T11:10:48.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:48.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 msgr2=0x7f6c04139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:48.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 --2- 172.21.15.71:0/1761564278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c040a57c0 0x7f6c04139860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40097c0 tx=0x7f6bf40046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c08d25640 1 -- 172.21.15.71:0/1761564278 reap_dead start 2024-08-19T11:10:48.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c08d25640 1 -- 172.21.15.71:0/1761564278 reap_dead start 2024-08-19T11:10:48.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 shutdown_connections 2024-08-19T11:10:48.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 >> 172.21.15.71:0/1761564278 conn(0x7f6c040abf50 msgr2=0x7f6c041c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:48.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 shutdown_connections 2024-08-19T11:10:48.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.820+0000 7f6c0a788640 1 -- 172.21.15.71:0/1761564278 wait complete. 2024-08-19T11:10:48.882 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:48.882 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:10:48.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:10:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.981+0000 7fb5a3b86640 10 monclient: get_monmap_and_config 2024-08-19T11:10:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.981+0000 7fb5a3b86640 10 monclient: build_initial_monmap 2024-08-19T11:10:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.981+0000 7fb5a3b86640 10 monclient: monmap: 2024-08-19T11:10:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:48.981944+0000 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:48.981944+0000 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:48.984 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:48.984 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:48.984 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:48.984 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.981+0000 7fb5a3b86640 1 Processor -- start 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 -- start start 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient: init 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient: _add_conns ranks=[4,6,7,1,0,3,9,8,5,2,10] 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): picked mon.noname-c con 0x7fb59c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 0x7fb59c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): picked mon.noname-d con 0x7fb59c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb59c139710 0x7fb59c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): picked mon.noname-i con 0x7fb59c139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb59c0a5020 con 0x7fb59c0a6950 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb59c0a77b0 con 0x7fb59c0a57c0 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fb59c0a7d40 con 0x7fb59c139710 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a3b86640 10 monclient(hunting): authenticate will time out at 707.023590s 2024-08-19T11:10:48.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 0x7fb59c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 0x7fb59c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55860/0 (socket says 172.21.15.71:55860) 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53214/0 (socket says 172.21.15.71:53214) 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 1 -- 172.21.15.71:0/3495292716 learned_addr learned my addr 172.21.15.71:0/3495292716 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): get_auth_request con 0x7fb59c0a57c0 auth_method 0 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): get_auth_request con 0x7fb59c0a6950 auth_method 0 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:48.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:48.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:48.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a2123640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb59c139710 0x7fb59c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient(hunting): handle_auth_done global_id 4405 payload 274 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 -- 172.21.15.71:0/3495292716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb59c139710 msgr2=0x7fb59c139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb59c139710 0x7fb59c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 -- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 msgr2=0x7fb59c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 0x7fb59c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 10 monclient: _finish_hunting 0 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.982+0000 7fb5a1922640 1 monclient: found mon.noname-c 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.983+0000 7fb5a1922640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.983+0000 7fb5a1922640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.983+0000 7fb5a1922640 1 -- 172.21.15.71:0/3495292716 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c0a6380 con 0x7fb59c0a6950 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.983+0000 7fb5a1121640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 0x7fb59c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a1922640 1 -- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 msgr2=0x7fb59c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a1922640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c0a6d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb598009800 tx=0x7fb598029fe0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6049bc079089dbae server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 1 -- 172.21.15.71:0/3495292716 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb598037070 con 0x7fb59c0a6950 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: dump: 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 1 -- 172.21.15.71:0/3495292716 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59802ad00 con 0x7fb59c0a6950 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a3b86640 5 monclient: authenticate success, global_id 4405 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a3b86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a3b86640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 1 -- 172.21.15.71:0/3495292716 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb598030c20 con 0x7fb59c0a6950 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a3b86640 4 set_mon_vals no callback set 2024-08-19T11:10:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.985+0000 7fb5a0920640 10 monclient: dump: 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 10 monclient: shutdown 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 -- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 msgr2=0x7fb59c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c0a6d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb598009800 tx=0x7fb598029fe0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 -- 172.21.15.71:0/3495292716 shutdown_connections 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb59c139710 0x7fb59c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb59c0a57c0 0x7fb59c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/3495292716 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c0a6d30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 -- 172.21.15.71:0/3495292716 >> 172.21.15.71:0/3495292716 conn(0x7fb59c0abf50 msgr2=0x7fb59c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 -- 172.21.15.71:0/3495292716 shutdown_connections 2024-08-19T11:10:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.986+0000 7fb5a3b86640 1 -- 172.21.15.71:0/3495292716 wait complete. 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient: monmap: 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 Processor -- start 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 -- start start 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient: init 2024-08-19T11:10:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient: _add_conns ranks=[0,4,5,6,3,8,7,1,2] 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb59c0a57c0 0x7fb59c1387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): picked mon.noname-a con 0x7fb59c0a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): picked mon.noname-c con 0x7fb59c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb59c139710 0x7fb59c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): picked mon.noname-h con 0x7fb59c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c0a84c0 con 0x7fb59c0a57c0 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb59c0a3650 con 0x7fb59c0a6950 2024-08-19T11:10:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb59c0a8700 con 0x7fb59c139710 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a3b86640 10 monclient(hunting): authenticate will time out at 707.028915s 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a1922640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb59c0a57c0 0x7fb59c1387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.987+0000 7fb5a1121640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb59c0a57c0 0x7fb59c1387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36822/0 (socket says 172.21.15.71:36822) 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 1 -- 172.21.15.71:0/516201386 learned_addr learned my addr 172.21.15.71:0/516201386 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c138cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53216/0 (socket says 172.21.15.71:53216) 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): get_auth_request con 0x7fb59c0a57c0 auth_method 0 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): get_auth_request con 0x7fb59c0a6950 auth_method 0 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a2123640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb59c139710 0x7fb59c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a2123640 10 monclient(hunting): get_auth_request con 0x7fb59c139710 auth_method 0 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a2123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a2123640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a2123640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient(hunting): handle_auth_done global_id 4414 payload 824 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb59c139710 msgr2=0x7fb59c1225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb59c139710 0x7fb59c1225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb59c0a57c0 msgr2=0x7fb59c1387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb59c0a57c0 0x7fb59c1387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 monclient: found mon.noname-c 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:10:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1121640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c126170 con 0x7fb59c0a6950 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.988+0000 7fb5a1922640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb59c0a57c0 0x7fb59c1387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a1121640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 msgr2=0x7fb59c138cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a1121640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c138cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00e930 tx=0x7fb58c00edf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb58c004030 con 0x7fb59c0a6950 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 5 monclient: authenticate success, global_id 4414 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c0041d0 con 0x7fb59c0a6950 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb58c004380 con 0x7fb59c0a6950 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb593fff640 4 set_mon_vals no callback set 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 10 monclient: _renew_subs 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c123e10 con 0x7fb59c0a6950 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 10 monclient: _renew_subs 2024-08-19T11:10:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.990+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c125bb0 con 0x7fb59c0a6950 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb58c00cbb0 con 0x7fb59c0a6950 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a3b86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 0x7fb59c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c076c60 con 0x7fb59c1ce3d0 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5927fc640 1 --2- 172.21.15.71:0/516201386 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58003ea80 0x7fb580040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3926+0+0 (secure 0 0 0) 0x7fb58c00f040 con 0x7fb59c0a6950 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a1922640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 0x7fb59c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a1922640 10 monclient: get_auth_request con 0x7fb59c1ce3d0 auth_method 0 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a1922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a1922640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.991+0000 7fb5a1922640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a2123640 1 --2- 172.21.15.71:0/516201386 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58003ea80 0x7fb580040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a2123640 10 monclient: get_auth_request con 0x7fb58003ea80 auth_method 0 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a1922640 10 monclient(hunting): handle_auth_done global_id 4447 payload 824 2024-08-19T11:10:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.992+0000 7fb5a1922640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb59c0a6d30 con 0x7fb59c1ce3d0 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5a2123640 1 --2- 172.21.15.71:0/516201386 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58003ea80 0x7fb580040f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb59c139310 tx=0x7fb5940073f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5a1922640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 msgr2=0x7fb59c1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5a1922640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 0x7fb59c1232a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5980096f0 tx=0x7fb5980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb598037040 con 0x7fb59c1ce3d0 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.994+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:10:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb59803e460 con 0x7fb59c1ce3d0 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 msgr2=0x7fb59c1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 0x7fb59c1232a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5980096f0 tx=0x7fb5980046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 msgr2=0x7fb59c1232a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:48.995+0000 7fb5927fc640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c1ce3d0 0x7fb59c1232a0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5980096f0 tx=0x7fb5980046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a3b86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 0x7fb59c02d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a3b86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c09e100 con 0x7fb59c02d1c0 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 0x7fb59c02d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient: get_auth_request con 0x7fb59c02d1c0 auth_method 0 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 10 monclient(hunting): handle_auth_done global_id 4456 payload 824 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.001+0000 7fb5a1922640 1 -- 172.21.15.71:0/516201386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb59c125db0 con 0x7fb59c02d1c0 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5a1922640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 msgr2=0x7fb59c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5a1922640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 0x7fb59c02d5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a020 tx=0x7fb598009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb598037040 con 0x7fb59c02d1c0 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fb59803ecb0 con 0x7fb59c02d1c0 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 msgr2=0x7fb59c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 0x7fb59c02d5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a020 tx=0x7fb598009190 comp rx=0 tx=0).stop 2024-08-19T11:10:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 msgr2=0x7fb59c02d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45844, 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:49.029 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 33, 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:49.030 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.031 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.032 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:49.033 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:49.034 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:49.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.041 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:49.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:49.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.048 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:49.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:49.052 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.053 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:49.054 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.004+0000 7fb5927fc640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59c02d1c0 0x7fb59c02d5d0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a020 tx=0x7fb598009190 comp rx=0 tx=0).stop 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58003ea80 msgr2=0x7fb580040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/516201386 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58003ea80 0x7fb580040f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb59c139310 tx=0x7fb5940073f0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 10 monclient: shutdown 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 msgr2=0x7fb59c138cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 --2- 172.21.15.71:0/516201386 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb59c0a6950 0x7fb59c138cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00e930 tx=0x7fb58c00edf0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a2123640 1 -- 172.21.15.71:0/516201386 reap_dead start 2024-08-19T11:10:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a2123640 1 -- 172.21.15.71:0/516201386 reap_dead start 2024-08-19T11:10:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 shutdown_connections 2024-08-19T11:10:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 >> 172.21.15.71:0/516201386 conn(0x7fb59c0abf50 msgr2=0x7fb59c0aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 shutdown_connections 2024-08-19T11:10:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.005+0000 7fb5a3b86640 1 -- 172.21.15.71:0/516201386 wait complete. 2024-08-19T11:10:49.057 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:49.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:10:49.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:10:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.155+0000 7fee0067e640 10 monclient: get_monmap_and_config 2024-08-19T11:10:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.155+0000 7fee0067e640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.155+0000 7fee0067e640 10 monclient: monmap: 2024-08-19T11:10:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:49.155915+0000 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:49.155915+0000 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:49.157 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:49.158 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.155+0000 7fee0067e640 1 Processor -- start 2024-08-19T11:10:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.155+0000 7fee0067e640 1 -- start start 2024-08-19T11:10:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.155+0000 7fee0067e640 10 monclient: init 2024-08-19T11:10:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient: _add_conns ranks=[0,5,10,4,3,7,9,6,8,2,1] 2024-08-19T11:10:49.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fedf80a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): picked mon.noname-h con 0x7fedf80a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fedf80a7440 0x7fedf81410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): picked mon.noname-f con 0x7fedf80a7440 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf80a6380 con 0x7fedf80a6950 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80a5020 con 0x7fedf80a7440 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fedf80a7d40 con 0x7fedf80a57c0 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fee0067e640 10 monclient(hunting): authenticate will time out at 707.197642s 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fedfe41a640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fedf80a6950 0x7fedf80a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36940/0 (socket says 172.21.15.71:36940) 2024-08-19T11:10:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fedfe41a640 1 -- 172.21.15.71:0/2388778485 learned_addr learned my addr 172.21.15.71:0/2388778485 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fedfdc19640 1 --2- 172.21.15.71:0/2388778485 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.156+0000 7fedfec1b640 1 --2- 172.21.15.71:0/2388778485 >> v2:172.21.15.135:3300/0 conn(0x7fedf80a7440 0x7fedf81410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): get_auth_request con 0x7fedf80a57c0 auth_method 0 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): get_auth_request con 0x7fedf80a7440 auth_method 0 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfec1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient(hunting): handle_auth_done global_id 14405 payload 274 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 1 -- 172.21.15.71:0/2388778485 >> v2:172.21.15.135:3300/0 conn(0x7fedf80a7440 msgr2=0x7fedf81410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 1 --2- 172.21.15.71:0/2388778485 >> v2:172.21.15.135:3300/0 conn(0x7fedf80a7440 0x7fedf81410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 1 -- 172.21.15.71:0/2388778485 >> v1:172.21.15.71:6789/0 conn(0x7fedf80a6950 legacy=0x7fedf80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 1 monclient: found mon.noname-h 2024-08-19T11:10:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:10:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.157+0000 7fedfdc19640 1 -- 172.21.15.71:0/2388778485 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80a3650 con 0x7fedf80a57c0 2024-08-19T11:10:49.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfdc19640 1 -- 172.21.15.71:0/2388778485 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 msgr2=0x7fedf813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfdc19640 1 --2- 172.21.15.71:0/2388778485 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf813eb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fede80097d0 tx=0x7fede802a000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=2a129a0bae351847 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 1 -- 172.21.15.71:0/2388778485 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fede8037070 con 0x7fedf80a57c0 2024-08-19T11:10:49.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:10:49.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: dump: 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 1 -- 172.21.15.71:0/2388778485 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede802ad20 con 0x7fedf80a57c0 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fee0067e640 5 monclient: authenticate success, global_id 14405 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fee0067e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fee0067e640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 1 -- 172.21.15.71:0/2388778485 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fede8030c20 con 0x7fedf80a57c0 2024-08-19T11:10:49.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fee0067e640 4 set_mon_vals no callback set 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.160+0000 7fedfd418640 10 monclient: dump: 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 10 monclient: shutdown 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 -- 172.21.15.71:0/2388778485 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 msgr2=0x7fedf813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 --2- 172.21.15.71:0/2388778485 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf813eb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fede80097d0 tx=0x7fede802a000 comp rx=0 tx=0).stop 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 -- 172.21.15.71:0/2388778485 shutdown_connections 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 --2- 172.21.15.71:0/2388778485 >> v2:172.21.15.135:3300/0 conn(0x7fedf80a7440 0x7fedf81410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 --2- 172.21.15.71:0/2388778485 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf813eb60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 -- 172.21.15.71:0/2388778485 >> 172.21.15.71:0/2388778485 conn(0x7fedf80abf50 msgr2=0x7fedf80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 -- 172.21.15.71:0/2388778485 shutdown_connections 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 1 -- 172.21.15.71:0/2388778485 wait complete. 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.161+0000 7fee0067e640 10 monclient: monmap: 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:49.174 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 Processor -- start 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 -- start start 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient: init 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient: _add_conns ranks=[5,6,0,1,4,7,2,8,3] 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf81ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): picked mon.noname-h con 0x7fedf80a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fedf80a6950 0x7fedf81cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): picked mon.noname-d con 0x7fedf80a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 0x7fedf81cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): picked mon.noname-a con 0x7fedf80a7440 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80a8700 con 0x7fedf80a7440 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fedf80a84c0 con 0x7fedf80a57c0 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fedf81415f0 con 0x7fedf80a6950 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fee0067e640 10 monclient(hunting): authenticate will time out at 707.203789s 2024-08-19T11:10:49.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfdc19640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fedf80a6950 0x7fedf81cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 0x7fedf81cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 0x7fedf81cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36836/0 (socket says 172.21.15.71:36836) 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfdc19640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fedf80a6950 0x7fedf81cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55866/0 (socket says 172.21.15.71:55866) 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 1 -- 172.21.15.71:0/1384644209 learned_addr learned my addr 172.21.15.71:0/1384644209 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 10 monclient(hunting): get_auth_request con 0x7fedf80a7440 auth_method 0 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfdc19640 10 monclient(hunting): get_auth_request con 0x7fedf80a6950 auth_method 0 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfdc19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfdc19640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfdc19640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfe41a640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf81ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.162+0000 7fedfec1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfdc19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfdc19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfdc19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): get_auth_request con 0x7fedf80a57c0 auth_method 0 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 10 monclient(hunting): handle_auth_done global_id 4428 payload 824 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fedf80a6950 msgr2=0x7fedf81cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fedf80a6950 0x7fedf81cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 msgr2=0x7fedf81ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fedf80a57c0 0x7fedf81ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 1 monclient: found mon.noname-a 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfec1b640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf813e580 con 0x7fedf80a7440 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.163+0000 7fedfdc19640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fedf80a6950 0x7fedf81cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedfec1b640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 msgr2=0x7fedf81cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedfec1b640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 0x7fedf81cf200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedf000efc0 tx=0x7fedf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fedf0018020 con 0x7fedf80a7440 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: dump: 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.180 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf00148f0 con 0x7fedf80a7440 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 5 monclient: authenticate success, global_id 4428 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 10 monclient: _renew_subs 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf813f300 con 0x7fedf80a7440 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fedf00133e0 con 0x7fedf80a7440 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:49.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedeeffd640 10 monclient: dump: 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.183 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 10 monclient: _renew_subs 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fedfcc17640 4 set_mon_vals no callback set 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.165+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf813e0c0 con 0x7fedf80a7440 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fee0067e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fee0067e640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 0x7fedf8136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fedf8076c60 con 0x7fedf81366e0 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fedf0005d10 con 0x7fedf80a7440 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 0x7fedf8136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient: get_auth_request con 0x7fedf81366e0 auth_method 0 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedeeffd640 1 --2- 172.21.15.71:0/1384644209 >> v2:172.21.15.135:6800/726754104 conn(0x7feddc03ea80 0x7feddc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3926+0+0 (secure 0 0 0) 0x7fedf0052670 con 0x7fedf80a7440 2024-08-19T11:10:49.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfdc19640 1 --2- 172.21.15.71:0/1384644209 >> v2:172.21.15.135:6800/726754104 conn(0x7feddc03ea80 0x7feddc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 10 monclient(hunting): handle_auth_done global_id 4458 payload 824 2024-08-19T11:10:49.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfe41a640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedf813f9d0 con 0x7fedf81366e0 2024-08-19T11:10:49.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.166+0000 7fedfdc19640 10 monclient: get_auth_request con 0x7feddc03ea80 auth_method 0 2024-08-19T11:10:49.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedfe41a640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 msgr2=0x7fedf8136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedfe41a640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 0x7fedf8136ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedf400ea70 tx=0x7fedf400ef30 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedfdc19640 1 --2- 172.21.15.71:0/1384644209 >> v2:172.21.15.135:6800/726754104 conn(0x7feddc03ea80 0x7feddc040f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fede80097d0 tx=0x7fede802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fedf401a070 con 0x7fedf81366e0 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 10 monclient: dump: 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.189 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fedf400cc50 con 0x7fedf81366e0 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 msgr2=0x7fedf8136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 0x7fedf8136ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedf400ea70 tx=0x7fedf400ef30 comp rx=0 tx=0).stop 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 msgr2=0x7fedf8136ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.169+0000 7fedeeffd640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf81366e0 0x7fedf8136ac0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.175+0000 7fee0067e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.175+0000 7fee0067e640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 0x7fedf8137900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.175+0000 7fee0067e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.175+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80778e0 con 0x7fedf8137000 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 0x7fedf8137900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient: get_auth_request con 0x7fedf8137000 auth_method 0 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 10 monclient(hunting): handle_auth_done global_id 4467 payload 824 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.176+0000 7fedfe41a640 1 -- 172.21.15.71:0/1384644209 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fedf8141240 con 0x7fedf8137000 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.178+0000 7fedfe41a640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 msgr2=0x7fedf8137900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.178+0000 7fedfe41a640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 0x7fedf8137900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedf4017000 tx=0x7fedf4004940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.178+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fedf401a050 con 0x7fedf8137000 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.178+0000 7fedeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.178+0000 7fedeeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:10:49.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.178+0000 7fedeeffd640 10 monclient: dump: 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7fedf401b040 con 0x7fedf8137000 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 msgr2=0x7fedf8137900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 0x7fedf8137900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedf4017000 tx=0x7fedf4004940 comp rx=0 tx=0).stop 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 msgr2=0x7fedf8137900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedeeffd640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fedf8137000 0x7fedf8137900 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedf4017000 tx=0x7fedf4004940 comp rx=0 tx=0).stop 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 46030, 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 33, 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.214 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.217 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.218 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:49.219 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:49.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 >> v2:172.21.15.135:6800/726754104 conn(0x7feddc03ea80 msgr2=0x7feddc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 --2- 172.21.15.71:0/1384644209 >> v2:172.21.15.135:6800/726754104 conn(0x7feddc03ea80 0x7feddc040f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fede80097d0 tx=0x7fede802e000 comp rx=0 tx=0).stop 2024-08-19T11:10:49.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 10 monclient: shutdown 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 msgr2=0x7fedf81cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 0x7fedf81cf200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fedf000efc0 tx=0x7fedf000c490 comp rx=0 tx=0).stop 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fedfec1b640 1 -- 172.21.15.71:0/1384644209 reap_dead start 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 shutdown_connections 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 --2- 172.21.15.71:0/1384644209 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedf80a7440 0x7fedf81cf200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 >> 172.21.15.71:0/1384644209 conn(0x7fedf80abf50 msgr2=0x7fedf80ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 shutdown_connections 2024-08-19T11:10:49.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.179+0000 7fee0067e640 1 -- 172.21.15.71:0/1384644209 wait complete. 2024-08-19T11:10:49.221 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:49.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:10:49.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:10:49.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.319+0000 7fb8d6706640 10 monclient: get_monmap_and_config 2024-08-19T11:10:49.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.319+0000 7fb8d6706640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.319+0000 7fb8d6706640 10 monclient: monmap: 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:49.320315+0000 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:49.320315+0000 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.321 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:49.322 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:49.322 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 1 Processor -- start 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 1 -- start start 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 10 monclient: init 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 10 monclient: _add_conns ranks=[5,8,10,4,2,0,9,3,1,7,6] 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d00a6950 0x7fb8d00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 10 monclient(hunting): picked mon.noname-h con 0x7fb8d00a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 0x7fb8d00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.320+0000 7fb8d6706640 10 monclient(hunting): picked mon.noname-e con 0x7fb8d00a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:49.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8d0139710 0x7fb8d0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 10 monclient(hunting): picked mon.noname-f con 0x7fb8d0139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d00a5020 con 0x7fb8d0139710 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb8d00a77b0 con 0x7fb8d00a6950 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fb8d00a7d40 con 0x7fb8d00a57c0 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8d6706640 10 monclient(hunting): authenticate will time out at 707.362030s 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 0x7fb8d00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 0x7fb8d00a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53548/0 (socket says 172.21.15.71:53548) 2024-08-19T11:10:49.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3509948446 learned_addr learned my addr 172.21.15.71:0/3509948446 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): get_auth_request con 0x7fb8d00a57c0 auth_method 0 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_done global_id 4400 payload 274 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3509948446 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d00a6950 msgr2=0x7fb8d00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3509948446 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d00a6950 0x7fb8d00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3509948446 >> v2:172.21.15.135:3300/0 conn(0x7fb8d0139710 msgr2=0x7fb8d0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3509948446 >> v2:172.21.15.135:3300/0 conn(0x7fb8d0139710 0x7fb8d0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 monclient: found mon.noname-e 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.321+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3509948446 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d00a6380 con 0x7fb8d00a57c0 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3509948446 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 msgr2=0x7fb8d00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3509948446 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 0x7fb8d00a7270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009870 tx=0x7fb8c402a0a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5ddb7e3df30d9ecb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 1 -- 172.21.15.71:0/3509948446 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8c4037070 con 0x7fb8d00a57c0 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: dump: 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.335 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.336 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 1 -- 172.21.15.71:0/3509948446 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c40307b0 con 0x7fb8d00a57c0 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 5 monclient: authenticate success, global_id 4400 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 1 -- 172.21.15.71:0/3509948446 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8c4030dd0 con 0x7fb8d00a57c0 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 4 set_mon_vals no callback set 2024-08-19T11:10:49.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8ceffd640 10 monclient: dump: 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.338 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 10 monclient: shutdown 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 -- 172.21.15.71:0/3509948446 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 msgr2=0x7fb8d00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 --2- 172.21.15.71:0/3509948446 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 0x7fb8d00a7270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009870 tx=0x7fb8c402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 -- 172.21.15.71:0/3509948446 shutdown_connections 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 --2- 172.21.15.71:0/3509948446 >> v2:172.21.15.135:3300/0 conn(0x7fb8d0139710 0x7fb8d0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 --2- 172.21.15.71:0/3509948446 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8d00a57c0 0x7fb8d00a7270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 --2- 172.21.15.71:0/3509948446 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d00a6950 0x7fb8d00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 -- 172.21.15.71:0/3509948446 >> 172.21.15.71:0/3509948446 conn(0x7fb8d00abf50 msgr2=0x7fb8d00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 -- 172.21.15.71:0/3509948446 shutdown_connections 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.324+0000 7fb8d6706640 1 -- 172.21.15.71:0/3509948446 wait complete. 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.325+0000 7fb8d6706640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.325+0000 7fb8d6706640 10 monclient: monmap: 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:49.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.325+0000 7fb8d6706640 1 Processor -- start 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.325+0000 7fb8d6706640 1 -- start start 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.325+0000 7fb8d6706640 10 monclient: init 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient: _add_conns ranks=[3,6,4,5,2,8,7,1,0] 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8d00a57c0 0x7fb8d0124ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): picked mon.noname-g con 0x7fb8d00a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 0x7fb8d0125400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): picked mon.noname-d con 0x7fb8d00a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb8d0139710 0x7fb8d0125940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): picked mon.noname-c con 0x7fb8d0139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d00a84c0 con 0x7fb8d00a57c0 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb8d00a3650 con 0x7fb8d0139710 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb8d00a8700 con 0x7fb8d00a6950 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d6706640 10 monclient(hunting): authenticate will time out at 707.367404s 2024-08-19T11:10:49.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 0x7fb8d0125400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb8d0139710 0x7fb8d0125940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 0x7fb8d0125400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:55872/0 (socket says 172.21.15.71:55872) 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/201232864 learned_addr learned my addr 172.21.15.71:0/201232864 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): get_auth_request con 0x7fb8d00a6950 auth_method 0 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb8d0139710 0x7fb8d0125940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53224/0 (socket says 172.21.15.71:53224) 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): get_auth_request con 0x7fb8d0139710 auth_method 0 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8d00a57c0 0x7fb8d0124ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): get_auth_request con 0x7fb8d00a57c0 auth_method 0 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8d4ca3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient(hunting): handle_auth_done global_id 4488 payload 824 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb8d0139710 msgr2=0x7fb8d0125940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb8d0139710 0x7fb8d0125940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8d00a57c0 msgr2=0x7fb8d0124ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8d00a57c0 0x7fb8d0124ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 monclient: found mon.noname-d 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.326+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d0127db0 con 0x7fb8d00a6950 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 msgr2=0x7fb8d0125400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 0x7fb8d0125400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40097c0 tx=0x7fb8c40046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8c4037040 con 0x7fb8d00a6950 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: dump: 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c4030b70 con 0x7fb8d00a6950 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 5 monclient: authenticate success, global_id 4488 2024-08-19T11:10:49.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 10 monclient: _renew_subs 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d0129040 con 0x7fb8d00a6950 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8c4030d20 con 0x7fb8d00a6950 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ccff9640 10 monclient: dump: 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.348 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 10 monclient: _renew_subs 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8ce7fc640 4 set_mon_vals no callback set 2024-08-19T11:10:49.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.329+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d01268c0 con 0x7fb8d00a6950 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb8c4003610 con 0x7fb8d00a6950 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8d6706640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8d6706640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 0x7fb8d0063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb8d006a590 con 0x7fb8d002e340 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8ccff9640 1 --2- 172.21.15.71:0/201232864 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8bc03ea80 0x7fb8bc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(20..20 src has 1..20) ==== 3926+0+0 (secure 0 0 0) 0x7fb8c4071fd0 con 0x7fb8d00a6950 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 0x7fb8d0063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient: get_auth_request con 0x7fb8d002e340 auth_method 0 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8d4ca3640 1 --2- 172.21.15.71:0/201232864 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8bc03ea80 0x7fb8bc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8d4ca3640 10 monclient: get_auth_request con 0x7fb8bc03ea80 auth_method 0 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 10 monclient(hunting): handle_auth_done global_id 14423 payload 824 2024-08-19T11:10:49.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.330+0000 7fb8cffff640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8d002e720 con 0x7fb8d002e340 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8cffff640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 msgr2=0x7fb8d0063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8cffff640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 0x7fb8d0063a80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000e7a0 tx=0x7fb8c000ec60 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8d4ca3640 1 --2- 172.21.15.71:0/201232864 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8bc03ea80 0x7fb8bc040f40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0128430 tx=0x7fb8c800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8c0017070 con 0x7fb8d002e340 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 10 monclient: dump: 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.354 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb8c000ee70 con 0x7fb8d002e340 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 msgr2=0x7fb8d0063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 0x7fb8d0063a80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000e7a0 tx=0x7fb8c000ec60 comp rx=0 tx=0).stop 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 msgr2=0x7fb8d0063a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.333+0000 7fb8ccff9640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d002e340 0x7fb8d0063a80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8d6706640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8d6706640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 0x7fb8d01d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8d6706640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb8d0076c60 con 0x7fb8d0063fc0 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 0x7fb8d01d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient: get_auth_request con 0x7fb8d0063fc0 auth_method 0 2024-08-19T11:10:49.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.339+0000 7fb8cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.340+0000 7fb8cffff640 10 monclient(hunting): handle_auth_done global_id 14432 payload 824 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.340+0000 7fb8cffff640 1 -- 172.21.15.71:0/201232864 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb8d00a6d30 con 0x7fb8d0063fc0 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8cffff640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 msgr2=0x7fb8d01d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8cffff640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 0x7fb8d01d8990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0019000 tx=0x7fb8c00047d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8c0017070 con 0x7fb8d0063fc0 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:10:49.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 10 monclient: dump: 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.358 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fb8c0006890 con 0x7fb8d0063fc0 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 msgr2=0x7fb8d01d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 0x7fb8d01d8990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0019000 tx=0x7fb8c00047d0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 msgr2=0x7fb8d01d8990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.342+0000 7fb8ccff9640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8d0063fc0 0x7fb8d01d8990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 46196, 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 34, 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:10:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:49.384 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8bc03ea80 msgr2=0x7fb8bc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 --2- 172.21.15.71:0/201232864 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8bc03ea80 0x7fb8bc040f40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0128430 tx=0x7fb8c800d040 comp rx=0 tx=0).stop 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 10 monclient: shutdown 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 msgr2=0x7fb8d0125400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 --2- 172.21.15.71:0/201232864 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8d00a6950 0x7fb8d0125400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40097c0 tx=0x7fb8c40046c0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d4ca3640 1 -- 172.21.15.71:0/201232864 reap_dead start 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d4ca3640 1 -- 172.21.15.71:0/201232864 reap_dead start 2024-08-19T11:10:49.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 shutdown_connections 2024-08-19T11:10:49.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 >> 172.21.15.71:0/201232864 conn(0x7fb8d00abf50 msgr2=0x7fb8d009ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 shutdown_connections 2024-08-19T11:10:49.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.343+0000 7fb8d6706640 1 -- 172.21.15.71:0/201232864 wait complete. 2024-08-19T11:10:49.386 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:49.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:10:49.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:10:49.483 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: starting. 2024-08-19T11:10:49.483 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-23996 2024-08-19T11:10:49.483 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: created object 0... 2024-08-19T11:10:49.484 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: created object 25... 2024-08-19T11:10:49.484 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: created object 49... 2024-08-19T11:10:49.484 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: finishing. 2024-08-19T11:10:49.484 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[23997]: shutting down. 2024-08-19T11:10:49.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.492+0000 7feef963f640 10 monclient: get_monmap_and_config 2024-08-19T11:10:49.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.492+0000 7feef963f640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.492+0000 7feef963f640 10 monclient: monmap: 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:10:49.493369+0000 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:10:49.493369+0000 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:10:49.495 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 Processor -- start 2024-08-19T11:10:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 -- start start 2024-08-19T11:10:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient: init 2024-08-19T11:10:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient: _add_conns ranks=[0,10,9,5,7,1,3,8,4,2,6] 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feef40a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feef40a57c0 0x7feef413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): picked mon.noname-f con 0x7feef40a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feef40a7440 0x7feef41410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): picked mon.noname-a con 0x7feef40a7440 addr v2:172.21.15.71:3300/0 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef40a6380 con 0x7feef40a6950 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7feef40a5020 con 0x7feef40a7440 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7feef40a7d40 con 0x7feef40a57c0 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef963f640 10 monclient(hunting): authenticate will time out at 707.534884s 2024-08-19T11:10:49.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.493+0000 7feef37fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feef40a7440 0x7feef41410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef2ffd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feef40a6950 0x7feef40a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:36952/0 (socket says 172.21.15.71:36952) 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef2ffd640 1 -- 172.21.15.71:0/1606354499 learned_addr learned my addr 172.21.15.71:0/1606354499 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): get_auth_request con 0x7feef40a7440 auth_method 0 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef27fc640 1 --2- 172.21.15.71:0/1606354499 >> v2:172.21.15.135:3300/0 conn(0x7feef40a57c0 0x7feef413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef27fc640 10 monclient(hunting): get_auth_request con 0x7feef40a57c0 auth_method 0 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient(hunting): handle_auth_done global_id 4437 payload 274 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 1 -- 172.21.15.71:0/1606354499 >> v2:172.21.15.135:3300/0 conn(0x7feef40a57c0 msgr2=0x7feef413eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 1 --2- 172.21.15.71:0/1606354499 >> v2:172.21.15.135:3300/0 conn(0x7feef40a57c0 0x7feef413eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 1 -- 172.21.15.71:0/1606354499 >> v1:172.21.15.71:6789/0 conn(0x7feef40a6950 legacy=0x7feef40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 1 monclient: found mon.noname-a 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.494+0000 7feef37fe640 1 -- 172.21.15.71:0/1606354499 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef40a3650 con 0x7feef40a7440 2024-08-19T11:10:49.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef37fe640 1 -- 172.21.15.71:0/1606354499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 msgr2=0x7feef41410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef37fe640 1 --2- 172.21.15.71:0/1606354499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef41410b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feef4074f90 tx=0x7feeec02a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733435018438d559 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 1 -- 172.21.15.71:0/1606354499 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feeec007bc0 con 0x7feef40a7440 2024-08-19T11:10:49.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: dump: 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.508 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 5 monclient: authenticate success, global_id 4437 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 1 -- 172.21.15.71:0/1606354499 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec007d80 con 0x7feef40a7440 2024-08-19T11:10:49.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 10 monclient: get_monmap_and_config success 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 4 set_mon_vals no callback set 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 1 -- 172.21.15.71:0/1606354499 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feeec031870 con 0x7feef40a7440 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef1ffb640 10 monclient: dump: 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.510 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 10 monclient: shutdown 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 -- 172.21.15.71:0/1606354499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 msgr2=0x7feef41410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 --2- 172.21.15.71:0/1606354499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef41410b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feef4074f90 tx=0x7feeec02a4e0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 -- 172.21.15.71:0/1606354499 shutdown_connections 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 --2- 172.21.15.71:0/1606354499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef41410b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 --2- 172.21.15.71:0/1606354499 >> v2:172.21.15.135:3300/0 conn(0x7feef40a57c0 0x7feef413eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 -- 172.21.15.71:0/1606354499 >> 172.21.15.71:0/1606354499 conn(0x7feef40abf50 msgr2=0x7feef40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 -- 172.21.15.71:0/1606354499 shutdown_connections 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.497+0000 7feef963f640 1 -- 172.21.15.71:0/1606354499 wait complete. 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.498+0000 7feef963f640 10 monclient: build_initial_monmap 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.498+0000 7feef963f640 10 monclient: monmap: 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:10:49.512 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:10:49.513 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.498+0000 7feef963f640 1 Processor -- start 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.498+0000 7feef963f640 1 -- start start 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.498+0000 7feef963f640 10 monclient: init 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient: _reopen_session rank -1 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient: _add_conns ranks=[4,8,0,5,6,7,2,3,1] 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7feef40a57c0 0x7feef4126390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): picked mon.noname-c con 0x7feef40a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feef40a6950 0x7feef41268d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): picked mon.noname-e con 0x7feef40a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef4126e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): picked mon.noname-a con 0x7feef40a7440 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feef40a8700 con 0x7feef40a7440 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7feef40a84c0 con 0x7feef40a57c0 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7feef41415f0 con 0x7feef40a6950 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): _renew_subs 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef963f640 10 monclient(hunting): authenticate will time out at 707.540339s 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7feef40a57c0 0x7feef4126390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef4126e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feef40a6950 0x7feef41268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef4126e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36848/0 (socket says 172.21.15.71:36848) 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7feef40a57c0 0x7feef4126390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53240/0 (socket says 172.21.15.71:53240) 2024-08-19T11:10:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 learned_addr learned my addr 172.21.15.71:0/1441615807 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): get_auth_request con 0x7feef40a7440 auth_method 0 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): get_auth_request con 0x7feef40a57c0 auth_method 0 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): get_auth_request con 0x7feef40a6950 auth_method 0 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient(hunting): handle_auth_done global_id 4446 payload 824 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feef40a6950 msgr2=0x7feef41268d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feef40a6950 0x7feef41268d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7feef40a57c0 msgr2=0x7feef4126390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7feef40a57c0 0x7feef4126390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 monclient: found mon.noname-a 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef4140ce0 con 0x7feef40a7440 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.499+0000 7feef27fc640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feef40a6950 0x7feef41268d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 msgr2=0x7feef4126e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef37fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef4126e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feeec02aa00 tx=0x7feeec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feeec0046c0 con 0x7feef40a7440 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:10:49.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: dump: 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 5 monclient: authenticate success, global_id 4446 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec03b410 con 0x7feef40a7440 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 10 monclient: _renew_subs 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feeec03ba30 con 0x7feef40a7440 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef40a9330 con 0x7feef40a7440 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef17fa640 4 set_mon_vals no callback set 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feedb7fe640 10 monclient: dump: 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 10 monclient: _renew_subs 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef4129ed0 con 0x7feef40a7440 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 0x7feef41ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.502+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7feef4076c60 con 0x7feef41ce500 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7feeec03bc10 con 0x7feef40a7440 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 0x7feef41ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient: get_auth_request con 0x7feef41ce500 auth_method 0 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feedb7fe640 1 --2- 172.21.15.71:0/1441615807 >> v2:172.21.15.135:6800/726754104 conn(0x7feee003ea80 0x7feee0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3926+0+0 (secure 0 0 0) 0x7feeec072c40 con 0x7feef40a7440 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef27fc640 1 --2- 172.21.15.71:0/1441615807 >> v2:172.21.15.135:6800/726754104 conn(0x7feee003ea80 0x7feee0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef27fc640 10 monclient: get_auth_request con 0x7feee003ea80 auth_method 0 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 10 monclient(hunting): handle_auth_done global_id 4399 payload 824 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.503+0000 7feef2ffd640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feef4129340 con 0x7feef41ce500 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feef2ffd640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 msgr2=0x7feef41ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feef2ffd640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 0x7feef41ce8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feee400ea70 tx=0x7feee400ef30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feef27fc640 1 --2- 172.21.15.71:0/1441615807 >> v2:172.21.15.135:6800/726754104 conn(0x7feee003ea80 0x7feee0040f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feee8006fd0 tx=0x7feee8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feee401a070 con 0x7feef41ce500 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 10 monclient: dump: 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.524 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.525 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7feee400cc50 con 0x7feef41ce500 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 msgr2=0x7feef41ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 0x7feef41ce8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feee400ea70 tx=0x7feee400ef30 comp rx=0 tx=0).stop 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 msgr2=0x7feef41ce8e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.506+0000 7feedb7fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41ce500 0x7feef41ce8e0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feee400ea70 tx=0x7feee400ef30 comp rx=0 tx=0).stop 2024-08-19T11:10:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef963f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:10:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef963f640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 0x7feef41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:10:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef963f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:10:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7feef4127e50 con 0x7feef41cee20 2024-08-19T11:10:49.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef2ffd640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 0x7feef41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef2ffd640 10 monclient: get_auth_request con 0x7feef41cee20 auth_method 0 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.512+0000 7feef2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.513+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.513+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.513+0000 7feef2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.513+0000 7feef2ffd640 10 monclient(hunting): handle_auth_done global_id 4408 payload 824 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.513+0000 7feef2ffd640 1 -- 172.21.15.71:0/1441615807 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feef412a660 con 0x7feef41cee20 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.515+0000 7feef2ffd640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 msgr2=0x7feef41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.515+0000 7feef2ffd640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 0x7feef41225a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee4017000 tx=0x7feee4004940 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.515+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feee401a070 con 0x7feef41cee20 2024-08-19T11:10:49.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.515+0000 7feedb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.515+0000 7feedb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.515+0000 7feedb7fe640 10 monclient: dump: 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:10:49.531 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7feee401b040 con 0x7feef41cee20 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 msgr2=0x7feef41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 0x7feef41225a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee4017000 tx=0x7feee4004940 comp rx=0 tx=0).stop 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 msgr2=0x7feef41225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:10:49.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feedb7fe640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7feef41cee20 0x7feef41225a0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee4017000 tx=0x7feee4004940 comp rx=0 tx=0).stop 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 14, 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 46370, 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:10:49.533 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 34, 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.534 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.535 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:10:49.536 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:10:49.537 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:10:49.538 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.540 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.547 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:10:49.550 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:10:49.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:10:49.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.554 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:10:49.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:10:49.556 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 >> v2:172.21.15.135:6800/726754104 conn(0x7feee003ea80 msgr2=0x7feee0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 --2- 172.21.15.71:0/1441615807 >> v2:172.21.15.135:6800/726754104 conn(0x7feee003ea80 0x7feee0040f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feee8006fd0 tx=0x7feee8008040 comp rx=0 tx=0).stop 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 10 monclient: shutdown 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 msgr2=0x7feef4126e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 --2- 172.21.15.71:0/1441615807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40a7440 0x7feef4126e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feeec02aa00 tx=0x7feeec004a40 comp rx=0 tx=0).stop 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 reap_dead start 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef37fe640 1 -- 172.21.15.71:0/1441615807 reap_dead start 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 shutdown_connections 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 >> 172.21.15.71:0/1441615807 conn(0x7feef40abf50 msgr2=0x7feef409f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:10:49.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 shutdown_connections 2024-08-19T11:10:49.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:10:49.516+0000 7feef963f640 1 -- 172.21.15.71:0/1441615807 wait complete. 2024-08-19T11:10:49.559 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:10:49.559 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d'] 2024-08-19T11:10:49.559 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-08-19T11:10:49.559 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-08-19T11:10:49.559 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-08-19T11:10:49.560 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-19T11:10:49.560 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:10:49.570 INFO:tasks.ceph.mon.d:Stopped 2024-08-19T11:10:49.571 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-19T11:10:49.571 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-19T11:10:49.571 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:11:04.572 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-19T11:11:04.573 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-19T11:11:04.573 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-19T11:11:04.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:11:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.680+0000 7fac47308640 10 monclient: get_monmap_and_config 2024-08-19T11:11:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.680+0000 7fac47308640 10 monclient: build_initial_monmap 2024-08-19T11:11:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.680+0000 7fac47308640 10 monclient: monmap: 2024-08-19T11:11:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:04.681542+0000 2024-08-19T11:11:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:04.681542+0000 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:04.684 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.681+0000 7fac47308640 1 Processor -- start 2024-08-19T11:11:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.681+0000 7fac47308640 1 -- start start 2024-08-19T11:11:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.681+0000 7fac47308640 10 monclient: init 2024-08-19T11:11:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient: _add_conns ranks=[3,0,2,5,8,4,10,6,1,9,7] 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): picked mon.noname-g con 0x7fac400a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fac400a6e10 addr v1:172.21.15.71:6789/0 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): picked mon.noname-b con 0x7fac4013eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac400a4f90 con 0x7fac400a6e10 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fac400a3650 con 0x7fac4013eb10 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac400a6380 con 0x7fac400a6a30 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac47308640 10 monclient(hunting): authenticate will time out at 722.723398s 2024-08-19T11:11:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac448a3640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fac400a6e10 0x7fac400a71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37798/0 (socket says 172.21.15.71:37798) 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 learned_addr learned my addr 172.21.15.71:0/4122522641 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 10 monclient(hunting): get_auth_request con 0x7fac4013eb10 auth_method 0 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac400a6a30 auth_method 0 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.682+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.684+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> v1:172.21.15.71:6789/0 conn(0x7fac400a6e10 legacy=0x7fac400a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 10 monclient(hunting): get_auth_request con 0x7fac4013eb10 auth_method 0 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:04.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac400a6a30 auth_method 0 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:04.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:04.883+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:05.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 10 monclient(hunting): get_auth_request con 0x7fac4013eb10 auth_method 0 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac400a6a30 auth_method 0 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:05.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:11:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:05.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:05.284+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:06.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:06.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 10 monclient(hunting): get_auth_request con 0x7fac4013eb10 auth_method 0 2024-08-19T11:11:06.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:06.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:06.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:06.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac400a6a30 auth_method 0 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.085+0000 7fac450a4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.086+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.086+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.086+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:06.086+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): tick 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 monclient(hunting): continuing hunt 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 msgr2=0x7fac400a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac400a6a30 0x7fac400a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 msgr2=0x7fac40140f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:11:07.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac4013eb10 0x7fac40140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 >> v1:172.21.15.71:6789/0 conn(0x7fac400a6e10 legacy=0x7fac400a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient: _add_conns ranks=[8,5,6,7,1,10,9,4] 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): picked mon.noname-e con 0x7fac2c0038d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): picked mon.noname-h con 0x7fac2c006350 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 0x7fac2c00b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): picked mon.noname-d con 0x7fac2c008eb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fac400a6380 con 0x7fac2c006350 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:07.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fac2c00ba40 con 0x7fac2c008eb0 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fac2c00bc40 con 0x7fac2c0038d0 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac3effd640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 msgr2=0x7fac2c00b340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 0x7fac2c00b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac2c0038d0 auth_method 0 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.682+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 10 monclient(hunting): get_auth_request con 0x7fac2c006350 auth_method 0 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.683+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:07.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 msgr2=0x7fac2c00b340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 0x7fac2c00b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac2c0038d0 auth_method 0 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:07.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.883+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:07.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:07.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 10 monclient(hunting): get_auth_request con 0x7fac2c006350 auth_method 0 2024-08-19T11:11:07.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:07.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:07.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:07.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:07.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:07.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:07.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:07.884+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:08.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 msgr2=0x7fac2c00b340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:08.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 0x7fac2c00b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:08.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:08.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac2c0038d0 auth_method 0 2024-08-19T11:11:08.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:08.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:08.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:08.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:11:08.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:08.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:08.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.284+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 10 monclient(hunting): get_auth_request con 0x7fac2c006350 auth_method 0 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:08.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:08.285+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:09.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 msgr2=0x7fac2c00b340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:09.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 0x7fac2c00b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:09.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:09.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac2c0038d0 auth_method 0 2024-08-19T11:11:09.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.085+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:09.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 10 monclient(hunting): get_auth_request con 0x7fac2c006350 auth_method 0 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:09.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:09.086+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:10.601 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[23998]: starting. 2024-08-19T11:11:10.601 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[23998]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-23996 2024-08-19T11:11:10.601 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[23998]: shutting down. 2024-08-19T11:11:10.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): tick 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 monclient(hunting): continuing hunt 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 msgr2=0x7fac2c005d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fac2c0038d0 0x7fac2c005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 msgr2=0x7fac2c00b340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fac2c008eb0 0x7fac2c00b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 msgr2=0x7fac2c0087c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c006350 0x7fac2c0087c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 reap_dead start 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient: _add_conns ranks=[4,7,9,1,10] 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 1 -- 172.21.15.71:0/4122522641 reap_dead start 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 0x7fac2c009330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): picked mon.noname-c con 0x7fac2c003cf0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac2c009870 0x7fac2c008740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): picked mon.noname-i con 0x7fac2c009870 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 --2- 172.21.15.71:0/4122522641 >> v2:172.21.15.71:3300/0 conn(0x7fac2c009c50 0x7fac2c00a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): picked mon.noname-a con 0x7fac2c009c50 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fac400a6380 con 0x7fac2c009c50 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:10.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fac2c00ba40 con 0x7fac2c003cf0 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 1 -- 172.21.15.71:0/4122522641 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fac2c00bc40 con 0x7fac2c009870 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac3effd640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 0x7fac2c009330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 1 --2- 172.21.15.71:0/4122522641 >> v2:172.21.15.71:3300/0 conn(0x7fac2c009c50 0x7fac2c00a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac2c003cf0 auth_method 0 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): get_auth_request con 0x7fac2c009c50 auth_method 0 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:10.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac448a3640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac2c009870 0x7fac2c008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac458a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac448a3640 10 monclient(hunting): get_auth_request con 0x7fac2c009870 auth_method 0 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac448a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac448a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac448a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient(hunting): handle_auth_done global_id 4441 payload 274 2024-08-19T11:11:10.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac2c009870 msgr2=0x7fac2c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac2c009870 0x7fac2c008740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> v2:172.21.15.71:3300/0 conn(0x7fac2c009c50 msgr2=0x7fac2c00a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> v2:172.21.15.71:3300/0 conn(0x7fac2c009c50 0x7fac2c00a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient: _finish_hunting 0 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 monclient: found mon.noname-c 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:10.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.683+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac400a49d0 con 0x7fac2c003cf0 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac450a4640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 msgr2=0x7fac2c009330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac450a4640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 0x7fac2c009330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac38006fd0 tx=0x7fac3802c320 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2f1c230904106f39 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 1 -- 172.21.15.71:0/4122522641 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac38032070 con 0x7fac2c003cf0 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: dump: 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:10.696 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:10.697 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: _finish_auth 0 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 1 -- 172.21.15.71:0/4122522641 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3802ce30 con 0x7fac2c003cf0 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac47308640 5 monclient: authenticate success, global_id 4441 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac47308640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac47308640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac47308640 4 set_mon_vals no callback set 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 1 -- 172.21.15.71:0/4122522641 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac38036ce0 con 0x7fac2c003cf0 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:10.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.686+0000 7fac3ffff640 10 monclient: dump: 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:10.699 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 10 monclient: shutdown 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 -- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 msgr2=0x7fac2c009330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 0x7fac2c009330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac38006fd0 tx=0x7fac3802c320 comp rx=0 tx=0).stop 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 -- 172.21.15.71:0/4122522641 shutdown_connections 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 --2- 172.21.15.71:0/4122522641 >> v2:172.21.15.71:3300/0 conn(0x7fac2c009c50 0x7fac2c00a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fac2c009870 0x7fac2c008740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 --2- 172.21.15.71:0/4122522641 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fac2c003cf0 0x7fac2c009330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 -- 172.21.15.71:0/4122522641 >> 172.21.15.71:0/4122522641 conn(0x7fac400ac030 msgr2=0x7fac400ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:10.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 -- 172.21.15.71:0/4122522641 shutdown_connections 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.687+0000 7fac47308640 1 -- 172.21.15.71:0/4122522641 wait complete. 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.688+0000 7fac47308640 10 monclient: build_initial_monmap 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.688+0000 7fac47308640 10 monclient: monmap: 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:10.701 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.688+0000 7fac47308640 1 Processor -- start 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.688+0000 7fac47308640 1 -- start start 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.688+0000 7fac47308640 10 monclient: init 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient: _add_conns ranks=[5,3,2,8,1,4,7,0,6] 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c003cf0 0x7fac40135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): picked mon.noname-h con 0x7fac2c003cf0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac2c009870 0x7fac401362b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): picked mon.noname-g con 0x7fac2c009870 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 0x7fac401cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): picked mon.noname-b con 0x7fac2c009c50 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fac400a7370 con 0x7fac2c009c50 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fac400a71f0 con 0x7fac2c009870 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fac400a74f0 con 0x7fac2c003cf0 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac47308640 10 monclient(hunting): authenticate will time out at 728.730257s 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 0x7fac401cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 0x7fac401cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48080/0 (socket says 172.21.15.71:48080) 2024-08-19T11:11:10.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 -- 172.21.15.71:0/3931290486 learned_addr learned my addr 172.21.15.71:0/3931290486 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): get_auth_request con 0x7fac2c009c50 auth_method 0 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac448a3640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac2c009870 0x7fac401362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac450a4640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c003cf0 0x7fac40135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac448a3640 10 monclient(hunting): get_auth_request con 0x7fac2c009870 auth_method 0 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac448a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac448a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:10.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac448a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac450a4640 10 monclient(hunting): get_auth_request con 0x7fac2c003cf0 auth_method 0 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac450a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac450a4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac450a4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient(hunting): handle_auth_done global_id 4610 payload 824 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 -- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c003cf0 msgr2=0x7fac40135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c003cf0 0x7fac40135d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 -- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac2c009870 msgr2=0x7fac401362b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac2c009870 0x7fac401362b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient: _finish_hunting 0 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 monclient: found mon.noname-b 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:11:10.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.689+0000 7fac458a5640 1 -- 172.21.15.71:0/3931290486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac40122820 con 0x7fac2c009c50 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.691+0000 7fac458a5640 1 -- 172.21.15.71:0/3931290486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 msgr2=0x7fac401cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.691+0000 7fac458a5640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 0x7fac401cad50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac400acf50 tx=0x7fac30009cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac3001c030 con 0x7fac2c009c50 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: dump: 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:10.706 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: _finish_auth 0 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac30015ca0 con 0x7fac2c009c50 2024-08-19T11:11:10.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 5 monclient: authenticate success, global_id 4610 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 10 monclient: _renew_subs 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4013ddf0 con 0x7fac2c009c50 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fac30015e50 con 0x7fac2c009c50 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3dffb640 10 monclient: dump: 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:10.708 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 10 monclient: _renew_subs 2024-08-19T11:11:10.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac3f7fe640 4 set_mon_vals no callback set 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.692+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac400a92e0 con 0x7fac2c009c50 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac47308640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac47308640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac47308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fac30005d10 con 0x7fac2c009c50 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4013e020 con 0x7fac2c009c50 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac3dffb640 1 --2- 172.21.15.71:0/3931290486 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2c040f00 0x7fac2c0433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 3534+0+0 (secure 0 0 0) 0x7fac3001d070 con 0x7fac2c009c50 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.693+0000 7fac450a4640 1 --2- 172.21.15.71:0/3931290486 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2c040f00 0x7fac2c0433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.694+0000 7fac450a4640 10 monclient: get_auth_request con 0x7fac2c040f00 auth_method 0 2024-08-19T11:11:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.696+0000 7fac450a4640 1 --2- 172.21.15.71:0/3931290486 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2c040f00 0x7fac2c0433c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac38037000 tx=0x7fac38032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.698+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fac4013e020 con 0x7fac2c009c50 2024-08-19T11:11:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.698+0000 7fac3dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.698+0000 7fac3dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:10.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac47308640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:11:10.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac47308640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:11:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac47308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fac400a57f0 con 0x7fac2c009c50 2024-08-19T11:11:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac3dffb640 1 -- 172.21.15.71:0/3931290486 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3186 (secure 0 0 0) 0x7fac30026030 con 0x7fac2c009c50 2024-08-19T11:11:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac3dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:11:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.942+0000 7fac3dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:10.946 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":20,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:11:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2c040f00 msgr2=0x7fac2c0433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 --2- 172.21.15.71:0/3931290486 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2c040f00 0x7fac2c0433c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac38037000 tx=0x7fac38032000 comp rx=0 tx=0).stop 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 10 monclient: shutdown 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 msgr2=0x7fac401cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 0x7fac401cad50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac400acf50 tx=0x7fac30009cb0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 shutdown_connections 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 --2- 172.21.15.71:0/3931290486 >> v2:172.21.15.135:6800/726754104 conn(0x7fac2c040f00 0x7fac2c0433c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fac2c009c50 0x7fac401cad50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac2c009870 0x7fac401362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 --2- 172.21.15.71:0/3931290486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fac2c003cf0 0x7fac40135d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:10.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 >> 172.21.15.71:0/3931290486 conn(0x7fac400ac030 msgr2=0x7fac40138950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:10.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 shutdown_connections 2024-08-19T11:11:10.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:10.945+0000 7fac47308640 1 -- 172.21.15.71:0/3931290486 wait complete. 2024-08-19T11:11:10.957 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-19T11:11:10.957 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-19T11:11:10.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:11:11.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.053+0000 7f8a84db3640 10 monclient: get_monmap_and_config 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.053+0000 7f8a84db3640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.053+0000 7f8a84db3640 10 monclient: monmap: 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:11.054415+0000 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:11.054415+0000 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:11.055 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:11.056 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.054+0000 7f8a84db3640 1 Processor -- start 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.054+0000 7f8a84db3640 1 -- start start 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.054+0000 7f8a84db3640 10 monclient: init 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient: _add_conns ranks=[0,3,8,1,7,2,10,5,9,6,4] 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8a800a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800a57c0 0x7f8a8013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): picked mon.noname-g con 0x7f8a800a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 0x7f8a801410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): picked mon.noname-e con 0x7f8a800a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a800a6380 con 0x7f8a800a6950 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a800a5020 con 0x7f8a800a57c0 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8a800a7d40 con 0x7f8a800a7440 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a84db3640 10 monclient(hunting): authenticate will time out at 729.096216s 2024-08-19T11:11:11.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 0x7f8a801410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7e59c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8a800a6950 0x7f8a800a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40254/0 (socket says 172.21.15.71:40254) 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7e59c640 1 -- 172.21.15.71:0/3624551618 learned_addr learned my addr 172.21.15.71:0/3624551618 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): get_auth_request con 0x7f8a800a7440 auth_method 0 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 1 --2- 172.21.15.71:0/3624551618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800a57c0 0x7f8a8013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): get_auth_request con 0x7f8a800a57c0 auth_method 0 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient(hunting): handle_auth_done global_id 4427 payload 274 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 1 -- 172.21.15.71:0/3624551618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800a57c0 msgr2=0x7f8a8013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 1 --2- 172.21.15.71:0/3624551618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800a57c0 0x7f8a8013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 1 -- 172.21.15.71:0/3624551618 >> v1:172.21.15.71:6789/0 conn(0x7f8a800a6950 legacy=0x7f8a800a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 1 monclient: found mon.noname-e 2024-08-19T11:11:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.055+0000 7f8a7ed9d640 1 -- 172.21.15.71:0/3624551618 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a800a3650 con 0x7f8a800a7440 2024-08-19T11:11:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7ed9d640 1 -- 172.21.15.71:0/3624551618 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 msgr2=0x7f8a801410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7ed9d640 1 --2- 172.21.15.71:0/3624551618 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 0x7f8a801410b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009800 tx=0x7f8a70029fe0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=3e0c78fad1842c80 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 1 -- 172.21.15.71:0/3624551618 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a70037070 con 0x7f8a800a7440 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: dump: 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.070 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 1 -- 172.21.15.71:0/3624551618 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7002ad00 con 0x7f8a800a7440 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a84db3640 5 monclient: authenticate success, global_id 4427 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a84db3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 1 -- 172.21.15.71:0/3624551618 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a70030c20 con 0x7f8a800a7440 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a84db3640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a84db3640 4 set_mon_vals no callback set 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.058+0000 7f8a7d59a640 10 monclient: dump: 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.072 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.073 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 10 monclient: shutdown 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 -- 172.21.15.71:0/3624551618 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 msgr2=0x7f8a801410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 --2- 172.21.15.71:0/3624551618 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 0x7f8a801410b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009800 tx=0x7f8a70029fe0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 -- 172.21.15.71:0/3624551618 shutdown_connections 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 --2- 172.21.15.71:0/3624551618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a800a57c0 0x7f8a8013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 --2- 172.21.15.71:0/3624551618 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a7440 0x7f8a801410b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 -- 172.21.15.71:0/3624551618 >> 172.21.15.71:0/3624551618 conn(0x7f8a800abf50 msgr2=0x7f8a800ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 -- 172.21.15.71:0/3624551618 shutdown_connections 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.059+0000 7f8a84db3640 1 -- 172.21.15.71:0/3624551618 wait complete. 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.060+0000 7f8a84db3640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.060+0000 7f8a84db3640 10 monclient: monmap: 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.060+0000 7f8a84db3640 1 Processor -- start 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.060+0000 7f8a84db3640 1 -- start start 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.060+0000 7f8a84db3640 10 monclient: init 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient: _add_conns ranks=[8,4,1,0,6,7,3,2,5] 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 0x7f8a80128c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): picked mon.noname-e con 0x7f8a800a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a800a6950 0x7f8a8013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): picked mon.noname-c con 0x7f8a800a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800a7440 0x7f8a80126650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): picked mon.noname-f con 0x7f8a800a7440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a800a8700 con 0x7f8a800a7440 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f8a800a84c0 con 0x7f8a800a6950 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8a801415f0 con 0x7f8a800a57c0 2024-08-19T11:11:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a84db3640 10 monclient(hunting): authenticate will time out at 729.102264s 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 0x7f8a80128c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 0x7f8a80128c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53326/0 (socket says 172.21.15.71:53326) 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a800a6950 0x7f8a8013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 -- 172.21.15.71:0/137772104 learned_addr learned my addr 172.21.15.71:0/137772104 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): get_auth_request con 0x7f8a800a57c0 auth_method 0 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): get_auth_request con 0x7f8a800a6950 auth_method 0 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient(hunting): handle_auth_done global_id 4436 payload 824 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7ed9d640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800a7440 0x7f8a80126650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a800a6950 msgr2=0x7f8a8013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a800a6950 0x7f8a8013fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800a7440 msgr2=0x7f8a80126650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800a7440 0x7f8a80126650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 monclient: found mon.noname-e 2024-08-19T11:11:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7e59c640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a80129600 con 0x7f8a800a57c0 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7ed9d640 10 monclient: get_auth_request con 0x7f8a800a7440 auth_method 0 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7dd9b640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a800a6950 0x7f8a8013fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.061+0000 7f8a7ed9d640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a800a7440 0x7f8a80126650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.063+0000 7f8a7e59c640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 msgr2=0x7f8a80128c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.063+0000 7f8a7e59c640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 0x7f8a80128c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800c460 tx=0x7f8a6800c920 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.063+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a68005cf0 con 0x7f8a800a57c0 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.063+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: dump: 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.082 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a680074e0 con 0x7f8a800a57c0 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a68007690 con 0x7f8a800a57c0 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 5 monclient: authenticate success, global_id 4436 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a76ffd640 10 monclient: dump: 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.084 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 10 monclient: _renew_subs 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a7cd99640 4 set_mon_vals no callback set 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a80128110 con 0x7f8a800a57c0 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 10 monclient: _renew_subs 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a80129bd0 con 0x7f8a800a57c0 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 0x7f8a80126f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.064+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a80076c60 con 0x7f8a80126b90 2024-08-19T11:11:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8a68007070 con 0x7f8a800a57c0 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 0x7f8a80126f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient: get_auth_request con 0x7f8a80126b90 auth_method 0 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a76ffd640 1 --2- 172.21.15.71:0/137772104 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a6003ea80 0x7f8a60040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_done global_id 4473 payload 824 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7dd9b640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a801274b0 con 0x7f8a80126b90 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(22..22 src has 1..22) ==== 3534+0+0 (secure 0 0 0) 0x7f8a68051770 con 0x7f8a800a57c0 2024-08-19T11:11:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7ed9d640 1 --2- 172.21.15.71:0/137772104 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a6003ea80 0x7f8a60040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.065+0000 7f8a7ed9d640 10 monclient: get_auth_request con 0x7f8a6003ea80 auth_method 0 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a7dd9b640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 msgr2=0x7f8a80126f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a7dd9b640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 0x7f8a80126f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009fd0 tx=0x7f8a780079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a7801b070 con 0x7f8a80126b90 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a7ed9d640 1 --2- 172.21.15.71:0/137772104 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a6003ea80 0x7f8a60040f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009800 tx=0x7f8a7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.067+0000 7f8a76ffd640 10 monclient: dump: 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8a78017a00 con 0x7f8a80126b90 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 msgr2=0x7f8a80126f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 0x7f8a80126f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009fd0 tx=0x7f8a780079f0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 msgr2=0x7f8a80126f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.068+0000 7f8a76ffd640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a80126b90 0x7f8a80126f70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a84db3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a84db3640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 0x7f8a801229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a84db3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8012a040 con 0x7f8a801225a0 2024-08-19T11:11:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 0x7f8a801229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient: get_auth_request con 0x7f8a801225a0 auth_method 0 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 10 monclient(hunting): handle_auth_done global_id 4482 payload 824 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.074+0000 7f8a7dd9b640 1 -- 172.21.15.71:0/137772104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a80140ed0 con 0x7f8a801225a0 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.076+0000 7f8a7dd9b640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 msgr2=0x7f8a801229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.076+0000 7f8a7dd9b640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 0x7f8a801229b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009fd0 tx=0x7f8a78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.076+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a78015a90 con 0x7f8a801225a0 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.076+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.076+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.076+0000 7f8a76ffd640 10 monclient: dump: 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f8a78015620 con 0x7f8a801225a0 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 msgr2=0x7f8a801229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 0x7f8a801229b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009fd0 tx=0x7f8a78004ab0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 msgr2=0x7f8a801229b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a76ffd640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a801225a0 0x7f8a801229b0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009fd0 tx=0x7f8a78004ab0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:11.095 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 67953, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:11.096 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.097 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:11.099 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:11.100 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:11.120 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:11.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a6003ea80 msgr2=0x7f8a60040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 --2- 172.21.15.71:0/137772104 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a6003ea80 0x7f8a60040f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009800 tx=0x7f8a7002e000 comp rx=0 tx=0).stop 2024-08-19T11:11:11.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 10 monclient: shutdown 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 msgr2=0x7f8a80128c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 0x7f8a80128c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800c460 tx=0x7f8a6800c920 comp rx=0 tx=0).stop 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a7ed9d640 1 -- 172.21.15.71:0/137772104 reap_dead start 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 shutdown_connections 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 --2- 172.21.15.71:0/137772104 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a800a57c0 0x7f8a80128c70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 >> 172.21.15.71:0/137772104 conn(0x7f8a800abf50 msgr2=0x7f8a800ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 shutdown_connections 2024-08-19T11:11:11.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.077+0000 7f8a84db3640 1 -- 172.21.15.71:0/137772104 wait complete. 2024-08-19T11:11:11.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:11.123 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-19T11:11:11.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:11:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.220+0000 7fe3a4d7f640 10 monclient: get_monmap_and_config 2024-08-19T11:11:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.220+0000 7fe3a4d7f640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.220+0000 7fe3a4d7f640 10 monclient: monmap: 2024-08-19T11:11:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:11.221178+0000 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:11.221178+0000 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 Processor -- start 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 -- start start 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient: init 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient: _add_conns ranks=[9,2,7,6,8,10,0,4,5,3,1] 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3a00a6950 0x7fe3a00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): picked mon.noname-a con 0x7fe3a00a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a00a57c0 0x7fe3a00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): picked mon.noname-b con 0x7fe3a00a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe3a0139710 0x7fe3a0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): picked mon.noname-i con 0x7fe3a0139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a00a5020 con 0x7fe3a00a6950 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a00a77b0 con 0x7fe3a00a57c0 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe3a00a7d40 con 0x7fe3a0139710 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe3a4d7f640 10 monclient(hunting): authenticate will time out at 729.262725s 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3a00a6950 0x7fe3a00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a00a57c0 0x7fe3a00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe3a00a6950 0x7fe3a00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52932/0 (socket says 172.21.15.71:52932) 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 1 -- 172.21.15.71:0/1687171950 learned_addr learned my addr 172.21.15.71:0/1687171950 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): get_auth_request con 0x7fe3a00a6950 auth_method 0 2024-08-19T11:11:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): get_auth_request con 0x7fe3a00a57c0 auth_method 0 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe39e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.221+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 10 monclient(hunting): handle_auth_done global_id 4491 payload 274 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39ed9d640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe3a0139710 0x7fe3a0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 1 -- 172.21.15.71:0/1687171950 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe3a0139710 msgr2=0x7fe3a0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe3a0139710 0x7fe3a0139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 1 -- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a00a57c0 msgr2=0x7fe3a00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a00a57c0 0x7fe3a00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 1 monclient: found mon.noname-a 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39e59c640 1 -- 172.21.15.71:0/1687171950 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a00a6380 con 0x7fe3a00a6950 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39ed9d640 10 monclient: get_auth_request con 0x7fe3a0139710 auth_method 0 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe395d9b640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a00a57c0 0x7fe3a00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.222+0000 7fe39ed9d640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe3a0139710 0x7fe3a0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.224+0000 7fe39e59c640 1 -- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a6950 msgr2=0x7fe3a00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.224+0000 7fe39e59c640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a6950 0x7fe3a00a6d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe3900098a0 tx=0x7fe39002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a16d92efbe4c92 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 1 -- 172.21.15.71:0/1687171950 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe390037070 con 0x7fe3a00a6950 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: dump: 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 1 -- 172.21.15.71:0/1687171950 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39002adf0 con 0x7fe3a00a6950 2024-08-19T11:11:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 5 monclient: authenticate success, global_id 4491 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 1 -- 172.21.15.71:0/1687171950 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe390030c20 con 0x7fe3a00a6950 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 4 set_mon_vals no callback set 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe39dd9b640 10 monclient: dump: 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 10 monclient: shutdown 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a6950 msgr2=0x7fe3a00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a6950 0x7fe3a00a6d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe3900098a0 tx=0x7fe39002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/1687171950 shutdown_connections 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe3a0139710 0x7fe3a0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a00a57c0 0x7fe3a00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/1687171950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a6950 0x7fe3a00a6d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/1687171950 >> 172.21.15.71:0/1687171950 conn(0x7fe3a00abf50 msgr2=0x7fe3a00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/1687171950 shutdown_connections 2024-08-19T11:11:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.225+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/1687171950 wait complete. 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.226+0000 7fe3a4d7f640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.226+0000 7fe3a4d7f640 10 monclient: monmap: 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.226+0000 7fe3a4d7f640 1 Processor -- start 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.226+0000 7fe3a4d7f640 1 -- start start 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.226+0000 7fe3a4d7f640 10 monclient: init 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient: _add_conns ranks=[0,8,6,7,1,3,5,4,2] 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 0x7fe3a01ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): picked mon.noname-a con 0x7fe3a00a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe3a00a6950 0x7fe3a0138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): picked mon.noname-e con 0x7fe3a00a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe3a0139710 0x7fe3a0139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): picked mon.noname-d con 0x7fe3a0139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a00a84c0 con 0x7fe3a00a57c0 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe3a00a3650 con 0x7fe3a0139710 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe3a00a8700 con 0x7fe3a00a6950 2024-08-19T11:11:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe3a4d7f640 10 monclient(hunting): authenticate will time out at 729.268431s 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39ed9d640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe3a0139710 msgr2=0x7fe3a0139010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39ed9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe3a0139710 0x7fe3a0139010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 0x7fe3a01ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe3a00a6950 0x7fe3a0138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 0x7fe3a01ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52938/0 (socket says 172.21.15.71:52938) 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 -- 172.21.15.71:0/739895222 learned_addr learned my addr 172.21.15.71:0/739895222 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): get_auth_request con 0x7fe3a00a57c0 auth_method 0 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): get_auth_request con 0x7fe3a00a6950 auth_method 0 2024-08-19T11:11:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient(hunting): handle_auth_done global_id 4500 payload 824 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe3a00a6950 msgr2=0x7fe3a0138ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe3a00a6950 0x7fe3a0138ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe3a0139710 msgr2=0x7fe3a0139010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe3a0139710 0x7fe3a0139010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 monclient: found mon.noname-a 2024-08-19T11:11:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe39e59c640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a00a1d20 con 0x7fe3a00a57c0 2024-08-19T11:11:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.227+0000 7fe395d9b640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe3a00a6950 0x7fe3a0138ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe39e59c640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 msgr2=0x7fe3a01ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe39e59c640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 0x7fe3a01ce390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3900097c0 tx=0x7fe3900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe390041020 con 0x7fe3a00a57c0 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: dump: 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe390003c50 con 0x7fe3a00a57c0 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 5 monclient: authenticate success, global_id 4500 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe390037040 con 0x7fe3a00a57c0 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 10 monclient: _renew_subs 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a0126490 con 0x7fe3a00a57c0 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe39d59a640 4 set_mon_vals no callback set 2024-08-19T11:11:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3977fe640 10 monclient: dump: 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 10 monclient: _renew_subs 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a0124130 con 0x7fe3a00a57c0 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.230+0000 7fe3a4d7f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 0x7fe3a002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a006a590 con 0x7fe3a0122f90 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe390044020 con 0x7fe3a00a57c0 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 0x7fe3a002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient: get_auth_request con 0x7fe3a0122f90 auth_method 0 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe3977fe640 1 --2- 172.21.15.71:0/739895222 >> v2:172.21.15.135:6800/726754104 conn(0x7fe38003ea80 0x7fe380040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 10 monclient(hunting): handle_auth_done global_id 4628 payload 824 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe395d9b640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3a0068d30 con 0x7fe3a0122f90 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3534+0+0 (secure 0 0 0) 0x7fe390071d50 con 0x7fe3a00a57c0 2024-08-19T11:11:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe39ed9d640 1 --2- 172.21.15.71:0/739895222 >> v2:172.21.15.135:6800/726754104 conn(0x7fe38003ea80 0x7fe380040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.231+0000 7fe39ed9d640 10 monclient: get_auth_request con 0x7fe38003ea80 auth_method 0 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.233+0000 7fe395d9b640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 msgr2=0x7fe3a002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.233+0000 7fe395d9b640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 0x7fe3a002d1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3a01247a0 tx=0x7fe38800f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.233+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe388019070 con 0x7fe3a0122f90 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.233+0000 7fe3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.233+0000 7fe3977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.233+0000 7fe3977fe640 10 monclient: dump: 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe388004240 con 0x7fe3a0122f90 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 msgr2=0x7fe3a002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 0x7fe3a002d1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3a01247a0 tx=0x7fe38800f610 comp rx=0 tx=0).stop 2024-08-19T11:11:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 msgr2=0x7fe3a002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe3977fe640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0122f90 0x7fe3a002d1c0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3a01247a0 tx=0x7fe38800f610 comp rx=0 tx=0).stop 2024-08-19T11:11:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.234+0000 7fe39ed9d640 1 --2- 172.21.15.71:0/739895222 >> v2:172.21.15.135:6800/726754104 conn(0x7fe38003ea80 0x7fe380040f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe398007130 tx=0x7fe398007080 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe3a4d7f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:11.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 0x7fe3a002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe3a4d7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a0125e30 con 0x7fe3a0123370 2024-08-19T11:11:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 0x7fe3a002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient: get_auth_request con 0x7fe3a0123370 auth_method 0 2024-08-19T11:11:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 10 monclient(hunting): handle_auth_done global_id 4637 payload 824 2024-08-19T11:11:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.240+0000 7fe395d9b640 1 -- 172.21.15.71:0/739895222 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3a00a6d30 con 0x7fe3a0123370 2024-08-19T11:11:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.242+0000 7fe395d9b640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 msgr2=0x7fe3a002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.242+0000 7fe395d9b640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 0x7fe3a002d700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe38801b000 tx=0x7fe3880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.242+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe388019040 con 0x7fe3a0123370 2024-08-19T11:11:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.242+0000 7fe3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 10 monclient: dump: 2024-08-19T11:11:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.267 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9255 (secure 0 0 0) 0x7fe3880044d0 con 0x7fe3a0123370 2024-08-19T11:11:11.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:11.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:11.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 msgr2=0x7fe3a002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 0x7fe3a002d700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe38801b000 tx=0x7fe3880046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 msgr2=0x7fe3a002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3977fe640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe3a0123370 0x7fe3a002d700 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe38801b000 tx=0x7fe3880046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.269 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 68122, 2024-08-19T11:11:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:11.317 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:11.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 >> v2:172.21.15.135:6800/726754104 conn(0x7fe38003ea80 msgr2=0x7fe380040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/739895222 >> v2:172.21.15.135:6800/726754104 conn(0x7fe38003ea80 0x7fe380040f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe398007130 tx=0x7fe398007080 comp rx=0 tx=0).stop 2024-08-19T11:11:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 10 monclient: shutdown 2024-08-19T11:11:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 msgr2=0x7fe3a01ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 --2- 172.21.15.71:0/739895222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3a00a57c0 0x7fe3a01ce390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe3900097c0 tx=0x7fe3900046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe39ed9d640 1 -- 172.21.15.71:0/739895222 reap_dead start 2024-08-19T11:11:11.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe39ed9d640 1 -- 172.21.15.71:0/739895222 reap_dead start 2024-08-19T11:11:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 shutdown_connections 2024-08-19T11:11:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 >> 172.21.15.71:0/739895222 conn(0x7fe3a00abf50 msgr2=0x7fe3a00aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 shutdown_connections 2024-08-19T11:11:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.243+0000 7fe3a4d7f640 1 -- 172.21.15.71:0/739895222 wait complete. 2024-08-19T11:11:11.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:11.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-19T11:11:11.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:11:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.420+0000 7ff11229f640 10 monclient: get_monmap_and_config 2024-08-19T11:11:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.420+0000 7ff11229f640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.420+0000 7ff11229f640 10 monclient: monmap: 2024-08-19T11:11:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:11.421164+0000 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:11.421164+0000 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:11.424 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 Processor -- start 2024-08-19T11:11:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 -- start start 2024-08-19T11:11:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient: init 2024-08-19T11:11:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient: _add_conns ranks=[5,6,3,1,4,9,0,2,10,7,8] 2024-08-19T11:11:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 0x7ff10c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): picked mon.noname-h con 0x7ff10c0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff10c0a57c0 0x7ff10c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): picked mon.noname-d con 0x7ff10c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 0x7ff10c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): picked mon.noname-g con 0x7ff10c139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c0a5020 con 0x7ff10c139710 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff10c0a77b0 con 0x7ff10c0a6950 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff10c0a7d40 con 0x7ff10c0a57c0 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff11229f640 10 monclient(hunting): authenticate will time out at 729.462812s 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff10b7fe640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff10c0a57c0 msgr2=0x7ff10c0a7270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.421+0000 7ff10b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff10c0a57c0 0x7ff10c0a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:11.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 0x7ff10c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 0x7ff10c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 0x7ff10c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:35942/0 (socket says 172.21.15.71:35942) 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 0x7ff10c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:54588/0 (socket says 172.21.15.71:54588) 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 -- 172.21.15.71:0/862802196 learned_addr learned my addr 172.21.15.71:0/862802196 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): get_auth_request con 0x7ff10c139710 auth_method 0 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): get_auth_request con 0x7ff10c0a6950 auth_method 0 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient(hunting): handle_auth_done global_id 4530 payload 274 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 -- 172.21.15.71:0/862802196 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff10c0a57c0 msgr2=0x7ff10c0a7270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff10c0a57c0 0x7ff10c0a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 -- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 msgr2=0x7ff10c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 0x7ff10c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 monclient: found mon.noname-g 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff11083c640 1 -- 172.21.15.71:0/862802196 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c0a6380 con 0x7ff10c139710 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.422+0000 7ff10bfff640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 0x7ff10c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff11083c640 1 -- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 msgr2=0x7ff10c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff11083c640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 0x7ff10c139b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff104009eb0 tx=0x7ff10402a580 comp rx=0 tx=0).ready entity=mon.3 client_cookie=f5579f0fc1bcf86c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 1 -- 172.21.15.71:0/862802196 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff104036070 con 0x7ff10c139710 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: dump: 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.439 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 1 -- 172.21.15.71:0/862802196 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104007a70 con 0x7ff10c139710 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 1 -- 172.21.15.71:0/862802196 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff104007c60 con 0x7ff10c139710 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff11229f640 5 monclient: authenticate success, global_id 4530 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff11229f640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff11229f640 4 set_mon_vals no callback set 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:11:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.425+0000 7ff10affd640 10 monclient: dump: 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 10 monclient: shutdown 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 -- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 msgr2=0x7ff10c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 0x7ff10c139b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff104009eb0 tx=0x7ff10402a580 comp rx=0 tx=0).stop 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 -- 172.21.15.71:0/862802196 shutdown_connections 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c139710 0x7ff10c139b10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff10c0a57c0 0x7ff10c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 --2- 172.21.15.71:0/862802196 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff10c0a6950 0x7ff10c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 -- 172.21.15.71:0/862802196 >> 172.21.15.71:0/862802196 conn(0x7ff10c0abf50 msgr2=0x7ff10c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 -- 172.21.15.71:0/862802196 shutdown_connections 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 -- 172.21.15.71:0/862802196 wait complete. 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 10 monclient: monmap: 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.443 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.426+0000 7ff11229f640 1 Processor -- start 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 -- start start 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient: init 2024-08-19T11:11:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient: _add_conns ranks=[3,2,4,5,7,0,1,8,6] 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c0a57c0 0x7ff10c1ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): picked mon.noname-g con 0x7ff10c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10c0a6950 0x7ff10c138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): picked mon.noname-b con 0x7ff10c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c139710 0x7ff10c138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): picked mon.noname-c con 0x7ff10c139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c0a84c0 con 0x7ff10c0a6950 2024-08-19T11:11:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c0a3650 con 0x7ff10c0a57c0 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff10c0a8700 con 0x7ff10c139710 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11229f640 10 monclient(hunting): authenticate will time out at 729.468656s 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10c0a6950 0x7ff10c138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c139710 0x7ff10c138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10c0a6950 0x7ff10c138970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48110/0 (socket says 172.21.15.71:48110) 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): get_auth_request con 0x7ff10c139710 auth_method 0 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 1 -- 172.21.15.71:0/1070980832 learned_addr learned my addr 172.21.15.71:0/1070980832 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): get_auth_request con 0x7ff10c0a6950 auth_method 0 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff11083c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10bfff640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c0a57c0 0x7ff10c1ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10bfff640 10 monclient(hunting): get_auth_request con 0x7ff10c0a57c0 auth_method 0 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.427+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 10 monclient(hunting): handle_auth_done global_id 4459 payload 824 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c0a57c0 msgr2=0x7ff10c1ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff10c0a57c0 0x7ff10c1ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10c0a6950 msgr2=0x7ff10c138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10c0a6950 0x7ff10c138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 1 monclient: found mon.noname-c 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff11083c640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c13a270 con 0x7ff10c139710 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.428+0000 7ff10b7fe640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10c0a6950 0x7ff10c138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11083c640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c139710 msgr2=0x7ff10c138eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11083c640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c139710 0x7ff10c138eb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0a4a60 tx=0x7ff104004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff104040020 con 0x7ff10c139710 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: dump: 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.450 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 5 monclient: authenticate success, global_id 4459 2024-08-19T11:11:11.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104003ba0 con 0x7ff10c139710 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff104036040 con 0x7ff10c139710 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 10 monclient: _renew_subs 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c126050 con 0x7ff10c139710 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff10a7fc640 4 set_mon_vals no callback set 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff108ff9640 10 monclient: dump: 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.452 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 10 monclient: _renew_subs 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.430+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c123fd0 con 0x7ff10c139710 2024-08-19T11:11:11.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff11229f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff11229f640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 0x7ff10c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff10c06a590 con 0x7ff10c122d60 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff104043020 con 0x7ff10c139710 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 0x7ff10c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient: get_auth_request con 0x7ff10c122d60 auth_method 0 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff108ff9640 1 --2- 172.21.15.71:0/1070980832 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f803ea80 0x7ff0f8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(22..22 src has 1..22) ==== 3534+0+0 (secure 0 0 0) 0x7ff104072040 con 0x7ff10c139710 2024-08-19T11:11:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 10 monclient(hunting): handle_auth_done global_id 4468 payload 824 2024-08-19T11:11:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.431+0000 7ff10bfff640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff10c0a6d30 con 0x7ff10c122d60 2024-08-19T11:11:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.432+0000 7ff10b7fe640 1 --2- 172.21.15.71:0/1070980832 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f803ea80 0x7ff0f8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.432+0000 7ff10b7fe640 10 monclient: get_auth_request con 0x7ff0f803ea80 auth_method 0 2024-08-19T11:11:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.433+0000 7ff10bfff640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 msgr2=0x7ff10c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff10bfff640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 0x7ff10c02d1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0118e0 tx=0x7ff0fc011da0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0fc0148b0 con 0x7ff10c122d60 2024-08-19T11:11:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 10 monclient: dump: 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff0fc014440 con 0x7ff10c122d60 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 msgr2=0x7ff10c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 0x7ff10c02d1c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0118e0 tx=0x7ff0fc011da0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 msgr2=0x7ff10c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff108ff9640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c122d60 0x7ff10c02d1c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.434+0000 7ff10b7fe640 1 --2- 172.21.15.71:0/1070980832 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f803ea80 0x7ff0f8040f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff10c124640 tx=0x7ff100009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff11229f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff11229f640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 0x7ff10c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff11229f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff10c124b30 con 0x7ff10c125a90 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 0x7ff10c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient: get_auth_request con 0x7ff10c125a90 auth_method 0 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 10 monclient(hunting): handle_auth_done global_id 4477 payload 824 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.440+0000 7ff10bfff640 1 -- 172.21.15.71:0/1070980832 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff10c09e100 con 0x7ff10c125a90 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.442+0000 7ff10bfff640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 msgr2=0x7ff10c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.442+0000 7ff10bfff640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 0x7ff10c02d700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c00 tx=0x7ff0fc0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0fc022e00 con 0x7ff10c125a90 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 10 monclient: dump: 2024-08-19T11:11:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9255 (secure 0 0 0) 0x7ff0fc02c450 con 0x7ff10c125a90 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 msgr2=0x7ff10c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 0x7ff10c02d700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c00 tx=0x7ff0fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 msgr2=0x7ff10c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff108ff9640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c125a90 0x7ff10c02d700 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc000c00 tx=0x7ff0fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 68313, 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:11.464 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.465 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.466 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:11.467 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:11.468 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.469 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.473 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.475 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.478 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:11.481 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.482 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.483 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:11.484 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.485 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:11.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:11.487 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:11.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f803ea80 msgr2=0x7ff0f8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 --2- 172.21.15.71:0/1070980832 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f803ea80 0x7ff0f8040f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff10c124640 tx=0x7ff100009190 comp rx=0 tx=0).stop 2024-08-19T11:11:11.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 10 monclient: shutdown 2024-08-19T11:11:11.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c139710 msgr2=0x7ff10c138eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 --2- 172.21.15.71:0/1070980832 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff10c139710 0x7ff10c138eb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0a4a60 tx=0x7ff104004a40 comp rx=0 tx=0).stop 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11083c640 1 -- 172.21.15.71:0/1070980832 reap_dead start 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11083c640 1 -- 172.21.15.71:0/1070980832 reap_dead start 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 shutdown_connections 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 >> 172.21.15.71:0/1070980832 conn(0x7ff10c0abf50 msgr2=0x7ff10c0aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 shutdown_connections 2024-08-19T11:11:11.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.443+0000 7ff11229f640 1 -- 172.21.15.71:0/1070980832 wait complete. 2024-08-19T11:11:11.489 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:11.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-08-19T11:11:11.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.587+0000 7f38db355640 10 monclient: get_monmap_and_config 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.587+0000 7f38db355640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.587+0000 7f38db355640 10 monclient: monmap: 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:11.588183+0000 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:11.588183+0000 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:11.590 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 Processor -- start 2024-08-19T11:11:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 -- start start 2024-08-19T11:11:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient: init 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient: _add_conns ranks=[4,8,3,10,6,5,7,2,9,1,0] 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): picked mon.noname-c con 0x7f38d40a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 0x7f38d40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): picked mon.noname-e con 0x7f38d40a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38d4139710 0x7f38d4139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): picked mon.noname-g con 0x7f38d4139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f38d40a5020 con 0x7f38d4139710 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f38d40a77b0 con 0x7f38d40a6950 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f38d40a7d40 con 0x7f38d40a57c0 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38db355640 10 monclient(hunting): authenticate will time out at 729.629813s 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d88f0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 0x7f38d40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d40a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:57538/0 (socket says 172.21.15.71:57538) 2024-08-19T11:11:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d88f0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 0x7f38d40a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53332/0 (socket says 172.21.15.71:53332) 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 1 -- 172.21.15.71:0/2515086549 learned_addr learned my addr 172.21.15.71:0/2515086549 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 10 monclient(hunting): get_auth_request con 0x7f38d40a6950 auth_method 0 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d90f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d88f0640 10 monclient(hunting): get_auth_request con 0x7f38d40a57c0 auth_method 0 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d88f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d88f0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.588+0000 7f38d88f0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d98f2640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38d4139710 0x7f38d4139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d98f2640 10 monclient(hunting): get_auth_request con 0x7f38d4139710 auth_method 0 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d98f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d98f2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d98f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 10 monclient(hunting): handle_auth_done global_id 4454 payload 274 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 1 -- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 msgr2=0x7f38d40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d40a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 1 -- 172.21.15.71:0/2515086549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38d4139710 msgr2=0x7f38d4139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38d4139710 0x7f38d4139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 1 monclient: found mon.noname-e 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d88f0640 1 -- 172.21.15.71:0/2515086549 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d40a6380 con 0x7f38d40a57c0 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.589+0000 7f38d98f2640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38d4139710 0x7f38d4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38d88f0640 1 -- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 msgr2=0x7f38d40a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38d88f0640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 0x7f38d40a7270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f38c40097d0 tx=0x7f38c4029fb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=8b3f2f0f155aa1b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 1 -- 172.21.15.71:0/2515086549 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38c4037070 con 0x7f38d40a57c0 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: dump: 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 1 -- 172.21.15.71:0/2515086549 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c402ad10 con 0x7f38d40a57c0 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38db355640 5 monclient: authenticate success, global_id 4454 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38db355640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38db355640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 1 -- 172.21.15.71:0/2515086549 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38c4030c20 con 0x7f38d40a57c0 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38db355640 4 set_mon_vals no callback set 2024-08-19T11:11:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.592+0000 7f38cbfff640 10 monclient: dump: 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 10 monclient: shutdown 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 -- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 msgr2=0x7f38d40a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 0x7f38d40a7270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f38c40097d0 tx=0x7f38c4029fb0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 -- 172.21.15.71:0/2515086549 shutdown_connections 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38d4139710 0x7f38d4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d40a57c0 0x7f38d40a7270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 --2- 172.21.15.71:0/2515086549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 -- 172.21.15.71:0/2515086549 >> 172.21.15.71:0/2515086549 conn(0x7f38d40abf50 msgr2=0x7f38d40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 -- 172.21.15.71:0/2515086549 shutdown_connections 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.593+0000 7f38db355640 1 -- 172.21.15.71:0/2515086549 wait complete. 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 10 monclient: monmap: 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:11.604 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 1 Processor -- start 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 1 -- start start 2024-08-19T11:11:11.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 10 monclient: init 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 10 monclient: _add_conns ranks=[2,4,5,0,3,8,1,7,6] 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38d40a57c0 0x7f38d41ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 10 monclient(hunting): picked mon.noname-b con 0x7f38d40a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.594+0000 7f38db355640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d4138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): picked mon.noname-c con 0x7f38d40a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38d4139710 0x7f38d4139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): picked mon.noname-h con 0x7f38d4139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:11.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f38d40a84c0 con 0x7f38d40a57c0 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f38d40a3650 con 0x7f38d40a6950 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f38d40a8700 con 0x7f38d4139710 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d4138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38db355640 10 monclient(hunting): authenticate will time out at 729.636198s 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38d40a57c0 0x7f38d41ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d4138b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:57544/0 (socket says 172.21.15.71:57544) 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 -- 172.21.15.71:0/1346611229 learned_addr learned my addr 172.21.15.71:0/1346611229 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): get_auth_request con 0x7f38d40a6950 auth_method 0 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): get_auth_request con 0x7f38d40a57c0 auth_method 0 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38d4139710 0x7f38d4139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): get_auth_request con 0x7f38d4139710 auth_method 0 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d98f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient(hunting): handle_auth_done global_id 4495 payload 824 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38d4139710 msgr2=0x7f38d4139040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38d4139710 0x7f38d4139040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38d40a57c0 msgr2=0x7f38d41ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38d40a57c0 0x7f38d41ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 monclient: found mon.noname-c 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d88f0640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d41ce840 con 0x7f38d40a6950 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.595+0000 7f38d90f1640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38d40a57c0 0x7f38d41ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.598+0000 7f38d88f0640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 msgr2=0x7f38d4138b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.598+0000 7f38d88f0640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d4138b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38c4000c00 tx=0x7f38c40046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38c4037040 con 0x7f38d40a6950 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: dump: 2024-08-19T11:11:11.614 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.615 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c4042070 con 0x7f38d40a6950 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38db355640 5 monclient: authenticate success, global_id 4495 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38c4003bd0 con 0x7f38d40a6950 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38db355640 10 monclient: _renew_subs 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38db355640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d40a2310 con 0x7f38d40a6950 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38cb7fe640 4 set_mon_vals no callback set 2024-08-19T11:11:11.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.599+0000 7f38c9ffb640 10 monclient: dump: 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.617 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.600+0000 7f38db355640 10 monclient: _renew_subs 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.600+0000 7f38db355640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.600+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d4124cc0 con 0x7f38d40a6950 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38db355640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f38c4032440 con 0x7f38d40a6950 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38db355640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 0x7f38d402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f38d406a590 con 0x7f38d4122f90 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 0x7f38d402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient: get_auth_request con 0x7f38d4122f90 auth_method 0 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38c9ffb640 1 --2- 172.21.15.71:0/1346611229 >> v2:172.21.15.135:6800/726754104 conn(0x7f38b803eab0 0x7f38b8040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d98f2640 1 --2- 172.21.15.71:0/1346611229 >> v2:172.21.15.135:6800/726754104 conn(0x7f38b803eab0 0x7f38b8040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d98f2640 10 monclient: get_auth_request con 0x7f38b803eab0 auth_method 0 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 10 monclient(hunting): handle_auth_done global_id 4463 payload 824 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.601+0000 7f38d90f1640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38d413a270 con 0x7f38d4122f90 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.603+0000 7f38d90f1640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 msgr2=0x7f38d402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.603+0000 7f38d90f1640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 0x7f38d402d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38d0011d20 tx=0x7f38d000f610 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.604+0000 7f38d98f2640 1 --2- 172.21.15.71:0/1346611229 >> v2:172.21.15.135:6800/726754104 conn(0x7f38b803eab0 0x7f38b8040f70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38d4074f90 tx=0x7f38cc0097d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.608+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38d0014ac0 con 0x7f38d4122f90 2024-08-19T11:11:11.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 10 monclient: dump: 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f38d0014c60 con 0x7f38d4122f90 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 msgr2=0x7f38d402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 0x7f38d402d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38d0011d20 tx=0x7f38d000f610 comp rx=0 tx=0).stop 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 msgr2=0x7f38d402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4122f90 0x7f38d402d1c0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38d0011d20 tx=0x7f38d000f610 comp rx=0 tx=0).stop 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.609+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(23..23 src has 1..23) ==== 3926+0+0 (secure 0 0 0) 0x7f38c4003d70 con 0x7f38d40a6950 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38db355640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38db355640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 0x7f38d402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38db355640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f38d4076c60 con 0x7f38d4123370 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 0x7f38d402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient: get_auth_request con 0x7f38d4123370 auth_method 0 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 10 monclient(hunting): handle_auth_done global_id 4472 payload 824 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.617+0000 7f38d90f1640 1 -- 172.21.15.71:0/1346611229 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f38d40a1ff0 con 0x7f38d4123370 2024-08-19T11:11:11.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38d90f1640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 msgr2=0x7f38d402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38d90f1640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 0x7f38d402d700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38d0011cf0 tx=0x7f38d00046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38d0022570 con 0x7f38d4123370 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 10 monclient: dump: 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.628 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9422 (secure 0 0 0) 0x7f38d002c430 con 0x7f38d4123370 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 msgr2=0x7f38d402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 0x7f38d402d700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38d0011cf0 tx=0x7f38d00046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 msgr2=0x7f38d402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.620+0000 7f38c9ffb640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f38d4123370 0x7f38d402d700 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38d0011cf0 tx=0x7f38d00046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 68490, 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:11.630 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.631 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.632 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:11.633 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.635 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:11.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.639 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:11.641 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.644 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.645 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.647 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.651 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.652 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:11.653 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 >> v2:172.21.15.135:6800/726754104 conn(0x7f38b803eab0 msgr2=0x7f38b8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 --2- 172.21.15.71:0/1346611229 >> v2:172.21.15.135:6800/726754104 conn(0x7f38b803eab0 0x7f38b8040f70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38d4074f90 tx=0x7f38cc0097d0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 10 monclient: shutdown 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 msgr2=0x7f38d4138b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 --2- 172.21.15.71:0/1346611229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f38d40a6950 0x7f38d4138b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38c4000c00 tx=0x7f38c40046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38d98f2640 1 -- 172.21.15.71:0/1346611229 reap_dead start 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38d98f2640 1 -- 172.21.15.71:0/1346611229 reap_dead start 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 shutdown_connections 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 >> 172.21.15.71:0/1346611229 conn(0x7f38d40abf50 msgr2=0x7f38d40aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 shutdown_connections 2024-08-19T11:11:11.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.621+0000 7f38db355640 1 -- 172.21.15.71:0/1346611229 wait complete. 2024-08-19T11:11:11.656 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:11.656 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-19T11:11:11.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.753+0000 7f26dc484640 10 monclient: get_monmap_and_config 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.753+0000 7f26dc484640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.753+0000 7f26dc484640 10 monclient: monmap: 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:11.753928+0000 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:11.753928+0000 2024-08-19T11:11:11.754 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.755 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:11.756 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:11.756 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.753+0000 7f26dc484640 1 Processor -- start 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.753+0000 7f26dc484640 1 -- start start 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.753+0000 7f26dc484640 10 monclient: init 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient: _add_conns ranks=[7,5,1,4,10,0,6,8,2,3,9] 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f26d40a57d0 0x7f26d40a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): picked mon.noname-i con 0x7f26d40a57d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 0x7f26d40a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): picked mon.noname-h con 0x7f26d40a5bb0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f26d4137580 addr v1:172.21.15.135:6789/0 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d40728a0 con 0x7f26d4137580 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f26d40a41b0 con 0x7f26d40a5bb0 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f26d4072620 con 0x7f26d40a57d0 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26dc484640 10 monclient(hunting): authenticate will time out at 729.795588s 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 0x7f26d40a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26daa21640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f26d4137580 0x7f26d4137a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:45026/0 (socket says 172.21.15.71:45026) 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26daa21640 1 -- 172.21.15.71:0/16516785 learned_addr learned my addr 172.21.15.71:0/16516785 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): get_auth_request con 0x7f26d40a5bb0 auth_method 0 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f26d40a57d0 0x7f26d40a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 10 monclient(hunting): get_auth_request con 0x7f26d40a57d0 auth_method 0 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26d9a1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.754+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 10 monclient(hunting): handle_auth_done global_id 14504 payload 274 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 1 -- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f26d40a57d0 msgr2=0x7f26d40a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f26d40a57d0 0x7f26d40a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 1 -- 172.21.15.71:0/16516785 >> v1:172.21.15.135:6789/0 conn(0x7f26d4137580 legacy=0x7f26d4137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 1 monclient: found mon.noname-h 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26d9a1f640 1 -- 172.21.15.71:0/16516785 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d4073940 con 0x7f26d40a5bb0 2024-08-19T11:11:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.755+0000 7f26da220640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f26d40a57d0 0x7f26d40a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.757+0000 7f26d9a1f640 1 -- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 msgr2=0x7f26d40a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.757+0000 7f26d9a1f640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 0x7f26d40a5fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009dc0 tx=0x7f26c802a510 comp rx=0 tx=0).ready entity=mon.5 client_cookie=4f723633e8c19f1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 1 -- 172.21.15.71:0/16516785 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26c8007bc0 con 0x7f26d40a5bb0 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: dump: 2024-08-19T11:11:11.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 1 -- 172.21.15.71:0/16516785 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c8007d80 con 0x7f26d40a5bb0 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 5 monclient: authenticate success, global_id 14504 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 4 set_mon_vals no callback set 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 1 -- 172.21.15.71:0/16516785 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26c8031870 con 0x7f26d40a5bb0 2024-08-19T11:11:11.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26d921e640 10 monclient: dump: 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.768 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 10 monclient: shutdown 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 -- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 msgr2=0x7f26d40a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 0x7f26d40a5fb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009dc0 tx=0x7f26c802a510 comp rx=0 tx=0).stop 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 -- 172.21.15.71:0/16516785 shutdown_connections 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a5bb0 0x7f26d40a5fb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 --2- 172.21.15.71:0/16516785 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f26d40a57d0 0x7f26d40a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 -- 172.21.15.71:0/16516785 >> 172.21.15.71:0/16516785 conn(0x7f26d40aa3f0 msgr2=0x7f26d40a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 -- 172.21.15.71:0/16516785 shutdown_connections 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.758+0000 7f26dc484640 1 -- 172.21.15.71:0/16516785 wait complete. 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.759+0000 7f26dc484640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.759+0000 7f26dc484640 10 monclient: monmap: 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:11.770 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.759+0000 7f26dc484640 1 Processor -- start 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.759+0000 7f26dc484640 1 -- start start 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.759+0000 7f26dc484640 10 monclient: init 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient: _add_conns ranks=[5,6,4,0,8,1,3,7,2] 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a57d0 0x7f26d4136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): picked mon.noname-h con 0x7f26d40a57d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26d40a5bb0 0x7f26d4136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): picked mon.noname-d con 0x7f26d40a5bb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 0x7f26d4120410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): picked mon.noname-c con 0x7f26d4137580 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f26d4138110 con 0x7f26d4137580 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f26d40a64f0 con 0x7f26d40a57d0 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f26d4138290 con 0x7f26d40a5bb0 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26dc484640 10 monclient(hunting): authenticate will time out at 729.801311s 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26d9a1f640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26d40a5bb0 msgr2=0x7f26d4136c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26d9a1f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26d40a5bb0 0x7f26d4136c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 0x7f26d4120410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 0x7f26d4120410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:57558/0 (socket says 172.21.15.71:57558) 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 learned_addr learned my addr 172.21.15.71:0/1825031004 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): get_auth_request con 0x7f26d4137580 auth_method 0 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a57d0 0x7f26d4136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): get_auth_request con 0x7f26d40a57d0 auth_method 0 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient(hunting): handle_auth_done global_id 4504 payload 824 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26d40a5bb0 msgr2=0x7f26d4136c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26d40a5bb0 0x7f26d4136c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a57d0 msgr2=0x7f26d4136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26d40a57d0 0x7f26d4136750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 monclient: found mon.noname-c 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.760+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d40a33c0 con 0x7f26d4137580 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.762+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 msgr2=0x7f26d4120410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.762+0000 7f26daa21640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 0x7f26d4120410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26c400b410 tx=0x7f26c4009f90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26c4015020 con 0x7f26d4137580 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: dump: 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c4011cb0 con 0x7f26d4137580 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 5 monclient: authenticate success, global_id 4504 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26c40107f0 con 0x7f26d4137580 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d2ffd640 10 monclient: dump: 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 10 monclient: _renew_subs 2024-08-19T11:11:11.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26d8a1d640 4 set_mon_vals no callback set 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d4124110 con 0x7f26d4137580 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 10 monclient: _renew_subs 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.765+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d4121db0 con 0x7f26d4137580 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26dc484640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26dc484640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 0x7f26d4120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26d406a590 con 0x7f26d4120950 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f26c4018020 con 0x7f26d4137580 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 0x7f26d4120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient: get_auth_request con 0x7f26d4120950 auth_method 0 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26d2ffd640 1 --2- 172.21.15.71:0/1825031004 >> v2:172.21.15.135:6800/726754104 conn(0x7f26c003ea80 0x7f26c0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(23..23 src has 1..23) ==== 3926+0+0 (secure 0 0 0) 0x7f26c4051500 con 0x7f26d4137580 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26d9a1f640 1 --2- 172.21.15.71:0/1825031004 >> v2:172.21.15.135:6800/726754104 conn(0x7f26c003ea80 0x7f26c0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 10 monclient(hunting): handle_auth_done global_id 4492 payload 824 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26da220640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26d4121270 con 0x7f26d4120950 2024-08-19T11:11:11.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.766+0000 7f26d9a1f640 10 monclient: get_auth_request con 0x7f26c003ea80 auth_method 0 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26da220640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 msgr2=0x7f26d4120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26da220640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 0x7f26d4120d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0118e0 tx=0x7f26cc011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26cc0148b0 con 0x7f26d4120950 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d9a1f640 1 --2- 172.21.15.71:0/1825031004 >> v2:172.21.15.135:6800/726754104 conn(0x7f26c003ea80 0x7f26c0040f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26c8034000 tx=0x7f26c802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 10 monclient: dump: 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.785 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f26cc014440 con 0x7f26d4120950 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 msgr2=0x7f26d4120d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 0x7f26d4120d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0118e0 tx=0x7f26cc011da0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 msgr2=0x7f26d4120d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.769+0000 7f26d2ffd640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d4120950 0x7f26d4120d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.775+0000 7f26dc484640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.775+0000 7f26dc484640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 0x7f26d409cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.775+0000 7f26dc484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.775+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4076c60 con 0x7f26d409c9f0 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 0x7f26d409cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient: get_auth_request con 0x7f26d409c9f0 auth_method 0 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 10 monclient(hunting): handle_auth_done global_id 4501 payload 824 2024-08-19T11:11:11.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.776+0000 7f26da220640 1 -- 172.21.15.71:0/1825031004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f26d40a1780 con 0x7f26d409c9f0 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.778+0000 7f26da220640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 msgr2=0x7f26d409cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.778+0000 7f26da220640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 0x7f26d409cdd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0118e0 tx=0x7f26cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26cc022e00 con 0x7f26d409c9f0 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 10 monclient: dump: 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.789 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.790 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9422 (secure 0 0 0) 0x7f26cc022990 con 0x7f26d409c9f0 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 msgr2=0x7f26d409cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 0x7f26d409cdd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0118e0 tx=0x7f26cc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 msgr2=0x7f26d409cdd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26d2ffd640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26d409c9f0 0x7f26d409cdd0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0118e0 tx=0x7f26cc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:11.791 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 68618, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:11.792 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.793 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.794 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:11.795 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.796 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:11.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:11.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:11.801 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.802 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.804 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.810 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.812 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.813 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.814 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:11.815 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 >> v2:172.21.15.135:6800/726754104 conn(0x7f26c003ea80 msgr2=0x7f26c0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 --2- 172.21.15.71:0/1825031004 >> v2:172.21.15.135:6800/726754104 conn(0x7f26c003ea80 0x7f26c0040f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26c8034000 tx=0x7f26c802f000 comp rx=0 tx=0).stop 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 10 monclient: shutdown 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 msgr2=0x7f26d4120410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 --2- 172.21.15.71:0/1825031004 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f26d4137580 0x7f26d4120410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26c400b410 tx=0x7f26c4009f90 comp rx=0 tx=0).stop 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 reap_dead start 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26daa21640 1 -- 172.21.15.71:0/1825031004 reap_dead start 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 shutdown_connections 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 >> 172.21.15.71:0/1825031004 conn(0x7f26d40aa3f0 msgr2=0x7f26d40a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 shutdown_connections 2024-08-19T11:11:11.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.779+0000 7f26dc484640 1 -- 172.21.15.71:0/1825031004 wait complete. 2024-08-19T11:11:11.817 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:11.817 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-19T11:11:11.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.914+0000 7f7e31b9a640 10 monclient: get_monmap_and_config 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.914+0000 7f7e31b9a640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.915+0000 7f7e31b9a640 10 monclient: monmap: 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:11.915622+0000 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:11.915622+0000 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:11.916 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:11.917 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.915+0000 7f7e31b9a640 1 Processor -- start 2024-08-19T11:11:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.915+0000 7f7e31b9a640 1 -- start start 2024-08-19T11:11:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.915+0000 7f7e31b9a640 10 monclient: init 2024-08-19T11:11:11.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient: _add_conns ranks=[1,0,8,2,10,6,3,4,5,7,9] 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7e2c0a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7e2c0a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 0x7f7e2c142290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient(hunting): picked mon.noname-e con 0x7f7e2c0a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0a6380 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0a3650 con 0x7f7e2c0a6950 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a5020 con 0x7f7e2c0a7440 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e31b9a640 10 monclient(hunting): authenticate will time out at 729.957313s 2024-08-19T11:11:11.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 0x7f7e2c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2affd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7e2c0a57c0 0x7f7e2c13eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40260/0 (socket says 172.21.15.71:40260) 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2affd640 1 -- 172.21.15.71:0/376923771 learned_addr learned my addr 172.21.15.71:0/376923771 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a7440 auth_method 0 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_done global_id 4481 payload 274 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 1 -- 172.21.15.71:0/376923771 >> v1:172.21.15.135:6789/0 conn(0x7f7e2c0a6950 legacy=0x7f7e2c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 1 -- 172.21.15.71:0/376923771 >> v1:172.21.15.71:6789/0 conn(0x7f7e2c0a57c0 legacy=0x7f7e2c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 1 monclient: found mon.noname-e 2024-08-19T11:11:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.916+0000 7f7e2bfff640 1 -- 172.21.15.71:0/376923771 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0a84c0 con 0x7f7e2c0a7440 2024-08-19T11:11:11.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2bfff640 1 -- 172.21.15.71:0/376923771 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 msgr2=0x7f7e2c142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2bfff640 1 --2- 172.21.15.71:0/376923771 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 0x7f7e2c142290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e240097d0 tx=0x7f7e24029fb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=45bedabed31c04b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 1 -- 172.21.15.71:0/376923771 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e24037070 con 0x7f7e2c0a7440 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: dump: 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.929 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e31b9a640 5 monclient: authenticate success, global_id 4481 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e31b9a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 1 -- 172.21.15.71:0/376923771 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2402adf0 con 0x7f7e2c0a7440 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e31b9a640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e31b9a640 4 set_mon_vals no callback set 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 1 -- 172.21.15.71:0/376923771 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e24030c20 con 0x7f7e2c0a7440 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.919+0000 7f7e2a7fc640 10 monclient: dump: 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.931 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.932 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 10 monclient: shutdown 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 -- 172.21.15.71:0/376923771 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 msgr2=0x7f7e2c142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 --2- 172.21.15.71:0/376923771 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 0x7f7e2c142290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e240097d0 tx=0x7f7e24029fb0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 -- 172.21.15.71:0/376923771 shutdown_connections 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 --2- 172.21.15.71:0/376923771 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a7440 0x7f7e2c142290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 -- 172.21.15.71:0/376923771 >> 172.21.15.71:0/376923771 conn(0x7f7e2c0abf50 msgr2=0x7f7e2c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 -- 172.21.15.71:0/376923771 shutdown_connections 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 1 -- 172.21.15.71:0/376923771 wait complete. 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 10 monclient: build_initial_monmap 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.920+0000 7f7e31b9a640 10 monclient: monmap: 2024-08-19T11:11:11.933 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:11.934 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 Processor -- start 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 -- start start 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient: init 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient: _add_conns ranks=[8,4,2,1,6,0,5,7,3] 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 0x7f7e2c128c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): picked mon.noname-e con 0x7f7e2c0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7e2c0a6950 0x7f7e2c1cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): picked mon.noname-c con 0x7f7e2c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e2c0a7440 0x7f7e2c1267d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): picked mon.noname-b con 0x7f7e2c0a7440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a8700 con 0x7f7e2c0a7440 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7e2c0a7d40 con 0x7f7e2c0a6950 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7e2c1427d0 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e31b9a640 10 monclient(hunting): authenticate will time out at 729.962892s 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.921+0000 7f7e2b7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 0x7f7e2c128c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 0x7f7e2c128c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53384/0 (socket says 172.21.15.71:53384) 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7e2c0a6950 0x7f7e2c1cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 -- 172.21.15.71:0/1923694354 learned_addr learned my addr 172.21.15.71:0/1923694354 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a57c0 auth_method 0 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e2c0a7440 0x7f7e2c1267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a6950 auth_method 0 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): get_auth_request con 0x7f7e2c0a7440 auth_method 0 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient(hunting): handle_auth_done global_id 4490 payload 824 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7e2c0a6950 msgr2=0x7f7e2c1cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7e2c0a6950 0x7f7e2c1cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e2c0a7440 msgr2=0x7f7e2c1267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e2c0a7440 0x7f7e2c1267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 monclient: found mon.noname-e 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2b7fe640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c12a180 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.922+0000 7f7e2bfff640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7e2c0a7440 0x7f7e2c1267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e2b7fe640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 msgr2=0x7f7e2c128c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e2b7fe640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 0x7f7e2c128c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c7f0 tx=0x7f7e1c00ccb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e1c016020 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: dump: 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.939 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.940 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: _finish_auth 0 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c012420 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 5 monclient: authenticate success, global_id 4490 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 10 monclient: _renew_subs 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c0a25c0 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e1c012a40 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e13fff640 10 monclient: dump: 2024-08-19T11:11:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 10 monclient: _renew_subs 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c0a9540 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.924+0000 7f7e29ffb640 4 set_mon_vals no callback set 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e31b9a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e31b9a640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 0x7f7e2c126d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e31b9a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c076c60 con 0x7f7e2c1cf350 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7e1c019020 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e2affd640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 0x7f7e2c126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e13fff640 1 --2- 172.21.15.71:0/1923694354 >> v2:172.21.15.135:6800/726754104 conn(0x7f7e1803ea80 0x7f7e18040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.925+0000 7f7e2affd640 10 monclient: get_auth_request con 0x7f7e2c1cf350 auth_method 0 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(23..23 src has 1..23) ==== 3926+0+0 (secure 0 0 0) 0x7f7e1c051be0 con 0x7f7e2c0a57c0 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2bfff640 1 --2- 172.21.15.71:0/1923694354 >> v2:172.21.15.135:6800/726754104 conn(0x7f7e1803ea80 0x7f7e18040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2bfff640 10 monclient: get_auth_request con 0x7f7e1803ea80 auth_method 0 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 10 monclient(hunting): handle_auth_done global_id 4557 payload 824 2024-08-19T11:11:11.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.926+0000 7f7e2affd640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e2c0a22a0 con 0x7f7e2c1cf350 2024-08-19T11:11:11.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e2affd640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 msgr2=0x7f7e2c126d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e2affd640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 0x7f7e2c126d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007fd0 tx=0x7f7e2000ef00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e2bfff640 1 --2- 172.21.15.71:0/1923694354 >> v2:172.21.15.135:6800/726754104 conn(0x7f7e1803ea80 0x7f7e18040f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7e24034000 tx=0x7f7e2402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e2001a070 con 0x7f7e2c1cf350 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e13fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.928+0000 7f7e13fff640 10 monclient: dump: 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.947 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7e2000cc50 con 0x7f7e2c1cf350 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:11.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 msgr2=0x7f7e2c126d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 0x7f7e2c126d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007fd0 tx=0x7f7e2000ef00 comp rx=0 tx=0).stop 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 msgr2=0x7f7e2c126d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.929+0000 7f7e13fff640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c1cf350 0x7f7e2c126d10 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007fd0 tx=0x7f7e2000ef00 comp rx=0 tx=0).stop 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e31b9a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e31b9a640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 0x7f7e2c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e31b9a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c127660 con 0x7f7e2c127250 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 0x7f7e2c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient: get_auth_request con 0x7f7e2c127250 auth_method 0 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:11.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 10 monclient(hunting): handle_auth_done global_id 4566 payload 824 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.935+0000 7f7e2affd640 1 -- 172.21.15.71:0/1923694354 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7e2c0a6d30 con 0x7f7e2c127250 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e2affd640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 msgr2=0x7f7e2c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e2affd640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 0x7f7e2c1225a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e20017000 tx=0x7f7e20004940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7e2001a070 con 0x7f7e2c127250 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 10 monclient: dump: 2024-08-19T11:11:11.950 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:11.951 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9589 (secure 0 0 0) 0x7f7e2001b040 con 0x7f7e2c127250 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 msgr2=0x7f7e2c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 0x7f7e2c1225a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e20017000 tx=0x7f7e20004940 comp rx=0 tx=0).stop 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 msgr2=0x7f7e2c1225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.938+0000 7f7e13fff640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e2c127250 0x7f7e2c1225a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.952 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 68790, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:11.976 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:11.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 >> v2:172.21.15.135:6800/726754104 conn(0x7f7e1803ea80 msgr2=0x7f7e18040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 --2- 172.21.15.71:0/1923694354 >> v2:172.21.15.135:6800/726754104 conn(0x7f7e1803ea80 0x7f7e18040f40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7e24034000 tx=0x7f7e2402e000 comp rx=0 tx=0).stop 2024-08-19T11:11:11.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 10 monclient: shutdown 2024-08-19T11:11:11.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 msgr2=0x7f7e2c128c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 --2- 172.21.15.71:0/1923694354 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7e2c0a57c0 0x7f7e2c128c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c7f0 tx=0x7f7e1c00ccb0 comp rx=0 tx=0).stop 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e2bfff640 1 -- 172.21.15.71:0/1923694354 reap_dead start 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e2bfff640 1 -- 172.21.15.71:0/1923694354 reap_dead start 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 shutdown_connections 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 >> 172.21.15.71:0/1923694354 conn(0x7f7e2c0abf50 msgr2=0x7f7e2c09f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 shutdown_connections 2024-08-19T11:11:11.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:11.939+0000 7f7e31b9a640 1 -- 172.21.15.71:0/1923694354 wait complete. 2024-08-19T11:11:11.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:11.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-19T11:11:11.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:11:12.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.075+0000 7f7fb6904640 10 monclient: get_monmap_and_config 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.075+0000 7f7fb6904640 10 monclient: build_initial_monmap 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.075+0000 7f7fb6904640 10 monclient: monmap: 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:12.076530+0000 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:12.076530+0000 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.077 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:12.078 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.076+0000 7f7fb6904640 1 Processor -- start 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.076+0000 7f7fb6904640 1 -- start start 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.076+0000 7f7fb6904640 10 monclient: init 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient: _add_conns ranks=[0,4,1,5,6,9,3,8,7,10,2] 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7fb00a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 0x7f7fb013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient(hunting): picked mon.noname-c con 0x7f7fb00a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:12.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7fb00a7440 addr v1:172.21.15.135:6789/0 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb00a6380 con 0x7f7fb00a6950 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb00a3650 con 0x7f7fb00a7440 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7fb00a5020 con 0x7f7fb00a57c0 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7fb6904640 10 monclient(hunting): authenticate will time out at 730.118255s 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 0x7f7fb013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faffff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7fb00a6950 0x7f7fb00a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40270/0 (socket says 172.21.15.71:40270) 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faffff640 1 -- 172.21.15.71:0/3631482365 learned_addr learned my addr 172.21.15.71:0/3631482365 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): get_auth_request con 0x7f7fb00a57c0 auth_method 0 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_done global_id 4522 payload 274 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 1 -- 172.21.15.71:0/3631482365 >> v1:172.21.15.135:6789/0 conn(0x7f7fb00a7440 legacy=0x7f7fb01410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 1 -- 172.21.15.71:0/3631482365 >> v1:172.21.15.71:6789/0 conn(0x7f7fb00a6950 legacy=0x7f7fb00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 1 monclient: found mon.noname-c 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.077+0000 7f7faf7fe640 1 -- 172.21.15.71:0/3631482365 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb00a84c0 con 0x7f7fb00a57c0 2024-08-19T11:11:12.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faf7fe640 1 -- 172.21.15.71:0/3631482365 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 msgr2=0x7f7fb013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faf7fe640 1 --2- 172.21.15.71:0/3631482365 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 0x7f7fb013eb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40097d0 tx=0x7f7fa4029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=1e2ffd14c86147b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 1 -- 172.21.15.71:0/3631482365 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7fa4037070 con 0x7f7fb00a57c0 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: dump: 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.086 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: _finish_auth 0 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7fb6904640 5 monclient: authenticate success, global_id 4522 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 1 -- 172.21.15.71:0/3631482365 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa402adf0 con 0x7f7fb00a57c0 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7fb6904640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7fb6904640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7fb6904640 4 set_mon_vals no callback set 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 1 -- 172.21.15.71:0/3631482365 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7fa4030c20 con 0x7f7fb00a57c0 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.080+0000 7f7faeffd640 10 monclient: dump: 2024-08-19T11:11:12.088 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.089 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 10 monclient: shutdown 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 -- 172.21.15.71:0/3631482365 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 msgr2=0x7f7fb013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 --2- 172.21.15.71:0/3631482365 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 0x7f7fb013eb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40097d0 tx=0x7f7fa4029fb0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 -- 172.21.15.71:0/3631482365 shutdown_connections 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 --2- 172.21.15.71:0/3631482365 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7fb00a57c0 0x7f7fb013eb60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 -- 172.21.15.71:0/3631482365 >> 172.21.15.71:0/3631482365 conn(0x7f7fb00abf50 msgr2=0x7f7fb00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 -- 172.21.15.71:0/3631482365 shutdown_connections 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 1 -- 172.21.15.71:0/3631482365 wait complete. 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 10 monclient: build_initial_monmap 2024-08-19T11:11:12.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.081+0000 7f7fb6904640 10 monclient: monmap: 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:12.091 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:12.092 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 Processor -- start 2024-08-19T11:11:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 -- start start 2024-08-19T11:11:12.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient: init 2024-08-19T11:11:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient: _add_conns ranks=[7,2,8,5,0,6,1,3,4] 2024-08-19T11:11:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7fb00a57c0 0x7f7fb0128b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): picked mon.noname-i con 0x7f7fb00a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 0x7f7fb01cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): picked mon.noname-b con 0x7f7fb00a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7fb00a7440 0x7f7fb0126660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): picked mon.noname-e con 0x7f7fb00a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb00a8700 con 0x7f7fb00a6950 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7fb00a7d40 con 0x7f7fb00a57c0 2024-08-19T11:11:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7fb01427d0 con 0x7f7fb00a7440 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb6904640 10 monclient(hunting): authenticate will time out at 730.123784s 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 0x7f7fb01cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb4ea1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7fb00a7440 0x7f7fb0126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 0x7f7fb01cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48144/0 (socket says 172.21.15.71:48144) 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 1 -- 172.21.15.71:0/921238202 learned_addr learned my addr 172.21.15.71:0/921238202 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 10 monclient(hunting): get_auth_request con 0x7f7fb00a6950 auth_method 0 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb4ea1640 10 monclient(hunting): get_auth_request con 0x7f7fb00a7440 auth_method 0 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb4ea1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb4ea1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.082+0000 7f7fb4ea1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7fb4ea1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7fb4ea1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7fb00a57c0 0x7f7fb0128b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7fb4ea1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): get_auth_request con 0x7f7fb00a57c0 auth_method 0 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 10 monclient(hunting): handle_auth_done global_id 4673 payload 824 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7fb00a7440 msgr2=0x7f7fb0126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7fb00a7440 0x7f7fb0126660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7fb00a57c0 msgr2=0x7f7fb0128b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7fb00a57c0 0x7f7fb0128b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:11:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 1 monclient: found mon.noname-b 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7faf7fe640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb012a0b0 con 0x7f7fb00a6950 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.083+0000 7f7fb4ea1640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7fb00a7440 0x7f7fb0126660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7faf7fe640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 msgr2=0x7f7fb01cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7faf7fe640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 0x7f7fb01cecb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4035040 tx=0x7f7fa40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7fa4041020 con 0x7f7fb00a6950 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: dump: 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: _finish_auth 0 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: _check_auth_tickets 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa4003bd0 con 0x7f7fb00a6950 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 5 monclient: authenticate success, global_id 4673 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 10 monclient: _renew_subs 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb012a390 con 0x7f7fb00a6950 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7fa4037040 con 0x7f7fb00a6950 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7facff9640 10 monclient: dump: 2024-08-19T11:11:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.106 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 10 monclient: _renew_subs 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb0129520 con 0x7f7fb00a6950 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.085+0000 7f7fae7fc640 4 set_mon_vals no callback set 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7fb6904640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7fb6904640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 0x7f7fb0126ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7fb6904640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7fb0076c60 con 0x7f7fb01cf1f0 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7fa4044020 con 0x7f7fb00a6950 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 0x7f7fb0126ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient: get_auth_request con 0x7f7fb01cf1f0 auth_method 0 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7facff9640 1 --2- 172.21.15.71:0/921238202 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f9c03ea80 0x7f7f9c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 3926+0+0 (secure 0 0 0) 0x7f7fa4071f90 con 0x7f7fb00a6950 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7fb4ea1640 1 --2- 172.21.15.71:0/921238202 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f9c03ea80 0x7f7f9c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7fb4ea1640 10 monclient: get_auth_request con 0x7f7f9c03ea80 auth_method 0 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 10 monclient(hunting): handle_auth_done global_id 14522 payload 824 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.086+0000 7f7faffff640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fb00a6d30 con 0x7f7fb01cf1f0 2024-08-19T11:11:12.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7faffff640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 msgr2=0x7f7fb0126ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7faffff640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 0x7f7fb0126ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000ea70 tx=0x7f7fa000ef30 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7fb4ea1640 1 --2- 172.21.15.71:0/921238202 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f9c03ea80 0x7f7f9c040f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800a770 tx=0x7f7fa800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7fa001a070 con 0x7f7fb01cf1f0 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 10 monclient: dump: 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.109 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7fa000cc50 con 0x7f7fb01cf1f0 2024-08-19T11:11:12.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 msgr2=0x7f7fb0126ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 0x7f7fb0126ba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000ea70 tx=0x7f7fa000ef30 comp rx=0 tx=0).stop 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 msgr2=0x7f7fb0126ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.089+0000 7f7facff9640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01cf1f0 0x7f7fb0126ba0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000ea70 tx=0x7f7fa000ef30 comp rx=0 tx=0).stop 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.095+0000 7f7fb6904640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7fb6904640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 0x7f7fb01225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7fb6904640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7fb01274f0 con 0x7f7fb01270e0 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 0x7f7fb01225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient: get_auth_request con 0x7f7fb01270e0 auth_method 0 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 10 monclient(hunting): handle_auth_done global_id 14531 payload 824 2024-08-19T11:11:12.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.096+0000 7f7faffff640 1 -- 172.21.15.71:0/921238202 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7fb00a25f0 con 0x7f7fb01270e0 2024-08-19T11:11:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.098+0000 7f7faffff640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 msgr2=0x7f7fb01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.098+0000 7f7faffff640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 0x7f7fb01225a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0017000 tx=0x7f7fa0004940 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7fa001a070 con 0x7f7fb01270e0 2024-08-19T11:11:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:11:12.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 10 monclient: dump: 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.114 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9422 (secure 0 0 0) 0x7f7fa001b040 con 0x7f7fb01270e0 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 msgr2=0x7f7fb01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 0x7f7fb01225a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0017000 tx=0x7f7fa0004940 comp rx=0 tx=0).stop 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 msgr2=0x7f7fb01225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:12.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7facff9640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7fb01270e0 0x7f7fb01225a0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0017000 tx=0x7f7fa0004940 comp rx=0 tx=0).stop 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 68952, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:12.116 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:12.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:12.118 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:12.119 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:12.120 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:12.121 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:12.123 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:12.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:12.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:12.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.132 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:12.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.138 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:12.139 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:12.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f9c03ea80 msgr2=0x7f7f9c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 --2- 172.21.15.71:0/921238202 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f9c03ea80 0x7f7f9c040f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800a770 tx=0x7f7fa800d040 comp rx=0 tx=0).stop 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 10 monclient: shutdown 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 msgr2=0x7f7fb01cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 0x7f7fb01cecb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4035040 tx=0x7f7fa40046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb4ea1640 1 -- 172.21.15.71:0/921238202 reap_dead start 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 shutdown_connections 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 --2- 172.21.15.71:0/921238202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fb00a6950 0x7f7fb01cecb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 >> 172.21.15.71:0/921238202 conn(0x7f7fb00abf50 msgr2=0x7f7fb009f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 shutdown_connections 2024-08-19T11:11:12.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.099+0000 7f7fb6904640 1 -- 172.21.15.71:0/921238202 wait complete. 2024-08-19T11:11:12.142 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:12.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-19T11:11:12.142 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:11:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.239+0000 7fcb47d12640 10 monclient: get_monmap_and_config 2024-08-19T11:11:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.239+0000 7fcb47d12640 10 monclient: build_initial_monmap 2024-08-19T11:11:12.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.239+0000 7fcb47d12640 10 monclient: monmap: 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:12.240054+0000 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:12.240054+0000 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:12.241 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.239+0000 7fcb47d12640 1 Processor -- start 2024-08-19T11:11:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 1 -- start start 2024-08-19T11:11:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient: init 2024-08-19T11:11:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient: _add_conns ranks=[1,8,9,4,0,3,5,2,6,10,7] 2024-08-19T11:11:12.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcb400a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 0x7fcb4013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): picked mon.noname-e con 0x7fcb400a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb400a7440 0x7fcb401410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): picked mon.noname-a con 0x7fcb400a7440 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb400a6380 con 0x7fcb400a6950 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcb400a5020 con 0x7fcb400a7440 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcb400a7d40 con 0x7fcb400a57c0 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb47d12640 10 monclient(hunting): authenticate will time out at 730.281701s 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb400a7440 0x7fcb401410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 0x7fcb4013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 0x7fcb4013eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53394/0 (socket says 172.21.15.71:53394) 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcb400a7440 0x7fcb401410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52946/0 (socket says 172.21.15.71:52946) 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 1 -- 172.21.15.71:0/703601313 learned_addr learned my addr 172.21.15.71:0/703601313 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): get_auth_request con 0x7fcb400a57c0 auth_method 0 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 10 monclient(hunting): get_auth_request con 0x7fcb400a7440 auth_method 0 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.240+0000 7fcb462af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 10 monclient(hunting): handle_auth_done global_id 4509 payload 274 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 1 -- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 msgr2=0x7fcb4013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 1 --2- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 0x7fcb4013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 1 -- 172.21.15.71:0/703601313 >> v1:172.21.15.135:6789/0 conn(0x7fcb400a6950 legacy=0x7fcb400a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 10 monclient: _finish_hunting 0 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 1 monclient: found mon.noname-a 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:12.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb462af640 1 -- 172.21.15.71:0/703601313 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb400a3650 con 0x7fcb400a7440 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.241+0000 7fcb452ad640 1 --2- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 0x7fcb4013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.243+0000 7fcb462af640 1 -- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a7440 msgr2=0x7fcb401410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.243+0000 7fcb462af640 1 --2- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a7440 0x7fcb401410b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009dc0 tx=0x7fcb3802a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1450e0b8425fb553 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 1 -- 172.21.15.71:0/703601313 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb38007bc0 con 0x7fcb400a7440 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: dump: 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.252 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: _finish_auth 0 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: _check_auth_tickets 2024-08-19T11:11:12.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 5 monclient: authenticate success, global_id 4509 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 1 -- 172.21.15.71:0/703601313 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38007d80 con 0x7fcb400a7440 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 4 set_mon_vals no callback set 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 1 -- 172.21.15.71:0/703601313 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb38031870 con 0x7fcb400a7440 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb44aac640 10 monclient: dump: 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.254 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.255 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 10 monclient: shutdown 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 -- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a7440 msgr2=0x7fcb401410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 --2- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a7440 0x7fcb401410b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009dc0 tx=0x7fcb3802a4d0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 -- 172.21.15.71:0/703601313 shutdown_connections 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 --2- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a7440 0x7fcb401410b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 --2- 172.21.15.71:0/703601313 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcb400a57c0 0x7fcb4013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 -- 172.21.15.71:0/703601313 >> 172.21.15.71:0/703601313 conn(0x7fcb400abf50 msgr2=0x7fcb400ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 -- 172.21.15.71:0/703601313 shutdown_connections 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.244+0000 7fcb47d12640 1 -- 172.21.15.71:0/703601313 wait complete. 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.245+0000 7fcb47d12640 10 monclient: build_initial_monmap 2024-08-19T11:11:12.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.245+0000 7fcb47d12640 10 monclient: monmap: 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:12.257 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.245+0000 7fcb47d12640 1 Processor -- start 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.245+0000 7fcb47d12640 1 -- start start 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.245+0000 7fcb47d12640 10 monclient: init 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient: _add_conns ranks=[0,1,3,4,2,6,8,5,7] 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 0x7fcb40126210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): picked mon.noname-a con 0x7fcb400a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb400a6950 0x7fcb40126750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): picked mon.noname-f con 0x7fcb400a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb400a7440 0x7fcb40126c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): picked mon.noname-g con 0x7fcb400a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb400a8700 con 0x7fcb400a57c0 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb400a84c0 con 0x7fcb400a6950 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcb401415f0 con 0x7fcb400a7440 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb47d12640 10 monclient(hunting): authenticate will time out at 730.287285s 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 0x7fcb40126210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 0x7fcb40126210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52956/0 (socket says 172.21.15.71:52956) 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 -- 172.21.15.71:0/585364292 learned_addr learned my addr 172.21.15.71:0/585364292 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): get_auth_request con 0x7fcb400a57c0 auth_method 0 2024-08-19T11:11:12.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient(hunting): handle_auth_done global_id 4518 payload 824 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb400a7440 msgr2=0x7fcb40126c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb400a7440 0x7fcb40126c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb400a6950 msgr2=0x7fcb40126750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb400a6950 0x7fcb40126750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient: _finish_hunting 0 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 monclient: found mon.noname-a 2024-08-19T11:11:12.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:12.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:12.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.246+0000 7fcb45aae640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb401291a0 con 0x7fcb400a57c0 2024-08-19T11:11:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.248+0000 7fcb45aae640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 msgr2=0x7fcb40126210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.248+0000 7fcb45aae640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 0x7fcb40126210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c3b0 tx=0x7fcb3c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.248+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:11:12.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb3c011c10 con 0x7fcb400a57c0 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: dump: 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.265 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: _finish_auth 0 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: _check_auth_tickets 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c017070 con 0x7fcb400a57c0 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb3c011df0 con 0x7fcb400a57c0 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 5 monclient: authenticate success, global_id 4518 2024-08-19T11:11:12.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 10 monclient: _renew_subs 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb40129770 con 0x7fcb400a57c0 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb37fff640 4 set_mon_vals no callback set 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb367fc640 10 monclient: dump: 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.267 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 10 monclient: _renew_subs 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.250+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4012a010 con 0x7fcb400a57c0 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.251+0000 7fcb47d12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:12.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.251+0000 7fcb47d12640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 0x7fcb40122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.251+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.251+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcb40076c60 con 0x7fcb401225a0 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.251+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcb3c0117a0 con 0x7fcb400a57c0 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb367fc640 1 --2- 172.21.15.71:0/585364292 >> v2:172.21.15.135:6800/726754104 conn(0x7fcb2403ea80 0x7fcb24040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 0x7fcb40122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient: get_auth_request con 0x7fcb401225a0 auth_method 0 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3926+0+0 (secure 0 0 0) 0x7fcb3c0518f0 con 0x7fcb400a57c0 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb462af640 1 --2- 172.21.15.71:0/585364292 >> v2:172.21.15.135:6800/726754104 conn(0x7fcb2403ea80 0x7fcb24040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb462af640 10 monclient: get_auth_request con 0x7fcb2403ea80 auth_method 0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 10 monclient(hunting): handle_auth_done global_id 4462 payload 824 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.252+0000 7fcb452ad640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb400a92d0 con 0x7fcb401225a0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb452ad640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 msgr2=0x7fcb40122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb452ad640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 0x7fcb40122980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb40128320 tx=0x7fcb3000eb40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb462af640 1 --2- 172.21.15.71:0/585364292 >> v2:172.21.15.135:6800/726754104 conn(0x7fcb2403ea80 0x7fcb24040f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009dc0 tx=0x7fcb3802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb30017070 con 0x7fcb401225a0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb367fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.254+0000 7fcb367fc640 10 monclient: dump: 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.270 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcb3000c960 con 0x7fcb401225a0 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 msgr2=0x7fcb40122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 0x7fcb40122980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb40128320 tx=0x7fcb3000eb40 comp rx=0 tx=0).stop 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 msgr2=0x7fcb40122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.255+0000 7fcb367fc640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb401225a0 0x7fcb40122980 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcb40128320 tx=0x7fcb3000eb40 comp rx=0 tx=0).stop 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb47d12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb47d12640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 0x7fcb401d8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb47d12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcb400a6d30 con 0x7fcb40122ec0 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 0x7fcb401d8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient: get_auth_request con 0x7fcb40122ec0 auth_method 0 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:12.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:12.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:12.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:12.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:12.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.261+0000 7fcb452ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:12.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.262+0000 7fcb452ad640 10 monclient(hunting): handle_auth_done global_id 4471 payload 824 2024-08-19T11:11:12.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.262+0000 7fcb452ad640 1 -- 172.21.15.71:0/585364292 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcb4006ca70 con 0x7fcb40122ec0 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.264+0000 7fcb452ad640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 msgr2=0x7fcb401d8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.264+0000 7fcb452ad640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 0x7fcb401d8550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb40128320 tx=0x7fcb300046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.264+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcb30017070 con 0x7fcb40122ec0 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.264+0000 7fcb367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.264+0000 7fcb367fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.264+0000 7fcb367fc640 10 monclient: dump: 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:12.274 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:12.275 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9255 (secure 0 0 0) 0x7fcb30006600 con 0x7fcb40122ec0 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 msgr2=0x7fcb401d8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 0x7fcb401d8550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb40128320 tx=0x7fcb300046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 msgr2=0x7fcb401d8550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb367fc640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcb40122ec0 0x7fcb401d8550 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb40128320 tx=0x7fcb300046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:12.276 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 20, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 69118, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:12.277 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:12.278 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:12.279 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:12.280 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:12.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:12.282 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.285 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:12.289 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:12.294 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:12.297 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:12.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:12.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:12.300 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:12.300 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 >> v2:172.21.15.135:6800/726754104 conn(0x7fcb2403ea80 msgr2=0x7fcb24040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 --2- 172.21.15.71:0/585364292 >> v2:172.21.15.135:6800/726754104 conn(0x7fcb2403ea80 0x7fcb24040f40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009dc0 tx=0x7fcb3802e000 comp rx=0 tx=0).stop 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 10 monclient: shutdown 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 msgr2=0x7fcb40126210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 --2- 172.21.15.71:0/585364292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb400a57c0 0x7fcb40126210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c3b0 tx=0x7fcb3c00c870 comp rx=0 tx=0).stop 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb462af640 1 -- 172.21.15.71:0/585364292 reap_dead start 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb462af640 1 -- 172.21.15.71:0/585364292 reap_dead start 2024-08-19T11:11:12.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 shutdown_connections 2024-08-19T11:11:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 >> 172.21.15.71:0/585364292 conn(0x7fcb400abf50 msgr2=0x7fcb4009f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 shutdown_connections 2024-08-19T11:11:12.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:12.265+0000 7fcb47d12640 1 -- 172.21.15.71:0/585364292 wait complete. 2024-08-19T11:11:12.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:11:12.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:11:12.733 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: starting. 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-23996 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: created object 0... 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: created object 25... 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: created object 49... 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: finishing. 2024-08-19T11:11:12.734 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24035]: shutting down. 2024-08-19T11:11:12.771 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:12.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24037]: starting. 2024-08-19T11:11:12.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24037]: listing objects. 2024-08-19T11:11:12.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24037]: listed object 0... 2024-08-19T11:11:12.772 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24037]: listed object 25... 2024-08-19T11:11:12.772 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24037]: saw 50 objects 2024-08-19T11:11:12.772 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24037]: shutting down. 2024-08-19T11:11:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24036]: starting. 2024-08-19T11:11:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24036]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-23996 2024-08-19T11:11:13.628 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24036]: shutting down. 2024-08-19T11:11:13.629 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:13.629 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:13.629 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:11:13.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:11:15.708 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: starting. 2024-08-19T11:11:15.708 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24103 2024-08-19T11:11:15.708 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: created object 0... 2024-08-19T11:11:15.708 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: created object 25... 2024-08-19T11:11:15.708 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: created object 49... 2024-08-19T11:11:15.708 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: finishing. 2024-08-19T11:11:15.709 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24104]: shutting down. 2024-08-19T11:11:16.595 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24105]: starting. 2024-08-19T11:11:16.595 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24105]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24103 2024-08-19T11:11:16.595 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24105]: shutting down. 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: starting. 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24103 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: created object 0... 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: created object 25... 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: created object 49... 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: finishing. 2024-08-19T11:11:18.739 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24138]: shutting down. 2024-08-19T11:11:18.979 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:18.979 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24140]: starting. 2024-08-19T11:11:18.980 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24140]: listing objects. 2024-08-19T11:11:18.980 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24140]: listed object 0... 2024-08-19T11:11:18.980 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24140]: listed object 25... 2024-08-19T11:11:18.980 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24140]: saw 50 objects 2024-08-19T11:11:18.980 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24140]: shutting down. 2024-08-19T11:11:19.620 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:19.621 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24139]: starting. 2024-08-19T11:11:19.621 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24139]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24103 2024-08-19T11:11:19.621 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24139]: shutting down. 2024-08-19T11:11:19.622 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:19.622 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:19.622 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:11:19.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:11:21.748 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: starting. 2024-08-19T11:11:21.748 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24206 2024-08-19T11:11:21.749 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: created object 0... 2024-08-19T11:11:21.749 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: created object 25... 2024-08-19T11:11:21.749 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: created object 49... 2024-08-19T11:11:21.749 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: finishing. 2024-08-19T11:11:21.749 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24207]: shutting down. 2024-08-19T11:11:22.654 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24208]: starting. 2024-08-19T11:11:22.654 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24208]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24206 2024-08-19T11:11:22.654 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24208]: shutting down. 2024-08-19T11:11:25.081 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:25.081 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: starting. 2024-08-19T11:11:25.081 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24206 2024-08-19T11:11:25.081 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: created object 0... 2024-08-19T11:11:25.081 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: created object 25... 2024-08-19T11:11:25.081 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: created object 49... 2024-08-19T11:11:25.082 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: finishing. 2024-08-19T11:11:25.082 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24241]: shutting down. 2024-08-19T11:11:25.120 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:25.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24243]: starting. 2024-08-19T11:11:25.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24243]: listing objects. 2024-08-19T11:11:25.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24243]: listed object 0... 2024-08-19T11:11:25.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24243]: listed object 25... 2024-08-19T11:11:25.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24243]: saw 50 objects 2024-08-19T11:11:25.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24243]: shutting down. 2024-08-19T11:11:25.961 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:25.962 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24242]: starting. 2024-08-19T11:11:25.962 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24242]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24206 2024-08-19T11:11:25.962 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24242]: shutting down. 2024-08-19T11:11:25.963 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:25.963 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:25.963 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:11:25.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: starting. 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24309 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: created object 0... 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: created object 25... 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: created object 49... 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: finishing. 2024-08-19T11:11:28.278 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24310]: shutting down. 2024-08-19T11:11:28.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24311]: starting. 2024-08-19T11:11:28.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24311]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24309 2024-08-19T11:11:28.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24311]: shutting down. 2024-08-19T11:11:31.683 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: starting. 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24309 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: created object 0... 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: created object 25... 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: created object 49... 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: finishing. 2024-08-19T11:11:31.684 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24344]: shutting down. 2024-08-19T11:11:31.721 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:31.722 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24346]: starting. 2024-08-19T11:11:31.722 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24346]: listing objects. 2024-08-19T11:11:31.722 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24346]: listed object 0... 2024-08-19T11:11:31.722 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24346]: listed object 25... 2024-08-19T11:11:31.722 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24346]: saw 50 objects 2024-08-19T11:11:31.722 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24346]: shutting down. 2024-08-19T11:11:32.303 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-08-19T11:11:32.303 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-19T11:11:32.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-19T11:11:32.307 INFO:tasks.ceph.mon.d:Started 2024-08-19T11:11:32.307 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-08-19T11:11:32.307 INFO:tasks.ceph.mon.a:Sent signal 19 2024-08-19T11:11:32.307 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24345]: starting. 2024-08-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24345]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24309 2024-08-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24345]: shutting down. 2024-08-19T11:11:37.815 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:37.815 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:37.815 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:11:37.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:11:47.308 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-08-19T11:11:47.309 INFO:tasks.ceph.mon.a:Sent signal 18 2024-08-19T11:11:47.309 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:11:47.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:11:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.416+0000 7f088c69f640 10 monclient: get_monmap_and_config 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.416+0000 7f088c69f640 10 monclient: build_initial_monmap 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.416+0000 7f088c69f640 10 monclient: monmap: 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:47.417395+0000 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:47.417395+0000 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:47.419 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.417+0000 7f088c69f640 1 Processor -- start 2024-08-19T11:11:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.417+0000 7f088c69f640 1 -- start start 2024-08-19T11:11:47.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.417+0000 7f088c69f640 10 monclient: init 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient: _add_conns ranks=[1,6,7,9,0,8,2,10,5,3,4] 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f08840a3740 addr v1:172.21.15.135:6789/0 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 0x7f088413c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): picked mon.noname-d con 0x7f08840a1810 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08840a4230 0x7f088413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): picked mon.noname-i con 0x7f08840a4230 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08840a1c90 con 0x7f08840a3740 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f088409e0a0 con 0x7f08840a1810 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f088409dba0 con 0x7f08840a4230 2024-08-19T11:11:47.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088c69f640 10 monclient(hunting): authenticate will time out at 765.459122s 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 0x7f088413c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 0x7f088413c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:45288/0 (socket says 172.21.15.71:45288) 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 -- 172.21.15.71:0/215167858 learned_addr learned my addr 172.21.15.71:0/215167858 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08840a1810 auth_method 0 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:47.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088ac3c640 1 --2- 172.21.15.71:0/215167858 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08840a4230 0x7f088413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f08840a4230 auth_method 0 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f088ac3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient(hunting): handle_auth_done global_id 24108 payload 274 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 -- 172.21.15.71:0/215167858 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08840a4230 msgr2=0x7f088413eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 --2- 172.21.15.71:0/215167858 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08840a4230 0x7f088413eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 -- 172.21.15.71:0/215167858 >> v1:172.21.15.135:6789/0 conn(0x7f08840a3740 legacy=0x7f08840a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient: _finish_hunting 0 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 monclient: found mon.noname-d 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:11:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.418+0000 7f0889c3a640 1 -- 172.21.15.71:0/215167858 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840a5240 con 0x7f08840a1810 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889c3a640 1 -- 172.21.15.71:0/215167858 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 msgr2=0x7f088413c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889c3a640 1 --2- 172.21.15.71:0/215167858 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 0x7f088413c960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08800098a0 tx=0x7f088002a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=da365f55e684012e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 1 -- 172.21.15.71:0/215167858 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0880037070 con 0x7f08840a1810 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: dump: 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: _finish_auth 0 2024-08-19T11:11:47.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: _check_auth_tickets 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f088c69f640 5 monclient: authenticate success, global_id 24108 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 1 -- 172.21.15.71:0/215167858 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088002ade0 con 0x7f08840a1810 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f088c69f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f088c69f640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f088c69f640 4 set_mon_vals no callback set 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 1 -- 172.21.15.71:0/215167858 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0880030c20 con 0x7f08840a1810 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.421+0000 7f0889439640 10 monclient: dump: 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:47.431 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:47.432 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 10 monclient: shutdown 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 -- 172.21.15.71:0/215167858 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 msgr2=0x7f088413c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 --2- 172.21.15.71:0/215167858 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 0x7f088413c960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f08800098a0 tx=0x7f088002a080 comp rx=0 tx=0).stop 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 -- 172.21.15.71:0/215167858 shutdown_connections 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 --2- 172.21.15.71:0/215167858 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08840a4230 0x7f088413eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 --2- 172.21.15.71:0/215167858 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f08840a1810 0x7f088413c960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 -- 172.21.15.71:0/215167858 >> 172.21.15.71:0/215167858 conn(0x7f088406d080 msgr2=0x7f08840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 -- 172.21.15.71:0/215167858 shutdown_connections 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 1 -- 172.21.15.71:0/215167858 wait complete. 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 10 monclient: build_initial_monmap 2024-08-19T11:11:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.422+0000 7f088c69f640 10 monclient: monmap: 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:47.434 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 Processor -- start 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 -- start start 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient: init 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient: _add_conns ranks=[5,4,2,6,8,1,3,0,7] 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): picked mon.noname-h con 0x7f08840a3740 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): picked mon.noname-c con 0x7f08840a4230 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): picked mon.noname-b con 0x7f08841cf140 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f088413f570 con 0x7f08841cf140 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f088413f3f0 con 0x7f08840a4230 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f088413f6f0 con 0x7f08840a3740 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088c69f640 10 monclient(hunting): authenticate will time out at 765.464738s 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088ac3c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53508/0 (socket says 172.21.15.71:53508) 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 learned_addr learned my addr 172.21.15.71:0/2340650859 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08840a4230 auth_method 0 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f08841cf140 auth_method 0 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088ac3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:47.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.423+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08840a3740 auth_method 0 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08840a4230 auth_method 0 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.624+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:47.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f08841cf140 auth_method 0 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08840a3740 auth_method 0 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.625+0000 7f088a43b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.626+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.626+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.626+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:47.626+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:48.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:48.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08840a4230 auth_method 0 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f08841cf140 auth_method 0 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:48.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:48.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:48.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.026+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:48.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.027+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08840a3740 auth_method 0 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.028+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08840a4230 auth_method 0 2024-08-19T11:11:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:48.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f08841cf140 auth_method 0 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.827+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08840a3740 auth_method 0 2024-08-19T11:11:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:48.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:48.829+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:50.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient(hunting): tick 2024-08-19T11:11:50.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:11:50.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:11:50.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:11:50.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 msgr2=0x7f0884121440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:50.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08840a3740 0x7f0884121440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:50.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 msgr2=0x7f08841cec00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:50.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f08840a4230 0x7f08841cec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:50.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 msgr2=0x7f088411ee30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:50.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08841cf140 0x7f088411ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:50.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient: _add_conns ranks=[7,8,1,0,3,6] 2024-08-19T11:11:50.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:50.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f08680037e0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:50.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:50.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f08680061f0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:50.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:50.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.423+0000 7f0875ffb640 10 monclient(hunting): picked mon.noname-f con 0x7f0868008d00 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:11:50.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f088413f570 con 0x7f0868008d00 2024-08-19T11:11:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f088413f3f0 con 0x7f08680037e0 2024-08-19T11:11:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f088413f6f0 con 0x7f08680061f0 2024-08-19T11:11:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0875ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:50.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:50.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08680061f0 auth_method 0 2024-08-19T11:11:50.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:50.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:50.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:50.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f0868008d00 auth_method 0 2024-08-19T11:11:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08680037e0 auth_method 0 2024-08-19T11:11:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:11:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:50.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.625+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:50.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.625+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08680061f0 auth_method 0 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.625+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.625+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.625+0000 7f0889c3a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f0868008d00 auth_method 0 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08680037e0 auth_method 0 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:50.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:50.626+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:11:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08680061f0 auth_method 0 2024-08-19T11:11:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.027+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f0868008d00 auth_method 0 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08680037e0 auth_method 0 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.028+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.828+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.828+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f08680061f0 auth_method 0 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.828+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.828+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.828+0000 7f0889c3a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:11:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f08680037e0 auth_method 0 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f0868008d00 auth_method 0 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:11:51.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:51.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:51.829+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: starting. 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24412 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: created object 0... 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: created object 25... 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: created object 49... 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: finishing. 2024-08-19T11:11:53.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24413]: shutting down. 2024-08-19T11:11:53.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): tick 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 msgr2=0x7f0868008660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08680061f0 0x7f0868008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 msgr2=0x7f0868005bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f08680037e0 0x7f0868005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:53.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0868008d00 0x7f086800b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 reap_dead start 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient: _add_conns ranks=[3,6,0] 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 1 -- 172.21.15.71:0/2340650859 reap_dead start 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0868003be0 0x7f0868006650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f0868003be0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 0x7f0868006f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): picked mon.noname-d con 0x7f0868006b90 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680074d0 0x7f086800b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f08680074d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f088413f570 con 0x7f08680074d0 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:53.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f088413f3f0 con 0x7f0868003be0 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f088413f6f0 con 0x7f0868006b90 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0875ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680074d0 0x7f086800b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 0x7f0868006f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): get_auth_request con 0x7f0868006b90 auth_method 0 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): get_auth_request con 0x7f08680074d0 auth_method 0 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:53.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0868003be0 0x7f0868006650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): get_auth_request con 0x7f0868003be0 auth_method 0 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:53.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088a43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient(hunting): handle_auth_done global_id 24117 payload 824 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0868003be0 msgr2=0x7f0868006650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0868003be0 0x7f0868006650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680074d0 msgr2=0x7f086800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680074d0 0x7f086800b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient: _finish_hunting 0 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 monclient: found mon.noname-d 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0884122960 con 0x7f0868006b90 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.424+0000 7f088ac3c640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680074d0 0x7f086800b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0889c3a640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 msgr2=0x7f0868006f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:53.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0889c3a640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 0x7f0868006f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08800090b0 tx=0x7f08800046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0880037040 con 0x7f0868006b90 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: dump: 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:53.436 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: _finish_auth 0 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0880040070 con 0x7f0868006b90 2024-08-19T11:11:53.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 5 monclient: authenticate success, global_id 24117 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 10 monclient: _renew_subs 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0884122c40 con 0x7f0868006b90 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0880030c20 con 0x7f0868006b90 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0888c38640 4 set_mon_vals no callback set 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f0876ffd640 10 monclient: dump: 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:53.438 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 10 monclient: _renew_subs 2024-08-19T11:11:53.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.427+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f0884121dd0 con 0x7f0868006b90 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0880003cf0 con 0x7f0868006b90 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f088c69f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f088c69f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f088c69f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08840a3b20 con 0x7f0868006b90 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f0876ffd640 1 --2- 172.21.15.71:0/2340650859 >> v2:172.21.15.135:6800/726754104 conn(0x7f086c03ea10 0x7f086c040ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(47..47 src has 1..47) ==== 3898+0+0 (secure 0 0 0) 0x7f0880071ac0 con 0x7f0868006b90 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.428+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> v2:172.21.15.135:6800/726754104 conn(0x7f086c03ea10 0x7f086c040ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:53.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.429+0000 7f088a43b640 10 monclient: get_auth_request con 0x7f086c03ea10 auth_method 0 2024-08-19T11:11:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.431+0000 7f088a43b640 1 --2- 172.21.15.71:0/2340650859 >> v2:172.21.15.135:6800/726754104 conn(0x7f086c03ea10 0x7f086c040ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0878007c50 tx=0x7f0878009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.433+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f0880070830 con 0x7f0868006b90 2024-08-19T11:11:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.433+0000 7f0876ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:53.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.433+0000 7f0876ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:53.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f088c69f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:11:53.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f088c69f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:11:53.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f088c69f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:53.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0884136920 con 0x7f0868006b90 2024-08-19T11:11:53.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f0876ffd640 1 -- 172.21.15.71:0/2340650859 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7f0880030340 con 0x7f0868006b90 2024-08-19T11:11:53.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f0876ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:11:53.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.675+0000 7f0876ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:53.677 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":22,"quorum":[1,2,3,4,5,6,7,8],"quorum_names":["f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:11:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 >> v2:172.21.15.135:6800/726754104 conn(0x7f086c03ea10 msgr2=0x7f086c040ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 --2- 172.21.15.71:0/2340650859 >> v2:172.21.15.135:6800/726754104 conn(0x7f086c03ea10 0x7f086c040ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0878007c50 tx=0x7f0878009040 comp rx=0 tx=0).stop 2024-08-19T11:11:53.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 10 monclient: shutdown 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 msgr2=0x7f0868006f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 0x7f0868006f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f08800090b0 tx=0x7f08800046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 shutdown_connections 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 --2- 172.21.15.71:0/2340650859 >> v2:172.21.15.135:6800/726754104 conn(0x7f086c03ea10 0x7f086c040ed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08680074d0 0x7f086800b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0868006b90 0x7f0868006f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 --2- 172.21.15.71:0/2340650859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0868003be0 0x7f0868006650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 >> 172.21.15.71:0/2340650859 conn(0x7f088406d080 msgr2=0x7f08840a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 shutdown_connections 2024-08-19T11:11:53.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:53.677+0000 7f088c69f640 1 -- 172.21.15.71:0/2340650859 wait complete. 2024-08-19T11:11:54.323 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24414]: starting. 2024-08-19T11:11:54.323 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24414]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24412 2024-08-19T11:11:54.323 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24414]: shutting down. 2024-08-19T11:11:56.471 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:56.471 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: starting. 2024-08-19T11:11:56.471 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24412 2024-08-19T11:11:56.471 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: created object 0... 2024-08-19T11:11:56.472 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: created object 25... 2024-08-19T11:11:56.472 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: created object 49... 2024-08-19T11:11:56.472 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: finishing. 2024-08-19T11:11:56.472 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24449]: shutting down. 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24451]: starting. 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24451]: listing objects. 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24451]: listed object 0... 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24451]: listed object 25... 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24451]: saw 50 objects 2024-08-19T11:11:56.509 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24451]: shutting down. 2024-08-19T11:11:56.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.785+0000 7f46ace2f640 10 monclient: get_monmap_and_config 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.785+0000 7f46ace2f640 10 monclient: build_initial_monmap 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.785+0000 7f46ace2f640 10 monclient: monmap: 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:56.786560+0000 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:56.786560+0000 2024-08-19T11:11:56.787 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:56.788 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:56.789 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:56.789 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:56.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.786+0000 7f46ace2f640 1 Processor -- start 2024-08-19T11:11:56.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.786+0000 7f46ace2f640 1 -- start start 2024-08-19T11:11:56.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.786+0000 7f46ace2f640 10 monclient: init 2024-08-19T11:11:56.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient: _add_conns ranks=[9,10,7,6,1,5,4,3,0,2,8] 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46a80a47c0 0x7f46a80a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): picked mon.noname-a con 0x7f46a80a47c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f46a80a2b10 0x7f46a80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): picked mon.noname-f con 0x7f46a80a2b10 addr v2:172.21.15.135:3300/0 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f46a8137580 0x7f46a8137a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): picked mon.noname-i con 0x7f46a8137580 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f46a806cdd0 con 0x7f46a80a47c0 2024-08-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f46a80a2f90 con 0x7f46a80a2b10 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f46a80a5620 con 0x7f46a8137580 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46ace2f640 10 monclient(hunting): authenticate will time out at 774.828121s 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46a80a47c0 0x7f46a80a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46a80a47c0 0x7f46a80a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40378/0 (socket says 172.21.15.71:40378) 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 -- 172.21.15.71:0/4161811579 learned_addr learned my addr 172.21.15.71:0/4161811579 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): get_auth_request con 0x7f46a80a47c0 auth_method 0 2024-08-19T11:11:56.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a6d9d640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f46a8137580 0x7f46a8137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 1 --2- 172.21.15.71:0/4161811579 >> v2:172.21.15.135:3300/0 conn(0x7f46a80a2b10 0x7f46a80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): get_auth_request con 0x7f46a80a2b10 auth_method 0 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:56.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a6d9d640 10 monclient(hunting): get_auth_request con 0x7f46a8137580 auth_method 0 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f469dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient(hunting): handle_auth_done global_id 4662 payload 274 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 -- 172.21.15.71:0/4161811579 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f46a8137580 msgr2=0x7f46a8137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f46a8137580 0x7f46a8137a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 -- 172.21.15.71:0/4161811579 >> v2:172.21.15.135:3300/0 conn(0x7f46a80a2b10 msgr2=0x7f46a80a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 --2- 172.21.15.71:0/4161811579 >> v2:172.21.15.135:3300/0 conn(0x7f46a80a2b10 0x7f46a80a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient: _finish_hunting 0 2024-08-19T11:11:56.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 monclient: found mon.noname-a 2024-08-19T11:11:56.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:56.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:56.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a659c640 1 -- 172.21.15.71:0/4161811579 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a80a2880 con 0x7f46a80a47c0 2024-08-19T11:11:56.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.787+0000 7f46a6d9d640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f46a8137580 0x7f46a8137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:11:56.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a659c640 1 -- 172.21.15.71:0/4161811579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80a47c0 msgr2=0x7f46a80a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:56.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a659c640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80a47c0 0x7f46a80a4ba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46a806fa40 tx=0x7f469802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc4f156786f6271 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:56.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 1 -- 172.21.15.71:0/4161811579 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4698037070 con 0x7f46a80a47c0 2024-08-19T11:11:56.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:56.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:56.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: dump: 2024-08-19T11:11:56.807 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:56.807 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:56.807 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.807 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.807 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:56.807 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:56.808 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:56.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:56.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:56.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:56.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:56.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: _finish_auth 0 2024-08-19T11:11:56.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:11:56.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:56.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 1 -- 172.21.15.71:0/4161811579 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469802ae20 con 0x7f46a80a47c0 2024-08-19T11:11:56.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 5 monclient: authenticate success, global_id 4662 2024-08-19T11:11:56.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:56.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 4 set_mon_vals no callback set 2024-08-19T11:11:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 1 -- 172.21.15.71:0/4161811579 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4698030c20 con 0x7f46a80a47c0 2024-08-19T11:11:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46a5d9b640 10 monclient: dump: 2024-08-19T11:11:56.812 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:56.812 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:56.812 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.812 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.812 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:56.813 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:56.814 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:56.814 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 10 monclient: shutdown 2024-08-19T11:11:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 1 -- 172.21.15.71:0/4161811579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80a47c0 msgr2=0x7f46a80a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.790+0000 7f46ace2f640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80a47c0 0x7f46a80a4ba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46a806fa40 tx=0x7f469802a100 comp rx=0 tx=0).stop 2024-08-19T11:11:56.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 -- 172.21.15.71:0/4161811579 shutdown_connections 2024-08-19T11:11:56.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f46a8137580 0x7f46a8137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 --2- 172.21.15.71:0/4161811579 >> v2:172.21.15.135:3300/0 conn(0x7f46a80a2b10 0x7f46a80a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 --2- 172.21.15.71:0/4161811579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a80a47c0 0x7f46a80a4ba0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 -- 172.21.15.71:0/4161811579 >> 172.21.15.71:0/4161811579 conn(0x7f46a80a58b0 msgr2=0x7f46a80a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:56.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 -- 172.21.15.71:0/4161811579 shutdown_connections 2024-08-19T11:11:56.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 1 -- 172.21.15.71:0/4161811579 wait complete. 2024-08-19T11:11:56.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 10 monclient: build_initial_monmap 2024-08-19T11:11:56.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.791+0000 7f46ace2f640 10 monclient: monmap: 2024-08-19T11:11:56.817 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:56.817 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:56.817 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:56.817 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:56.818 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:56.819 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:56.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 Processor -- start 2024-08-19T11:11:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 -- start start 2024-08-19T11:11:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient: init 2024-08-19T11:11:56.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient: _add_conns ranks=[1,8,3,0,4,7,6,2,5] 2024-08-19T11:11:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46a80a2b10 0x7f46a8123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): picked mon.noname-f con 0x7f46a80a2b10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:11:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): picked mon.noname-e con 0x7f46a80a47c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:56.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46a8137580 0x7f46a8120f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): picked mon.noname-g con 0x7f46a8137580 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46a80a31a0 con 0x7f46a80a2b10 2024-08-19T11:11:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f46a806d740 con 0x7f46a8137580 2024-08-19T11:11:56.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:56.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f46a8137f70 con 0x7f46a80a47c0 2024-08-19T11:11:56.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:56.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46ace2f640 10 monclient(hunting): authenticate will time out at 774.833749s 2024-08-19T11:11:56.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51032/0 (socket says 172.21.15.71:51032) 2024-08-19T11:11:56.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 1 -- 172.21.15.71:0/2095149108 learned_addr learned my addr 172.21.15.71:0/2095149108 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): get_auth_request con 0x7f46a80a47c0 auth_method 0 2024-08-19T11:11:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46a80a2b10 0x7f46a8123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 10 monclient(hunting): get_auth_request con 0x7f46a80a2b10 auth_method 0 2024-08-19T11:11:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:56.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f469dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a6d9d640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46a8137580 0x7f46a8120f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a6d9d640 10 monclient(hunting): get_auth_request con 0x7f46a8137580 auth_method 0 2024-08-19T11:11:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:56.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.792+0000 7f46a659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f46a659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f46a6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:56.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f46a6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f46a6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 10 monclient(hunting): handle_auth_done global_id 4634 payload 824 2024-08-19T11:11:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 1 -- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46a8137580 msgr2=0x7f46a8120f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46a8137580 0x7f46a8120f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 1 -- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46a80a2b10 msgr2=0x7f46a8123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:56.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46a80a2b10 0x7f46a8123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:56.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:11:56.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 1 monclient: found mon.noname-e 2024-08-19T11:11:56.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:56.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:56.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.793+0000 7f469dd9b640 1 -- 172.21.15.71:0/2095149108 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a8124860 con 0x7f46a80a47c0 2024-08-19T11:11:56.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469dd9b640 1 -- 172.21.15.71:0/2095149108 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 msgr2=0x7f46a8120a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:56.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469dd9b640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f469000e980 tx=0x7f469000ee40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:56.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4690017070 con 0x7f46a80a47c0 2024-08-19T11:11:56.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:56.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:56.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: dump: 2024-08-19T11:11:56.831 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:56.831 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:56.831 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.831 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.831 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:56.831 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:56.832 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:56.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:56.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:56.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:56.832 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:56.833 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:56.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:56.833 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:56.833 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:56.833 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:56.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:11:56.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:11:56.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:56.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469000cc10 con 0x7f46a80a47c0 2024-08-19T11:11:56.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 5 monclient: authenticate success, global_id 4634 2024-08-19T11:11:56.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 10 monclient: _renew_subs 2024-08-19T11:11:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a8137ac0 con 0x7f46a80a47c0 2024-08-19T11:11:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f469000cdc0 con 0x7f46a80a47c0 2024-08-19T11:11:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f469f7fe640 10 monclient: dump: 2024-08-19T11:11:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:56.839 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 10 monclient: _renew_subs 2024-08-19T11:11:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46a559a640 4 set_mon_vals no callback set 2024-08-19T11:11:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.795+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a8122500 con 0x7f46a80a47c0 2024-08-19T11:11:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f469dd9b640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f469000e980 tx=0x7f469000ee40 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f469000f040 osd_map(51..51 src has 1..51) 2024-08-19T11:11:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f469001a070 con 0x7f46a80a47c0 2024-08-19T11:11:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f469f7fe640 1 --2- 172.21.15.71:0/2095149108 >> v2:172.21.15.135:6800/726754104 conn(0x7f468803eab0 0x7f4688040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f46ace2f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f46ace2f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f46ace2f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:56.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a8138300 con 0x7f46a80a47c0 2024-08-19T11:11:56.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f46a659c640 1 --2- 172.21.15.71:0/2095149108 >> v2:172.21.15.135:6800/726754104 conn(0x7f468803eab0 0x7f4688040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:56.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.796+0000 7f46a659c640 10 monclient: get_auth_request con 0x7f468803eab0 auth_method 0 2024-08-19T11:11:56.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.799+0000 7f46a659c640 1 --2- 172.21.15.71:0/2095149108 >> v2:172.21.15.135:6800/726754104 conn(0x7f468803eab0 0x7f4688040f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f469802afd0 tx=0x7f469802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:56.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:56.801+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (secure 0 0 0) 0x7f469000f040 con 0x7f46a80a47c0 2024-08-19T11:11:57.595 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:57.595 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24450]: starting. 2024-08-19T11:11:57.595 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24450]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24412 2024-08-19T11:11:57.596 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24450]: shutting down. 2024-08-19T11:11:57.597 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:57.597 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:11:57.597 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:11:57.600 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:11:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.624+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f4690013470 con 0x7f46a80a47c0 2024-08-19T11:11:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.624+0000 7f469f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:57.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.624+0000 7f469f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.869+0000 7f46ace2f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.869+0000 7f46ace2f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.869+0000 7f46ace2f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.869+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46a8134320 con 0x7f46a80a47c0 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.870+0000 7f469f7fe640 1 -- 172.21.15.71:0/2095149108 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f4690013750 con 0x7f46a80a47c0 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.870+0000 7f469f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:11:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.870+0000 7f469f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:57.872 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:11:57.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 >> v2:172.21.15.135:6800/726754104 conn(0x7f468803eab0 msgr2=0x7f4688040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:57.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 --2- 172.21.15.71:0/2095149108 >> v2:172.21.15.135:6800/726754104 conn(0x7f468803eab0 0x7f4688040f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f469802afd0 tx=0x7f469802e000 comp rx=0 tx=0).stop 2024-08-19T11:11:57.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 10 monclient: shutdown 2024-08-19T11:11:57.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:57.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 msgr2=0x7f46a8120a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f469000e980 tx=0x7f469000ee40 comp rx=0 tx=0).stop 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 shutdown_connections 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 --2- 172.21.15.71:0/2095149108 >> v2:172.21.15.135:6800/726754104 conn(0x7f468803eab0 0x7f4688040f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46a8137580 0x7f46a8120f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46a80a47c0 0x7f46a8120a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 --2- 172.21.15.71:0/2095149108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46a80a2b10 0x7f46a8123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 >> 172.21.15.71:0/2095149108 conn(0x7f46a80a58b0 msgr2=0x7f46a809dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 shutdown_connections 2024-08-19T11:11:57.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.872+0000 7f46ace2f640 1 -- 172.21.15.71:0/2095149108 wait complete. 2024-08-19T11:11:57.883 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:11:57.884 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:11:57.884 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:11:57.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.980+0000 7f74ae4da640 10 monclient: get_monmap_and_config 2024-08-19T11:11:57.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.980+0000 7f74ae4da640 10 monclient: build_initial_monmap 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.980+0000 7f74ae4da640 10 monclient: monmap: 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:57.981163+0000 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:57.981163+0000 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:57.982 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:57.983 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:57.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 Processor -- start 2024-08-19T11:11:57.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 -- start start 2024-08-19T11:11:57.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient: init 2024-08-19T11:11:57.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:57.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient: _add_conns ranks=[2,4,3,8,7,0,1,5,9,10,6] 2024-08-19T11:11:57.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 0x7f74a80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): picked mon.noname-b con 0x7f74a80a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f74a80a57c0 0x7f74a80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): picked mon.noname-c con 0x7f74a80a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74a8139710 0x7f74a8139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): picked mon.noname-g con 0x7f74a8139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f74a80a5020 con 0x7f74a80a6950 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f74a80a77b0 con 0x7f74a8139710 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f74a80a7d40 con 0x7f74a80a57c0 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:57.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74ae4da640 10 monclient(hunting): authenticate will time out at 776.022881s 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.981+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 0x7f74a80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 0x7f74a80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33096/0 (socket says 172.21.15.71:33096) 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 -- 172.21.15.71:0/2499195133 learned_addr learned my addr 172.21.15.71:0/2499195133 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f74a80a57c0 0x7f74a80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): get_auth_request con 0x7f74a80a6950 auth_method 0 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): get_auth_request con 0x7f74a80a57c0 auth_method 0 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74a8139710 0x7f74a8139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): get_auth_request con 0x7f74a8139710 auth_method 0 2024-08-19T11:11:57.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74aca77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient(hunting): handle_auth_done global_id 4817 payload 274 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 -- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f74a80a57c0 msgr2=0x7f74a80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f74a80a57c0 0x7f74a80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:57.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 -- 172.21.15.71:0/2499195133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74a8139710 msgr2=0x7f74a8139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74a8139710 0x7f74a8139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient: _finish_hunting 0 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 monclient: found mon.noname-b 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a7fff640 1 -- 172.21.15.71:0/2499195133 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a80a6380 con 0x7f74a80a6950 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.982+0000 7f74a77fe640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f74a80a57c0 0x7f74a80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a7fff640 1 -- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 msgr2=0x7f74a80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a7fff640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 0x7f74a80a6d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74980098d0 tx=0x7f749802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ac4633e1bcb424 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 1 -- 172.21.15.71:0/2499195133 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7498037070 con 0x7f74a80a6950 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: dump: 2024-08-19T11:11:57.997 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:57.998 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 1 -- 172.21.15.71:0/2499195133 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749802adc0 con 0x7f74a80a6950 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 5 monclient: authenticate success, global_id 4817 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 4 set_mon_vals no callback set 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 1 -- 172.21.15.71:0/2499195133 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7498030c20 con 0x7f74a80a6950 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:57.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74a6ffd640 10 monclient: dump: 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.000 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 10 monclient: shutdown 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 -- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 msgr2=0x7f74a80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 0x7f74a80a6d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74980098d0 tx=0x7f749802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 -- 172.21.15.71:0/2499195133 shutdown_connections 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f74a80a57c0 0x7f74a80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74a8139710 0x7f74a8139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 --2- 172.21.15.71:0/2499195133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a6950 0x7f74a80a6d30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 -- 172.21.15.71:0/2499195133 >> 172.21.15.71:0/2499195133 conn(0x7f74a80abf50 msgr2=0x7f74a80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 -- 172.21.15.71:0/2499195133 shutdown_connections 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.985+0000 7f74ae4da640 1 -- 172.21.15.71:0/2499195133 wait complete. 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.986+0000 7f74ae4da640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.986+0000 7f74ae4da640 10 monclient: monmap: 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:58.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.986+0000 7f74ae4da640 1 Processor -- start 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.986+0000 7f74ae4da640 1 -- start start 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.986+0000 7f74ae4da640 10 monclient: init 2024-08-19T11:11:58.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient: _add_conns ranks=[2,1,7,5,4,6,0,3,8] 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 0x7f74a81ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): picked mon.noname-b con 0x7f74a80a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74a80a6950 0x7f74a8138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): picked mon.noname-f con 0x7f74a80a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f74a8139710 0x7f74a8138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): picked mon.noname-i con 0x7f74a8139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74a80a84c0 con 0x7f74a80a6950 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f74a80a3650 con 0x7f74a80a57c0 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f74a80a8700 con 0x7f74a8139710 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74ae4da640 10 monclient(hunting): authenticate will time out at 776.028381s 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 0x7f74a81ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 0x7f74a81ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33104/0 (socket says 172.21.15.71:33104) 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 -- 172.21.15.71:0/1214929014 learned_addr learned my addr 172.21.15.71:0/1214929014 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): get_auth_request con 0x7f74a80a57c0 auth_method 0 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74aca77640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f74a8139710 0x7f74a8138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient(hunting): handle_auth_done global_id 4826 payload 824 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a77fe640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74a80a6950 0x7f74a8138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f74a8139710 msgr2=0x7f74a8138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f74a8139710 0x7f74a8138cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74a80a6950 msgr2=0x7f74a8138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74a80a6950 0x7f74a8138790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 monclient: found mon.noname-b 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.987+0000 7f74a7fff640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a8123df0 con 0x7f74a80a57c0 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.989+0000 7f74a7fff640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 msgr2=0x7f74a81ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.989+0000 7f74a7fff640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 0x7f74a81ce0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f749802a0e0 tx=0x7f74980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7498037040 con 0x7f74a80a57c0 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: dump: 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.008 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7498004490 con 0x7f74a80a57c0 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 5 monclient: authenticate success, global_id 4826 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 10 monclient: _renew_subs 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7498030c20 con 0x7f74a80a57c0 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a81ce630 con 0x7f74a80a57c0 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a4ff9640 10 monclient: dump: 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.010 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74a67fc640 4 set_mon_vals no callback set 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 10 monclient: _renew_subs 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.990+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a8122780 con 0x7f74a80a57c0 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7498003bd0 con 0x7f74a80a57c0 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74ae4da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74ae4da640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 0x7f74a8123550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74a806a590 con 0x7f74a8123170 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a4ff9640 1 --2- 172.21.15.71:0/1214929014 >> v2:172.21.15.135:6800/726754104 conn(0x7f749403ea80 0x7f7494040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 0x7f74a8123550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient: get_auth_request con 0x7f74a8123170 auth_method 0 2024-08-19T11:11:58.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(52..52 src has 1..52) ==== 3506+0+0 (secure 0 0 0) 0x7f7498071da0 con 0x7f74a80a57c0 2024-08-19T11:11:58.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74aca77640 1 --2- 172.21.15.71:0/1214929014 >> v2:172.21.15.135:6800/726754104 conn(0x7f749403ea80 0x7f7494040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74aca77640 10 monclient: get_auth_request con 0x7f749403ea80 auth_method 0 2024-08-19T11:11:58.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 10 monclient(hunting): handle_auth_done global_id 4671 payload 824 2024-08-19T11:11:58.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.991+0000 7f74a77fe640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74a80a1f20 con 0x7f74a8123170 2024-08-19T11:11:58.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.993+0000 7f74a77fe640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 msgr2=0x7f74a8123550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.993+0000 7f74a77fe640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 0x7f74a8123550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74a80a1970 tx=0x7f749c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74aca77640 1 --2- 172.21.15.71:0/1214929014 >> v2:172.21.15.135:6800/726754104 conn(0x7f749403ea80 0x7f7494040f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f74a8074f90 tx=0x7f74a000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f749c00f040 con 0x7f74a8123170 2024-08-19T11:11:58.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:58.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 10 monclient: dump: 2024-08-19T11:11:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.018 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f749c01c400 con 0x7f74a8123170 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:58.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 msgr2=0x7f74a8123550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 0x7f74a8123550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74a80a1970 tx=0x7f749c010c20 comp rx=0 tx=0).stop 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 msgr2=0x7f74a8123550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:57.994+0000 7f74a4ff9640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a8123170 0x7f74a8123550 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f74a80a1970 tx=0x7f749c010c20 comp rx=0 tx=0).stop 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74ae4da640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74ae4da640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 0x7f74a802d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74ae4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74a8076c60 con 0x7f74a802d1c0 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 0x7f74a802d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient: get_auth_request con 0x7f74a802d1c0 auth_method 0 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 10 monclient(hunting): handle_auth_done global_id 4680 payload 824 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.000+0000 7f74a77fe640 1 -- 172.21.15.71:0/1214929014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f74a813a400 con 0x7f74a802d1c0 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a77fe640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 msgr2=0x7f74a802d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a77fe640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 0x7f74a802d5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f749c01a000 tx=0x7f749c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f749c003c90 con 0x7f74a802d1c0 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 10 monclient: dump: 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9436 (secure 0 0 0) 0x7f749c003820 con 0x7f74a802d1c0 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 msgr2=0x7f74a802d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 0x7f74a802d5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f749c01a000 tx=0x7f749c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 msgr2=0x7f74a802d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74a4ff9640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f74a802d1c0 0x7f74a802d5d0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f749c01a000 tx=0x7f749c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.024 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 114880, 2024-08-19T11:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:58.025 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:58.026 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.027 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.028 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:58.030 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:58.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:58.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:58.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:58.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.049 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:58.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.051 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:58.052 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 >> v2:172.21.15.135:6800/726754104 conn(0x7f749403ea80 msgr2=0x7f7494040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 --2- 172.21.15.71:0/1214929014 >> v2:172.21.15.135:6800/726754104 conn(0x7f749403ea80 0x7f7494040f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f74a8074f90 tx=0x7f74a000b040 comp rx=0 tx=0).stop 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 10 monclient: shutdown 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 msgr2=0x7f74a81ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 --2- 172.21.15.71:0/1214929014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f74a80a57c0 0x7f74a81ce0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f749802a0e0 tx=0x7f74980046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74aca77640 1 -- 172.21.15.71:0/1214929014 reap_dead start 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74aca77640 1 -- 172.21.15.71:0/1214929014 reap_dead start 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 shutdown_connections 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 >> 172.21.15.71:0/1214929014 conn(0x7f74a80abf50 msgr2=0x7f74a80aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 shutdown_connections 2024-08-19T11:11:58.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.003+0000 7f74ae4da640 1 -- 172.21.15.71:0/1214929014 wait complete. 2024-08-19T11:11:58.055 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:58.055 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:11:58.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.153+0000 7fc367620640 10 monclient: get_monmap_and_config 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.153+0000 7fc367620640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.153+0000 7fc367620640 10 monclient: monmap: 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:58.153805+0000 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:58.153805+0000 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.154 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:58.155 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.153+0000 7fc367620640 1 Processor -- start 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 -- start start 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient: init 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient: _add_conns ranks=[9,8,2,4,3,7,6,1,10,5,0] 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600a3c80 0x7fc3600a4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): picked mon.noname-a con 0x7fc3600a3c80 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:58.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc3600a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): picked mon.noname-e con 0x7fc36006d3a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc360139900 0x7fc360139d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): picked mon.noname-b con 0x7fc360139900 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc3600a1480 con 0x7fc3600a3c80 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc36006d1a0 con 0x7fc360139900 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc3600a4ae0 con 0x7fc36006d3a0 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc367620640 10 monclient(hunting): authenticate will time out at 776.195614s 2024-08-19T11:11:58.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600a3c80 0x7fc3600a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc3600a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600a3c80 0x7fc3600a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40390/0 (socket says 172.21.15.71:40390) 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc360139900 0x7fc360139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 1 -- 172.21.15.71:0/3960744768 learned_addr learned my addr 172.21.15.71:0/3960744768 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): get_auth_request con 0x7fc3600a3c80 auth_method 0 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): get_auth_request con 0x7fc36006d3a0 auth_method 0 2024-08-19T11:11:58.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): get_auth_request con 0x7fc360139900 auth_method 0 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc3653bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc365bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.154+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 10 monclient(hunting): handle_auth_done global_id 4689 payload 274 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 1 -- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 msgr2=0x7fc3600a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc3600a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 1 -- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc360139900 msgr2=0x7fc360139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc360139900 0x7fc360139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 1 monclient: found mon.noname-a 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc3653bc640 1 -- 172.21.15.71:0/3960744768 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3600a0b50 con 0x7fc3600a3c80 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc364bbb640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc3600a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.155+0000 7fc365bbd640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc360139900 0x7fc360139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.157+0000 7fc3653bc640 1 -- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600a3c80 msgr2=0x7fc3600a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.157+0000 7fc3653bc640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600a3c80 0x7fc3600a4060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc350009e50 tx=0x7fc35002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fa5b8fa33cb260 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.157+0000 7fc35ffff640 1 -- 172.21.15.71:0/3960744768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc350036070 con 0x7fc3600a3c80 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.157+0000 7fc35ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: dump: 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.165 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 5 monclient: authenticate success, global_id 4689 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 1 -- 172.21.15.71:0/3960744768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc350007a70 con 0x7fc3600a3c80 2024-08-19T11:11:58.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 4 set_mon_vals no callback set 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 1 -- 172.21.15.71:0/3960744768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc350007ca0 con 0x7fc3600a3c80 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc35ffff640 10 monclient: dump: 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 10 monclient: shutdown 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 -- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600a3c80 msgr2=0x7fc3600a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600a3c80 0x7fc3600a4060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc350009e50 tx=0x7fc35002a560 comp rx=0 tx=0).stop 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 -- 172.21.15.71:0/3960744768 shutdown_connections 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc360139900 0x7fc360139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc3600a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 --2- 172.21.15.71:0/3960744768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600a3c80 0x7fc3600a4060 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 -- 172.21.15.71:0/3960744768 >> 172.21.15.71:0/3960744768 conn(0x7fc3600a9190 msgr2=0x7fc3600a95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 -- 172.21.15.71:0/3960744768 shutdown_connections 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.158+0000 7fc367620640 1 -- 172.21.15.71:0/3960744768 wait complete. 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.159+0000 7fc367620640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.159+0000 7fc367620640 10 monclient: monmap: 2024-08-19T11:11:58.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.159+0000 7fc367620640 1 Processor -- start 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.159+0000 7fc367620640 1 -- start start 2024-08-19T11:11:58.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.159+0000 7fc367620640 10 monclient: init 2024-08-19T11:11:58.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient: _add_conns ranks=[8,3,0,7,2,5,6,1,4] 2024-08-19T11:11:58.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc36009e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): picked mon.noname-e con 0x7fc36006d3a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3600a3c80 0x7fc360138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): picked mon.noname-g con 0x7fc3600a3c80 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc360139900 0x7fc360138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): picked mon.noname-a con 0x7fc360139900 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc36006cbd0 con 0x7fc360139900 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc36006cef0 con 0x7fc3600a3c80 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc3600a02b0 con 0x7fc36006d3a0 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc367620640 10 monclient(hunting): authenticate will time out at 776.201187s 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc36009e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc360139900 0x7fc360138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc36009e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51046/0 (socket says 172.21.15.71:51046) 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 -- 172.21.15.71:0/526721025 learned_addr learned my addr 172.21.15.71:0/526721025 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): get_auth_request con 0x7fc36006d3a0 auth_method 0 2024-08-19T11:11:58.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): get_auth_request con 0x7fc360139900 auth_method 0 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc364bbb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3600a3c80 0x7fc360138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc364bbb640 10 monclient(hunting): get_auth_request con 0x7fc3600a3c80 auth_method 0 2024-08-19T11:11:58.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc364bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc364bbb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc364bbb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient(hunting): handle_auth_done global_id 4661 payload 824 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3600a3c80 msgr2=0x7fc360138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3600a3c80 0x7fc360138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc360139900 msgr2=0x7fc360138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc360139900 0x7fc360138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 monclient: found mon.noname-e 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:58.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc3653bc640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc360123cb0 con 0x7fc36006d3a0 2024-08-19T11:11:58.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.160+0000 7fc365bbd640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc360139900 0x7fc360138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc3653bc640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 msgr2=0x7fc36009e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc3653bc640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc36009e990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc35002ab50 tx=0x7fc350004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc350036050 con 0x7fc36006d3a0 2024-08-19T11:11:58.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: dump: 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.185 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc367620640 5 monclient: authenticate success, global_id 4661 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc350042070 con 0x7fc36006d3a0 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc367620640 10 monclient: _renew_subs 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc367620640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36013a390 con 0x7fc36006d3a0 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc350003db0 con 0x7fc36006d3a0 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc35dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc35dffb640 10 monclient: dump: 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.187 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc367620640 10 monclient: _renew_subs 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc367620640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc360126430 con 0x7fc36006d3a0 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.162+0000 7fc35f7fe640 4 set_mon_vals no callback set 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc367620640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.163+0000 7fc367620640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 0x7fc3601ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc360076c60 con 0x7fc3601ce160 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc350004040 con 0x7fc36006d3a0 2024-08-19T11:11:58.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 0x7fc3601ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient: get_auth_request con 0x7fc3601ce160 auth_method 0 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc35dffb640 1 --2- 172.21.15.71:0/526721025 >> v2:172.21.15.135:6800/726754104 conn(0x7fc34c03ea80 0x7fc34c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(52..52 src has 1..52) ==== 3506+0+0 (secure 0 0 0) 0x7fc3500727f0 con 0x7fc36006d3a0 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 10 monclient(hunting): handle_auth_done global_id 4844 payload 824 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc364bbb640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3600a4060 con 0x7fc3601ce160 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc365bbd640 1 --2- 172.21.15.71:0/526721025 >> v2:172.21.15.135:6800/726754104 conn(0x7fc34c03ea80 0x7fc34c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.164+0000 7fc365bbd640 10 monclient: get_auth_request con 0x7fc34c03ea80 auth_method 0 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc364bbb640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 msgr2=0x7fc3601ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc364bbb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 0x7fc3601ce540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc360125f40 tx=0x7fc354011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc354015dd0 con 0x7fc3601ce160 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc35dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc35dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:58.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc35dffb640 10 monclient: dump: 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.192 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc365bbd640 1 --2- 172.21.15.71:0/526721025 >> v2:172.21.15.135:6800/726754104 conn(0x7fc34c03ea80 0x7fc34c040f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc358009560 tx=0x7fc358009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.166+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc354015960 con 0x7fc3601ce160 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.167+0000 7fc35dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.167+0000 7fc35dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:58.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.167+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 msgr2=0x7fc3601ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.167+0000 7fc35dffb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 0x7fc3601ce540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc360125f40 tx=0x7fc354011990 comp rx=0 tx=0).stop 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.167+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 msgr2=0x7fc3601ce540 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.167+0000 7fc35dffb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601ce160 0x7fc3601ce540 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc360125f40 tx=0x7fc354011990 comp rx=0 tx=0).stop 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc367620640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc367620640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 0x7fc360071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc367620640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc360126000 con 0x7fc3601cea80 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 0x7fc360071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient: get_auth_request con 0x7fc3601cea80 auth_method 0 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 10 monclient(hunting): handle_auth_done global_id 4853 payload 824 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.173+0000 7fc364bbb640 1 -- 172.21.15.71:0/526721025 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc36006ecf0 con 0x7fc3601cea80 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.175+0000 7fc364bbb640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 msgr2=0x7fc360071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.175+0000 7fc364bbb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 0x7fc360071290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc360125f40 tx=0x7fc3540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.175+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc354004490 con 0x7fc3601cea80 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.175+0000 7fc35dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.175+0000 7fc35dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.175+0000 7fc35dffb640 10 monclient: dump: 2024-08-19T11:11:58.195 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.196 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fc354022570 con 0x7fc3601cea80 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 msgr2=0x7fc360071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 0x7fc360071290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc360125f40 tx=0x7fc3540046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 msgr2=0x7fc360071290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc35dffb640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3601cea80 0x7fc360071290 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc360125f40 tx=0x7fc3540046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 115054, 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:58.198 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.199 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.200 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.201 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:58.202 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.203 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.204 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:58.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.217 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.219 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:58.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.221 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:58.222 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.224 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:58.225 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 >> v2:172.21.15.135:6800/726754104 conn(0x7fc34c03ea80 msgr2=0x7fc34c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 --2- 172.21.15.71:0/526721025 >> v2:172.21.15.135:6800/726754104 conn(0x7fc34c03ea80 0x7fc34c040f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc358009560 tx=0x7fc358009190 comp rx=0 tx=0).stop 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 10 monclient: shutdown 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 msgr2=0x7fc36009e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc36009e990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc35002ab50 tx=0x7fc350004a40 comp rx=0 tx=0).stop 2024-08-19T11:11:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc365bbd640 1 -- 172.21.15.71:0/526721025 reap_dead start 2024-08-19T11:11:58.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 shutdown_connections 2024-08-19T11:11:58.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 --2- 172.21.15.71:0/526721025 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc36006d3a0 0x7fc36009e990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 >> 172.21.15.71:0/526721025 conn(0x7fc3600a9190 msgr2=0x7fc3600a9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 shutdown_connections 2024-08-19T11:11:58.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.176+0000 7fc367620640 1 -- 172.21.15.71:0/526721025 wait complete. 2024-08-19T11:11:58.228 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:58.228 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:11:58.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:11:58.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.326+0000 7fbbfaaf6640 10 monclient: get_monmap_and_config 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.326+0000 7fbbfaaf6640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.326+0000 7fbbfaaf6640 10 monclient: monmap: 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:58.327303+0000 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:58.327303+0000 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.328 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:58.329 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 1 Processor -- start 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 1 -- start start 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 10 monclient: init 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 10 monclient: _add_conns ranks=[5,4,8,3,7,9,10,6,0,2,1] 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbbf409b510 0x7fbbf40a0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 10 monclient(hunting): picked mon.noname-h con 0x7fbbf409b510 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 0x7fbbf409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 10 monclient(hunting): picked mon.noname-c con 0x7fbbf40693a0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf40a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.327+0000 7fbbfaaf6640 10 monclient(hunting): picked mon.noname-e con 0x7fbbf409be30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbbf40a5d60 con 0x7fbbf40693a0 2024-08-19T11:11:58.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbbf409eb90 con 0x7fbbf409b510 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbbf409fa10 con 0x7fbbf409be30 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbfaaf6640 10 monclient(hunting): authenticate will time out at 776.369032s 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 0x7fbbf409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf40a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 0x7fbbf409b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48452/0 (socket says 172.21.15.71:48452) 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 1 -- 172.21.15.71:0/4077406419 learned_addr learned my addr 172.21.15.71:0/4077406419 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): get_auth_request con 0x7fbbf40693a0 auth_method 0 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): get_auth_request con 0x7fbbf409be30 auth_method 0 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf8892640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbbf409b510 0x7fbbf40a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient(hunting): handle_auth_done global_id 4670 payload 274 2024-08-19T11:11:58.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 -- 172.21.15.71:0/4077406419 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbbf409b510 msgr2=0x7fbbf40a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbbf409b510 0x7fbbf40a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 -- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 msgr2=0x7fbbf409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 0x7fbbf409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 monclient: found mon.noname-e 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf9093640 1 -- 172.21.15.71:0/4077406419 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf409fcf0 con 0x7fbbf409be30 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.328+0000 7fbbf3fff640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 0x7fbbf409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf9093640 1 -- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 msgr2=0x7fbbf40a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf9093640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf40a3d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009dc0 tx=0x7fbbec02a480 comp rx=0 tx=0).ready entity=mon.8 client_cookie=95db1cb1f107c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 1 -- 172.21.15.71:0/4077406419 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbbec007bc0 con 0x7fbbf409be30 2024-08-19T11:11:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: dump: 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.338 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 1 -- 172.21.15.71:0/4077406419 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec007d80 con 0x7fbbf409be30 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 5 monclient: authenticate success, global_id 4670 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 1 -- 172.21.15.71:0/4077406419 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbbec031870 con 0x7fbbf409be30 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 4 set_mon_vals no callback set 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbf37fe640 10 monclient: dump: 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 10 monclient: shutdown 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 msgr2=0x7fbbf40a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf40a3d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009dc0 tx=0x7fbbec02a480 comp rx=0 tx=0).stop 2024-08-19T11:11:58.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/4077406419 shutdown_connections 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf40a3d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40693a0 0x7fbbf409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/4077406419 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbbf409b510 0x7fbbf40a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/4077406419 >> 172.21.15.71:0/4077406419 conn(0x7fbbf40a4e70 msgr2=0x7fbbf40a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/4077406419 shutdown_connections 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.331+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/4077406419 wait complete. 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.332+0000 7fbbfaaf6640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.332+0000 7fbbfaaf6640 10 monclient: monmap: 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:58.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.332+0000 7fbbfaaf6640 1 Processor -- start 2024-08-19T11:11:58.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.332+0000 7fbbfaaf6640 1 -- start start 2024-08-19T11:11:58.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.332+0000 7fbbfaaf6640 10 monclient: init 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient: _add_conns ranks=[6,4,8,7,5,0,1,2,3] 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbbf40693a0 0x7fbbf41cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): picked mon.noname-d con 0x7fbbf40693a0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 0x7fbbf41ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): picked mon.noname-c con 0x7fbbf409b510 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:58.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf4091e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): picked mon.noname-e con 0x7fbbf409be30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbbf40a4690 con 0x7fbbf409b510 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbbf40a4510 con 0x7fbbf40693a0 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbbf40a4810 con 0x7fbbf409be30 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbfaaf6640 10 monclient(hunting): authenticate will time out at 776.374457s 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 0x7fbbf41ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbbf40693a0 0x7fbbf41cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 0x7fbbf41ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48460/0 (socket says 172.21.15.71:48460) 2024-08-19T11:11:58.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 -- 172.21.15.71:0/3467137741 learned_addr learned my addr 172.21.15.71:0/3467137741 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): get_auth_request con 0x7fbbf40693a0 auth_method 0 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): get_auth_request con 0x7fbbf409b510 auth_method 0 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf4091e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): get_auth_request con 0x7fbbf409be30 auth_method 0 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient(hunting): handle_auth_done global_id 4657 payload 824 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 msgr2=0x7fbbf4091e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf4091e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbbf40693a0 msgr2=0x7fbbf41cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbbf40693a0 0x7fbbf41cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 monclient: found mon.noname-c 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf3fff640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf4094ed0 con 0x7fbbf409b510 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf8892640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbbf40693a0 0x7fbbf41cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.333+0000 7fbbf9093640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbbf409be30 0x7fbbf4091e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf3fff640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 msgr2=0x7fbbf41ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf3fff640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 0x7fbbf41ccb20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0010ce0 tx=0x7fbbe000b510 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbbe001e070 con 0x7fbbf409b510 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: dump: 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.355 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe000be30 con 0x7fbbf409b510 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 5 monclient: authenticate success, global_id 4657 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 10 monclient: _renew_subs 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbbe0017e00 con 0x7fbbf409b510 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:58.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf4095470 con 0x7fbbf409b510 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf17fa640 10 monclient: dump: 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.357 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbf2ffd640 4 set_mon_vals no callback set 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 10 monclient: _renew_subs 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.336+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf4099f40 con 0x7fbbf409b510 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbfaaf6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 0x7fbbf4092780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbbf4076c60 con 0x7fbbf40923a0 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbbe0017520 con 0x7fbbf409b510 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 0x7fbbf4092780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient: get_auth_request con 0x7fbbf40923a0 auth_method 0 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf17fa640 1 --2- 172.21.15.71:0/3467137741 >> v2:172.21.15.135:6800/726754104 conn(0x7fbbd803ea80 0x7fbbd8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 10 monclient(hunting): handle_auth_done global_id 4666 payload 824 2024-08-19T11:11:58.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf8892640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbf409e380 con 0x7fbbf40923a0 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(52..52 src has 1..52) ==== 3506+0+0 (secure 0 0 0) 0x7fbbe0016070 con 0x7fbbf409b510 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf9093640 1 --2- 172.21.15.71:0/3467137741 >> v2:172.21.15.135:6800/726754104 conn(0x7fbbd803ea80 0x7fbbd8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.337+0000 7fbbf9093640 10 monclient: get_auth_request con 0x7fbbd803ea80 auth_method 0 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.339+0000 7fbbf8892640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 msgr2=0x7fbbf4092780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.339+0000 7fbbf8892640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 0x7fbbf4092780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800fb50 tx=0x7fbbe800d590 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.339+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbbe800fe50 con 0x7fbbf40923a0 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.339+0000 7fbbf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.339+0000 7fbbf17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.339+0000 7fbbf17fa640 10 monclient: dump: 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.360 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.361 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbbe800fe50 con 0x7fbbf40923a0 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 msgr2=0x7fbbf4092780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 0x7fbbf4092780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800fb50 tx=0x7fbbe800d590 comp rx=0 tx=0).stop 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 msgr2=0x7fbbf4092780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf17fa640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf40923a0 0x7fbbf4092780 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800fb50 tx=0x7fbbe800d590 comp rx=0 tx=0).stop 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.340+0000 7fbbf9093640 1 --2- 172.21.15.71:0/3467137741 >> v2:172.21.15.135:6800/726754104 conn(0x7fbbd803ea80 0x7fbbd8040f40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009d90 tx=0x7fbbec02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbfaaf6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 0x7fbbf408df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbfaaf6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbbf4069ed0 con 0x7fbbf4092cc0 2024-08-19T11:11:58.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 0x7fbbf408df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient: get_auth_request con 0x7fbbf4092cc0 auth_method 0 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 10 monclient(hunting): handle_auth_done global_id 4675 payload 824 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.346+0000 7fbbf8892640 1 -- 172.21.15.71:0/3467137741 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbbf40a0460 con 0x7fbbf4092cc0 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.348+0000 7fbbf8892640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 msgr2=0x7fbbf408df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.348+0000 7fbbf8892640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 0x7fbbf408df80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800fb50 tx=0x7fbbe80046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.348+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbbe8000e60 con 0x7fbbf4092cc0 2024-08-19T11:11:58.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.348+0000 7fbbf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.348+0000 7fbbf17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.348+0000 7fbbf17fa640 10 monclient: dump: 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.364 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fbbe8024070 con 0x7fbbf4092cc0 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 msgr2=0x7fbbf408df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 0x7fbbf408df80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800fb50 tx=0x7fbbe80046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 msgr2=0x7fbbf408df80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf17fa640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf4092cc0 0x7fbbf408df80 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800fb50 tx=0x7fbbe80046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 115219, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:58.389 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 >> v2:172.21.15.135:6800/726754104 conn(0x7fbbd803ea80 msgr2=0x7fbbd8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/3467137741 >> v2:172.21.15.135:6800/726754104 conn(0x7fbbd803ea80 0x7fbbd8040f40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009d90 tx=0x7fbbec02f000 comp rx=0 tx=0).stop 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 10 monclient: shutdown 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 msgr2=0x7fbbf41ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 --2- 172.21.15.71:0/3467137741 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbbf409b510 0x7fbbf41ccb20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0010ce0 tx=0x7fbbe000b510 comp rx=0 tx=0).stop 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf9093640 1 -- 172.21.15.71:0/3467137741 reap_dead start 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbf9093640 1 -- 172.21.15.71:0/3467137741 reap_dead start 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 shutdown_connections 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 >> 172.21.15.71:0/3467137741 conn(0x7fbbf40a4e70 msgr2=0x7fbbf4073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 shutdown_connections 2024-08-19T11:11:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.349+0000 7fbbfaaf6640 1 -- 172.21.15.71:0/3467137741 wait complete. 2024-08-19T11:11:58.391 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:58.392 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:11:58.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:11:58.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.490+0000 7fcd965f7640 10 monclient: get_monmap_and_config 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.490+0000 7fcd965f7640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.490+0000 7fcd965f7640 10 monclient: monmap: 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:58.491579+0000 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:58.491579+0000 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:58.492 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:58.493 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.491+0000 7fcd965f7640 1 Processor -- start 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.491+0000 7fcd965f7640 1 -- start start 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.491+0000 7fcd965f7640 10 monclient: init 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient: _add_conns ranks=[6,4,2,5,7,3,0,9,1,8,10] 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 0x7fcd90136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): picked mon.noname-d con 0x7fcd900a3d80 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 0x7fcd90136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): picked mon.noname-c con 0x7fcd90136ab0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 0x7fcd900a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): picked mon.noname-b con 0x7fcd900a4160 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcd900a1fa0 con 0x7fcd900a4160 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcd9009fe70 con 0x7fcd90136ab0 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd901373d0 con 0x7fcd900a3d80 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd965f7640 10 monclient(hunting): authenticate will time out at 776.533243s 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 0x7fcd90136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 0x7fcd900a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 0x7fcd90136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 0x7fcd90136e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48492/0 (socket says 172.21.15.71:48492) 2024-08-19T11:11:58.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 0x7fcd900a45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33122/0 (socket says 172.21.15.71:33122) 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 0x7fcd90136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43828/0 (socket says 172.21.15.71:43828) 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 -- 172.21.15.71:0/2753362620 learned_addr learned my addr 172.21.15.71:0/2753362620 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): get_auth_request con 0x7fcd900a4160 auth_method 0 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): get_auth_request con 0x7fcd90136ab0 auth_method 0 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): get_auth_request con 0x7fcd900a3d80 auth_method 0 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient(hunting): handle_auth_done global_id 4862 payload 274 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 -- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 msgr2=0x7fcd90136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 0x7fcd90136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 -- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 msgr2=0x7fcd90136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 0x7fcd90136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 monclient: found mon.noname-b 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd94b94640 1 -- 172.21.15.71:0/2753362620 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd900a0b70 con 0x7fcd900a4160 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8ffff640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 0x7fcd90136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.492+0000 7fcd8f7fe640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 0x7fcd90136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd94b94640 1 -- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 msgr2=0x7fcd900a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd94b94640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 0x7fcd900a45e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009e80 tx=0x7fcd8802a520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae35ed1e73efe634 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 1 -- 172.21.15.71:0/2753362620 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd88036070 con 0x7fcd900a4160 2024-08-19T11:11:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: dump: 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd965f7640 5 monclient: authenticate success, global_id 4862 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 1 -- 172.21.15.71:0/2753362620 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd88007a70 con 0x7fcd900a4160 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd965f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd965f7640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd965f7640 4 set_mon_vals no callback set 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 1 -- 172.21.15.71:0/2753362620 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd88007c60 con 0x7fcd900a4160 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.495+0000 7fcd8effd640 10 monclient: dump: 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 10 monclient: shutdown 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 -- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 msgr2=0x7fcd900a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 0x7fcd900a45e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009e80 tx=0x7fcd8802a520 comp rx=0 tx=0).stop 2024-08-19T11:11:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 -- 172.21.15.71:0/2753362620 shutdown_connections 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd900a4160 0x7fcd900a45e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd90136ab0 0x7fcd90136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 --2- 172.21.15.71:0/2753362620 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd900a3d80 0x7fcd90136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 -- 172.21.15.71:0/2753362620 >> 172.21.15.71:0/2753362620 conn(0x7fcd900a91d0 msgr2=0x7fcd900a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 -- 172.21.15.71:0/2753362620 shutdown_connections 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 1 -- 172.21.15.71:0/2753362620 wait complete. 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.496+0000 7fcd965f7640 10 monclient: monmap: 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:58.507 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 Processor -- start 2024-08-19T11:11:58.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 -- start start 2024-08-19T11:11:58.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient: init 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient: _add_conns ranks=[5,3,7,2,0,8,4,1,6] 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd900a3d80 0x7fcd90125080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): picked mon.noname-h con 0x7fcd900a3d80 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd900a4160 0x7fcd90122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): picked mon.noname-g con 0x7fcd900a4160 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 0x7fcd90122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): picked mon.noname-i con 0x7fcd90136ab0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd900a08c0 con 0x7fcd900a4160 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcd900a2520 con 0x7fcd900a3d80 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcd900a2ca0 con 0x7fcd90136ab0 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.497+0000 7fcd965f7640 10 monclient(hunting): authenticate will time out at 776.538893s 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 0x7fcd90122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd900a4160 0x7fcd90122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 0x7fcd90122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:52592/0 (socket says 172.21.15.71:52592) 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 learned_addr learned my addr 172.21.15.71:0/3124006398 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): get_auth_request con 0x7fcd90136ab0 auth_method 0 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd900a3d80 0x7fcd90125080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): get_auth_request con 0x7fcd900a4160 auth_method 0 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): get_auth_request con 0x7fcd900a3d80 auth_method 0 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient(hunting): handle_auth_done global_id 4606 payload 824 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd900a3d80 msgr2=0x7fcd90125080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd900a3d80 0x7fcd90125080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd900a4160 msgr2=0x7fcd90122ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd900a4160 0x7fcd90122ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 monclient: found mon.noname-i 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd90126880 con 0x7fcd90136ab0 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.498+0000 7fcd8f7fe640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd900a4160 0x7fcd90122ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.500+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 msgr2=0x7fcd90122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.500+0000 7fcd94b94640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 0x7fcd90122ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd88034040 tx=0x7fcd88004a40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd880078b0 con 0x7fcd90136ab0 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: dump: 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.521 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 5 monclient: authenticate success, global_id 4606 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd88003db0 con 0x7fcd90136ab0 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 10 monclient: _renew_subs 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd900a1710 con 0x7fcd90136ab0 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd88044480 con 0x7fcd90136ab0 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:11:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8cff9640 10 monclient: dump: 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 10 monclient: _renew_subs 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd90125a10 con 0x7fcd90136ab0 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd8e7fc640 4 set_mon_vals no callback set 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 0x7fcd9006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.501+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd90076c60 con 0x7fcd90123530 2024-08-19T11:11:58.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 0x7fcd9006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient: get_auth_request con 0x7fcd90123530 auth_method 0 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcd88004040 con 0x7fcd90136ab0 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_done global_id 24162 payload 824 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8ffff640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd90123910 con 0x7fcd90123530 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8cff9640 1 --2- 172.21.15.71:0/3124006398 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd7c03ea80 0x7fcd7c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(52..52 src has 1..52) ==== 3506+0+0 (secure 0 0 0) 0x7fcd880746d0 con 0x7fcd90136ab0 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8f7fe640 1 --2- 172.21.15.71:0/3124006398 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd7c03ea80 0x7fcd7c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.502+0000 7fcd8f7fe640 10 monclient: get_auth_request con 0x7fcd7c03ea80 auth_method 0 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8ffff640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 msgr2=0x7fcd9006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8ffff640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 0x7fcd9006c8a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd800118e0 tx=0x7fcd80011da0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd800148b0 con 0x7fcd90123530 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8cff9640 10 monclient: dump: 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.527 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.504+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcd80014440 con 0x7fcd90123530 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 msgr2=0x7fcd9006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8cff9640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 0x7fcd9006c8a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcd800118e0 tx=0x7fcd80011da0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 msgr2=0x7fcd9006c8a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8cff9640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd90123530 0x7fcd9006c8a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.505+0000 7fcd8f7fe640 1 --2- 172.21.15.71:0/3124006398 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd7c03ea80 0x7fcd7c040f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009560 tx=0x7fcd84009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.510+0000 7fcd965f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd965f7640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 0x7fcd9006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd965f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd90124580 con 0x7fcd9006cde0 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 0x7fcd9006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient: get_auth_request con 0x7fcd9006cde0 auth_method 0 2024-08-19T11:11:58.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 10 monclient(hunting): handle_auth_done global_id 24171 payload 824 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.511+0000 7fcd8ffff640 1 -- 172.21.15.71:0/3124006398 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd90136570 con 0x7fcd9006cde0 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8ffff640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 msgr2=0x7fcd9006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8ffff640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 0x7fcd9006d1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000c00 tx=0x7fcd800046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd80022e00 con 0x7fcd9006cde0 2024-08-19T11:11:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 10 monclient: dump: 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7fcd8002b3b0 con 0x7fcd9006cde0 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 msgr2=0x7fcd9006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 0x7fcd9006d1f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000c00 tx=0x7fcd800046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 msgr2=0x7fcd9006d1f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.513+0000 7fcd8cff9640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd9006cde0 0x7fcd9006d1f0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000c00 tx=0x7fcd800046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 26127, 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:58.533 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:58.534 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.535 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.536 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:58.537 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:58.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.547 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:58.548 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.549 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:58.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.553 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.555 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.557 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:58.557 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd7c03ea80 msgr2=0x7fcd7c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 --2- 172.21.15.71:0/3124006398 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd7c03ea80 0x7fcd7c040f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009560 tx=0x7fcd84009190 comp rx=0 tx=0).stop 2024-08-19T11:11:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 10 monclient: shutdown 2024-08-19T11:11:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 msgr2=0x7fcd90122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 --2- 172.21.15.71:0/3124006398 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcd90136ab0 0x7fcd90122ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd88034040 tx=0x7fcd88004a40 comp rx=0 tx=0).stop 2024-08-19T11:11:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 reap_dead start 2024-08-19T11:11:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd94b94640 1 -- 172.21.15.71:0/3124006398 reap_dead start 2024-08-19T11:11:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 shutdown_connections 2024-08-19T11:11:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 >> 172.21.15.71:0/3124006398 conn(0x7fcd900a91d0 msgr2=0x7fcd9009ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 shutdown_connections 2024-08-19T11:11:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.514+0000 7fcd965f7640 1 -- 172.21.15.71:0/3124006398 wait complete. 2024-08-19T11:11:58.559 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:58.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:11:58.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.659+0000 7fbda319a640 10 monclient: get_monmap_and_config 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.659+0000 7fbda319a640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.659+0000 7fbda319a640 10 monclient: monmap: 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:58.659672+0000 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:58.659672+0000 2024-08-19T11:11:58.660 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.661 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.662 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.662 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:58.662 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:58.662 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.659+0000 7fbda319a640 1 Processor -- start 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.659+0000 7fbda319a640 1 -- start start 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.659+0000 7fbda319a640 10 monclient: init 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient: _add_conns ranks=[10,4,7,8,6,5,9,1,0,3,2] 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd9c06c8a0 0x7fbd9c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): picked mon.noname-f con 0x7fbd9c06c8a0 addr v2:172.21.15.135:3300/0 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): picked mon.noname-c con 0x7fbd9c06d1c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbd9c137ac0 0x7fbd9c137f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): picked mon.noname-i con 0x7fbd9c137ac0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9c09feb0 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbd9c074430 con 0x7fbd9c06d1c0 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fbd9c09cb20 con 0x7fbd9c137ac0 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda319a640 10 monclient(hunting): authenticate will time out at 776.701290s 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c137580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48504/0 (socket says 172.21.15.71:48504) 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 -- 172.21.15.71:0/684547567 learned_addr learned my addr 172.21.15.71:0/684547567 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): get_auth_request con 0x7fbd9c06d1c0 auth_method 0 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient(hunting): handle_auth_done global_id 4693 payload 274 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 -- 172.21.15.71:0/684547567 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbd9c137ac0 msgr2=0x7fbd9c137f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 --2- 172.21.15.71:0/684547567 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbd9c137ac0 0x7fbd9c137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda0f36640 1 --2- 172.21.15.71:0/684547567 >> v2:172.21.15.135:3300/0 conn(0x7fbd9c06c8a0 0x7fbd9c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 -- 172.21.15.71:0/684547567 >> v2:172.21.15.135:3300/0 conn(0x7fbd9c06c8a0 msgr2=0x7fbd9c06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 --2- 172.21.15.71:0/684547567 >> v2:172.21.15.135:3300/0 conn(0x7fbd9c06c8a0 0x7fbd9c06cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 monclient: found mon.noname-c 2024-08-19T11:11:58.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbd93fff640 1 -- 172.21.15.71:0/684547567 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c0a3d60 con 0x7fbd9c06d1c0 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda0f36640 10 monclient: get_auth_request con 0x7fbd9c06c8a0 auth_method 0 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.660+0000 7fbda0f36640 1 --2- 172.21.15.71:0/684547567 >> v2:172.21.15.135:3300/0 conn(0x7fbd9c06c8a0 0x7fbd9c06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd93fff640 1 -- 172.21.15.71:0/684547567 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 msgr2=0x7fbd9c137580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd93fff640 1 --2- 172.21.15.71:0/684547567 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c137580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009870 tx=0x7fbd8c02a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5996f552a52dc57d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 1 -- 172.21.15.71:0/684547567 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd8c037070 con 0x7fbd9c06d1c0 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: dump: 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.670 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 1 -- 172.21.15.71:0/684547567 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0307b0 con 0x7fbd9c06d1c0 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbda319a640 5 monclient: authenticate success, global_id 4693 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbda319a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbda319a640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 1 -- 172.21.15.71:0/684547567 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd8c030e50 con 0x7fbd9c06d1c0 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbda319a640 4 set_mon_vals no callback set 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.663+0000 7fbd937fe640 10 monclient: dump: 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 10 monclient: shutdown 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 -- 172.21.15.71:0/684547567 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 msgr2=0x7fbd9c137580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 --2- 172.21.15.71:0/684547567 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c137580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009870 tx=0x7fbd8c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 -- 172.21.15.71:0/684547567 shutdown_connections 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 --2- 172.21.15.71:0/684547567 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbd9c137ac0 0x7fbd9c137f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 --2- 172.21.15.71:0/684547567 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c137580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 --2- 172.21.15.71:0/684547567 >> v2:172.21.15.135:3300/0 conn(0x7fbd9c06c8a0 0x7fbd9c06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 -- 172.21.15.71:0/684547567 >> 172.21.15.71:0/684547567 conn(0x7fbd9c0a91d0 msgr2=0x7fbd9c0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 -- 172.21.15.71:0/684547567 shutdown_connections 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 1 -- 172.21.15.71:0/684547567 wait complete. 2024-08-19T11:11:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.664+0000 7fbda319a640 10 monclient: monmap: 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 Processor -- start 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 -- start start 2024-08-19T11:11:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient: init 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient: _add_conns ranks=[6,5,3,2,8,4,1,7,0] 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 0x7fbd9c1ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): picked mon.noname-d con 0x7fbd9c06c8a0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): picked mon.noname-h con 0x7fbd9c06d1c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd9c137ac0 0x7fbd9c1cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): picked mon.noname-g con 0x7fbd9c137ac0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c06d5a0 con 0x7fbd9c137ac0 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbd9c0a27f0 con 0x7fbd9c06d1c0 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbd9c09ecf0 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda319a640 10 monclient(hunting): authenticate will time out at 776.706877s 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.665+0000 7fbda0f36640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 0x7fbd9c1ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 0x7fbd9c1ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43862/0 (socket says 172.21.15.71:43862) 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 -- 172.21.15.71:0/2357919671 learned_addr learned my addr 172.21.15.71:0/2357919671 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): get_auth_request con 0x7fbd9c06c8a0 auth_method 0 2024-08-19T11:11:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd9c137ac0 0x7fbd9c1cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): get_auth_request con 0x7fbd9c06d1c0 auth_method 0 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): get_auth_request con 0x7fbd9c137ac0 auth_method 0 2024-08-19T11:11:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda1737640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient(hunting): handle_auth_done global_id 24180 payload 824 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd9c06d1c0 msgr2=0x7fbd9c136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd9c06d1c0 0x7fbd9c136ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd9c137ac0 msgr2=0x7fbd9c1cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd9c137ac0 0x7fbd9c1cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 monclient: found mon.noname-d 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.666+0000 7fbda0f36640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c0a6450 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda0f36640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 msgr2=0x7fbd9c1ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda0f36640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 0x7fbd9c1ce560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800cf90 tx=0x7fbd9800a7d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd9801a070 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:11:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: dump: 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9800dcc0 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 5 monclient: authenticate success, global_id 24180 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 10 monclient: _renew_subs 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c0a1a00 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd980137b0 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd917fa640 10 monclient: dump: 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 10 monclient: _renew_subs 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c137540 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.668+0000 7fbd92ffd640 4 set_mon_vals no callback set 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbda319a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbda319a640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 0x7fbd9c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbd9c06a590 con 0x7fbd9c124d90 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 0x7fbd9c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient: get_auth_request con 0x7fbd9c124d90 auth_method 0 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbd98013340 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 10 monclient(hunting): handle_auth_done global_id 4688 payload 824 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd917fa640 1 --2- 172.21.15.71:0/2357919671 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd8803eab0 0x7fbd88040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd93fff640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd9c1377b0 con 0x7fbd9c124d90 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.669+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(52..52 src has 1..52) ==== 3506+0+0 (secure 0 0 0) 0x7fbd980522c0 con 0x7fbd9c06c8a0 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.670+0000 7fbda1737640 1 --2- 172.21.15.71:0/2357919671 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd8803eab0 0x7fbd88040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.670+0000 7fbda1737640 10 monclient: get_auth_request con 0x7fbd8803eab0 auth_method 0 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd93fff640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 msgr2=0x7fbd9c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd93fff640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 0x7fbd9c02d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c06f080 tx=0x7fbd8c0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd8c043070 con 0x7fbd9c124d90 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 10 monclient: dump: 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbd8c003b10 con 0x7fbd9c124d90 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 msgr2=0x7fbd9c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 0x7fbd9c02d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c06f080 tx=0x7fbd8c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 msgr2=0x7fbd9c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbd917fa640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c124d90 0x7fbd9c02d1c0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c06f080 tx=0x7fbd8c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.672+0000 7fbda1737640 1 --2- 172.21.15.71:0/2357919671 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd8803eab0 0x7fbd88040f70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd94006a00 tx=0x7fbd94006990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbda319a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbda319a640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 0x7fbd9c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbda319a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbd9c06d720 con 0x7fbd9c136ff0 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 0x7fbd9c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient: get_auth_request con 0x7fbd9c136ff0 auth_method 0 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 10 monclient(hunting): handle_auth_done global_id 4697 payload 824 2024-08-19T11:11:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.678+0000 7fbd93fff640 1 -- 172.21.15.71:0/2357919671 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd9c09d4f0 con 0x7fbd9c136ff0 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd93fff640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 msgr2=0x7fbd9c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd93fff640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 0x7fbd9c02d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c035040 tx=0x7fbd8c008030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd8c037040 con 0x7fbd9c136ff0 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 10 monclient: dump: 2024-08-19T11:11:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fbd8c0489c0 con 0x7fbd9c136ff0 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 msgr2=0x7fbd9c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 0x7fbd9c02d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c035040 tx=0x7fbd8c008030 comp rx=0 tx=0).stop 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 msgr2=0x7fbd9c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbd917fa640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd9c136ff0 0x7fbd9c02d700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.697 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 115551, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:58.721 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd8803eab0 msgr2=0x7fbd88040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 --2- 172.21.15.71:0/2357919671 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd8803eab0 0x7fbd88040f70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd94006a00 tx=0x7fbd94006990 comp rx=0 tx=0).stop 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 10 monclient: shutdown 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 msgr2=0x7fbd9c1ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 --2- 172.21.15.71:0/2357919671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd9c06c8a0 0x7fbd9c1ce560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800cf90 tx=0x7fbd9800a7d0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda1737640 1 -- 172.21.15.71:0/2357919671 reap_dead start 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda1737640 1 -- 172.21.15.71:0/2357919671 reap_dead start 2024-08-19T11:11:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 shutdown_connections 2024-08-19T11:11:58.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 >> 172.21.15.71:0/2357919671 conn(0x7fbd9c0a91d0 msgr2=0x7fbd9c072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 shutdown_connections 2024-08-19T11:11:58.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.681+0000 7fbda319a640 1 -- 172.21.15.71:0/2357919671 wait complete. 2024-08-19T11:11:58.723 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:58.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:11:58.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.821+0000 7f9cd358a640 10 monclient: get_monmap_and_config 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.821+0000 7f9cd358a640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.821+0000 7f9cd358a640 10 monclient: monmap: 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:58.821756+0000 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:58.821756+0000 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:58.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:58.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.821+0000 7f9cd358a640 1 Processor -- start 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.821+0000 7f9cd358a640 1 -- start start 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.821+0000 7f9cd358a640 10 monclient: init 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient: _add_conns ranks=[0,9,3,7,8,6,10,1,2,4,5] 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9ccc0a47c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0a52b0 0x7f9ccc13ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): picked mon.noname-a con 0x7f9ccc0a52b0 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc1414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): picked mon.noname-g con 0x7f9ccc13f0f0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc0a32a0 con 0x7f9ccc0a47c0 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9ccc0a1540 con 0x7f9ccc0a52b0 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc06cc40 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd358a640 10 monclient(hunting): authenticate will time out at 776.863477s 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0a52b0 0x7f9ccc13ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0a52b0 0x7f9ccc13ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40400/0 (socket says 172.21.15.71:40400) 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 1 -- 172.21.15.71:0/2532167349 learned_addr learned my addr 172.21.15.71:0/2532167349 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): get_auth_request con 0x7f9ccc0a52b0 auth_method 0 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd0b25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 1 --2- 172.21.15.71:0/2532167349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc1414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): get_auth_request con 0x7f9ccc13f0f0 auth_method 0 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.822+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_done global_id 4737 payload 274 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2532167349 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0a52b0 msgr2=0x7f9ccc13ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 1 --2- 172.21.15.71:0/2532167349 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0a52b0 0x7f9ccc13ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2532167349 >> v1:172.21.15.71:6789/0 conn(0x7f9ccc0a47c0 legacy=0x7f9ccc0a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 1 monclient: found mon.noname-g 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:11:58.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.823+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2532167349 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc0a6380 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.825+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2532167349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 msgr2=0x7f9ccc1414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd1b27640 1 --2- 172.21.15.71:0/2532167349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc1414e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40097a0 tx=0x7f9cc4029fd0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=81f24c538d1b1b79 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 1 -- 172.21.15.71:0/2532167349 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cc4037070 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: dump: 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.835 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 1 -- 172.21.15.71:0/2532167349 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc402ad30 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 1 -- 172.21.15.71:0/2532167349 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cc4030c20 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 5 monclient: authenticate success, global_id 4737 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 4 set_mon_vals no callback set 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9ccbfff640 10 monclient: dump: 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.837 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.838 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 10 monclient: shutdown 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 -- 172.21.15.71:0/2532167349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 msgr2=0x7f9ccc1414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2532167349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc1414e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40097a0 tx=0x7f9cc4029fd0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 -- 172.21.15.71:0/2532167349 shutdown_connections 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2532167349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc1414e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2532167349 >> v2:172.21.15.71:3300/0 conn(0x7f9ccc0a52b0 0x7f9ccc13ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 -- 172.21.15.71:0/2532167349 >> 172.21.15.71:0/2532167349 conn(0x7f9ccc0a9470 msgr2=0x7f9ccc0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 -- 172.21.15.71:0/2532167349 shutdown_connections 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.826+0000 7f9cd358a640 1 -- 172.21.15.71:0/2532167349 wait complete. 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.827+0000 7f9cd358a640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.827+0000 7f9cd358a640 10 monclient: monmap: 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.840 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.827+0000 7f9cd358a640 1 Processor -- start 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.827+0000 7f9cd358a640 1 -- start start 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.827+0000 7f9cd358a640 10 monclient: init 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient: _add_conns ranks=[3,7,2,0,1,5,8,4,6] 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc0a47c0 0x7f9ccc124c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): picked mon.noname-g con 0x7f9ccc0a47c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ccc0a52b0 0x7f9ccc139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): picked mon.noname-i con 0x7f9ccc0a52b0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:58.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc13a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): picked mon.noname-b con 0x7f9ccc13f0f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc06d300 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc06cfd0 con 0x7f9ccc0a47c0 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9ccc06d480 con 0x7f9ccc0a52b0 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd358a640 10 monclient(hunting): authenticate will time out at 776.869366s 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc13a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc13a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33134/0 (socket says 172.21.15.71:33134) 2024-08-19T11:11:58.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2799568979 learned_addr learned my addr 172.21.15.71:0/2799568979 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): get_auth_request con 0x7f9ccc13f0f0 auth_method 0 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc0a47c0 0x7f9ccc124c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ccc0a52b0 0x7f9ccc139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): get_auth_request con 0x7f9ccc0a52b0 auth_method 0 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): get_auth_request con 0x7f9ccc0a47c0 auth_method 0 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd0b25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient(hunting): handle_auth_done global_id 4871 payload 824 2024-08-19T11:11:58.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ccc0a52b0 msgr2=0x7f9ccc139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9ccc0a52b0 0x7f9ccc139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc0a47c0 msgr2=0x7f9ccc124c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ccc0a47c0 0x7f9ccc124c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 monclient: found mon.noname-b 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.828+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc09f3c0 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 msgr2=0x7f9ccc13a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd1b27640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc13a010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40096f0 tx=0x7f9cc40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cc4040020 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: dump: 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.846 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc4038040 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 5 monclient: authenticate success, global_id 4871 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 10 monclient: _renew_subs 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc123ca0 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:58.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cc4037070 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cc9ffb640 10 monclient: dump: 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.848 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9ccb7fe640 4 set_mon_vals no callback set 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 10 monclient: _renew_subs 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.831+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc125be0 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd358a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 0x7f9ccc1ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc076c60 con 0x7f9ccc123810 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9cc4043020 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cc9ffb640 1 --2- 172.21.15.71:0/2799568979 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb803ea80 0x7f9cb8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 0x7f9ccc1ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(53..53 src has 1..53) ==== 3898+0+0 (secure 0 0 0) 0x7f9cc4071a90 con 0x7f9ccc13f0f0 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient: get_auth_request con 0x7f9ccc123810 auth_method 0 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd0b25640 1 --2- 172.21.15.71:0/2799568979 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb803ea80 0x7f9cb8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd0b25640 10 monclient: get_auth_request con 0x7f9cb803ea80 auth_method 0 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 10 monclient(hunting): handle_auth_done global_id 4591 payload 824 2024-08-19T11:11:58.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.832+0000 7f9cd1326640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ccc0a02b0 con 0x7f9ccc123810 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cd1326640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 msgr2=0x7f9ccc1ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cd1326640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 0x7f9ccc1ce460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00fb10 tx=0x7f9cbc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cd0b25640 1 --2- 172.21.15.71:0/2799568979 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb803ea80 0x7f9cb8040f40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc073300 tx=0x7f9cc0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cbc018030 con 0x7f9ccc123810 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 10 monclient: dump: 2024-08-19T11:11:58.853 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.854 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9cbc00dd30 con 0x7f9ccc123810 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 msgr2=0x7f9ccc1ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 0x7f9ccc1ce460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00fb10 tx=0x7f9cbc005800 comp rx=0 tx=0).stop 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 msgr2=0x7f9ccc1ce460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.835+0000 7f9cc9ffb640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc123810 0x7f9ccc1ce460 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00fb10 tx=0x7f9cbc005800 comp rx=0 tx=0).stop 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.841+0000 7f9cd358a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.841+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 0x7f9ccc1ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.841+0000 7f9cd358a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.841+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc069ed0 con 0x7f9ccc125db0 2024-08-19T11:11:58.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 0x7f9ccc1ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient: get_auth_request con 0x7f9ccc125db0 auth_method 0 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 10 monclient(hunting): handle_auth_done global_id 4600 payload 824 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.842+0000 7f9cd1326640 1 -- 172.21.15.71:0/2799568979 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9ccc09fab0 con 0x7f9ccc125db0 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.844+0000 7f9cd1326640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 msgr2=0x7f9ccc1ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.844+0000 7f9cd1326640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 0x7f9ccc1ce9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc019040 tx=0x7f9cbc003ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cbc028440 con 0x7f9ccc125db0 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:58.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 10 monclient: dump: 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:58.857 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f9cbc014b90 con 0x7f9ccc125db0 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 msgr2=0x7f9ccc1ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 0x7f9ccc1ce9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc019040 tx=0x7f9cbc003ae0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 msgr2=0x7f9ccc1ce9a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:58.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cc9ffb640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ccc125db0 0x7f9ccc1ce9a0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc019040 tx=0x7f9cbc003ae0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 115684, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:58.859 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.860 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.861 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:58.863 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.864 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:58.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.876 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.878 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:58.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:58.880 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:58.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:58.882 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:58.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb803ea80 msgr2=0x7f9cb8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2799568979 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb803ea80 0x7f9cb8040f40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc073300 tx=0x7f9cc0009240 comp rx=0 tx=0).stop 2024-08-19T11:11:58.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd358a640 10 monclient: shutdown 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd358a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 msgr2=0x7f9ccc13a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc13a010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40096f0 tx=0x7f9cc40046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.845+0000 7f9cd1b27640 1 -- 172.21.15.71:0/2799568979 reap_dead start 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.846+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 shutdown_connections 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.846+0000 7f9cd358a640 1 --2- 172.21.15.71:0/2799568979 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9ccc13f0f0 0x7f9ccc13a010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.846+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 >> 172.21.15.71:0/2799568979 conn(0x7f9ccc0a9470 msgr2=0x7f9ccc0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.846+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 shutdown_connections 2024-08-19T11:11:58.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.846+0000 7f9cd358a640 1 -- 172.21.15.71:0/2799568979 wait complete. 2024-08-19T11:11:58.889 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:58.889 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:11:58.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:11:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.985+0000 7f95003f2640 10 monclient: get_monmap_and_config 2024-08-19T11:11:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.985+0000 7f95003f2640 10 monclient: build_initial_monmap 2024-08-19T11:11:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.985+0000 7f95003f2640 10 monclient: monmap: 2024-08-19T11:11:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:58.986056+0000 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:58.986056+0000 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:58.988 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:58.988 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:58.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 Processor -- start 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 -- start start 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient: init 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient: _add_conns ranks=[5,4,8,9,3,0,1,10,7,6,2] 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f94f80a6950 0x7f94f80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): picked mon.noname-h con 0x7f94f80a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): picked mon.noname-c con 0x7f94f80a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 0x7f94f8139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): picked mon.noname-e con 0x7f94f8139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f94f80a5020 con 0x7f94f80a57c0 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f94f80a77b0 con 0x7f94f80a6950 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f94f80a7d40 con 0x7f94f8139710 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f95003f2640 10 monclient(hunting): authenticate will time out at 777.027759s 2024-08-19T11:11:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 0x7f94f8139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fd98d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 0x7f94f8139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51084/0 (socket says 172.21.15.71:51084) 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 1 -- 172.21.15.71:0/1717146790 learned_addr learned my addr 172.21.15.71:0/1717146790 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 10 monclient(hunting): get_auth_request con 0x7f94f8139710 auth_method 0 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fd98d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f80a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48516/0 (socket says 172.21.15.71:48516) 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fd98d640 10 monclient(hunting): get_auth_request con 0x7f94f80a57c0 auth_method 0 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fd98d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fd98d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fd98d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.986+0000 7f94fe98f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fe98f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fe18e640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f94f80a6950 0x7f94f80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 10 monclient(hunting): handle_auth_done global_id 4702 payload 274 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 1 -- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 msgr2=0x7f94f8139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 0x7f94f8139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 1 -- 172.21.15.71:0/1717146790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f94f80a6950 msgr2=0x7f94f80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f94f80a6950 0x7f94f80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 10 monclient: _finish_hunting 0 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 1 monclient: found mon.noname-c 2024-08-19T11:11:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fd98d640 1 -- 172.21.15.71:0/1717146790 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f80a6380 con 0x7f94f80a57c0 2024-08-19T11:11:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fe18e640 10 monclient: get_auth_request con 0x7f94f80a6950 auth_method 0 2024-08-19T11:11:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fe98f640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 0x7f94f8139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:58.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.987+0000 7f94fe18e640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f94f80a6950 0x7f94f80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:11:59.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.989+0000 7f94fd98d640 1 -- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 msgr2=0x7f94f80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.989+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f80a7270 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009800 tx=0x7f94e8029fe0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8440315f13d435a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 1 -- 172.21.15.71:0/1717146790 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94e8037070 con 0x7f94f80a57c0 2024-08-19T11:11:59.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: dump: 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 5 monclient: authenticate success, global_id 4702 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 1 -- 172.21.15.71:0/1717146790 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e802ad00 con 0x7f94f80a57c0 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 4 set_mon_vals no callback set 2024-08-19T11:11:59.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 1 -- 172.21.15.71:0/1717146790 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94e8030c20 con 0x7f94f80a57c0 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f94fd18c640 10 monclient: dump: 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 10 monclient: shutdown 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 -- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 msgr2=0x7f94f80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f80a7270 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009800 tx=0x7f94e8029fe0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 -- 172.21.15.71:0/1717146790 shutdown_connections 2024-08-19T11:11:59.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f8139710 0x7f94f8139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f80a7270 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 --2- 172.21.15.71:0/1717146790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f94f80a6950 0x7f94f80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 -- 172.21.15.71:0/1717146790 >> 172.21.15.71:0/1717146790 conn(0x7f94f80abf50 msgr2=0x7f94f80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 -- 172.21.15.71:0/1717146790 shutdown_connections 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.990+0000 7f95003f2640 1 -- 172.21.15.71:0/1717146790 wait complete. 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.991+0000 7f95003f2640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.991+0000 7f95003f2640 10 monclient: monmap: 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.991+0000 7f95003f2640 1 Processor -- start 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.991+0000 7f95003f2640 1 -- start start 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.991+0000 7f95003f2640 10 monclient: init 2024-08-19T11:11:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient: _add_conns ranks=[4,8,0,3,1,2,5,6,7] 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f8138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): picked mon.noname-c con 0x7f94f80a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f80a6950 0x7f94f8138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): picked mon.noname-e con 0x7f94f80a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94f8139710 0x7f94f81229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): picked mon.noname-a con 0x7f94f8139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94f80a84c0 con 0x7f94f8139710 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f94f80a3650 con 0x7f94f80a57c0 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f94f80a8700 con 0x7f94f80a6950 2024-08-19T11:11:59.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f95003f2640 10 monclient(hunting): authenticate will time out at 777.033193s 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f8138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f80a6950 0x7f94f8138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f8138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48518/0 (socket says 172.21.15.71:48518) 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f80a6950 0x7f94f8138fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51100/0 (socket says 172.21.15.71:51100) 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 -- 172.21.15.71:0/1880418497 learned_addr learned my addr 172.21.15.71:0/1880418497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): get_auth_request con 0x7f94f80a57c0 auth_method 0 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94f8139710 0x7f94f81229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): get_auth_request con 0x7f94f80a6950 auth_method 0 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): get_auth_request con 0x7f94f8139710 auth_method 0 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe98f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient(hunting): handle_auth_done global_id 4711 payload 824 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f80a6950 msgr2=0x7f94f8138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94f80a6950 0x7f94f8138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94f8139710 msgr2=0x7f94f81229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94f8139710 0x7f94f81229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 monclient: found mon.noname-c 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.992+0000 7f94fe18e640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f81240d0 con 0x7f94f80a57c0 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94fe18e640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 msgr2=0x7f94f8138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94fe18e640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f8138a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c820 tx=0x7f94f400cc20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94f4015070 con 0x7f94f80a57c0 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: dump: 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f40113f0 con 0x7f94f80a57c0 2024-08-19T11:11:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f95003f2640 5 monclient: authenticate success, global_id 4711 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f95003f2640 10 monclient: _renew_subs 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f95003f2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f8126150 con 0x7f94f80a57c0 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94f4011a10 con 0x7f94f80a57c0 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f94eeffd640 10 monclient: dump: 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.013 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 10 monclient: _renew_subs 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.994+0000 7f94fc98b640 4 set_mon_vals no callback set 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f813a270 con 0x7f94f80a57c0 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 0x7f94f802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94f8076c60 con 0x7f94f81ce530 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f94fe18e640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f8138a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c820 tx=0x7f94f400cc20 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f94f4018070 mgrmap(e 5) 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.995+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f94f4018070 con 0x7f94f80a57c0 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 0x7f94f802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient: get_auth_request con 0x7f94f81ce530 auth_method 0 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94eeffd640 1 --2- 172.21.15.71:0/1880418497 >> v2:172.21.15.135:6800/726754104 conn(0x7f94dc03eab0 0x7f94dc040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 10 monclient(hunting): handle_auth_done global_id 4755 payload 824 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fe98f640 1 --2- 172.21.15.71:0/1880418497 >> v2:172.21.15.135:6800/726754104 conn(0x7f94dc03eab0 0x7f94dc040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fd98d640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94f8125250 con 0x7f94f81ce530 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.996+0000 7f94fe98f640 10 monclient: get_auth_request con 0x7f94dc03eab0 auth_method 0 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94fd98d640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 msgr2=0x7f94f802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 0x7f94f802d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097d0 tx=0x7f94e80046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94e8037040 con 0x7f94f81ce530 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94eeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94eeffd640 10 monclient: dump: 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.017 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.998+0000 7f94fe98f640 1 --2- 172.21.15.71:0/1880418497 >> v2:172.21.15.135:6800/726754104 conn(0x7f94dc03eab0 0x7f94dc040f70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f94f00072e0 tx=0x7f94f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f94e8003a30 con 0x7f94f81ce530 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 msgr2=0x7f94f802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 0x7f94f802d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097d0 tx=0x7f94e80046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 msgr2=0x7f94f802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:59.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:58.999+0000 7f94eeffd640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f81ce530 0x7f94f802d1c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f95003f2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:59.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f95003f2640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 0x7f94f802db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f95003f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94f80a1ff0 con 0x7f94f802d700 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 0x7f94f802db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient: get_auth_request con 0x7f94f802d700 auth_method 0 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 10 monclient(hunting): handle_auth_done global_id 4764 payload 824 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.005+0000 7f94fd98d640 1 -- 172.21.15.71:0/1880418497 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f94f80a6d30 con 0x7f94f802d700 2024-08-19T11:11:59.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.007+0000 7f94fd98d640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 msgr2=0x7f94f802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.007+0000 7f94fd98d640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 0x7f94f802db10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f94e802a020 tx=0x7f94e8009190 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94e8037030 con 0x7f94f802d700 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 10 monclient: dump: 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.022 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7f94e8032ca0 con 0x7f94f802d700 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:59.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 msgr2=0x7f94f802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 0x7f94f802db10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f94e802a020 tx=0x7f94e8009190 comp rx=0 tx=0).stop 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 msgr2=0x7f94f802db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94f802d700 0x7f94f802db10 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f94e802a020 tx=0x7f94e8009190 comp rx=0 tx=0).stop 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 115859, 2024-08-19T11:11:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:59.048 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 >> v2:172.21.15.135:6800/726754104 conn(0x7f94dc03eab0 msgr2=0x7f94dc040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 --2- 172.21.15.71:0/1880418497 >> v2:172.21.15.135:6800/726754104 conn(0x7f94dc03eab0 0x7f94dc040f70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f94f00072e0 tx=0x7f94f000b040 comp rx=0 tx=0).stop 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 10 monclient: shutdown 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 msgr2=0x7f94f8138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 --2- 172.21.15.71:0/1880418497 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f94f80a57c0 0x7f94f8138a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94f400c820 tx=0x7f94f400cc20 comp rx=0 tx=0).stop 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94fe98f640 1 -- 172.21.15.71:0/1880418497 reap_dead start 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94eeffd640 1 -- 172.21.15.71:0/1880418497 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(53..53 src has 1..53) ==== 3898+0+0 (unknown 0 0 0) 0x7f94f4051ba0 con 0x7f94f80a57c0 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f94fe98f640 1 -- 172.21.15.71:0/1880418497 reap_dead start 2024-08-19T11:11:59.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 shutdown_connections 2024-08-19T11:11:59.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 >> 172.21.15.71:0/1880418497 conn(0x7f94f80abf50 msgr2=0x7f94f80aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 shutdown_connections 2024-08-19T11:11:59.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.008+0000 7f95003f2640 1 -- 172.21.15.71:0/1880418497 wait complete. 2024-08-19T11:11:59.051 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:59.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:11:59.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:11:59.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.149+0000 7f7bd75b1640 10 monclient: get_monmap_and_config 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.149+0000 7f7bd75b1640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.149+0000 7f7bd75b1640 10 monclient: monmap: 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:59.150173+0000 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:59.150173+0000 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 Processor -- start 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 -- start start 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient: init 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient: _add_conns ranks=[2,1,9,10,8,4,6,3,5,0,7] 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 0x7f7bd00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): picked mon.noname-b con 0x7f7bd00a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:59.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7bd00a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7bd00a7270 0x7f7bd0139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): picked mon.noname-a con 0x7f7bd00a7270 addr v2:172.21.15.71:3300/0 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd00a6380 con 0x7f7bd00a57c0 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00a5020 con 0x7f7bd00a7270 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00a7d40 con 0x7f7bd00a6950 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd75b1640 10 monclient(hunting): authenticate will time out at 777.191919s 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.150+0000 7f7bd534d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 0x7f7bd00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7bd00a7270 0x7f7bd0139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 0x7f7bd00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33150/0 (socket says 172.21.15.71:33150) 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 1 -- 172.21.15.71:0/289971115 learned_addr learned my addr 172.21.15.71:0/289971115 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): get_auth_request con 0x7f7bd00a6950 auth_method 0 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): get_auth_request con 0x7f7bd00a7270 auth_method 0 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_done global_id 4725 payload 274 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 msgr2=0x7f7bd00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 0x7f7bd00a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/289971115 >> v1:172.21.15.135:6789/0 conn(0x7f7bd00a57c0 legacy=0x7f7bd0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 1 monclient: found mon.noname-a 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:59.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/289971115 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00a3650 con 0x7f7bd00a7270 2024-08-19T11:11:59.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.151+0000 7f7bd534d640 1 --2- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 0x7f7bd00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:59.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.154+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a7270 msgr2=0x7f7bd0139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.154+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a7270 0x7f7bd0139e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009dc0 tx=0x7f7bc802a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8057d4168aed2132 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 1 -- 172.21.15.71:0/289971115 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7bc8007bc0 con 0x7f7bd00a7270 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: dump: 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.165 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 5 monclient: authenticate success, global_id 4725 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 1 -- 172.21.15.71:0/289971115 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc8007d80 con 0x7f7bd00a7270 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 4 set_mon_vals no callback set 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 1 -- 172.21.15.71:0/289971115 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7bc8031870 con 0x7f7bd00a7270 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bc7fff640 10 monclient: dump: 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 10 monclient: shutdown 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 -- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a7270 msgr2=0x7f7bd0139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a7270 0x7f7bd0139e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009dc0 tx=0x7f7bc802a4d0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 -- 172.21.15.71:0/289971115 shutdown_connections 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a7270 0x7f7bd0139e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/289971115 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7bd00a6950 0x7f7bd00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 -- 172.21.15.71:0/289971115 >> 172.21.15.71:0/289971115 conn(0x7f7bd00abf50 msgr2=0x7f7bd00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 -- 172.21.15.71:0/289971115 shutdown_connections 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.156+0000 7f7bd75b1640 1 -- 172.21.15.71:0/289971115 wait complete. 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.157+0000 7f7bd75b1640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.157+0000 7f7bd75b1640 10 monclient: monmap: 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.157+0000 7f7bd75b1640 1 Processor -- start 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.157+0000 7f7bd75b1640 1 -- start start 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.157+0000 7f7bd75b1640 10 monclient: init 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient: _add_conns ranks=[0,7,4,2,1,6,3,8,5] 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 0x7f7bd0139ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): picked mon.noname-a con 0x7f7bd00a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7bd00a6950 0x7f7bd0139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): picked mon.noname-i con 0x7f7bd00a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7bd00a7270 0x7f7bd01237e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): picked mon.noname-c con 0x7f7bd00a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00a76c0 con 0x7f7bd00a57c0 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7bd00a84c0 con 0x7f7bd00a7270 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7bd00a8700 con 0x7f7bd00a6950 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd75b1640 10 monclient(hunting): authenticate will time out at 777.199296s 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 0x7f7bd0139ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 0x7f7bd0139ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40428/0 (socket says 172.21.15.71:40428) 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 -- 172.21.15.71:0/2669743296 learned_addr learned my addr 172.21.15.71:0/2669743296 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): get_auth_request con 0x7f7bd00a57c0 auth_method 0 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7bd00a7270 0x7f7bd01237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): get_auth_request con 0x7f7bd00a7270 auth_method 0 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7bd00a6950 0x7f7bd0139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): get_auth_request con 0x7f7bd00a6950 auth_method 0 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd4b4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient(hunting): handle_auth_done global_id 4734 payload 824 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7bd00a6950 msgr2=0x7f7bd0139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7bd00a6950 0x7f7bd0139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7bd00a7270 msgr2=0x7f7bd01237e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7bd00a7270 0x7f7bd01237e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 monclient: found mon.noname-a 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.158+0000 7f7bd534d640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd01cf2b0 con 0x7f7bd00a57c0 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.160+0000 7f7bd534d640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 msgr2=0x7f7bd0139ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.160+0000 7f7bd534d640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 0x7f7bd0139ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00e9d0 tx=0x7f7bcc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7bcc017070 con 0x7f7bd00a57c0 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: dump: 2024-08-19T11:11:59.175 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.176 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 5 monclient: authenticate success, global_id 4734 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00cc70 con 0x7f7bd00a57c0 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 10 monclient: _renew_subs 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd00a95d0 con 0x7f7bd00a57c0 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7bcc00ce20 con 0x7f7bd00a57c0 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:11:59.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc5ffb640 10 monclient: dump: 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 10 monclient: _renew_subs 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bc6ffd640 4 set_mon_vals no callback set 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.161+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd0127190 con 0x7f7bd00a57c0 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7bcc01a070 con 0x7f7bd00a57c0 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bc5ffb640 1 --2- 172.21.15.71:0/2669743296 >> v2:172.21.15.135:6800/726754104 conn(0x7f7bb403ea80 0x7f7bb4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd75b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 0x7f7bd0123d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7bd0076c60 con 0x7f7bd01ce630 2024-08-19T11:11:59.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 3898+0+0 (secure 0 0 0) 0x7f7bcc00f040 con 0x7f7bd00a57c0 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 0x7f7bd0123d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient: get_auth_request con 0x7f7bd01ce630 auth_method 0 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd4b4c640 1 --2- 172.21.15.71:0/2669743296 >> v2:172.21.15.135:6800/726754104 conn(0x7f7bb403ea80 0x7f7bb4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd4b4c640 10 monclient: get_auth_request con 0x7f7bb403ea80 auth_method 0 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_done global_id 14666 payload 824 2024-08-19T11:11:59.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.162+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bd0077270 con 0x7f7bd01ce630 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bd4b4c640 1 --2- 172.21.15.71:0/2669743296 >> v2:172.21.15.135:6800/726754104 conn(0x7f7bb403ea80 0x7f7bb4040f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bd013a760 tx=0x7f7bc0009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 msgr2=0x7f7bd0123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 0x7f7bd0123d20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8034000 tx=0x7f7bc8004a40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7bc8007da0 con 0x7f7bd01ce630 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 10 monclient: dump: 2024-08-19T11:11:59.183 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.184 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7bc8007da0 con 0x7f7bd01ce630 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 msgr2=0x7f7bd0123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 0x7f7bd0123d20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8034000 tx=0x7f7bc8004a40 comp rx=0 tx=0).stop 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 msgr2=0x7f7bd0123d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.165+0000 7f7bc5ffb640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd01ce630 0x7f7bd0123d20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.171+0000 7f7bd75b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.171+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 0x7f7bd009e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.171+0000 7f7bd75b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.171+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7bd0124670 con 0x7f7bd0124260 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.171+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 0x7f7bd009e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient: get_auth_request con 0x7f7bd0124260 auth_method 0 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 10 monclient(hunting): handle_auth_done global_id 14675 payload 824 2024-08-19T11:11:59.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.172+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/2669743296 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7bd00a6d30 con 0x7f7bd0124260 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.174+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 msgr2=0x7f7bd009e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.174+0000 7f7bd5b4e640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 0x7f7bd009e7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bc802a9f0 tx=0x7f7bc8030000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7bc804bbf0 con 0x7f7bd0124260 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 10 monclient: dump: 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.187 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f7bc804b780 con 0x7f7bd0124260 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:59.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 msgr2=0x7f7bd009e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 0x7f7bd009e7c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bc802a9f0 tx=0x7f7bc8030000 comp rx=0 tx=0).stop 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 msgr2=0x7f7bd009e7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bc5ffb640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7bd0124260 0x7f7bd009e7c0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bc802a9f0 tx=0x7f7bc8030000 comp rx=0 tx=0).stop 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:59.189 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 116028, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.190 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.191 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:59.193 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.194 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:59.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:59.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.211 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.212 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:59.213 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 >> v2:172.21.15.135:6800/726754104 conn(0x7f7bb403ea80 msgr2=0x7f7bb4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/2669743296 >> v2:172.21.15.135:6800/726754104 conn(0x7f7bb403ea80 0x7f7bb4040f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bd013a760 tx=0x7f7bc0009060 comp rx=0 tx=0).stop 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 10 monclient: shutdown 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 msgr2=0x7f7bd0139ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 --2- 172.21.15.71:0/2669743296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd00a57c0 0x7f7bd0139ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00e9d0 tx=0x7f7bcc00ee90 comp rx=0 tx=0).stop 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/2669743296 reap_dead start 2024-08-19T11:11:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd5b4e640 1 -- 172.21.15.71:0/2669743296 reap_dead start 2024-08-19T11:11:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 shutdown_connections 2024-08-19T11:11:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 >> 172.21.15.71:0/2669743296 conn(0x7f7bd00abf50 msgr2=0x7f7bd01c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 shutdown_connections 2024-08-19T11:11:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.175+0000 7f7bd75b1640 1 -- 172.21.15.71:0/2669743296 wait complete. 2024-08-19T11:11:59.215 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:59.215 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:11:59.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.313+0000 7f9209cc7640 10 monclient: get_monmap_and_config 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.313+0000 7f9209cc7640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.313+0000 7f9209cc7640 10 monclient: monmap: 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:59.313851+0000 2024-08-19T11:11:59.314 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:59.313851+0000 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:59.315 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:59.316 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 Processor -- start 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 -- start start 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient: init 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient: _add_conns ranks=[2,10,6,7,1,9,0,8,3,5,4] 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 0x7f92040a0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): picked mon.noname-b con 0x7f920409b510 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92040693a0 0x7f920409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): picked mon.noname-f con 0x7f92040693a0 addr v2:172.21.15.135:3300/0 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 0x7f92040a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): picked mon.noname-d con 0x7f920409be30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f92040a5d60 con 0x7f92040693a0 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f920409eb90 con 0x7f920409b510 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f920409fa10 con 0x7f920409be30 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9209cc7640 10 monclient(hunting): authenticate will time out at 777.355660s 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 0x7f92040a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 0x7f92040a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33162/0 (socket says 172.21.15.71:33162) 2024-08-19T11:11:59.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 0x7f92040a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 1 -- 172.21.15.71:0/962536643 learned_addr learned my addr 172.21.15.71:0/962536643 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): get_auth_request con 0x7f920409b510 auth_method 0 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): get_auth_request con 0x7f920409be30 auth_method 0 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9202ffd640 1 --2- 172.21.15.71:0/962536643 >> v2:172.21.15.135:3300/0 conn(0x7f92040693a0 0x7f920409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f92037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9202ffd640 10 monclient(hunting): get_auth_request con 0x7f92040693a0 auth_method 0 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9202ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9202ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9202ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.314+0000 7f9203fff640 10 monclient(hunting): handle_auth_done global_id 24189 payload 274 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 1 -- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 msgr2=0x7f92040a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 1 --2- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 0x7f92040a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 1 -- 172.21.15.71:0/962536643 >> v2:172.21.15.135:3300/0 conn(0x7f92040693a0 msgr2=0x7f920409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 1 --2- 172.21.15.71:0/962536643 >> v2:172.21.15.135:3300/0 conn(0x7f92040693a0 0x7f920409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 1 monclient: found mon.noname-d 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:11:59.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9203fff640 1 -- 172.21.15.71:0/962536643 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920409fcf0 con 0x7f920409be30 2024-08-19T11:11:59.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f92037fe640 1 --2- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 0x7f92040a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:11:59.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.315+0000 7f9202ffd640 1 --2- 172.21.15.71:0/962536643 >> v2:172.21.15.135:3300/0 conn(0x7f92040693a0 0x7f920409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.317+0000 7f9203fff640 1 -- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 msgr2=0x7f92040a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.317+0000 7f9203fff640 1 --2- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 0x7f92040a3d80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc02a490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=11b2bc1c93ed498b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.317+0000 7f92027fc640 1 -- 172.21.15.71:0/962536643 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91fc007bc0 con 0x7f920409be30 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: dump: 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.329 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 5 monclient: authenticate success, global_id 24189 2024-08-19T11:11:59.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 1 -- 172.21.15.71:0/962536643 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc007d80 con 0x7f920409be30 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 4 set_mon_vals no callback set 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 1 -- 172.21.15.71:0/962536643 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91fc031870 con 0x7f920409be30 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f92027fc640 10 monclient: dump: 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.331 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 10 monclient: shutdown 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 -- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 msgr2=0x7f92040a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 --2- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 0x7f92040a3d80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc02a490 comp rx=0 tx=0).stop 2024-08-19T11:11:59.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 -- 172.21.15.71:0/962536643 shutdown_connections 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 --2- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f920409be30 0x7f92040a3d80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 --2- 172.21.15.71:0/962536643 >> v2:172.21.15.135:3300/0 conn(0x7f92040693a0 0x7f920409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 --2- 172.21.15.71:0/962536643 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f920409b510 0x7f92040a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 -- 172.21.15.71:0/962536643 >> 172.21.15.71:0/962536643 conn(0x7f92040a4e70 msgr2=0x7f92040a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 -- 172.21.15.71:0/962536643 shutdown_connections 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.318+0000 7f9209cc7640 1 -- 172.21.15.71:0/962536643 wait complete. 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.319+0000 7f9209cc7640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.319+0000 7f9209cc7640 10 monclient: monmap: 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.333 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.319+0000 7f9209cc7640 1 Processor -- start 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 -- start start 2024-08-19T11:11:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient: init 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient: _add_conns ranks=[8,0,3,5,1,6,7,2,4] 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 0x7f92041cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): picked mon.noname-e con 0x7f92040693a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 0x7f92041ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): picked mon.noname-a con 0x7f920409b510 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f920409be30 0x7f9204091c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): picked mon.noname-g con 0x7f920409be30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92040a4690 con 0x7f920409b510 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f92040a4510 con 0x7f920409be30 2024-08-19T11:11:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f92040a4810 con 0x7f92040693a0 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9209cc7640 10 monclient(hunting): authenticate will time out at 777.361537s 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 0x7f92041cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 0x7f92041ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 0x7f92041cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51112/0 (socket says 172.21.15.71:51112) 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 1 -- 172.21.15.71:0/3656063976 learned_addr learned my addr 172.21.15.71:0/3656063976 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 10 monclient(hunting): get_auth_request con 0x7f920409b510 auth_method 0 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): get_auth_request con 0x7f92040693a0 auth_method 0 2024-08-19T11:11:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 msgr2=0x7f92041ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 msgr2=0x7f92041ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 0x7f92041ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9202ffd640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 0x7f92041ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f920409be30 0x7f9204091c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): get_auth_request con 0x7f920409be30 auth_method 0 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f9203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 10 monclient(hunting): handle_auth_done global_id 4724 payload 824 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f920409be30 msgr2=0x7f9204091c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.320+0000 7f92037fe640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f920409be30 0x7f9204091c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 msgr2=0x7f92041ccac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f920409b510 0x7f92041ccac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 1 monclient: found mon.noname-e 2024-08-19T11:11:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.321+0000 7f92037fe640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920409aab0 con 0x7f92040693a0 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f92037fe640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 msgr2=0x7f92041cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f92037fe640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 0x7f92041cc580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91f400e9d0 tx=0x7f91f400ee90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91f4017070 con 0x7f92040693a0 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: dump: 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f400cc70 con 0x7f92040693a0 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 5 monclient: authenticate success, global_id 4724 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 10 monclient: _renew_subs 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92040a5580 con 0x7f92040693a0 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91f400ce20 con 0x7f92040693a0 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f91ebfff640 10 monclient: dump: 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 10 monclient: _renew_subs 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9204095500 con 0x7f92040693a0 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.323+0000 7f9201ffb640 4 set_mon_vals no callback set 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9209cc7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9209cc7640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 0x7f9204092550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f920406a590 con 0x7f9204092170 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f92037fe640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 0x7f92041cc580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91f400e9d0 tx=0x7f91f400ee90 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f91f400f040 osd_map(53..53 src has 1..53) 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f91f401a070 con 0x7f92040693a0 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 0x7f9204092550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient: get_auth_request con 0x7f9204092170 auth_method 0 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f91ebfff640 1 --2- 172.21.15.71:0/3656063976 >> v2:172.21.15.135:6800/726754104 conn(0x7f91f003ea80 0x7f91f0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 10 monclient(hunting): handle_auth_done global_id 4633 payload 824 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9203fff640 1 --2- 172.21.15.71:0/3656063976 >> v2:172.21.15.135:6800/726754104 conn(0x7f91f003ea80 0x7f91f0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9202ffd640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9204093fe0 con 0x7f9204092170 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.324+0000 7f9203fff640 10 monclient: get_auth_request con 0x7f91f003ea80 auth_method 0 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f9202ffd640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 msgr2=0x7f9204092550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f9202ffd640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 0x7f9204092550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92040a7de0 tx=0x7f91f8010c20 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91f801a030 con 0x7f9204092170 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f9203fff640 1 --2- 172.21.15.71:0/3656063976 >> v2:172.21.15.135:6800/726754104 conn(0x7f91f003ea80 0x7f91f0040f40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91fc034000 tx=0x7f91fc02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 10 monclient: dump: 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f91f800ebb0 con 0x7f9204092170 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 msgr2=0x7f9204092550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 0x7f9204092550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92040a7de0 tx=0x7f91f8010c20 comp rx=0 tx=0).stop 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 msgr2=0x7f9204092550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.327+0000 7f91ebfff640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092170 0x7f9204092550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.333+0000 7f9209cc7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:11:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.333+0000 7f9209cc7640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 0x7f920408df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.333+0000 7f9209cc7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.333+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9204076c60 con 0x7f9204092a90 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 0x7f920408df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient: get_auth_request con 0x7f9204092a90 auth_method 0 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 10 monclient(hunting): handle_auth_done global_id 4642 payload 824 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.334+0000 7f9202ffd640 1 -- 172.21.15.71:0/3656063976 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f920406e5c0 con 0x7f9204092a90 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.336+0000 7f9202ffd640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 msgr2=0x7f920408df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.336+0000 7f9202ffd640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 0x7f920408df80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92040a7de0 tx=0x7f91f80046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.336+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91f800f040 con 0x7f9204092a90 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.336+0000 7f91ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.336+0000 7f91ebfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.336+0000 7f91ebfff640 10 monclient: dump: 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.350 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f91f8003610 con 0x7f9204092a90 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 msgr2=0x7f920408df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 0x7f920408df80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92040a7de0 tx=0x7f91f80046c0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 msgr2=0x7f920408df80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:11:59.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9204092a90 0x7f920408df80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 116190, 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:11:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:11:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:11:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:11:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:11:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:11:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:11:59.374 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 >> v2:172.21.15.135:6800/726754104 conn(0x7f91f003ea80 msgr2=0x7f91f0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 --2- 172.21.15.71:0/3656063976 >> v2:172.21.15.135:6800/726754104 conn(0x7f91f003ea80 0x7f91f0040f40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91fc034000 tx=0x7f91fc02f000 comp rx=0 tx=0).stop 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 10 monclient: shutdown 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 msgr2=0x7f92041cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 --2- 172.21.15.71:0/3656063976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f92040693a0 0x7f92041cc580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91f400e9d0 tx=0x7f91f400ee90 comp rx=0 tx=0).stop 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9203fff640 1 -- 172.21.15.71:0/3656063976 reap_dead start 2024-08-19T11:11:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f91ebfff640 1 -- 172.21.15.71:0/3656063976 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(53..53 src has 1..53) ==== 3898+0+0 (unknown 0 0 0) 0x7f91f400f040 con 0x7f92040693a0 2024-08-19T11:11:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9203fff640 1 -- 172.21.15.71:0/3656063976 reap_dead start 2024-08-19T11:11:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 shutdown_connections 2024-08-19T11:11:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 >> 172.21.15.71:0/3656063976 conn(0x7f92040a4e70 msgr2=0x7f92040a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 shutdown_connections 2024-08-19T11:11:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.337+0000 7f9209cc7640 1 -- 172.21.15.71:0/3656063976 wait complete. 2024-08-19T11:11:59.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:11:59.377 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:11:59.377 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.474+0000 7fc499856640 10 monclient: get_monmap_and_config 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.474+0000 7fc499856640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.474+0000 7fc499856640 10 monclient: monmap: 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:11:59.475563+0000 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:11:59.475563+0000 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:11:59.476 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:11:59.477 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.475+0000 7fc499856640 1 Processor -- start 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.475+0000 7fc499856640 1 -- start start 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.475+0000 7fc499856640 10 monclient: init 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.475+0000 7fc499856640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient: _add_conns ranks=[8,3,7,0,10,9,5,1,2,6,4] 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 0x7fc4940a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): picked mon.noname-e con 0x7fc4940a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4940a6e10 0x7fc4940a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): picked mon.noname-g con 0x7fc4940a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc494139860 0x7fc494139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): picked mon.noname-i con 0x7fc494139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:11:59.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc4940a4f90 con 0x7fc4940a6e10 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc4940a6380 con 0x7fc494139860 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc4940a49d0 con 0x7fc4940a6a30 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc499856640 10 monclient(hunting): authenticate will time out at 777.517083s 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 0x7fc4940a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 0x7fc4940a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51114/0 (socket says 172.21.15.71:51114) 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 -- 172.21.15.71:0/3785865924 learned_addr learned my addr 172.21.15.71:0/3785865924 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): get_auth_request con 0x7fc4940a6a30 auth_method 0 2024-08-19T11:11:59.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc4927fc640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4940a6e10 0x7fc4940a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient(hunting): handle_auth_done global_id 4733 payload 274 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 -- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc494139860 msgr2=0x7fc494139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc4937fe640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc494139860 0x7fc494139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc494139860 0x7fc494139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 -- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4940a6e10 msgr2=0x7fc4940a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:11:59.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4940a6e10 0x7fc4940a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 monclient: found mon.noname-e 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc492ffd640 1 -- 172.21.15.71:0/3785865924 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4940a46f0 con 0x7fc4940a6a30 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc4927fc640 10 monclient: get_auth_request con 0x7fc4940a6e10 auth_method 0 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.476+0000 7fc4927fc640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4940a6e10 0x7fc4940a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc492ffd640 1 -- 172.21.15.71:0/3785865924 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 msgr2=0x7fc4940a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc492ffd640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 0x7fc4940a57f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4840098a0 tx=0x7fc48402a080 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5a07de040ce39c1a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 1 -- 172.21.15.71:0/3785865924 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc484037070 con 0x7fc4940a6a30 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: dump: 2024-08-19T11:11:59.484 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.485 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 5 monclient: authenticate success, global_id 4733 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 1 -- 172.21.15.71:0/3785865924 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4840307b0 con 0x7fc4940a6a30 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 10 monclient: get_monmap_and_config success 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 4 set_mon_vals no callback set 2024-08-19T11:11:59.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 1 -- 172.21.15.71:0/3785865924 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc484030e10 con 0x7fc4940a6a30 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc491ffb640 10 monclient: dump: 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.487 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 10 monclient: shutdown 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 1 -- 172.21.15.71:0/3785865924 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 msgr2=0x7fc4940a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.479+0000 7fc499856640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 0x7fc4940a57f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4840098a0 tx=0x7fc48402a080 comp rx=0 tx=0).stop 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 -- 172.21.15.71:0/3785865924 shutdown_connections 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc494139860 0x7fc494139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc4940a6e10 0x7fc4940a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 --2- 172.21.15.71:0/3785865924 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc4940a6a30 0x7fc4940a57f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 -- 172.21.15.71:0/3785865924 >> 172.21.15.71:0/3785865924 conn(0x7fc4940ac030 msgr2=0x7fc4940ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 -- 172.21.15.71:0/3785865924 shutdown_connections 2024-08-19T11:11:59.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 -- 172.21.15.71:0/3785865924 wait complete. 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 10 monclient: build_initial_monmap 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 10 monclient: monmap: 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:11:59.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.480+0000 7fc499856640 1 Processor -- start 2024-08-19T11:11:59.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 -- start start 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient: init 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient: _reopen_session rank -1 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient: _add_conns ranks=[4,6,1,2,5,0,7,8,3] 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4940a6a30 0x7fc4941ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): picked mon.noname-c con 0x7fc4940a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 0x7fc494138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): picked mon.noname-d con 0x7fc4940a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494139860 0x7fc4941392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): picked mon.noname-f con 0x7fc494139860 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4940a7730 con 0x7fc494139860 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc49413a1a0 con 0x7fc4940a6a30 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc4941ce910 con 0x7fc4940a6e10 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): _renew_subs 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc499856640 10 monclient(hunting): authenticate will time out at 777.522609s 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4940a6a30 0x7fc4941ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 0x7fc494138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4940a6a30 0x7fc4941ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48544/0 (socket says 172.21.15.71:48544) 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): get_auth_request con 0x7fc4940a6e10 auth_method 0 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 1 -- 172.21.15.71:0/3726236229 learned_addr learned my addr 172.21.15.71:0/3726236229 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): get_auth_request con 0x7fc4940a6a30 auth_method 0 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc492ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4937fe640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494139860 0x7fc4941392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4937fe640 10 monclient(hunting): get_auth_request con 0x7fc494139860 auth_method 0 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:11:59.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4937fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4937fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 10 monclient(hunting): handle_auth_done global_id 24198 payload 824 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 1 -- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4940a6a30 msgr2=0x7fc4941ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4940a6a30 0x7fc4941ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 1 -- 172.21.15.71:0/3726236229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494139860 msgr2=0x7fc4941392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.481+0000 7fc4927fc640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494139860 0x7fc4941392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.482+0000 7fc4927fc640 10 monclient: _finish_hunting 0 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.482+0000 7fc4927fc640 1 monclient: found mon.noname-d 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.482+0000 7fc4927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.482+0000 7fc4927fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.482+0000 7fc4927fc640 1 -- 172.21.15.71:0/3726236229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4940a5880 con 0x7fc4940a6e10 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.482+0000 7fc4937fe640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494139860 0x7fc4941392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:11:59.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc4927fc640 1 -- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 msgr2=0x7fc494138d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc4927fc640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 0x7fc494138d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c7f0 tx=0x7fc48800ccb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc488015070 con 0x7fc4940a6e10 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: dump: 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.499 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: _finish_auth 0 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc488007c40 con 0x7fc4940a6e10 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 5 monclient: authenticate success, global_id 24198 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 10 monclient: _renew_subs 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:59.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4940a26d0 con 0x7fc4940a6e10 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc488007e30 con 0x7fc4940a6e10 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc47bfff640 10 monclient: dump: 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:11:59.501 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc4917fa640 4 set_mon_vals no callback set 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 10 monclient: _renew_subs 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:59.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.484+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc494126740 con 0x7fc4940a6e10 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc4880077d0 con 0x7fc4940a6e10 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc499856640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc499856640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc499856640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4941263c0 con 0x7fc4940a6e10 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc47bfff640 1 --2- 172.21.15.71:0/3726236229 >> v2:172.21.15.135:6800/726754104 conn(0x7fc48003ea80 0x7fc480040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(53..53 src has 1..53) ==== 3898+0+0 (secure 0 0 0) 0x7fc488051d30 con 0x7fc4940a6e10 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc492ffd640 1 --2- 172.21.15.71:0/3726236229 >> v2:172.21.15.135:6800/726754104 conn(0x7fc48003ea80 0x7fc480040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.485+0000 7fc492ffd640 10 monclient: get_auth_request con 0x7fc48003ea80 auth_method 0 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.488+0000 7fc492ffd640 1 --2- 172.21.15.71:0/3726236229 >> v2:172.21.15.135:6800/726754104 conn(0x7fc48003ea80 0x7fc480040f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc48402bfd0 tx=0x7fc48402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:11:59.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.490+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc4941263c0 con 0x7fc4940a6e10 2024-08-19T11:11:59.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.490+0000 7fc47bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:11:59.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.490+0000 7fc47bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:11:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.735+0000 7fc499856640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:11:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.735+0000 7fc499856640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:11:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.735+0000 7fc499856640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:11:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.735+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc49413a500 con 0x7fc4940a6e10 2024-08-19T11:11:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.736+0000 7fc47bfff640 1 -- 172.21.15.71:0/3726236229 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc48801e020 con 0x7fc4940a6e10 2024-08-19T11:11:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.736+0000 7fc47bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:11:59.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.736+0000 7fc47bfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:11:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.740+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 >> v2:172.21.15.135:6800/726754104 conn(0x7fc48003ea80 msgr2=0x7fc480040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.740+0000 7fc499856640 1 --2- 172.21.15.71:0/3726236229 >> v2:172.21.15.135:6800/726754104 conn(0x7fc48003ea80 0x7fc480040f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc48402bfd0 tx=0x7fc48402e000 comp rx=0 tx=0).stop 2024-08-19T11:11:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.740+0000 7fc499856640 10 monclient: shutdown 2024-08-19T11:11:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.740+0000 7fc499856640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:11:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.740+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 msgr2=0x7fc494138d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:11:59.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.740+0000 7fc499856640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 0x7fc494138d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c7f0 tx=0x7fc48800ccb0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=9,config=2,health=10,kv=11,logm=68} crc {auth=4174576645,config=2586702516,health=1281764270,kv=1111774046,logm=2264218399}) 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=8,config=2,health=11,kv=12,logm=67} crc {auth=2005045496,config=2586702516,health=3172947059,kv=427669880,logm=1528269201}) 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.740+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=8,config=2,health=12,kv=12,logm=66} crc {auth=2005045496,config=2586702516,health=3977944326,kv=3646823213,logm=290157640}) 2024-08-19T11:11:59.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=8,config=2,health=9,kv=12,logm=69} crc {auth=3017108621,config=2586702516,health=3685101774,kv=3646823213,logm=34742474}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=9,config=2,health=12,kv=9,logm=68} crc {auth=4174576645,config=2586702516,health=3977944326,kv=2629447488,logm=2836754523}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=9,config=2,health=12,kv=12,logm=65} crc {auth=4174576645,config=2586702516,health=1326388786,kv=3646823213,logm=3963932121}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=9,config=2,health=11,kv=11,logm=67} crc {auth=4174576645,config=2586702516,health=3926953126,kv=803884263,logm=4014614323}) 2024-08-19T11:11:59.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.741+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 shutdown_connections 2024-08-19T11:11:59.745 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.745 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=9,config=2,health=12,kv=11,logm=66} crc {auth=4174576645,config=2586702517,health=3977944326,kv=803884263,logm=1254803469}) 2024-08-19T11:11:59.745 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.741+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=8,config=2,health=10,kv=12,logm=68} crc {auth=4227797970,config=2586702516,health=1151464652,kv=3646823213,logm=599087887}) 2024-08-19T11:11:59.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.741+0000 7fc499856640 1 --2- 172.21.15.71:0/3726236229 >> v2:172.21.15.135:6800/726754104 conn(0x7fc48003ea80 0x7fc480040f40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.741+0000 7fc499856640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494139860 0x7fc4941392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.741+0000 7fc499856640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc4940a6e10 0x7fc494138d80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.741+0000 7fc499856640 1 --2- 172.21.15.71:0/3726236229 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc4940a6a30 0x7fc4941ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:11:59.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.741+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 >> 172.21.15.71:0/3726236229 conn(0x7fc4940ac030 msgr2=0x7fc4941c1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:11:59.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.744+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 shutdown_connections 2024-08-19T11:11:59.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:11:59.744+0000 7fc499856640 1 -- 172.21.15.71:0/3726236229 wait complete. 2024-08-19T11:11:59.755 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.755 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.755 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=159506711}) 2024-08-19T11:11:59.755 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2077786263}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2201805853}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2615405824}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3386082329}) 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3181917224}) 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=304224795}) 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3453122896}) 2024-08-19T11:11:59.757 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.754+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1704237438}) 2024-08-19T11:11:59.759 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.759 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.759 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3644650868}) 2024-08-19T11:11:59.759 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.759 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1786293810}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=145034349}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=220932610}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2867570440}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.760 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1315064299}) 2024-08-19T11:11:59.761 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.761 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.761 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970841449}) 2024-08-19T11:11:59.761 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:11:59.761 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3985910137}) 2024-08-19T11:11:59.761 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:11:59.757+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2511335590}) 2024-08-19T11:11:59.762 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: starting. 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24517 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: created object 0... 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: created object 25... 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: created object 49... 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: finishing. 2024-08-19T11:11:59.856 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24518]: shutting down. 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1234140382}) 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1017388218}) 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1561975953}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=331009944}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3046239157}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=414019977}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2294159073}) 2024-08-19T11:12:00.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159292253}) 2024-08-19T11:12:00.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.194+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=646992720}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=950593361}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2427867182}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1248506663}) 2024-08-19T11:12:00.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2761272076}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=705994233}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2752429264}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1540586485}) 2024-08-19T11:12:00.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2933771435}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.248+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2056327503}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1575993606}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=752498572}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=337361176}) 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=395805601}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1891238474}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1873674083}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2538415070}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475133890}) 2024-08-19T11:12:00.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.249+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1420719204}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=48,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=5} crc {logm=644949049,mdsmap=4081106307,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=4079843041,monmap=2667667542,osd_metadata=3914635832,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=3143755637}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=54,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=2,osd_metadata=6} crc {logm=3308542849,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727127,mgr_metadata=880626121,mgrstat=2765287093,mon_config_key=2720761110,monmap=2667667542,osd_metadata=2544538045}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=52,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1} crc {logm=2473736649,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1838273085,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2140471196}) 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.250+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=54,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,osd_metadata=5,osd_pg_creating=1} crc {logm=228833967,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=2039596593,monmap=1080203526,osd_metadata=306360182,osd_pg_creating=2140471196}) 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=49,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=2} crc {logm=1771909241,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgrstat=1098397988,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=1359874820}) 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=52,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1} crc {logm=722613324,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1903644540,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2140471196}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=51,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2} crc {logm=37882797,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1920545669,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2140471196,osd_snap=421676469}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=2357614056,mdsmap=4204236774,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599917,mon_config_key=1502467057,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.251+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=54,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,osd_metadata=6,osd_pg_creating=1} crc {logm=2082922098,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3604599918,mon_config_key=363605677,monmap=1080203526,osd_metadata=554792967,osd_pg_creating=2140471196}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=801196908}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=885170877}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=1160528835}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=95} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=3064855277}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=94} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=1802619590}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=94} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=346651874}) 2024-08-19T11:12:00.261 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.253+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.262 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.254+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.262 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.254+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=95} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=687265110}) 2024-08-19T11:12:00.262 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.254+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:12:00.262 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.254+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=91} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2810684315}) 2024-08-19T11:12:00.262 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:12:00.254+0000 7f14877ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=88} crc {osd_metadata=3193044352,osd_pg_creating=2140471196,osd_snap=421676469,osdmap=2346762172}) 2024-08-19T11:12:00.751 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24519]: starting. 2024-08-19T11:12:00.752 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24519]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24517 2024-08-19T11:12:00.752 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24519]: shutting down. 2024-08-19T11:12:00.763 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:12:00.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:00.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.858+0000 7fd8c73a3640 10 monclient: get_monmap_and_config 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.858+0000 7fd8c73a3640 10 monclient: build_initial_monmap 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.858+0000 7fd8c73a3640 10 monclient: monmap: 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:00.859285+0000 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:00.859285+0000 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:00.860 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:00.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 1 Processor -- start 2024-08-19T11:12:00.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 1 -- start start 2024-08-19T11:12:00.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 10 monclient: init 2024-08-19T11:12:00.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 10 monclient: _add_conns ranks=[9,3,0,5,7,1,10,8,4,6,2] 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8c00a6a30 0x7fd8c00a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 10 monclient(hunting): picked mon.noname-a con 0x7fd8c00a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 0x7fd8c00a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 10 monclient(hunting): picked mon.noname-g con 0x7fd8c00a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd8c0139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.859+0000 7fd8c73a3640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c00a4f90 con 0x7fd8c0139860 2024-08-19T11:12:00.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c73a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c73a3640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c00a6380 con 0x7fd8c00a6a30 2024-08-19T11:12:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c73a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c73a3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c00a49d0 con 0x7fd8c00a6e10 2024-08-19T11:12:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c73a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c73a3640 10 monclient(hunting): authenticate will time out at 778.901023s 2024-08-19T11:12:00.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8c00a6a30 0x7fd8c00a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd8c00a6a30 0x7fd8c00a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40452/0 (socket says 172.21.15.71:40452) 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 1 -- 172.21.15.71:0/2506444403 learned_addr learned my addr 172.21.15.71:0/2506444403 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): get_auth_request con 0x7fd8c00a6a30 auth_method 0 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c513f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 1 --2- 172.21.15.71:0/2506444403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 0x7fd8c00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): get_auth_request con 0x7fd8c00a6e10 auth_method 0 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:00.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient(hunting): handle_auth_done global_id 4791 payload 274 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 1 -- 172.21.15.71:0/2506444403 >> v2:172.21.15.71:3300/0 conn(0x7fd8c00a6a30 msgr2=0x7fd8c00a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 1 --2- 172.21.15.71:0/2506444403 >> v2:172.21.15.71:3300/0 conn(0x7fd8c00a6a30 0x7fd8c00a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 1 -- 172.21.15.71:0/2506444403 >> v1:172.21.15.71:6789/0 conn(0x7fd8c0139860 legacy=0x7fd8c0139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient: _finish_hunting 0 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 1 monclient: found mon.noname-g 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:12:00.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.860+0000 7fd8c493e640 1 -- 172.21.15.71:0/2506444403 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c00a46f0 con 0x7fd8c00a6e10 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8c493e640 1 -- 172.21.15.71:0/2506444403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 msgr2=0x7fd8c00a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8c493e640 1 --2- 172.21.15.71:0/2506444403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 0x7fd8c00a71f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097d0 tx=0x7fd8b002a000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=d80a35eeac90522e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 1 -- 172.21.15.71:0/2506444403 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8b0037070 con 0x7fd8c00a6e10 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: dump: 2024-08-19T11:12:00.874 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:00.875 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: _finish_auth 0 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 1 -- 172.21.15.71:0/2506444403 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b002ad20 con 0x7fd8c00a6e10 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 1 -- 172.21.15.71:0/2506444403 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8b0030c20 con 0x7fd8c00a6e10 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8c73a3640 5 monclient: authenticate success, global_id 4791 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8c73a3640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8c73a3640 4 set_mon_vals no callback set 2024-08-19T11:12:00.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.863+0000 7fd8b7fff640 10 monclient: dump: 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:00.877 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 10 monclient: shutdown 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 -- 172.21.15.71:0/2506444403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 msgr2=0x7fd8c00a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/2506444403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 0x7fd8c00a71f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097d0 tx=0x7fd8b002a000 comp rx=0 tx=0).stop 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 -- 172.21.15.71:0/2506444403 shutdown_connections 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/2506444403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8c00a6e10 0x7fd8c00a71f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:00.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/2506444403 >> v2:172.21.15.71:3300/0 conn(0x7fd8c00a6a30 0x7fd8c00a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 -- 172.21.15.71:0/2506444403 >> 172.21.15.71:0/2506444403 conn(0x7fd8c00ac030 msgr2=0x7fd8c00ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 -- 172.21.15.71:0/2506444403 shutdown_connections 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.864+0000 7fd8c73a3640 1 -- 172.21.15.71:0/2506444403 wait complete. 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 10 monclient: build_initial_monmap 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 10 monclient: monmap: 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:00.879 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:00.880 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:00.881 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 1 Processor -- start 2024-08-19T11:12:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 1 -- start start 2024-08-19T11:12:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 10 monclient: init 2024-08-19T11:12:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:00.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 10 monclient: _add_conns ranks=[7,6,8,3,1,5,4,0,2] 2024-08-19T11:12:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.865+0000 7fd8c73a3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8c00a6a30 0x7fd8c0124d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): picked mon.noname-i con 0x7fd8c00a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 0x7fd8c0125280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): picked mon.noname-d con 0x7fd8c00a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 0x7fd8c01257c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:00.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): picked mon.noname-e con 0x7fd8c0139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd8c00a7730 con 0x7fd8c00a6e10 2024-08-19T11:12:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd8c013a400 con 0x7fd8c00a6a30 2024-08-19T11:12:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd8c00a22b0 con 0x7fd8c0139860 2024-08-19T11:12:00.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:00.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c73a3640 10 monclient(hunting): authenticate will time out at 778.907071s 2024-08-19T11:12:00.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 0x7fd8c0125280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:00.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 0x7fd8c01257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:00.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 0x7fd8c0125280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43894/0 (socket says 172.21.15.71:43894) 2024-08-19T11:12:00.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 1 -- 172.21.15.71:0/914692189 learned_addr learned my addr 172.21.15.71:0/914692189 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:00.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 0x7fd8c01257c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51122/0 (socket says 172.21.15.71:51122) 2024-08-19T11:12:00.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): get_auth_request con 0x7fd8c0139860 auth_method 0 2024-08-19T11:12:00.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:00.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:00.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:00.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): get_auth_request con 0x7fd8c00a6e10 auth_method 0 2024-08-19T11:12:00.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:00.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:00.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:00.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:00.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:00.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:00.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:00.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:00.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8c00a6a30 0x7fd8c0124d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:00.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:00.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): get_auth_request con 0x7fd8c00a6a30 auth_method 0 2024-08-19T11:12:00.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:00.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:00.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:00.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:00.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:00.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c513f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:00.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient(hunting): handle_auth_done global_id 4751 payload 824 2024-08-19T11:12:00.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 -- 172.21.15.71:0/914692189 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8c00a6a30 msgr2=0x7fd8c0124d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:00.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8c00a6a30 0x7fd8c0124d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:00.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 -- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 msgr2=0x7fd8c0125280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:00.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 0x7fd8c0125280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:00.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient: _finish_hunting 0 2024-08-19T11:12:00.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 monclient: found mon.noname-e 2024-08-19T11:12:00.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:00.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:00.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c5940640 1 -- 172.21.15.71:0/914692189 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c0128b90 con 0x7fd8c0139860 2024-08-19T11:12:00.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.866+0000 7fd8c493e640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 0x7fd8c0125280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:00.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8c5940640 1 -- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 msgr2=0x7fd8c01257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:00.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8c5940640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 0x7fd8c01257c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800be30 tx=0x7fd8b800bf20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:00.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8b8019070 con 0x7fd8c0139860 2024-08-19T11:12:00.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:00.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:00.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: dump: 2024-08-19T11:12:00.891 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:00.892 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:00.893 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:00.893 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:00.893 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:00.893 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:00.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:00.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:00.894 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:00.894 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:00.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:12:00.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:12:00.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:00.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b80127b0 con 0x7fd8c0139860 2024-08-19T11:12:00.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8c73a3640 5 monclient: authenticate success, global_id 4751 2024-08-19T11:12:00.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8c73a3640 10 monclient: _renew_subs 2024-08-19T11:12:00.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8c73a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:00.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c00a3ed0 con 0x7fd8c0139860 2024-08-19T11:12:00.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:00.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8b8012e10 con 0x7fd8c0139860 2024-08-19T11:12:00.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:00.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:00.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b5ffb640 10 monclient: dump: 2024-08-19T11:12:00.896 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:00.896 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:00.897 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.897 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:00.897 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:00.897 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:00.897 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:00.898 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:00.898 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:00.898 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:00.898 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:00.898 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:00.898 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:00.899 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:00.899 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:00.899 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:00.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.868+0000 7fd8b77fe640 4 set_mon_vals no callback set 2024-08-19T11:12:00.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 10 monclient: _renew_subs 2024-08-19T11:12:00.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:00.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c01288b0 con 0x7fd8c0139860 2024-08-19T11:12:00.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd8b80129a0 con 0x7fd8c0139860 2024-08-19T11:12:00.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:00.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:00.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:00.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.870+0000 7fd8b5ffb640 1 --2- 172.21.15.71:0/914692189 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8a403ea80 0x7fd8a4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:00.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.869+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c00a57f0 con 0x7fd8c0139860 2024-08-19T11:12:00.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.870+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(55..55 src has 1..55) ==== 3506+0+0 (secure 0 0 0) 0x7fd8b8051810 con 0x7fd8c0139860 2024-08-19T11:12:00.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.870+0000 7fd8c513f640 1 --2- 172.21.15.71:0/914692189 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8a403ea80 0x7fd8a4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:00.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.870+0000 7fd8c513f640 10 monclient: get_auth_request con 0x7fd8a403ea80 auth_method 0 2024-08-19T11:12:00.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.872+0000 7fd8c513f640 1 --2- 172.21.15.71:0/914692189 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8a403ea80 0x7fd8a4040f40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009bd0 tx=0x7fd8bc009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:00.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.874+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fd8b8010200 con 0x7fd8c0139860 2024-08-19T11:12:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.874+0000 7fd8b5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:00.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:00.874+0000 7fd8b5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:01.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.116+0000 7fd8c73a3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.116+0000 7fd8c73a3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.116+0000 7fd8c73a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.116+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd8c00a0ea0 con 0x7fd8c0139860 2024-08-19T11:12:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.117+0000 7fd8b5ffb640 1 -- 172.21.15.71:0/914692189 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7fd8b8050700 con 0x7fd8c0139860 2024-08-19T11:12:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.117+0000 7fd8b5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:01.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.117+0000 7fd8b5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:01.119 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8a403ea80 msgr2=0x7fd8a4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/914692189 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8a403ea80 0x7fd8a4040f40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009bd0 tx=0x7fd8bc009240 comp rx=0 tx=0).stop 2024-08-19T11:12:01.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 10 monclient: shutdown 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 msgr2=0x7fd8c01257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 0x7fd8c01257c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800be30 tx=0x7fd8b800bf20 comp rx=0 tx=0).stop 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 shutdown_connections 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/914692189 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8a403ea80 0x7fd8a4040f40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd8c0139860 0x7fd8c01257c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8c00a6e10 0x7fd8c0125280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 --2- 172.21.15.71:0/914692189 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8c00a6a30 0x7fd8c0124d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 >> 172.21.15.71:0/914692189 conn(0x7fd8c00ac030 msgr2=0x7fd8c01390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 shutdown_connections 2024-08-19T11:12:01.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.119+0000 7fd8c73a3640 1 -- 172.21.15.71:0/914692189 wait complete. 2024-08-19T11:12:01.131 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:12:01.131 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:12:01.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:12:01.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:12:01.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.228+0000 7fe56d1d9640 10 monclient: get_monmap_and_config 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.228+0000 7fe56d1d9640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.228+0000 7fe56d1d9640 10 monclient: monmap: 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:01.229533+0000 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:01.229533+0000 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:01.230 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:01.231 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.229+0000 7fe56d1d9640 1 Processor -- start 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.229+0000 7fe56d1d9640 1 -- start start 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.229+0000 7fe56d1d9640 10 monclient: init 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient: _add_conns ranks=[8,1,4,2,7,3,10,6,0,9,5] 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 0x7fe5680a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): picked mon.noname-e con 0x7fe5680a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe5680a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 0x7fe568139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): picked mon.noname-c con 0x7fe5680a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5680a6380 con 0x7fe5680a57c0 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe5680a5020 con 0x7fe5680a7270 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe5680a7d40 con 0x7fe5680a6950 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56d1d9640 10 monclient(hunting): authenticate will time out at 779.271102s 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 0x7fe5680a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 0x7fe568139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 0x7fe568139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48558/0 (socket says 172.21.15.71:48558) 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 1 -- 172.21.15.71:0/3319286735 learned_addr learned my addr 172.21.15.71:0/3319286735 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): get_auth_request con 0x7fe5680a7270 auth_method 0 2024-08-19T11:12:01.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): get_auth_request con 0x7fe5680a6950 auth_method 0 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient(hunting): handle_auth_done global_id 4760 payload 274 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 1 -- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 msgr2=0x7fe568139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 1 --2- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 0x7fe568139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 1 -- 172.21.15.71:0/3319286735 >> v1:172.21.15.135:6789/0 conn(0x7fe5680a57c0 legacy=0x7fe568139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 1 monclient: found mon.noname-e 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe566d9d640 1 -- 172.21.15.71:0/3319286735 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5680a3650 con 0x7fe5680a6950 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.230+0000 7fe56759e640 1 --2- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 0x7fe568139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe566d9d640 1 -- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 msgr2=0x7fe5680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe566d9d640 1 --2- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 0x7fe5680a6d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe558009df0 tx=0x7fe55802a4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=3d746c7157262fa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 1 -- 172.21.15.71:0/3319286735 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe558007bc0 con 0x7fe5680a6950 2024-08-19T11:12:01.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: dump: 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 1 -- 172.21.15.71:0/3319286735 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe558007d80 con 0x7fe5680a6950 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 5 monclient: authenticate success, global_id 4760 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 1 -- 172.21.15.71:0/3319286735 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe558031870 con 0x7fe5680a6950 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 4 set_mon_vals no callback set 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe565d9b640 10 monclient: dump: 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 10 monclient: shutdown 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 1 -- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 msgr2=0x7fe5680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.233+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 0x7fe5680a6d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe558009df0 tx=0x7fe55802a4b0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 1 -- 172.21.15.71:0/3319286735 shutdown_connections 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5680a7270 0x7fe568139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/3319286735 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a6950 0x7fe5680a6d30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 1 -- 172.21.15.71:0/3319286735 >> 172.21.15.71:0/3319286735 conn(0x7fe5680abf50 msgr2=0x7fe5680ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 1 -- 172.21.15.71:0/3319286735 shutdown_connections 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 1 -- 172.21.15.71:0/3319286735 wait complete. 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.234+0000 7fe56d1d9640 10 monclient: monmap: 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.246 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 Processor -- start 2024-08-19T11:12:01.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 -- start start 2024-08-19T11:12:01.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient: init 2024-08-19T11:12:01.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient: _add_conns ranks=[8,5,7,6,2,0,4,3,1] 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 0x7fe568123cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): picked mon.noname-e con 0x7fe5680a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5680a6950 0x7fe568124200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): picked mon.noname-h con 0x7fe5680a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe5680a7270 0x7fe568124740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): picked mon.noname-i con 0x7fe5680a7270 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe5680a8700 con 0x7fe5680a6950 2024-08-19T11:12:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe5680a84c0 con 0x7fe5680a7270 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe5680a7690 con 0x7fe5680a57c0 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe56d1d9640 10 monclient(hunting): authenticate will time out at 779.276782s 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 0x7fe568123cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 0x7fe568123cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51148/0 (socket says 172.21.15.71:51148) 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 1 -- 172.21.15.71:0/4070093743 learned_addr learned my addr 172.21.15.71:0/4070093743 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): get_auth_request con 0x7fe5680a57c0 auth_method 0 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.235+0000 7fe566d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 10 monclient(hunting): handle_auth_done global_id 4769 payload 824 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe5680a7270 msgr2=0x7fe568124740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe56759e640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe5680a7270 0x7fe568124740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe5680a7270 0x7fe568124740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe56659c640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5680a6950 0x7fe568124200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5680a6950 msgr2=0x7fe568124200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5680a6950 0x7fe568124200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 1 monclient: found mon.noname-e 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe566d9d640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe568127ac0 con 0x7fe5680a57c0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe56759e640 10 monclient: get_auth_request con 0x7fe5680a7270 auth_method 0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe56659c640 10 monclient: get_auth_request con 0x7fe5680a6950 auth_method 0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe56759e640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe5680a7270 0x7fe568124740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.236+0000 7fe56659c640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5680a6950 0x7fe568124200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe566d9d640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 msgr2=0x7fe568123cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe566d9d640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 0x7fe568123cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe55802a9d0 tx=0x7fe558004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe558040070 con 0x7fe5680a57c0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: dump: 2024-08-19T11:12:01.257 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.258 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5580046c0 con 0x7fe5680a57c0 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 5 monclient: authenticate success, global_id 4769 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 10 monclient: _renew_subs 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5680a2090 con 0x7fe5680a57c0 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe55803c890 con 0x7fe5680a57c0 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe54f7fe640 10 monclient: dump: 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 10 monclient: _renew_subs 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe568126c50 con 0x7fe5680a57c0 2024-08-19T11:12:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.238+0000 7fe56559a640 4 set_mon_vals no callback set 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56d1d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 0x7fe568063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe568127460 con 0x7fe56802e340 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe558039040 con 0x7fe5680a57c0 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 0x7fe568063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient: get_auth_request con 0x7fe56802e340 auth_method 0 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe54f7fe640 1 --2- 172.21.15.71:0/4070093743 >> v2:172.21.15.135:6800/726754104 conn(0x7fe55403ea80 0x7fe554040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.239+0000 7fe56659c640 10 monclient(hunting): handle_auth_done global_id 4761 payload 824 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.240+0000 7fe56659c640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe56802e720 con 0x7fe56802e340 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.240+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(55..55 src has 1..55) ==== 3506+0+0 (secure 0 0 0) 0x7fe5580729e0 con 0x7fe5680a57c0 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.240+0000 7fe56759e640 1 --2- 172.21.15.71:0/4070093743 >> v2:172.21.15.135:6800/726754104 conn(0x7fe55403ea80 0x7fe554040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.240+0000 7fe56759e640 10 monclient: get_auth_request con 0x7fe55403ea80 auth_method 0 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe56659c640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 msgr2=0x7fe568063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe56659c640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 0x7fe568063a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe568125dd0 tx=0x7fe55c00d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe55c012c80 con 0x7fe56802e340 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:12:01.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 10 monclient: dump: 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.264 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe55c012810 con 0x7fe56802e340 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 msgr2=0x7fe568063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 0x7fe568063a80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe568125dd0 tx=0x7fe55c00d950 comp rx=0 tx=0).stop 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 msgr2=0x7fe568063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe54f7fe640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe56802e340 0x7fe568063a80 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe568125dd0 tx=0x7fe55c00d950 comp rx=0 tx=0).stop 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.242+0000 7fe56759e640 1 --2- 172.21.15.71:0/4070093743 >> v2:172.21.15.135:6800/726754104 conn(0x7fe55403ea80 0x7fe554040f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe568125fe0 tx=0x7fe560008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56d1d9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:01.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 0x7fe5681d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56d1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe568076c60 con 0x7fe568063fc0 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 0x7fe5681d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient: get_auth_request con 0x7fe568063fc0 auth_method 0 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.248+0000 7fe56659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.249+0000 7fe56659c640 10 monclient(hunting): handle_auth_done global_id 4770 payload 824 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.249+0000 7fe56659c640 1 -- 172.21.15.71:0/4070093743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe5680a0510 con 0x7fe568063fc0 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe56659c640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 msgr2=0x7fe5681d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe56659c640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 0x7fe5681d8990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe568125dd0 tx=0x7fe55c003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe55c006e50 con 0x7fe568063fc0 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 10 monclient: dump: 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.267 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9436 (secure 0 0 0) 0x7fe55c0069e0 con 0x7fe568063fc0 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:01.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 msgr2=0x7fe5681d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 0x7fe5681d8990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe568125dd0 tx=0x7fe55c003760 comp rx=0 tx=0).stop 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 msgr2=0x7fe5681d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.251+0000 7fe54f7fe640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe568063fc0 0x7fe5681d8990 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe568125dd0 tx=0x7fe55c003760 comp rx=0 tx=0).stop 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:12:01.269 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 118128, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.271 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.272 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.273 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:01.274 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.275 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:01.278 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:01.282 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.283 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.285 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.293 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:01.295 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 >> v2:172.21.15.135:6800/726754104 conn(0x7fe55403ea80 msgr2=0x7fe554040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/4070093743 >> v2:172.21.15.135:6800/726754104 conn(0x7fe55403ea80 0x7fe554040f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe568125fe0 tx=0x7fe560008040 comp rx=0 tx=0).stop 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 10 monclient: shutdown 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 msgr2=0x7fe568123cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 --2- 172.21.15.71:0/4070093743 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5680a57c0 0x7fe568123cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe55802a9d0 tx=0x7fe558004a40 comp rx=0 tx=0).stop 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56759e640 1 -- 172.21.15.71:0/4070093743 reap_dead start 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56759e640 1 -- 172.21.15.71:0/4070093743 reap_dead start 2024-08-19T11:12:01.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 shutdown_connections 2024-08-19T11:12:01.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 >> 172.21.15.71:0/4070093743 conn(0x7fe5680abf50 msgr2=0x7fe56809d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 shutdown_connections 2024-08-19T11:12:01.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.252+0000 7fe56d1d9640 1 -- 172.21.15.71:0/4070093743 wait complete. 2024-08-19T11:12:01.298 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:01.298 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:12:01.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.398+0000 7fd8e84d3640 10 monclient: get_monmap_and_config 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.398+0000 7fd8e84d3640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.398+0000 7fd8e84d3640 10 monclient: monmap: 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:01.398861+0000 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:01.398861+0000 2024-08-19T11:12:01.399 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:01.400 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.398+0000 7fd8e84d3640 1 Processor -- start 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.398+0000 7fd8e84d3640 1 -- start start 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.398+0000 7fd8e84d3640 10 monclient: init 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient: _add_conns ranks=[1,5,6,0,7,9,10,3,2,4,8] 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd8e00a3d80 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd8e0136c80 0x7fd8e013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): picked mon.noname-h con 0x7fd8e0136c80 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e013dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): picked mon.noname-d con 0x7fd8e0137060 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8e00a24d0 con 0x7fd8e00a3d80 2024-08-19T11:12:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd8e00a1fa0 con 0x7fd8e0136c80 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd8e009fe70 con 0x7fd8e0137060 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e84d3640 10 monclient(hunting): authenticate will time out at 779.440578s 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e013dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e013dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43910/0 (socket says 172.21.15.71:43910) 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 -- 172.21.15.71:0/4218581243 learned_addr learned my addr 172.21.15.71:0/4218581243 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): get_auth_request con 0x7fd8e0137060 auth_method 0 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 1 --2- 172.21.15.71:0/4218581243 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd8e0136c80 0x7fd8e013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): get_auth_request con 0x7fd8e0136c80 auth_method 0 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e5a6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_done global_id 24252 payload 274 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 -- 172.21.15.71:0/4218581243 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd8e0136c80 msgr2=0x7fd8e013b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 --2- 172.21.15.71:0/4218581243 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd8e0136c80 0x7fd8e013b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 -- 172.21.15.71:0/4218581243 >> v1:172.21.15.135:6789/0 conn(0x7fd8e00a3d80 legacy=0x7fd8e0136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 monclient: found mon.noname-d 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.399+0000 7fd8e6a70640 1 -- 172.21.15.71:0/4218581243 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e00a0b70 con 0x7fd8e0137060 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.402+0000 7fd8e6a70640 1 -- 172.21.15.71:0/4218581243 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 msgr2=0x7fd8e013dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.402+0000 7fd8e6a70640 1 --2- 172.21.15.71:0/4218581243 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e013dd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009e80 tx=0x7fd8d802a530 comp rx=0 tx=0).ready entity=mon.6 client_cookie=943620d00a724fb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 1 -- 172.21.15.71:0/4218581243 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8d8036070 con 0x7fd8e0137060 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: dump: 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.413 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 1 -- 172.21.15.71:0/4218581243 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8007a70 con 0x7fd8e0137060 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 5 monclient: authenticate success, global_id 24252 2024-08-19T11:12:01.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 1 -- 172.21.15.71:0/4218581243 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8d8007ca0 con 0x7fd8e0137060 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 4 set_mon_vals no callback set 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e526d640 10 monclient: dump: 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.415 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 10 monclient: shutdown 2024-08-19T11:12:01.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 -- 172.21.15.71:0/4218581243 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 msgr2=0x7fd8e013dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/4218581243 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e013dd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009e80 tx=0x7fd8d802a530 comp rx=0 tx=0).stop 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 -- 172.21.15.71:0/4218581243 shutdown_connections 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/4218581243 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e013dd00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/4218581243 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd8e0136c80 0x7fd8e013b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 -- 172.21.15.71:0/4218581243 >> 172.21.15.71:0/4218581243 conn(0x7fd8e00a91d0 msgr2=0x7fd8e00a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 -- 172.21.15.71:0/4218581243 shutdown_connections 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.403+0000 7fd8e84d3640 1 -- 172.21.15.71:0/4218581243 wait complete. 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.404+0000 7fd8e84d3640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.404+0000 7fd8e84d3640 10 monclient: monmap: 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:01.417 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.418 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.404+0000 7fd8e84d3640 1 Processor -- start 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.404+0000 7fd8e84d3640 1 -- start start 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.404+0000 7fd8e84d3640 10 monclient: init 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient: _add_conns ranks=[2,7,6,4,1,3,0,8,5] 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e00a3d80 0x7fd8e0123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): picked mon.noname-b con 0x7fd8e00a3d80 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8e0136c80 0x7fd8e0120aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): picked mon.noname-i con 0x7fd8e0136c80 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): picked mon.noname-d con 0x7fd8e0137060 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:01.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e00a2ca0 con 0x7fd8e00a3d80 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd8e00a08c0 con 0x7fd8e0137060 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd8e006c8a0 con 0x7fd8e0136c80 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e84d3640 10 monclient(hunting): authenticate will time out at 779.446243s 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e00a3d80 0x7fd8e0123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43918/0 (socket says 172.21.15.71:43918) 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 -- 172.21.15.71:0/3804192822 learned_addr learned my addr 172.21.15.71:0/3804192822 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): get_auth_request con 0x7fd8e0137060 auth_method 0 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): get_auth_request con 0x7fd8e00a3d80 auth_method 0 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e5a6e640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8e0136c80 0x7fd8e0120aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e5a6e640 10 monclient(hunting): get_auth_request con 0x7fd8e0136c80 auth_method 0 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e5a6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e5a6e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e5a6e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient(hunting): handle_auth_done global_id 24261 payload 824 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8e0136c80 msgr2=0x7fd8e0120aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd8e0136c80 0x7fd8e0120aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e00a3d80 msgr2=0x7fd8e0123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e00a3d80 0x7fd8e0123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 monclient: found mon.noname-d 2024-08-19T11:12:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:01.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.405+0000 7fd8e6a70640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e0124850 con 0x7fd8e0137060 2024-08-19T11:12:01.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.407+0000 7fd8e6a70640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 msgr2=0x7fd8e0120fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.407+0000 7fd8e6a70640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d802ab20 tx=0x7fd8d8004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8d8036070 con 0x7fd8e0137060 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: dump: 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.428 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8041070 con 0x7fd8e0137060 2024-08-19T11:12:01.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 5 monclient: authenticate success, global_id 24261 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 10 monclient: _renew_subs 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e00a95b0 con 0x7fd8e0137060 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8d8003db0 con 0x7fd8e0137060 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 10 monclient: dump: 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.430 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 10 monclient: _renew_subs 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e01239e0 con 0x7fd8e0137060 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e4a6c640 4 set_mon_vals no callback set 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 0x7fd8e0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e0076c60 con 0x7fd8e0121520 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 0x7fd8e0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 10 monclient: get_auth_request con 0x7fd8e0121520 auth_method 0 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e6a70640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d802ab20 tx=0x7fd8d8004a40 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fd8d80722b0 osd_map(55..55 src has 1..55) 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.408+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd8d8007930 con 0x7fd8e0137060 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.409+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.409+0000 7fd8e626f640 10 monclient(hunting): handle_auth_done global_id 4916 payload 824 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.409+0000 7fd8e626f640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8e0121900 con 0x7fd8e0121520 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.409+0000 7fd8d6ffd640 1 --2- 172.21.15.71:0/3804192822 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8c403ea80 0x7fd8c4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.409+0000 7fd8e5a6e640 1 --2- 172.21.15.71:0/3804192822 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8c403ea80 0x7fd8c4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.409+0000 7fd8e5a6e640 10 monclient: get_auth_request con 0x7fd8c403ea80 auth_method 0 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8e626f640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 msgr2=0x7fd8e0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8e626f640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 0x7fd8e0070e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00f7a0 tx=0x7fd8dc00fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8dc018030 con 0x7fd8e0121520 2024-08-19T11:12:01.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 10 monclient: dump: 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.434 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd8dc00d9b0 con 0x7fd8e0121520 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 msgr2=0x7fd8e0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 0x7fd8e0070e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00f7a0 tx=0x7fd8dc00fc60 comp rx=0 tx=0).stop 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 msgr2=0x7fd8e0070e10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.411+0000 7fd8d6ffd640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0121520 0x7fd8e0070e10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.412+0000 7fd8e5a6e640 1 --2- 172.21.15.71:0/3804192822 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8c403ea80 0x7fd8c4040f40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0122b60 tx=0x7fd8d000b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e84d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 0x7fd8e0071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e84d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e00a83e0 con 0x7fd8e0071350 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 0x7fd8e0071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient: get_auth_request con 0x7fd8e0071350 auth_method 0 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.417+0000 7fd8e626f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.418+0000 7fd8e626f640 10 monclient(hunting): handle_auth_done global_id 4925 payload 824 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.418+0000 7fd8e626f640 1 -- 172.21.15.71:0/3804192822 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd8e01224f0 con 0x7fd8e0071350 2024-08-19T11:12:01.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8e626f640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 msgr2=0x7fd8e0071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8e626f640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 0x7fd8e0071760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc019040 tx=0x7fd8dc003760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd8dc004470 con 0x7fd8e0071350 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 10 monclient: dump: 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.437 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fd8dc004000 con 0x7fd8e0071350 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 msgr2=0x7fd8e0071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 0x7fd8e0071760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc019040 tx=0x7fd8dc003760 comp rx=0 tx=0).stop 2024-08-19T11:12:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 msgr2=0x7fd8e0071760 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.420+0000 7fd8d6ffd640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e0071350 0x7fd8e0071760 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc019040 tx=0x7fd8dc003760 comp rx=0 tx=0).stop 2024-08-19T11:12:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:01.439 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:01.439 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 118299, 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:01.440 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:01.441 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:01.441 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:01.441 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:01.441 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:01.441 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:01.441 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:01.442 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.442 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:12:01.442 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.442 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:01.442 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:01.442 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.443 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.443 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.443 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.443 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.443 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.444 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.444 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.444 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.444 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.444 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.444 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.446 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.446 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.446 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.446 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.446 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.446 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.447 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.447 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:01.447 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:01.447 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:01.448 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:01.448 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:01.448 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:01.448 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.448 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.448 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:01.449 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:01.449 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:01.449 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:01.449 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:01.449 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:01.449 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:01.450 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.450 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:01.450 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.450 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.450 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.451 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.451 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.451 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.451 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.451 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:01.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.453 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:01.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.453 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:01.453 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:01.453 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:01.454 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.455 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.456 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.456 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.456 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.456 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.457 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:01.457 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:01.457 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.458 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.458 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.458 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:01.458 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:01.459 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.460 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.461 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.461 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:01.461 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:01.461 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.462 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.462 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:01.462 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.463 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.463 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:01.463 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.464 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.464 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.464 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.465 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.465 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.465 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:01.465 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:01.466 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.466 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.466 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:01.467 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.467 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:01.467 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.468 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.468 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.468 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.468 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.470 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.475 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.477 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.478 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.479 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:01.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.479 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:01.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8c403ea80 msgr2=0x7fd8c4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/3804192822 >> v2:172.21.15.135:6800/726754104 conn(0x7fd8c403ea80 0x7fd8c4040f40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0122b60 tx=0x7fd8d000b3a0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 10 monclient: shutdown 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 msgr2=0x7fd8e0120fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e6a70640 1 -- 172.21.15.71:0/3804192822 reap_dead start 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d802ab20 tx=0x7fd8d8004a40 comp rx=0 tx=0).stop 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8d6ffd640 1 -- 172.21.15.71:0/3804192822 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(55..55 src has 1..55) ==== 3506+0+0 (unknown 0 0 0) 0x7fd8d80722b0 con 0x7fd8e0137060 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 shutdown_connections 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 --2- 172.21.15.71:0/3804192822 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd8e0137060 0x7fd8e0120fe0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 >> 172.21.15.71:0/3804192822 conn(0x7fd8e00a91d0 msgr2=0x7fd8e0135d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 shutdown_connections 2024-08-19T11:12:01.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.421+0000 7fd8e84d3640 1 -- 172.21.15.71:0/3804192822 wait complete. 2024-08-19T11:12:01.482 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:01.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:12:01.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:12:01.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.579+0000 7f9ce0af6640 10 monclient: get_monmap_and_config 2024-08-19T11:12:01.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.579+0000 7f9ce0af6640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.579+0000 7f9ce0af6640 10 monclient: monmap: 2024-08-19T11:12:01.580 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:01.580073+0000 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:01.580073+0000 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.581 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:01.582 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.579+0000 7f9ce0af6640 1 Processor -- start 2024-08-19T11:12:01.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 -- start start 2024-08-19T11:12:01.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient: init 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient: _add_conns ranks=[2,8,7,5,6,4,3,9,0,1,10] 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 0x7f9cdc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): picked mon.noname-b con 0x7f9cdc0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 0x7f9cdc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): picked mon.noname-e con 0x7f9cdc0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cdc139710 0x7f9cdc139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): picked mon.noname-i con 0x7f9cdc139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:01.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc0a5020 con 0x7f9cdc0a6950 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9cdc0a77b0 con 0x7f9cdc139710 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9cdc0a7d40 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9ce0af6640 10 monclient(hunting): authenticate will time out at 779.621743s 2024-08-19T11:12:01.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 0x7f9cdc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 0x7f9cdc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 0x7f9cdc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33188/0 (socket says 172.21.15.71:33188) 2024-08-19T11:12:01.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 0x7f9cdc0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51164/0 (socket says 172.21.15.71:51164) 2024-08-19T11:12:01.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 1 -- 172.21.15.71:0/1283990839 learned_addr learned my addr 172.21.15.71:0/1283990839 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): get_auth_request con 0x7f9cdc0a6950 auth_method 0 2024-08-19T11:12:01.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 10 monclient(hunting): get_auth_request con 0x7f9cdc0a57c0 auth_method 0 2024-08-19T11:12:01.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cda59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.580+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 10 monclient(hunting): handle_auth_done global_id 4934 payload 274 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 1 -- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 msgr2=0x7f9cdc0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cdad9d640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cdc139710 0x7f9cdc139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 0x7f9cdc0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 1 -- 172.21.15.71:0/1283990839 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cdc139710 msgr2=0x7f9cdc139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cdc139710 0x7f9cdc139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 1 monclient: found mon.noname-b 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:01.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cda59c640 1 -- 172.21.15.71:0/1283990839 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc0a6380 con 0x7f9cdc0a6950 2024-08-19T11:12:01.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.581+0000 7f9cd9d9b640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 0x7f9cdc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:01.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.583+0000 7f9cda59c640 1 -- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 msgr2=0x7f9cdc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.583+0000 7f9cda59c640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 0x7f9cdc0a6d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0098d0 tx=0x7f9ccc02a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be750d26f39729f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 1 -- 172.21.15.71:0/1283990839 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ccc037070 con 0x7f9cdc0a6950 2024-08-19T11:12:01.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: dump: 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.596 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.597 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 5 monclient: authenticate success, global_id 4934 2024-08-19T11:12:01.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 1 -- 172.21.15.71:0/1283990839 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc02adc0 con 0x7f9cdc0a6950 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 1 -- 172.21.15.71:0/1283990839 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ccc030c20 con 0x7f9cdc0a6950 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 4 set_mon_vals no callback set 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:01.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9cd959a640 10 monclient: dump: 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.600 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 10 monclient: shutdown 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 -- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 msgr2=0x7f9cdc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 0x7f9cdc0a6d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0098d0 tx=0x7f9ccc02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 -- 172.21.15.71:0/1283990839 shutdown_connections 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cdc139710 0x7f9cdc139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cdc0a57c0 0x7f9cdc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/1283990839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9cdc0a6950 0x7f9cdc0a6d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 -- 172.21.15.71:0/1283990839 >> 172.21.15.71:0/1283990839 conn(0x7f9cdc0abf50 msgr2=0x7f9cdc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 -- 172.21.15.71:0/1283990839 shutdown_connections 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.584+0000 7f9ce0af6640 1 -- 172.21.15.71:0/1283990839 wait complete. 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.585+0000 7f9ce0af6640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.585+0000 7f9ce0af6640 10 monclient: monmap: 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:01.602 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.603 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.585+0000 7f9ce0af6640 1 Processor -- start 2024-08-19T11:12:01.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 -- start start 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient: init 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient: _add_conns ranks=[4,6,0,8,1,2,7,5,3] 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 0x7f9cdc1ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): picked mon.noname-c con 0x7f9cdc0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cdc0a6950 0x7f9cdc138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): picked mon.noname-d con 0x7f9cdc0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cdc139710 0x7f9cdc138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): picked mon.noname-a con 0x7f9cdc139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0a84c0 con 0x7f9cdc139710 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9cdc0a3650 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9cdc0a8700 con 0x7f9cdc0a6950 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9ce0af6640 10 monclient(hunting): authenticate will time out at 779.627466s 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 0x7f9cdc1ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cdc0a6950 0x7f9cdc138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cdc139710 0x7f9cdc138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 0x7f9cdc1ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48570/0 (socket says 172.21.15.71:48570) 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cdc0a6950 0x7f9cdc138790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43934/0 (socket says 172.21.15.71:43934) 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 -- 172.21.15.71:0/186520545 learned_addr learned my addr 172.21.15.71:0/186520545 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): get_auth_request con 0x7f9cdc0a57c0 auth_method 0 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): get_auth_request con 0x7f9cdc0a6950 auth_method 0 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): get_auth_request con 0x7f9cdc139710 auth_method 0 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient(hunting): handle_auth_done global_id 4765 payload 824 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cdc0a6950 msgr2=0x7f9cdc138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cdc0a6950 0x7f9cdc138790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cdc139710 msgr2=0x7f9cdc138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cdc139710 0x7f9cdc138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 monclient: found mon.noname-c 2024-08-19T11:12:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:12:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cda59c640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc123df0 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.586+0000 7f9cdad9d640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cdc139710 0x7f9cdc138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:01.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9cda59c640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 msgr2=0x7f9cdc1ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9cda59c640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 0x7f9cdc1ce0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc02a0e0 tx=0x7f9ccc0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ccc037040 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:12:01.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: dump: 2024-08-19T11:12:01.615 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.616 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 5 monclient: authenticate success, global_id 4765 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 10 monclient: _renew_subs 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc003bd0 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:12:01.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc1ce630 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ccc003dc0 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ccaffd640 10 monclient: dump: 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.618 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9cd8d99640 4 set_mon_vals no callback set 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 10 monclient: _renew_subs 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.589+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc122780 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ce0af6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 0x7f9cdc02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9cdc06a590 con 0x7f9cdc123230 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9ccc030340 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 0x7f9cdc02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient: get_auth_request con 0x7f9cdc123230 auth_method 0 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ccaffd640 1 --2- 172.21.15.71:0/186520545 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cbc03ea80 0x7f9cbc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(55..55 src has 1..55) ==== 3506+0+0 (secure 0 0 0) 0x7f9ccc071da0 con 0x7f9cdc0a57c0 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_done global_id 4774 payload 824 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cd9d9b640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cdc0a1f20 con 0x7f9cdc123230 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cdad9d640 1 --2- 172.21.15.71:0/186520545 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cbc03ea80 0x7f9cbc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.590+0000 7f9cdad9d640 10 monclient: get_auth_request con 0x7f9cbc03ea80 auth_method 0 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.592+0000 7f9cd9d9b640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 msgr2=0x7f9cdc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.592+0000 7f9cd9d9b640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 0x7f9cdc02d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0a1970 tx=0x7f9cd0011d40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.592+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cd0019070 con 0x7f9cdc123230 2024-08-19T11:12:01.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.592+0000 7f9ccaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.592+0000 7f9ccaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.592+0000 7f9ccaffd640 10 monclient: dump: 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.622 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9cd000f860 con 0x7f9cdc123230 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 msgr2=0x7f9cdc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 0x7f9cdc02d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0a1970 tx=0x7f9cd0011d40 comp rx=0 tx=0).stop 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 msgr2=0x7f9cdc02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9ccaffd640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123230 0x7f9cdc02d1c0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0a1970 tx=0x7f9cd0011d40 comp rx=0 tx=0).stop 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.593+0000 7f9cdad9d640 1 --2- 172.21.15.71:0/186520545 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cbc03ea80 0x7f9cbc040f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc074f90 tx=0x7f9cd4007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9ce0af6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 0x7f9cdc02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9ce0af6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9cdc076c60 con 0x7f9cdc123610 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 0x7f9cdc02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient: get_auth_request con 0x7f9cdc123610 auth_method 0 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 10 monclient(hunting): handle_auth_done global_id 4783 payload 824 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.599+0000 7f9cd9d9b640 1 -- 172.21.15.71:0/186520545 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cdc13a400 con 0x7f9cdc123610 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.601+0000 7f9cd9d9b640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 msgr2=0x7f9cdc02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.601+0000 7f9cd9d9b640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 0x7f9cdc02d700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0a1970 tx=0x7f9cd00046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.601+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cd0019040 con 0x7f9cdc123610 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.601+0000 7f9ccaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.601+0000 7f9ccaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.601+0000 7f9ccaffd640 10 monclient: dump: 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.626 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f9cd001e450 con 0x7f9cdc123610 2024-08-19T11:12:01.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 msgr2=0x7f9cdc02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 0x7f9cdc02d700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0a1970 tx=0x7f9cd00046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 msgr2=0x7f9cdc02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ccaffd640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc123610 0x7f9cdc02d700 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0a1970 tx=0x7f9cd00046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:01.628 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 118471, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:01.629 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.630 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.631 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:01.632 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.633 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.634 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:01.635 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:01.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.637 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.639 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.641 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.643 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.645 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.646 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:01.647 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.648 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.650 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.652 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:01.653 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.654 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.655 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:01.657 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cbc03ea80 msgr2=0x7f9cbc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/186520545 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cbc03ea80 0x7f9cbc040f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc074f90 tx=0x7f9cd4007670 comp rx=0 tx=0).stop 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 10 monclient: shutdown 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 msgr2=0x7f9cdc1ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 --2- 172.21.15.71:0/186520545 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cdc0a57c0 0x7f9cdc1ce0f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc02a0e0 tx=0x7f9ccc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9cdad9d640 1 -- 172.21.15.71:0/186520545 reap_dead start 2024-08-19T11:12:01.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9cdad9d640 1 -- 172.21.15.71:0/186520545 reap_dead start 2024-08-19T11:12:01.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 shutdown_connections 2024-08-19T11:12:01.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 >> 172.21.15.71:0/186520545 conn(0x7f9cdc0abf50 msgr2=0x7f9cdc0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 shutdown_connections 2024-08-19T11:12:01.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.602+0000 7f9ce0af6640 1 -- 172.21.15.71:0/186520545 wait complete. 2024-08-19T11:12:01.660 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:01.660 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:12:01.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:12:01.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.763+0000 7f73b1b28640 10 monclient: get_monmap_and_config 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.763+0000 7f73b1b28640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.763+0000 7f73b1b28640 10 monclient: monmap: 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:01.764521+0000 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:01.764521+0000 2024-08-19T11:12:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.766 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:01.767 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:01.767 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.764+0000 7f73b1b28640 1 Processor -- start 2024-08-19T11:12:01.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.764+0000 7f73b1b28640 1 -- start start 2024-08-19T11:12:01.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.764+0000 7f73b1b28640 10 monclient: init 2024-08-19T11:12:01.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient: _add_conns ranks=[2,7,8,6,10,5,1,9,4,0,3] 2024-08-19T11:12:01.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 0x7f73ac0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): picked mon.noname-b con 0x7f73ac0a3cb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f73ac0a5020 0x7f73ac0a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): picked mon.noname-i con 0x7f73ac0a5020 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac139970 0x7f73ac139d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): picked mon.noname-e con 0x7f73ac139970 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac0a4b10 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f73ac0a13d0 con 0x7f73ac0a5020 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f73ac074530 con 0x7f73ac139970 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73b1b28640 10 monclient(hunting): authenticate will time out at 779.806425s 2024-08-19T11:12:01.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 0x7f73ac0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac139970 0x7f73ac139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 0x7f73ac0a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33200/0 (socket says 172.21.15.71:33200) 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3129350546 learned_addr learned my addr 172.21.15.71:0/3129350546 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): get_auth_request con 0x7f73ac0a3cb0 auth_method 0 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): get_auth_request con 0x7f73ac139970 auth_method 0 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f73ac0a5020 0x7f73ac0a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): get_auth_request con 0x7f73ac0a5020 auth_method 0 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_done global_id 4943 payload 274 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac139970 msgr2=0x7f73ac139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac139970 0x7f73ac139d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3129350546 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f73ac0a5020 msgr2=0x7f73ac0a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f73ac0a5020 0x7f73ac0a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 monclient: found mon.noname-b 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3129350546 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0a4da0 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.765+0000 7f73abfff640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac139970 0x7f73ac139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 msgr2=0x7f73ac0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73ab7fe640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 0x7f73ac0a4090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f739c0098d0 tx=0x7f739c02a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6798b1f5156d281 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 1 -- 172.21.15.71:0/3129350546 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f739c037070 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: dump: 2024-08-19T11:12:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.777 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 1 -- 172.21.15.71:0/3129350546 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c02adc0 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73b1b28640 5 monclient: authenticate success, global_id 4943 2024-08-19T11:12:01.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73b1b28640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73b1b28640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 1 -- 172.21.15.71:0/3129350546 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f739c030c20 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73b1b28640 4 set_mon_vals no callback set 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.768+0000 7f73aaffd640 10 monclient: dump: 2024-08-19T11:12:01.779 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 10 monclient: shutdown 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 -- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 msgr2=0x7f73ac0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 0x7f73ac0a4090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f739c0098d0 tx=0x7f739c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 -- 172.21.15.71:0/3129350546 shutdown_connections 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac139970 0x7f73ac139d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f73ac0a5020 0x7f73ac0a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3129350546 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73ac0a3cb0 0x7f73ac0a4090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 -- 172.21.15.71:0/3129350546 >> 172.21.15.71:0/3129350546 conn(0x7f73ac0a91d0 msgr2=0x7f73ac0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 -- 172.21.15.71:0/3129350546 shutdown_connections 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.769+0000 7f73b1b28640 1 -- 172.21.15.71:0/3129350546 wait complete. 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 10 monclient: monmap: 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:01.782 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 1 Processor -- start 2024-08-19T11:12:01.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 1 -- start start 2024-08-19T11:12:01.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 10 monclient: init 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 10 monclient: _add_conns ranks=[8,0,5,7,6,2,3,4,1] 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.770+0000 7f73b1b28640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 0x7f73ac072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): picked mon.noname-e con 0x7f73ac0a3cb0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73ac0a5020 0x7f73ac138b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): picked mon.noname-a con 0x7f73ac0a5020 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:01.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f73ac139970 0x7f73ac139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): picked mon.noname-h con 0x7f73ac139970 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0a54f0 con 0x7f73ac0a5020 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f73ac06cb70 con 0x7f73ac139970 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f73ac13a2d0 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73b1b28640 10 monclient(hunting): authenticate will time out at 779.812068s 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 0x7f73ac072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 0x7f73ac072f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51190/0 (socket says 172.21.15.71:51190) 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3182244339 learned_addr learned my addr 172.21.15.71:0/3182244339 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): get_auth_request con 0x7f73ac0a3cb0 auth_method 0 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73ac0a5020 0x7f73ac138b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): get_auth_request con 0x7f73ac0a5020 auth_method 0 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73abfff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f73ac139970 0x7f73ac139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient(hunting): handle_auth_done global_id 4796 payload 824 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f73ac139970 msgr2=0x7f73ac139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f73ac139970 0x7f73ac139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73ac0a5020 msgr2=0x7f73ac138b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73ac0a5020 0x7f73ac138b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 monclient: found mon.noname-e 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac1ce7c0 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73abfff640 10 monclient: get_auth_request con 0x7f73ac139970 auth_method 0 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.771+0000 7f73abfff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f73ac139970 0x7f73ac139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73ab7fe640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 msgr2=0x7f73ac072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73ab7fe640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 0x7f73ac072f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f739c0098d0 tx=0x7f739c0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f739c037040 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: dump: 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.795 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.796 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 5 monclient: authenticate success, global_id 4796 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c042070 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 10 monclient: _renew_subs 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0a8500 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f739c0044b0 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73aa7fc640 4 set_mon_vals no callback set 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73a8ff9640 10 monclient: dump: 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.798 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.799 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 10 monclient: _renew_subs 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.773+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac073910 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73b1b28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 0x7f73ac123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f73ac06a590 con 0x7f73ac123810 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 0x7f73ac123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f739c003c50 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient: get_auth_request con 0x7f73ac123810 auth_method 0 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.774+0000 7f73a8ff9640 1 --2- 172.21.15.71:0/3182244339 >> v2:172.21.15.135:6800/726754104 conn(0x7f738c03ea80 0x7f738c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.775+0000 7f73a3fff640 10 monclient(hunting): handle_auth_done global_id 24279 payload 824 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.775+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(56..56 src has 1..56) ==== 3898+0+0 (secure 0 0 0) 0x7f739c071f60 con 0x7f73ac0a3cb0 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.775+0000 7f73a3fff640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73ac126090 con 0x7f73ac123810 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.775+0000 7f73abfff640 1 --2- 172.21.15.71:0/3182244339 >> v2:172.21.15.135:6800/726754104 conn(0x7f738c03ea80 0x7f738c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.775+0000 7f73abfff640 10 monclient: get_auth_request con 0x7f738c03ea80 auth_method 0 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a3fff640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 msgr2=0x7f73ac123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a3fff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 0x7f73ac123bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06cf80 tx=0x7f7394011d40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f73940044a0 con 0x7f73ac123810 2024-08-19T11:12:01.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 10 monclient: dump: 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.802 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f739400fe50 con 0x7f73ac123810 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 msgr2=0x7f73ac123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 0x7f73ac123bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06cf80 tx=0x7f7394011d40 comp rx=0 tx=0).stop 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 msgr2=0x7f73ac123bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73a8ff9640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac123810 0x7f73ac123bf0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06cf80 tx=0x7f7394011d40 comp rx=0 tx=0).stop 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.777+0000 7f73abfff640 1 --2- 172.21.15.71:0/3182244339 >> v2:172.21.15.135:6800/726754104 conn(0x7f738c03ea80 0x7f738c040f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06d0f0 tx=0x7f73a400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73b1b28640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 0x7f73ac09d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73b1b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f73ac076c60 con 0x7f73ac124130 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 0x7f73ac09d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient: get_auth_request con 0x7f73ac124130 auth_method 0 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.783+0000 7f73a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.784+0000 7f73a3fff640 10 monclient(hunting): handle_auth_done global_id 24288 payload 824 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.784+0000 7f73a3fff640 1 -- 172.21.15.71:0/3182244339 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f73ac13a660 con 0x7f73ac124130 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a3fff640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 msgr2=0x7f73ac09d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a3fff640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 0x7f73ac09d140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f739401b000 tx=0x7f73940046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f73940148b0 con 0x7f73ac124130 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 10 monclient: dump: 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:01.805 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f73940273f0 con 0x7f73ac124130 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 msgr2=0x7f73ac09d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 0x7f73ac09d140 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f739401b000 tx=0x7f73940046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 msgr2=0x7f73ac09d140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.786+0000 7f73a8ff9640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f73ac124130 0x7f73ac09d140 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f739401b000 tx=0x7f73940046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:01.807 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 29400, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:01.808 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.809 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.810 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:01.811 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:01.812 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.813 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:01.814 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:01.819 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.820 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.823 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:01.824 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.825 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:01.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:01.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:01.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.831 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:01.832 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:01.833 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 >> v2:172.21.15.135:6800/726754104 conn(0x7f738c03ea80 msgr2=0x7f738c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3182244339 >> v2:172.21.15.135:6800/726754104 conn(0x7f738c03ea80 0x7f738c040f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06d0f0 tx=0x7f73a400b040 comp rx=0 tx=0).stop 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 10 monclient: shutdown 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 msgr2=0x7f73ac072f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 --2- 172.21.15.71:0/3182244339 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f73ac0a3cb0 0x7f73ac072f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f739c0098d0 tx=0x7f739c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73abfff640 1 -- 172.21.15.71:0/3182244339 reap_dead start 2024-08-19T11:12:01.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73abfff640 1 -- 172.21.15.71:0/3182244339 reap_dead start 2024-08-19T11:12:01.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 shutdown_connections 2024-08-19T11:12:01.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 >> 172.21.15.71:0/3182244339 conn(0x7f73ac0a91d0 msgr2=0x7f73ac0a5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:01.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 shutdown_connections 2024-08-19T11:12:01.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.787+0000 7f73b1b28640 1 -- 172.21.15.71:0/3182244339 wait complete. 2024-08-19T11:12:01.835 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:01.835 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:12:01.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.932+0000 7f043cd41640 10 monclient: get_monmap_and_config 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.932+0000 7f043cd41640 10 monclient: build_initial_monmap 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.932+0000 7f043cd41640 10 monclient: monmap: 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:01.933575+0000 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:01.933575+0000 2024-08-19T11:12:01.934 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:01.935 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:01.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.933+0000 7f043cd41640 1 Processor -- start 2024-08-19T11:12:01.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.933+0000 7f043cd41640 1 -- start start 2024-08-19T11:12:01.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.933+0000 7f043cd41640 10 monclient: init 2024-08-19T11:12:01.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:01.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient: _add_conns ranks=[2,5,6,8,1,4,7,3,0,10,9] 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): picked mon.noname-b con 0x7f04380a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04380a57c0 0x7f04380a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): picked mon.noname-h con 0x7f04380a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0438139710 0x7f0438139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): picked mon.noname-d con 0x7f0438139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04380a5020 con 0x7f04380a6950 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f04380a77b0 con 0x7f04380a57c0 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f04380a7d40 con 0x7f0438139710 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:01.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043cd41640 10 monclient(hunting): authenticate will time out at 779.975314s 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0438139710 0x7f0438139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33202/0 (socket says 172.21.15.71:33202) 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 -- 172.21.15.71:0/603480749 learned_addr learned my addr 172.21.15.71:0/603480749 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): get_auth_request con 0x7f04380a6950 auth_method 0 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): get_auth_request con 0x7f0438139710 auth_method 0 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0435d9b640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04380a57c0 0x7f04380a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0435d9b640 10 monclient(hunting): get_auth_request con 0x7f04380a57c0 auth_method 0 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0435d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0435d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0435d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient(hunting): handle_auth_done global_id 4952 payload 274 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0438139710 msgr2=0x7f0438139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0438139710 0x7f0438139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04380a57c0 msgr2=0x7f04380a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04380a57c0 0x7f04380a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient: _finish_hunting 0 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 monclient: found mon.noname-b 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f043659c640 1 -- 172.21.15.71:0/603480749 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04380a6380 con 0x7f04380a6950 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0436d9d640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0438139710 0x7f0438139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.934+0000 7f0435d9b640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04380a57c0 0x7f04380a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.935+0000 7f043659c640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 msgr2=0x7f04380a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.935+0000 7f043659c640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 msgr2=0x7f04380a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.935+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7f0428009eb0 tx=0x7f042802a560 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:01.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:01.935+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:02.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient: get_auth_request con 0x7f04380a6950 auth_method 0 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 0 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient: ms_handle_reset current mon [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 msgr2=0x7f04380a6d30 unknown :-1 s=STATE_CLOSED l=0).mark_down 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04380a6950 0x7f04380a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient: _add_conns ranks=[3,0,8,4,9,1,10,7] 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0420003630 0x7f0420005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): picked mon.noname-g con 0x7f0420003630 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0420006340 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 0x7f042000c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): picked mon.noname-e con 0x7f042000a2e0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042000d120 con 0x7f0420006340 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f042000e390 con 0x7f0420003630 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f042000e560 con 0x7f042000a2e0 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043559a640 10 monclient(hunting): ms_handle_reset stray mon [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 0x7f042000c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): get_auth_request con 0x7f042000a2e0 auth_method 0 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0420003630 0x7f0420005a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): get_auth_request con 0x7f0420003630 auth_method 0 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient(hunting): handle_auth_done global_id 4952 payload 293 2024-08-19T11:12:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0420003630 msgr2=0x7f0420005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0420003630 0x7f0420005a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 -- 172.21.15.71:0/603480749 >> v1:172.21.15.71:6789/0 conn(0x7f0420006340 legacy=0x7f04200087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 monclient: found mon.noname-e 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 -- 172.21.15.71:0/603480749 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042000e820 con 0x7f042000a2e0 2024-08-19T11:12:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.136+0000 7f0436d9d640 1 -- 172.21.15.71:0/603480749 reap_dead start 2024-08-19T11:12:02.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f0436d9d640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 msgr2=0x7f042000c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f0436d9d640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 0x7f042000c7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0430009c60 tx=0x7f0428009810 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f93fc701af495e62 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0430009860 con 0x7f042000a2e0 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: dump: 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.150 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.153 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.153 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.153 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043000ee50 con 0x7f042000a2e0 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043cd41640 5 monclient: authenticate success, global_id 4952 2024-08-19T11:12:02.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043cd41640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043cd41640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 1 -- 172.21.15.71:0/603480749 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0430013d50 con 0x7f042000a2e0 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043cd41640 4 set_mon_vals no callback set 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.138+0000 7f043559a640 10 monclient: dump: 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.155 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 10 monclient: shutdown 2024-08-19T11:12:02.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 -- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 msgr2=0x7f042000c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 0x7f042000c7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0430009c60 tx=0x7f0428009810 comp rx=0 tx=0).stop 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 -- 172.21.15.71:0/603480749 shutdown_connections 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 --2- 172.21.15.71:0/603480749 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f042000a2e0 0x7f042000c7a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 -- 172.21.15.71:0/603480749 >> 172.21.15.71:0/603480749 conn(0x7f04380abf50 msgr2=0x7f04380ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 -- 172.21.15.71:0/603480749 shutdown_connections 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.139+0000 7f043cd41640 1 -- 172.21.15.71:0/603480749 wait complete. 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.140+0000 7f043cd41640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.140+0000 7f043cd41640 10 monclient: monmap: 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:02.157 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.158 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.140+0000 7f043cd41640 1 Processor -- start 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.140+0000 7f043cd41640 1 -- start start 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.140+0000 7f043cd41640 10 monclient: init 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient: _add_conns ranks=[2,8,4,6,7,1,0,5,3] 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 0x7f04381ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): picked mon.noname-b con 0x7f042000a2e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438124d80 0x7f0438138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): picked mon.noname-e con 0x7f0438124d80 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0438139100 0x7f0438122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): picked mon.noname-c con 0x7f0438139100 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04380a84c0 con 0x7f042000a2e0 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f04380a3650 con 0x7f0438139100 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f04380a8700 con 0x7f0438124d80 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043cd41640 10 monclient(hunting): authenticate will time out at 780.182275s 2024-08-19T11:12:02.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 0x7f04381ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438124d80 0x7f0438138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 0x7f04381ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33226/0 (socket says 172.21.15.71:33226) 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 -- 172.21.15.71:0/2165991447 learned_addr learned my addr 172.21.15.71:0/2165991447 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438124d80 0x7f0438138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51220/0 (socket says 172.21.15.71:51220) 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): get_auth_request con 0x7f042000a2e0 auth_method 0 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0438139100 0x7f0438122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): get_auth_request con 0x7f0438139100 auth_method 0 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): get_auth_request con 0x7f0438124d80 auth_method 0 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient(hunting): handle_auth_done global_id 4961 payload 824 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438124d80 msgr2=0x7f0438138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438124d80 0x7f0438138bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0438139100 msgr2=0x7f0438122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0438139100 0x7f0438122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 monclient: found mon.noname-b 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f043659c640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04381254f0 con 0x7f042000a2e0 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.141+0000 7f0436d9d640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0438139100 0x7f0438122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.143+0000 7f043659c640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 msgr2=0x7f04381ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.143+0000 7f043659c640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 0x7f04381ce550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0428033620 tx=0x7f0428033650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0428003e00 con 0x7f042000a2e0 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: dump: 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428033c90 con 0x7f042000a2e0 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 5 monclient: authenticate success, global_id 4961 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 10 monclient: _renew_subs 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0438126580 con 0x7f042000a2e0 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0428033e40 con 0x7f042000a2e0 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0426ffd640 10 monclient: dump: 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.166 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.167 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f0434d99640 4 set_mon_vals no callback set 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 10 monclient: _renew_subs 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.144+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0438122d60 con 0x7f042000a2e0 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f043cd41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f043cd41640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 0x7f043809da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f043806a590 con 0x7f0438122f60 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 0x7f043809da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient: get_auth_request con 0x7f0438122f60 auth_method 0 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0428003990 con 0x7f042000a2e0 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 10 monclient(hunting): handle_auth_done global_id 4814 payload 824 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0435d9b640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f043813a480 con 0x7f0438122f60 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0426ffd640 1 --2- 172.21.15.71:0/2165991447 >> v2:172.21.15.135:6800/726754104 conn(0x7f041803e9b0 0x7f0418040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(56..56 src has 1..56) ==== 3898+0+0 (secure 0 0 0) 0x7f04280729b0 con 0x7f042000a2e0 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0436d9d640 1 --2- 172.21.15.71:0/2165991447 >> v2:172.21.15.135:6800/726754104 conn(0x7f041803e9b0 0x7f0418040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.145+0000 7f0436d9d640 10 monclient: get_auth_request con 0x7f041803e9b0 auth_method 0 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.147+0000 7f0435d9b640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 msgr2=0x7f043809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.147+0000 7f0435d9b640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 0x7f043809da00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f042c009fd0 tx=0x7f042c011920 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.147+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f042c019020 con 0x7f0438122f60 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.147+0000 7f0426ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.147+0000 7f0426ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.147+0000 7f0426ffd640 10 monclient: dump: 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f042c003610 con 0x7f0438122f60 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 msgr2=0x7f043809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 0x7f043809da00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f042c009fd0 tx=0x7f042c011920 comp rx=0 tx=0).stop 2024-08-19T11:12:02.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 msgr2=0x7f043809da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0426ffd640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438122f60 0x7f043809da00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.148+0000 7f0436d9d640 1 --2- 172.21.15.71:0/2165991447 >> v2:172.21.15.135:6800/726754104 conn(0x7f041803e9b0 0x7f0418040e70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f042000e730 tx=0x7f043001e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f043cd41640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f043cd41640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 0x7f043809df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f043cd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f04380a20f0 con 0x7f0438123340 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 0x7f043809df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient: get_auth_request con 0x7f0438123340 auth_method 0 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 10 monclient(hunting): handle_auth_done global_id 4823 payload 824 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.154+0000 7f0435d9b640 1 -- 172.21.15.71:0/2165991447 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f04381cea90 con 0x7f0438123340 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.156+0000 7f0435d9b640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 msgr2=0x7f043809df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.156+0000 7f0435d9b640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 0x7f043809df40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f042c01a000 tx=0x7f042c0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.156+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f042c019040 con 0x7f0438123340 2024-08-19T11:12:02.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.156+0000 7f0426ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.156+0000 7f0426ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.156+0000 7f0426ffd640 10 monclient: dump: 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f042c003e30 con 0x7f0438123340 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 msgr2=0x7f043809df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 0x7f043809df40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f042c01a000 tx=0x7f042c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 msgr2=0x7f043809df40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0426ffd640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0438123340 0x7f043809df40 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f042c01a000 tx=0x7f042c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 119026, 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:02.204 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:02.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 >> v2:172.21.15.135:6800/726754104 conn(0x7f041803e9b0 msgr2=0x7f0418040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 --2- 172.21.15.71:0/2165991447 >> v2:172.21.15.135:6800/726754104 conn(0x7f041803e9b0 0x7f0418040e70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f042000e730 tx=0x7f043001e040 comp rx=0 tx=0).stop 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 10 monclient: shutdown 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 msgr2=0x7f04381ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 --2- 172.21.15.71:0/2165991447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f042000a2e0 0x7f04381ce550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0428033620 tx=0x7f0428033650 comp rx=0 tx=0).stop 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0436d9d640 1 -- 172.21.15.71:0/2165991447 reap_dead start 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f0436d9d640 1 -- 172.21.15.71:0/2165991447 reap_dead start 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 shutdown_connections 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 >> 172.21.15.71:0/2165991447 conn(0x7f04380abf50 msgr2=0x7f04381c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 shutdown_connections 2024-08-19T11:12:02.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.157+0000 7f043cd41640 1 -- 172.21.15.71:0/2165991447 wait complete. 2024-08-19T11:12:02.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:02.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:12:02.207 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:12:02.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.305+0000 7fbcc59a3640 10 monclient: get_monmap_and_config 2024-08-19T11:12:02.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.305+0000 7fbcc59a3640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.305+0000 7fbcc59a3640 10 monclient: monmap: 2024-08-19T11:12:02.306 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.306 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.306 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:02.305701+0000 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:02.305701+0000 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.307 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.308 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:02.308 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:02.308 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.305+0000 7fbcc59a3640 1 Processor -- start 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.305+0000 7fbcc59a3640 1 -- start start 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.305+0000 7fbcc59a3640 10 monclient: init 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient: _add_conns ranks=[5,4,8,1,10,0,6,7,3,2,9] 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc00a02b0 0x7fbcc00a0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): picked mon.noname-h con 0x7fbcc00a02b0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 0x7fbcc00a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): picked mon.noname-c con 0x7fbcc00a4da0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 0x7fbcc0136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): picked mon.noname-e con 0x7fbcc009fbb0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbcc00a1110 con 0x7fbcc00a4da0 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbcc00a25e0 con 0x7fbcc00a02b0 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbcc00a1d40 con 0x7fbcc009fbb0 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcc59a3640 10 monclient(hunting): authenticate will time out at 780.347232s 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 0x7fbcc0136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 0x7fbcc00a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 0x7fbcc0136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51256/0 (socket says 172.21.15.71:51256) 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 0x7fbcc00a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:48608/0 (socket says 172.21.15.71:48608) 2024-08-19T11:12:02.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 1 -- 172.21.15.71:0/4292926734 learned_addr learned my addr 172.21.15.71:0/4292926734 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): get_auth_request con 0x7fbcc009fbb0 auth_method 0 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): get_auth_request con 0x7fbcc00a4da0 auth_method 0 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbeffd640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc00a02b0 0x7fbcc00a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbeffd640 10 monclient(hunting): get_auth_request con 0x7fbcc00a02b0 auth_method 0 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_done global_id 4801 payload 274 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 msgr2=0x7fbcc0136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 0x7fbcc0136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4292926734 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc00a02b0 msgr2=0x7fbcc00a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc00a02b0 0x7fbcc00a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 monclient: found mon.noname-c 2024-08-19T11:12:02.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4292926734 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc00a2ae0 con 0x7fbcc00a4da0 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbeffd640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc00a02b0 0x7fbcc00a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.306+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 0x7fbcc0136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 msgr2=0x7fbcc00a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 0x7fbcc00a0bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbca80097d0 tx=0x7fbca8029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=e315c919ca37e8f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 1 -- 172.21.15.71:0/4292926734 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbca8037070 con 0x7fbcc00a4da0 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: dump: 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.319 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.320 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcc59a3640 5 monclient: authenticate success, global_id 4801 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcc59a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 1 -- 172.21.15.71:0/4292926734 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca802ad10 con 0x7fbcc00a4da0 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcc59a3640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcc59a3640 4 set_mon_vals no callback set 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 1 -- 172.21.15.71:0/4292926734 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbca8030c20 con 0x7fbcc00a4da0 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.309+0000 7fbcbdffb640 10 monclient: dump: 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.323 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.323 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.323 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.324 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.324 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.324 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.324 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.325 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 10 monclient: shutdown 2024-08-19T11:12:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 msgr2=0x7fbcc00a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 0x7fbcc00a0bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbca80097d0 tx=0x7fbca8029fb0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4292926734 shutdown_connections 2024-08-19T11:12:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbcc009fbb0 0x7fbcc0136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbcc00a4da0 0x7fbcc00a0bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4292926734 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc00a02b0 0x7fbcc00a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4292926734 >> 172.21.15.71:0/4292926734 conn(0x7fbcc00a58b0 msgr2=0x7fbcc00a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4292926734 shutdown_connections 2024-08-19T11:12:02.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4292926734 wait complete. 2024-08-19T11:12:02.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.310+0000 7fbcc59a3640 10 monclient: monmap: 2024-08-19T11:12:02.327 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.327 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:02.328 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:02.328 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:02.328 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.328 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.328 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:02.328 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.329 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 1 Processor -- start 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 1 -- start start 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 10 monclient: init 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 10 monclient: _add_conns ranks=[2,6,5,0,1,8,7,3,4] 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcc009fbb0 0x7fbcc009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.311+0000 7fbcc59a3640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc009fbb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:02.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 0x7fbcc009cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): picked mon.noname-d con 0x7fbcc00a02b0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:02.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc009d470 0x7fbcc01ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): picked mon.noname-h con 0x7fbcc009d470 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:02.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcc009fbb0 0x7fbcc009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc0136c30 con 0x7fbcc009fbb0 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcc009fbb0 0x7fbcc009c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33230/0 (socket says 172.21.15.71:33230) 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbcc0136ab0 con 0x7fbcc009d470 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 1 -- 172.21.15.71:0/4206703846 learned_addr learned my addr 172.21.15.71:0/4206703846 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:02.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbcc0136db0 con 0x7fbcc00a02b0 2024-08-19T11:12:02.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcc59a3640 10 monclient(hunting): authenticate will time out at 780.353301s 2024-08-19T11:12:02.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 0x7fbcc009cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): get_auth_request con 0x7fbcc009fbb0 auth_method 0 2024-08-19T11:12:02.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): get_auth_request con 0x7fbcc00a02b0 auth_method 0 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc009d470 0x7fbcc01ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbf7fe640 10 monclient(hunting): get_auth_request con 0x7fbcc009d470 auth_method 0 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient(hunting): handle_auth_done global_id 24306 payload 824 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc009d470 msgr2=0x7fbcc01ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc009d470 0x7fbcc01ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcc009fbb0 msgr2=0x7fbcc009c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcc009fbb0 0x7fbcc009c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 monclient: found mon.noname-d 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc00a6f40 con 0x7fbcc00a02b0 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbeffd640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbcc009fbb0 0x7fbcc009c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.312+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbcc009d470 0x7fbcc01ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.315+0000 7fbcbe7fc640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 msgr2=0x7fbcc009cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.315+0000 7fbcbe7fc640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 0x7fbcc009cf30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbca8031000 tx=0x7fbca80046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbca8037040 con 0x7fbcc00a02b0 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: dump: 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.345 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.346 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca8042070 con 0x7fbcc00a02b0 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcc59a3640 5 monclient: authenticate success, global_id 24306 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcc59a3640 10 monclient: _renew_subs 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcc59a3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc009f170 con 0x7fbcc00a02b0 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbca803dd20 con 0x7fbcc00a02b0 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.318+0000 7fbcb7fff640 10 monclient: dump: 2024-08-19T11:12:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.348 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.349 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.319+0000 7fbcc59a3640 10 monclient: _renew_subs 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.319+0000 7fbcc59a3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.319+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc011f8c0 con 0x7fbcc00a02b0 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.320+0000 7fbcbd7fa640 4 set_mon_vals no callback set 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.320+0000 7fbcc59a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.321+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbca8003c90 con 0x7fbcc00a02b0 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.322+0000 7fbcb7fff640 1 --2- 172.21.15.71:0/4206703846 >> v2:172.21.15.135:6800/726754104 conn(0x7fbca003ea80 0x7fbca0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.322+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7fbca8071fc0 con 0x7fbcc00a02b0 2024-08-19T11:12:02.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.322+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 0x7fbca4004d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.322+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.322+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4007cb0 con 0x7fbca4002880 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbeffd640 1 --2- 172.21.15.71:0/4206703846 >> v2:172.21.15.135:6800/726754104 conn(0x7fbca003ea80 0x7fbca0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbeffd640 10 monclient: get_auth_request con 0x7fbca003ea80 auth_method 0 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 0x7fbca4004d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient: get_auth_request con 0x7fbca4002880 auth_method 0 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.323+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.324+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_done global_id 4654 payload 824 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.324+0000 7fbcbf7fe640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca4007eb0 con 0x7fbca4002880 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.326+0000 7fbcbeffd640 1 --2- 172.21.15.71:0/4206703846 >> v2:172.21.15.135:6800/726754104 conn(0x7fbca003ea80 0x7fbca0040f40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009fd0 tx=0x7fbcb80099d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.326+0000 7fbcbf7fe640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 msgr2=0x7fbca4004d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.326+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 0x7fbca4004d20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcc006f600 tx=0x7fbcb000e730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcb001f070 con 0x7fbca4002880 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 10 monclient: dump: 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.353 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbcb000f7f0 con 0x7fbca4002880 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:02.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 msgr2=0x7fbca4004d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 0x7fbca4004d20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcc006f600 tx=0x7fbcb000e730 comp rx=0 tx=0).stop 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 msgr2=0x7fbca4004d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.327+0000 7fbcb7fff640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4002880 0x7fbca4004d20 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcc006f600 tx=0x7fbcb000e730 comp rx=0 tx=0).stop 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcc59a3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 0x7fbca40071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcc59a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbca400a1d0 con 0x7fbca4006d20 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 0x7fbca40071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient: get_auth_request con 0x7fbca4006d20 auth_method 0 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.336+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.337+0000 7fbcbf7fe640 10 monclient(hunting): handle_auth_done global_id 4663 payload 824 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.337+0000 7fbcbf7fe640 1 -- 172.21.15.71:0/4206703846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbca40076f0 con 0x7fbca4006d20 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcbf7fe640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 msgr2=0x7fbca40071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcbf7fe640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 0x7fbca40071b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbcc006f600 tx=0x7fbcb00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbcb001f030 con 0x7fbca4006d20 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:02.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 10 monclient: dump: 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.357 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fbcb00226b0 con 0x7fbca4006d20 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 msgr2=0x7fbca40071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 0x7fbca40071b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbcc006f600 tx=0x7fbcb00046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 msgr2=0x7fbca40071b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.339+0000 7fbcb7fff640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbca4006d20 0x7fbca40071b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 119179, 2024-08-19T11:12:02.363 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:02.364 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.365 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.366 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.367 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:02.369 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:02.370 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.372 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:02.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:02.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:02.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:02.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:02.382 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:02.386 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.390 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.393 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:02.394 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 >> v2:172.21.15.135:6800/726754104 conn(0x7fbca003ea80 msgr2=0x7fbca0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4206703846 >> v2:172.21.15.135:6800/726754104 conn(0x7fbca003ea80 0x7fbca0040f40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009fd0 tx=0x7fbcb80099d0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 10 monclient: shutdown 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 msgr2=0x7fbcc009cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcbf7fe640 1 -- 172.21.15.71:0/4206703846 reap_dead start 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 0x7fbcc009cf30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbca8031000 tx=0x7fbca80046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 shutdown_connections 2024-08-19T11:12:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 --2- 172.21.15.71:0/4206703846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbcc00a02b0 0x7fbcc009cf30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 >> 172.21.15.71:0/4206703846 conn(0x7fbcc00a58b0 msgr2=0x7fbcc0135e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 shutdown_connections 2024-08-19T11:12:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.340+0000 7fbcc59a3640 1 -- 172.21.15.71:0/4206703846 wait complete. 2024-08-19T11:12:02.397 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:02.397 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:12:02.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:12:02.435 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: starting. 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24517 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: created object 0... 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: created object 25... 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: created object 49... 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: finishing. 2024-08-19T11:12:02.436 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24552]: shutting down. 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24554]: starting. 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24554]: listing objects. 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24554]: listed object 0... 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24554]: listed object 25... 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24554]: saw 50 objects 2024-08-19T11:12:02.473 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24554]: shutting down. 2024-08-19T11:12:02.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.497+0000 7f0878be2640 10 monclient: get_monmap_and_config 2024-08-19T11:12:02.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.497+0000 7f0878be2640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.497+0000 7f0878be2640 10 monclient: monmap: 2024-08-19T11:12:02.499 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.502 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.502 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:02.498352+0000 2024-08-19T11:12:02.502 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:02.498352+0000 2024-08-19T11:12:02.502 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.502 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.502 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.503 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:02.504 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:02.504 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.498+0000 7f0878be2640 1 Processor -- start 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.498+0000 7f0878be2640 1 -- start start 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.498+0000 7f0878be2640 10 monclient: init 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.498+0000 7f0878be2640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.498+0000 7f0878be2640 10 monclient: _add_conns ranks=[0,10,3,9,4,7,8,6,5,1,2] 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f08740a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f08740a57c0 0x7f087413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): picked mon.noname-f con 0x7f08740a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:02.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08740a7440 0x7f08741410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): picked mon.noname-g con 0x7f08740a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08740a6380 con 0x7f08740a6950 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f08740a5020 con 0x7f08740a57c0 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08740a7d40 con 0x7f08740a7440 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0878be2640 10 monclient(hunting): authenticate will time out at 780.540143s 2024-08-19T11:12:02.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f087259c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f08740a6950 0x7f08740a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48312/0 (socket says 172.21.15.71:48312) 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f087259c640 1 -- 172.21.15.71:0/76575542 learned_addr learned my addr 172.21.15.71:0/76575542 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 1 --2- 172.21.15.71:0/76575542 >> v2:172.21.15.135:3300/0 conn(0x7f08740a57c0 0x7f087413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08740a7440 0x7f08741410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): get_auth_request con 0x7f08740a57c0 auth_method 0 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): get_auth_request con 0x7f08740a7440 auth_method 0 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient(hunting): handle_auth_done global_id 4672 payload 274 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 1 -- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08740a7440 msgr2=0x7f08741410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08740a7440 0x7f08741410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 1 -- 172.21.15.71:0/76575542 >> v1:172.21.15.71:6789/0 conn(0x7f08740a6950 legacy=0x7f08740a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 1 monclient: found mon.noname-f 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:12:02.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f086bfff640 1 -- 172.21.15.71:0/76575542 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08740a3650 con 0x7f08740a57c0 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.499+0000 7f0872d9d640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08740a7440 0x7f08741410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f086bfff640 1 -- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08740a57c0 msgr2=0x7f087413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f086bfff640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08740a57c0 0x7f087413eb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f085c0097d0 tx=0x7f085c02a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226e937b096f392c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 1 -- 172.21.15.71:0/76575542 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f085c037070 con 0x7f08740a57c0 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: dump: 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.518 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.519 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0878be2640 5 monclient: authenticate success, global_id 4672 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0878be2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 1 -- 172.21.15.71:0/76575542 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c02ad20 con 0x7f08740a57c0 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0878be2640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0878be2640 4 set_mon_vals no callback set 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 1 -- 172.21.15.71:0/76575542 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f085c0307b0 con 0x7f08740a57c0 2024-08-19T11:12:02.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.502+0000 7f0871d9b640 10 monclient: dump: 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.521 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 10 monclient: shutdown 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 -- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08740a57c0 msgr2=0x7f087413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08740a57c0 0x7f087413eb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f085c0097d0 tx=0x7f085c02a000 comp rx=0 tx=0).stop 2024-08-19T11:12:02.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 -- 172.21.15.71:0/76575542 shutdown_connections 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08740a7440 0x7f08741410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 --2- 172.21.15.71:0/76575542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08740a57c0 0x7f087413eb60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 -- 172.21.15.71:0/76575542 >> 172.21.15.71:0/76575542 conn(0x7f08740abf50 msgr2=0x7f08740ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 -- 172.21.15.71:0/76575542 shutdown_connections 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.503+0000 7f0878be2640 1 -- 172.21.15.71:0/76575542 wait complete. 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 10 monclient: monmap: 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:02.523 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 1 Processor -- start 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 1 -- start start 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 10 monclient: init 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.504+0000 7f0878be2640 10 monclient: _add_conns ranks=[8,2,5,0,6,3,7,4,1] 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08740a57c0 0x7f08741ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): picked mon.noname-e con 0x7f08740a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 0x7f08741ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): picked mon.noname-b con 0x7f08740a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08740a7440 0x7f08741cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): picked mon.noname-h con 0x7f08740a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f08740a8700 con 0x7f08740a6950 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f08740a84c0 con 0x7f08740a7440 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f08741415f0 con 0x7f08740a57c0 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0878be2640 10 monclient(hunting): authenticate will time out at 780.546089s 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08740a57c0 0x7f08741ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 0x7f08741ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08740a57c0 0x7f08741ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51266/0 (socket says 172.21.15.71:51266) 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 1 -- 172.21.15.71:0/2807067549 learned_addr learned my addr 172.21.15.71:0/2807067549 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:02.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): get_auth_request con 0x7f08740a57c0 auth_method 0 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): get_auth_request con 0x7f08740a6950 auth_method 0 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08740a7440 0x7f08741cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): get_auth_request con 0x7f08740a7440 auth_method 0 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f0872d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient(hunting): handle_auth_done global_id 4979 payload 824 2024-08-19T11:12:02.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08740a57c0 msgr2=0x7f08741ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08740a57c0 0x7f08741ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08740a7440 msgr2=0x7f08741cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f08740a7440 0x7f08741cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 monclient: found mon.noname-b 2024-08-19T11:12:02.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f086bfff640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0874129360 con 0x7f08740a6950 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.505+0000 7f087259c640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f08740a57c0 0x7f08741ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086bfff640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 msgr2=0x7f08741ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086bfff640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 0x7f08741ceb20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08740a2e70 tx=0x7f085c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f085c041020 con 0x7f08740a6950 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: dump: 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085c003c50 con 0x7f08740a6950 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f0878be2640 5 monclient: authenticate success, global_id 4979 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f085c037040 con 0x7f08740a6950 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f0878be2640 10 monclient: _renew_subs 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f0878be2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087412a1d0 con 0x7f08740a6950 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f086affd640 10 monclient: dump: 2024-08-19T11:12:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.533 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.507+0000 7f087159a640 4 set_mon_vals no callback set 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 10 monclient: _renew_subs 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08740a93a0 con 0x7f08740a6950 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f085c032440 con 0x7f08740a6950 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 0x7f08741267b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.508+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0874076c60 con 0x7f08741263d0 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f086affd640 1 --2- 172.21.15.71:0/2807067549 >> v2:172.21.15.135:6800/726754104 conn(0x7f085803ea80 0x7f0858040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7f085c071d10 con 0x7f08740a6950 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 0x7f08741267b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient: get_auth_request con 0x7f08741263d0 auth_method 0 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f0872d9d640 1 --2- 172.21.15.71:0/2807067549 >> v2:172.21.15.135:6800/726754104 conn(0x7f085803ea80 0x7f0858040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f0872d9d640 10 monclient: get_auth_request con 0x7f085803ea80 auth_method 0 2024-08-19T11:12:02.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 10 monclient(hunting): handle_auth_done global_id 4809 payload 824 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.509+0000 7f087259c640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08740a6d30 con 0x7f08741263d0 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f087259c640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 msgr2=0x7f08741267b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f087259c640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 0x7f08741267b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f08640072e0 tx=0x7f08640077a0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f0872d9d640 1 --2- 172.21.15.71:0/2807067549 >> v2:172.21.15.135:6800/726754104 conn(0x7f085803ea80 0x7f0858040f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f086c009c10 tx=0x7f086c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f086400fd40 con 0x7f08741263d0 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f086affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f086affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.511+0000 7f086affd640 10 monclient: dump: 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.536 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f086400fd40 con 0x7f08741263d0 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:02.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 msgr2=0x7f08741267b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 0x7f08741267b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f08640072e0 tx=0x7f08640077a0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 msgr2=0x7f08741267b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.512+0000 7f086affd640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08741263d0 0x7f08741267b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f0878be2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f0878be2640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 0x7f08741225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f0878be2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0874127e70 con 0x7f0874126cf0 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 0x7f08741225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient: get_auth_request con 0x7f0874126cf0 auth_method 0 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 10 monclient(hunting): handle_auth_done global_id 4818 payload 824 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.518+0000 7f087259c640 1 -- 172.21.15.71:0/2807067549 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f087406ca70 con 0x7f0874126cf0 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f087259c640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 msgr2=0x7f08741225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f087259c640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 0x7f08741225a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08640072e0 tx=0x7f0864004940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08640133f0 con 0x7f0874126cf0 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 10 monclient: dump: 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7f0864006450 con 0x7f0874126cf0 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 msgr2=0x7f08741225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 0x7f08741225a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08640072e0 tx=0x7f0864004940 comp rx=0 tx=0).stop 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 msgr2=0x7f08741225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.521+0000 7f086affd640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0874126cf0 0x7f08741225a0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f08640072e0 tx=0x7f0864004940 comp rx=0 tx=0).stop 2024-08-19T11:12:02.543 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 119373, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:02.544 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.545 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.546 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:02.547 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:02.548 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:02.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:02.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:02.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.556 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.558 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.562 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:02.563 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:02.564 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.567 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.568 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:02.569 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 >> v2:172.21.15.135:6800/726754104 conn(0x7f085803ea80 msgr2=0x7f0858040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 --2- 172.21.15.71:0/2807067549 >> v2:172.21.15.135:6800/726754104 conn(0x7f085803ea80 0x7f0858040f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f086c009c10 tx=0x7f086c00b040 comp rx=0 tx=0).stop 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 10 monclient: shutdown 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 msgr2=0x7f08741ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 0x7f08741ceb20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08740a2e70 tx=0x7f085c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0872d9d640 1 -- 172.21.15.71:0/2807067549 reap_dead start 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 shutdown_connections 2024-08-19T11:12:02.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 --2- 172.21.15.71:0/2807067549 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08740a6950 0x7f08741ceb20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 >> 172.21.15.71:0/2807067549 conn(0x7f08740abf50 msgr2=0x7f087409f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 shutdown_connections 2024-08-19T11:12:02.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.522+0000 7f0878be2640 1 -- 172.21.15.71:0/2807067549 wait complete. 2024-08-19T11:12:02.572 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:02.572 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:12:02.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:12:02.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.670+0000 7f912b353640 10 monclient: get_monmap_and_config 2024-08-19T11:12:02.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.670+0000 7f912b353640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.670+0000 7f912b353640 10 monclient: monmap: 2024-08-19T11:12:02.671 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.671 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:02.670672+0000 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:02.670672+0000 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.672 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:02.673 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:02.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.670+0000 7f912b353640 1 Processor -- start 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.670+0000 7f912b353640 1 -- start start 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.670+0000 7f912b353640 10 monclient: init 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient: _add_conns ranks=[10,3,2,4,9,8,1,7,5,0,6] 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91240a6950 0x7f91240a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): picked mon.noname-f con 0x7f91240a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91240a57c0 0x7f91240a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): picked mon.noname-g con 0x7f91240a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 0x7f9124139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): picked mon.noname-b con 0x7f9124139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f91240a5020 con 0x7f91240a6950 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91240a77b0 con 0x7f9124139710 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91240a7d40 con 0x7f91240a57c0 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f912b353640 10 monclient(hunting): authenticate will time out at 780.712430s 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 0x7f9124139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 0x7f9124139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33244/0 (socket says 172.21.15.71:33244) 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 -- 172.21.15.71:0/3348625971 learned_addr learned my addr 172.21.15.71:0/3348625971 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): get_auth_request con 0x7f9124139710 auth_method 0 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 1 --2- 172.21.15.71:0/3348625971 >> v2:172.21.15.135:3300/0 conn(0x7f91240a6950 0x7f91240a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 1 --2- 172.21.15.71:0/3348625971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91240a57c0 0x7f91240a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): get_auth_request con 0x7f91240a6950 auth_method 0 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): get_auth_request con 0x7f91240a57c0 auth_method 0 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient(hunting): handle_auth_done global_id 4988 payload 274 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 -- 172.21.15.71:0/3348625971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91240a57c0 msgr2=0x7f91240a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 --2- 172.21.15.71:0/3348625971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91240a57c0 0x7f91240a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 -- 172.21.15.71:0/3348625971 >> v2:172.21.15.135:3300/0 conn(0x7f91240a6950 msgr2=0x7f91240a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 --2- 172.21.15.71:0/3348625971 >> v2:172.21.15.135:3300/0 conn(0x7f91240a6950 0x7f91240a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 monclient: found mon.noname-b 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91298f0640 1 -- 172.21.15.71:0/3348625971 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240a6380 con 0x7f9124139710 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.671+0000 7f91290ef640 1 --2- 172.21.15.71:0/3348625971 >> v2:172.21.15.135:3300/0 conn(0x7f91240a6950 0x7f91240a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.674+0000 7f91298f0640 1 -- 172.21.15.71:0/3348625971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 msgr2=0x7f9124139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.674+0000 7f91298f0640 1 --2- 172.21.15.71:0/3348625971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 0x7f9124139b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f911c009eb0 tx=0x7f911c02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10716a94ca80c46 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 1 -- 172.21.15.71:0/3348625971 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f911c036070 con 0x7f9124139710 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: dump: 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.682 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 1 -- 172.21.15.71:0/3348625971 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c007a70 con 0x7f9124139710 2024-08-19T11:12:02.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 5 monclient: authenticate success, global_id 4988 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 1 -- 172.21.15.71:0/3348625971 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f911c007c60 con 0x7f9124139710 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 4 set_mon_vals no callback set 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f911bfff640 10 monclient: dump: 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.684 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 10 monclient: shutdown 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 -- 172.21.15.71:0/3348625971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 msgr2=0x7f9124139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 --2- 172.21.15.71:0/3348625971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 0x7f9124139b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f911c009eb0 tx=0x7f911c02a5b0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 -- 172.21.15.71:0/3348625971 shutdown_connections 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 --2- 172.21.15.71:0/3348625971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9124139710 0x7f9124139b30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 --2- 172.21.15.71:0/3348625971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91240a57c0 0x7f91240a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 --2- 172.21.15.71:0/3348625971 >> v2:172.21.15.135:3300/0 conn(0x7f91240a6950 0x7f91240a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 -- 172.21.15.71:0/3348625971 >> 172.21.15.71:0/3348625971 conn(0x7f91240abf50 msgr2=0x7f91240ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 -- 172.21.15.71:0/3348625971 shutdown_connections 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.675+0000 7f912b353640 1 -- 172.21.15.71:0/3348625971 wait complete. 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.676+0000 7f912b353640 10 monclient: build_initial_monmap 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.676+0000 7f912b353640 10 monclient: monmap: 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:02.686 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:02.687 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.676+0000 7f912b353640 1 Processor -- start 2024-08-19T11:12:02.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.676+0000 7f912b353640 1 -- start start 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.676+0000 7f912b353640 10 monclient: init 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient: _add_conns ranks=[6,1,5,4,2,0,8,7,3] 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 0x7f91241ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): picked mon.noname-d con 0x7f91240a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91240a6950 0x7f91241388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): picked mon.noname-f con 0x7f91240a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124139710 0x7f9124138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): picked mon.noname-h con 0x7f9124139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91240a84c0 con 0x7f91240a6950 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f91240a3650 con 0x7f9124139710 2024-08-19T11:12:02.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f91240a8700 con 0x7f91240a57c0 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f912b353640 10 monclient(hunting): authenticate will time out at 780.718250s 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 0x7f91241ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 0x7f91241ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43976/0 (socket says 172.21.15.71:43976) 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 -- 172.21.15.71:0/2076492181 learned_addr learned my addr 172.21.15.71:0/2076492181 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): get_auth_request con 0x7f91240a57c0 auth_method 0 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124139710 0x7f9124138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91240a6950 0x7f91241388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): get_auth_request con 0x7f9124139710 auth_method 0 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): get_auth_request con 0x7f91240a6950 auth_method 0 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91298f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient(hunting): handle_auth_done global_id 24315 payload 824 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124139710 msgr2=0x7f9124138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124139710 0x7f9124138df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91240a6950 msgr2=0x7f91241388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91240a6950 0x7f91241388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient: _finish_hunting 0 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 monclient: found mon.noname-d 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.677+0000 7f91290ef640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240a1d10 con 0x7f91240a57c0 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f91290ef640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 msgr2=0x7f91241ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f91290ef640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 0x7f91241ce0f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f912000ec10 tx=0x7f912000c520 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9120017070 con 0x7f91240a57c0 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 10 monclient: dump: 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 10 monclient: _finish_auth 0 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.679+0000 7f9119ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 5 monclient: authenticate success, global_id 24315 2024-08-19T11:12:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912000ce40 con 0x7f91240a57c0 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 10 monclient: _renew_subs 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9124126270 con 0x7f91240a57c0 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9120013d50 con 0x7f91240a57c0 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 10 monclient: dump: 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 10 monclient: _renew_subs 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f911b7fe640 4 set_mon_vals no callback set 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9124123f10 con 0x7f91240a57c0 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f912001a070 con 0x7f91240a57c0 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 0x7f912402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.680+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f912406a590 con 0x7f9124122d60 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f9119ffb640 1 --2- 172.21.15.71:0/2076492181 >> v2:172.21.15.135:6800/726754104 conn(0x7f910803ea80 0x7f9108040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7f912000f040 con 0x7f91240a57c0 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 0x7f912402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient: get_auth_request con 0x7f9124122d60 auth_method 0 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91298f0640 1 --2- 172.21.15.71:0/2076492181 >> v2:172.21.15.135:6800/726754104 conn(0x7f910803ea80 0x7f9108040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91298f0640 10 monclient: get_auth_request con 0x7f910803ea80 auth_method 0 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 10 monclient(hunting): handle_auth_done global_id 14747 payload 824 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.681+0000 7f91288ee640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9124125bd0 con 0x7f9124122d60 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.683+0000 7f91288ee640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 msgr2=0x7f912402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.683+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 0x7f912402d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9124124580 tx=0x7f9114011d40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.683+0000 7f91298f0640 1 --2- 172.21.15.71:0/2076492181 >> v2:172.21.15.135:6800/726754104 conn(0x7f910803ea80 0x7f9108040f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f911c033000 tx=0x7f911c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9114019070 con 0x7f9124122d60 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 10 monclient: dump: 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.705 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f911400f860 con 0x7f9124122d60 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 msgr2=0x7f912402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 0x7f912402d1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9124124580 tx=0x7f9114011d40 comp rx=0 tx=0).stop 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 msgr2=0x7f912402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.684+0000 7f9119ffb640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124122d60 0x7f912402d1c0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9124124580 tx=0x7f9114011d40 comp rx=0 tx=0).stop 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f912b353640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:02.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f912b353640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f912b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9124076c60 con 0x7f9124123140 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 10 monclient: get_auth_request con 0x7f9124123140 auth_method 0 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 msgr2=0x7f912402d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 msgr2=0x7f912402d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:02.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.690+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient: get_auth_request con 0x7f9124123140 auth_method 0 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 10 monclient(hunting): handle_auth_done global_id 14765 payload 824 2024-08-19T11:12:02.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.891+0000 7f91288ee640 1 -- 172.21.15.71:0/2076492181 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f91240a6d30 con 0x7f9124123140 2024-08-19T11:12:02.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f91288ee640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 msgr2=0x7f912402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:02.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f91288ee640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f911401b000 tx=0x7f91140046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:02.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9114019040 con 0x7f9124123140 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 10 monclient: dump: 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f91140133a0 con 0x7f9124123140 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 msgr2=0x7f912402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f911401b000 tx=0x7f91140046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 msgr2=0x7f912402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.894+0000 7f9119ffb640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9124123140 0x7f912402d700 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f911401b000 tx=0x7f91140046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 119748, 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:02.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:02.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:02.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:02.922 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:02.922 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 >> v2:172.21.15.135:6800/726754104 conn(0x7f910803ea80 msgr2=0x7f9108040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 --2- 172.21.15.71:0/2076492181 >> v2:172.21.15.135:6800/726754104 conn(0x7f910803ea80 0x7f9108040f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f911c033000 tx=0x7f911c009000 comp rx=0 tx=0).stop 2024-08-19T11:12:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 10 monclient: shutdown 2024-08-19T11:12:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 msgr2=0x7f91241ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:02.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 --2- 172.21.15.71:0/2076492181 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f91240a57c0 0x7f91241ce0f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f912000ec10 tx=0x7f912000c520 comp rx=0 tx=0).stop 2024-08-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f91298f0640 1 -- 172.21.15.71:0/2076492181 reap_dead start 2024-08-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f91298f0640 1 -- 172.21.15.71:0/2076492181 reap_dead start 2024-08-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 shutdown_connections 2024-08-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 >> 172.21.15.71:0/2076492181 conn(0x7f91240abf50 msgr2=0x7f91240aa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 shutdown_connections 2024-08-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:02.895+0000 7f912b353640 1 -- 172.21.15.71:0/2076492181 wait complete. 2024-08-19T11:12:02.924 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:02.924 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:12:02.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.021+0000 7fd57b448640 10 monclient: get_monmap_and_config 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.021+0000 7fd57b448640 10 monclient: build_initial_monmap 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.021+0000 7fd57b448640 10 monclient: monmap: 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:03.022297+0000 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:03.022297+0000 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 Processor -- start 2024-08-19T11:12:03.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 -- start start 2024-08-19T11:12:03.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient: init 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient: _add_conns ranks=[6,7,1,0,4,10,8,3,2,9,5] 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 0x7fd5740a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): picked mon.noname-d con 0x7fd5740a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd5740a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): picked mon.noname-i con 0x7fd5740a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd574139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5740a6380 con 0x7fd574139710 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd5740a5020 con 0x7fd5740a6950 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd5740a77b0 con 0x7fd5740a57c0 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.022+0000 7fd57b448640 10 monclient(hunting): authenticate will time out at 781.063938s 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 0x7fd5740a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 0x7fd5740a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43982/0 (socket says 172.21.15.71:43982) 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 -- 172.21.15.71:0/2652546332 learned_addr learned my addr 172.21.15.71:0/2652546332 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): get_auth_request con 0x7fd5740a6950 auth_method 0 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5789e3640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd5740a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5789e3640 10 monclient(hunting): get_auth_request con 0x7fd5740a57c0 auth_method 0 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5789e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5789e3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5789e3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient(hunting): handle_auth_done global_id 24324 payload 274 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 -- 172.21.15.71:0/2652546332 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 msgr2=0x7fd5740a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd5740a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 -- 172.21.15.71:0/2652546332 >> v1:172.21.15.135:6789/0 conn(0x7fd574139710 legacy=0x7fd574139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient: _finish_hunting 0 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 monclient: found mon.noname-d 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5791e4640 1 -- 172.21.15.71:0/2652546332 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740a3650 con 0x7fd5740a6950 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.023+0000 7fd5789e3640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd5740a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd5791e4640 1 -- 172.21.15.71:0/2652546332 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 msgr2=0x7fd5740a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd5791e4640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 0x7fd5740a6d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5700098a0 tx=0x7fd57002a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=a3996046469c5b3c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 1 -- 172.21.15.71:0/2652546332 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd570037070 con 0x7fd5740a6950 2024-08-19T11:12:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: dump: 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: _finish_auth 0 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd57b448640 5 monclient: authenticate success, global_id 24324 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd57b448640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 1 -- 172.21.15.71:0/2652546332 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57002ade0 con 0x7fd5740a6950 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd57b448640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 1 -- 172.21.15.71:0/2652546332 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd570030c20 con 0x7fd5740a6950 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd57b448640 4 set_mon_vals no callback set 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd56bfff640 10 monclient: dump: 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.026+0000 7fd57b448640 10 monclient: shutdown 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 -- 172.21.15.71:0/2652546332 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 msgr2=0x7fd5740a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 0x7fd5740a6d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5700098a0 tx=0x7fd57002a080 comp rx=0 tx=0).stop 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 -- 172.21.15.71:0/2652546332 shutdown_connections 2024-08-19T11:12:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd5740a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 --2- 172.21.15.71:0/2652546332 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd5740a6950 0x7fd5740a6d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 -- 172.21.15.71:0/2652546332 >> 172.21.15.71:0/2652546332 conn(0x7fd5740abf50 msgr2=0x7fd5740ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 -- 172.21.15.71:0/2652546332 shutdown_connections 2024-08-19T11:12:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 1 -- 172.21.15.71:0/2652546332 wait complete. 2024-08-19T11:12:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 10 monclient: build_initial_monmap 2024-08-19T11:12:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.027+0000 7fd57b448640 10 monclient: monmap: 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 Processor -- start 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 -- start start 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient: init 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient: _add_conns ranks=[7,8,2,5,3,6,0,1,4] 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd574138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): picked mon.noname-i con 0x7fd5740a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 0x7fd5741caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): picked mon.noname-e con 0x7fd5740a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd574139710 0x7fd5741cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): picked mon.noname-b con 0x7fd574139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740a84c0 con 0x7fd574139710 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd5740a7d40 con 0x7fd5740a57c0 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd5740a8700 con 0x7fd5740a6950 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd57b448640 10 monclient(hunting): authenticate will time out at 781.069635s 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 0x7fd5741caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 0x7fd5741caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51272/0 (socket says 172.21.15.71:51272) 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 1 -- 172.21.15.71:0/1205377442 learned_addr learned my addr 172.21.15.71:0/1205377442 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd574139710 0x7fd5741cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): get_auth_request con 0x7fd5740a6950 auth_method 0 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd574138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): get_auth_request con 0x7fd574139710 auth_method 0 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): get_auth_request con 0x7fd5740a57c0 auth_method 0 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5789e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5799e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.028+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 10 monclient(hunting): handle_auth_done global_id 4850 payload 824 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 msgr2=0x7fd574138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5740a57c0 0x7fd574138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd574139710 msgr2=0x7fd5741cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd574139710 0x7fd5741cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 10 monclient: _finish_hunting 0 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 1 monclient: found mon.noname-e 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5789e3640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740a1e00 con 0x7fd5740a6950 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.029+0000 7fd5799e5640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd574139710 0x7fd5741cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd5789e3640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 msgr2=0x7fd5741caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd5789e3640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 0x7fd5741caf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e730 tx=0x7fd56400ebf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd56400f040 con 0x7fd5740a6950 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: dump: 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: _finish_auth 0 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56400ee40 con 0x7fd5740a6950 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 5 monclient: authenticate success, global_id 4850 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 10 monclient: _renew_subs 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd574126690 con 0x7fd5740a6950 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd5640044a0 con 0x7fd5740a6950 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd569ffb640 10 monclient: dump: 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd56b7fe640 4 set_mon_vals no callback set 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 10 monclient: _renew_subs 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.031+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fd574139210 con 0x7fd5740a6950 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd57b448640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd57b448640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 0x7fd57402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd57406a590 con 0x7fd5741cec10 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd564004030 con 0x7fd5740a6950 2024-08-19T11:12:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 0x7fd57402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient: get_auth_request con 0x7fd5741cec10 auth_method 0 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd569ffb640 1 --2- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 0x7fd558040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7fd564051960 con 0x7fd5740a6950 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.032+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5799e5640 1 --2- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 0x7fd558040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5799e5640 10 monclient: get_auth_request con 0x7fd55803ea80 auth_method 0 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5791e4640 10 monclient(hunting): handle_auth_done global_id 4705 payload 824 2024-08-19T11:12:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5791e4640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5741394d0 con 0x7fd5741cec10 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5799e5640 1 -- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 msgr2=0x7fd558040f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5799e5640 1 -- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 msgr2=0x7fd558040f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5799e5640 1 --2- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 0x7fd558040f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.033+0000 7fd5799e5640 1 --2- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 0x7fd558040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd5791e4640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 msgr2=0x7fd57402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd5791e4640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 0x7fd57402d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd570034000 tx=0x7fd5700046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd570037040 con 0x7fd5741cec10 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 10 monclient: dump: 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.056 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd570003a30 con 0x7fd5741cec10 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 msgr2=0x7fd57402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 0x7fd57402d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd570034000 tx=0x7fd5700046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 msgr2=0x7fd57402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.035+0000 7fd569ffb640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741cec10 0x7fd57402d1c0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd570034000 tx=0x7fd5700046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.041+0000 7fd57b448640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.041+0000 7fd57b448640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 0x7fd57402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.041+0000 7fd57b448640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.041+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd574077030 con 0x7fd5741ceff0 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 0x7fd57402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient: get_auth_request con 0x7fd5741ceff0 auth_method 0 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 10 monclient(hunting): handle_auth_done global_id 4714 payload 824 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.042+0000 7fd5791e4640 1 -- 172.21.15.71:0/1205377442 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd5740a6d30 con 0x7fd5741ceff0 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.044+0000 7fd5791e4640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 msgr2=0x7fd57402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd5791e4640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 0x7fd57402d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5700097c0 tx=0x7fd570008030 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd570037030 con 0x7fd5741ceff0 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 10 monclient: dump: 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fd570049a10 con 0x7fd5741ceff0 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 msgr2=0x7fd57402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 0x7fd57402d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5700097c0 tx=0x7fd570008030 comp rx=0 tx=0).stop 2024-08-19T11:12:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 msgr2=0x7fd57402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.045+0000 7fd569ffb640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd5741ceff0 0x7fd57402d700 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5700097c0 tx=0x7fd570008030 comp rx=0 tx=0).stop 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 30, 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 119899, 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:03.062 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:03.063 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:03.064 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:03.066 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:03.069 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.072 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:03.073 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.078 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:03.080 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:03.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:03.083 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.084 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:03.085 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 msgr2=0x7fd558040f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 --2- 172.21.15.71:0/1205377442 >> v2:172.21.15.135:6800/726754104 conn(0x7fd55803ea80 0x7fd558040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 10 monclient: shutdown 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 msgr2=0x7fd5741caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd5799e5640 1 -- 172.21.15.71:0/1205377442 reap_dead start 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 0x7fd5741caf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e730 tx=0x7fd56400ebf0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 shutdown_connections 2024-08-19T11:12:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 --2- 172.21.15.71:0/1205377442 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd5740a6950 0x7fd5741caf50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 >> 172.21.15.71:0/1205377442 conn(0x7fd5740abf50 msgr2=0x7fd5740aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 shutdown_connections 2024-08-19T11:12:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.046+0000 7fd57b448640 1 -- 172.21.15.71:0/1205377442 wait complete. 2024-08-19T11:12:03.088 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:12:03.088 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-08-19T11:12:03.088 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-19T11:12:03.088 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-19T11:12:03.089 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-19T11:12:03.089 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-19T11:12:03.089 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:12:03.100 INFO:tasks.ceph.mon.a:Stopped 2024-08-19T11:12:03.100 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-19T11:12:03.100 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:03.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.234+0000 7fcc159d9640 10 monclient: get_monmap_and_config 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.234+0000 7fcc159d9640 10 monclient: build_initial_monmap 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.234+0000 7fcc159d9640 10 monclient: monmap: 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:03.235391+0000 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:03.235391+0000 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:03.236 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:03.237 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 1 Processor -- start 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 1 -- start start 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient: init 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient: _add_conns ranks=[3,10,9,1,6,7,2,0,5,8,4] 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 0x7fcc100a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient(hunting): picked mon.noname-g con 0x7fcc100a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc100a6e10 0x7fcc100a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient(hunting): picked mon.noname-f con 0x7fcc100a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc10139860 0x7fcc10139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient(hunting): picked mon.noname-a con 0x7fcc10139860 addr v2:172.21.15.71:3300/0 2024-08-19T11:12:03.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcc100a4f90 con 0x7fcc10139860 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.235+0000 7fcc159d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc159d9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcc100a6380 con 0x7fcc100a6e10 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc159d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc159d9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc100a49d0 con 0x7fcc100a6a30 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc159d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc159d9640 10 monclient(hunting): authenticate will time out at 781.277015s 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0f7fe640 1 -- >> v2:172.21.15.71:3300/0 conn(0x7fcc10139860 msgr2=0x7fcc10139cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0f7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc10139860 0x7fcc10139cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 0x7fcc100a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc100a6e10 0x7fcc100a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 0x7fcc100a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:56220/0 (socket says 172.21.15.71:56220) 2024-08-19T11:12:03.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 -- 172.21.15.71:0/3700614555 learned_addr learned my addr 172.21.15.71:0/3700614555 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): get_auth_request con 0x7fcc100a6a30 auth_method 0 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): get_auth_request con 0x7fcc100a6e10 auth_method 0 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient(hunting): handle_auth_done global_id 4836 payload 274 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 -- 172.21.15.71:0/3700614555 >> v2:172.21.15.135:3300/0 conn(0x7fcc100a6e10 msgr2=0x7fcc100a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 --2- 172.21.15.71:0/3700614555 >> v2:172.21.15.135:3300/0 conn(0x7fcc100a6e10 0x7fcc100a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 -- 172.21.15.71:0/3700614555 >> v2:172.21.15.71:3300/0 conn(0x7fcc10139860 msgr2=0x7fcc10139cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 --2- 172.21.15.71:0/3700614555 >> v2:172.21.15.71:3300/0 conn(0x7fcc10139860 0x7fcc10139cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient: _finish_hunting 0 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 monclient: found mon.noname-g 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:12:03.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.236+0000 7fcc0effd640 1 -- 172.21.15.71:0/3700614555 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100a46f0 con 0x7fcc100a6a30 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0effd640 1 -- 172.21.15.71:0/3700614555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 msgr2=0x7fcc100a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0effd640 1 --2- 172.21.15.71:0/3700614555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 0x7fcc100a57f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc100a5760 tx=0x7fcc0002a0d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=249ba8a93c4de4b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 1 -- 172.21.15.71:0/3700614555 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc00037070 con 0x7fcc100a6a30 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: dump: 2024-08-19T11:12:03.249 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.250 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc159d9640 5 monclient: authenticate success, global_id 4836 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc159d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 1 -- 172.21.15.71:0/3700614555 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0002ae30 con 0x7fcc100a6a30 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc159d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:03.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc159d9640 4 set_mon_vals no callback set 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 1 -- 172.21.15.71:0/3700614555 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc00030c20 con 0x7fcc100a6a30 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.239+0000 7fcc0e7fc640 10 monclient: dump: 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.252 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 10 monclient: shutdown 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 -- 172.21.15.71:0/3700614555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 msgr2=0x7fcc100a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 --2- 172.21.15.71:0/3700614555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 0x7fcc100a57f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc100a5760 tx=0x7fcc0002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 -- 172.21.15.71:0/3700614555 shutdown_connections 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 --2- 172.21.15.71:0/3700614555 >> v2:172.21.15.71:3300/0 conn(0x7fcc10139860 0x7fcc10139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 --2- 172.21.15.71:0/3700614555 >> v2:172.21.15.135:3300/0 conn(0x7fcc100a6e10 0x7fcc100a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 --2- 172.21.15.71:0/3700614555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc100a6a30 0x7fcc100a57f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 -- 172.21.15.71:0/3700614555 >> 172.21.15.71:0/3700614555 conn(0x7fcc100ac030 msgr2=0x7fcc100ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 -- 172.21.15.71:0/3700614555 shutdown_connections 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 1 -- 172.21.15.71:0/3700614555 wait complete. 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 10 monclient: build_initial_monmap 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.240+0000 7fcc159d9640 10 monclient: monmap: 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:03.254 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 Processor -- start 2024-08-19T11:12:03.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 -- start start 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient: init 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient: _add_conns ranks=[4,6,7,0,1,2,3,8,5] 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc100a6a30 0x7fcc101ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): picked mon.noname-c con 0x7fcc100a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 0x7fcc10138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): picked mon.noname-d con 0x7fcc100a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc10139860 0x7fcc10139070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): picked mon.noname-i con 0x7fcc10139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcc100a7730 con 0x7fcc100a6a30 2024-08-19T11:12:03.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcc1013a230 con 0x7fcc100a6e10 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcc100a2790 con 0x7fcc10139860 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.241+0000 7fcc159d9640 10 monclient(hunting): authenticate will time out at 781.282963s 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 0x7fcc10138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc100a6a30 0x7fcc101ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 0x7fcc10138b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43988/0 (socket says 172.21.15.71:43988) 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 -- 172.21.15.71:0/1897491953 learned_addr learned my addr 172.21.15.71:0/1897491953 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): get_auth_request con 0x7fcc100a6e10 auth_method 0 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): get_auth_request con 0x7fcc100a6a30 auth_method 0 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc10139860 0x7fcc10139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): get_auth_request con 0x7fcc10139860 auth_method 0 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:03.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient(hunting): handle_auth_done global_id 24333 payload 824 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 -- 172.21.15.71:0/1897491953 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc10139860 msgr2=0x7fcc10139070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc10139860 0x7fcc10139070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 -- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc100a6a30 msgr2=0x7fcc101ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc100a6a30 0x7fcc101ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient: _finish_hunting 0 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 monclient: found mon.noname-d 2024-08-19T11:12:03.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc067fc640 1 -- 172.21.15.71:0/1897491953 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100a22b0 con 0x7fcc100a6e10 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.242+0000 7fcc0effd640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc100a6a30 0x7fcc101ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc067fc640 1 -- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 msgr2=0x7fcc10138b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc067fc640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 0x7fcc10138b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800e9e0 tx=0x7fcbf800eea0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbf8017070 con 0x7fcc100a6e10 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: dump: 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.260 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: _finish_auth 0 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:03.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 5 monclient: authenticate success, global_id 24333 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf800cbe0 con 0x7fcc100a6e10 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 10 monclient: _renew_subs 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc100a3ff0 con 0x7fcc100a6e10 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbf800cd90 con 0x7fcc100a6e10 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0dffb640 4 set_mon_vals no callback set 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc0cff9640 10 monclient: dump: 2024-08-19T11:12:03.262 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:03.263 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 10 monclient: _renew_subs 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.244+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc101ce7f0 con 0x7fcc100a6e10 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcbf801a070 con 0x7fcc100a6e10 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc0cff9640 1 --2- 172.21.15.71:0/1897491953 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbf003ea80 0x7fcbf0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc159d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc159d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc159d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7fcbf800f040 con 0x7fcc100a6e10 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.245+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1013a590 con 0x7fcc100a6e10 2024-08-19T11:12:03.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.246+0000 7fcc0effd640 1 --2- 172.21.15.71:0/1897491953 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbf003ea80 0x7fcbf0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:03.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.246+0000 7fcc0effd640 10 monclient: get_auth_request con 0x7fcbf003ea80 auth_method 0 2024-08-19T11:12:03.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.248+0000 7fcc0effd640 1 --2- 172.21.15.71:0/1897491953 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbf003ea80 0x7fcbf0040f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc100a5760 tx=0x7fcc0002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:03.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.250+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fcbf8021070 con 0x7fcc100a6e10 2024-08-19T11:12:03.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.250+0000 7fcc0cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:03.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.250+0000 7fcc0cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc159d9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc159d9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc159d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcc1006ca70 con 0x7fcc100a6e10 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc0cff9640 1 -- 172.21.15.71:0/1897491953 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7fcbf801bdc0 con 0x7fcc100a6e10 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc0cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.495+0000 7fcc0cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:03.497 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.497+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbf003ea80 msgr2=0x7fcbf0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.497+0000 7fcc159d9640 1 --2- 172.21.15.71:0/1897491953 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbf003ea80 0x7fcbf0040f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc100a5760 tx=0x7fcc0002e000 comp rx=0 tx=0).stop 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 10 monclient: shutdown 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 msgr2=0x7fcc10138b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 0x7fcc10138b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcbf800e9e0 tx=0x7fcbf800eea0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 shutdown_connections 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 --2- 172.21.15.71:0/1897491953 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbf003ea80 0x7fcbf0040f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc10139860 0x7fcc10139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcc100a6e10 0x7fcc10138b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 --2- 172.21.15.71:0/1897491953 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc100a6a30 0x7fcc101ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 >> 172.21.15.71:0/1897491953 conn(0x7fcc100ac030 msgr2=0x7fcc101c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 shutdown_connections 2024-08-19T11:12:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:03.498+0000 7fcc159d9640 1 -- 172.21.15.71:0/1897491953 wait complete. 2024-08-19T11:12:06.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:06.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.619+0000 7f467ec36640 10 monclient: get_monmap_and_config 2024-08-19T11:12:06.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.619+0000 7f467ec36640 10 monclient: build_initial_monmap 2024-08-19T11:12:06.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.619+0000 7f467ec36640 10 monclient: monmap: 2024-08-19T11:12:06.620 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:06.620 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:06.620 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:06.619894+0000 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:06.619894+0000 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:06.621 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:06.622 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:06.622 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:06.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 Processor -- start 2024-08-19T11:12:06.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 -- start start 2024-08-19T11:12:06.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient: init 2024-08-19T11:12:06.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:06.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient: _add_conns ranks=[10,5,2,1,3,7,4,8,9,0,6] 2024-08-19T11:12:06.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f467809b510 0x7f46780a0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): picked mon.noname-f con 0x7f467809b510 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:06.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b8f0 0x7f46780a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): picked mon.noname-h con 0x7f467809b8f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 0x7f46780a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): picked mon.noname-b con 0x7f467809bcd0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f467809f070 con 0x7f467809b510 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:06.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f46780a00f0 con 0x7f467809bcd0 2024-08-19T11:12:06.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:06.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f46780a5ba0 con 0x7f467809b8f0 2024-08-19T11:12:06.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:06.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467ec36640 10 monclient(hunting): authenticate will time out at 784.661634s 2024-08-19T11:12:06.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 0x7f46780a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 0x7f46780a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34318/0 (socket says 172.21.15.71:34318) 2024-08-19T11:12:06.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 1 -- 172.21.15.71:0/1885236350 learned_addr learned my addr 172.21.15.71:0/1885236350 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:06.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): get_auth_request con 0x7f467809bcd0 auth_method 0 2024-08-19T11:12:06.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:06.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:06.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:06.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f467c9d2640 1 --2- 172.21.15.71:0/1885236350 >> v2:172.21.15.135:3300/0 conn(0x7f467809b510 0x7f46780a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.620+0000 7f4677fff640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b8f0 0x7f46780a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467c9d2640 10 monclient(hunting): get_auth_request con 0x7f467809b510 auth_method 0 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467c9d2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 10 monclient(hunting): handle_auth_done global_id 5006 payload 274 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 1 -- 172.21.15.71:0/1885236350 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b8f0 msgr2=0x7f46780a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:06.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b8f0 0x7f46780a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 1 -- 172.21.15.71:0/1885236350 >> v2:172.21.15.135:3300/0 conn(0x7f467809b510 msgr2=0x7f46780a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:06.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 1 --2- 172.21.15.71:0/1885236350 >> v2:172.21.15.135:3300/0 conn(0x7f467809b510 0x7f46780a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 10 monclient: _finish_hunting 0 2024-08-19T11:12:06.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 1 monclient: found mon.noname-b 2024-08-19T11:12:06.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:06.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:06.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f467d1d3640 1 -- 172.21.15.71:0/1885236350 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467809fac0 con 0x7f467809bcd0 2024-08-19T11:12:06.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f4677fff640 10 monclient: get_auth_request con 0x7f467809b8f0 auth_method 0 2024-08-19T11:12:06.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.621+0000 7f4677fff640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b8f0 0x7f46780a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:12:06.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.623+0000 7f467d1d3640 1 -- 172.21.15.71:0/1885236350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 msgr2=0x7f46780a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.623+0000 7f467d1d3640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 0x7f46780a42c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4670009870 tx=0x7f467002a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b64c3637b45478 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 1 -- 172.21.15.71:0/1885236350 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4670037070 con 0x7f467809bcd0 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: dump: 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:06.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:06.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:06.646 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:06.646 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:06.646 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:06.646 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:06.646 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:06.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: _finish_auth 0 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: _check_auth_tickets 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 1 -- 172.21.15.71:0/1885236350 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467002ae00 con 0x7f467809bcd0 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 5 monclient: authenticate success, global_id 5006 2024-08-19T11:12:06.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:06.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:06.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:06.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 1 -- 172.21.15.71:0/1885236350 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4670030c20 con 0x7f467809bcd0 2024-08-19T11:12:06.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:06.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 4 set_mon_vals no callback set 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f46777fe640 10 monclient: dump: 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:06.650 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:06.651 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:06.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 10 monclient: shutdown 2024-08-19T11:12:06.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 -- 172.21.15.71:0/1885236350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 msgr2=0x7f46780a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 0x7f46780a42c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4670009870 tx=0x7f467002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 -- 172.21.15.71:0/1885236350 shutdown_connections 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f467809bcd0 0x7f46780a42c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 --2- 172.21.15.71:0/1885236350 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b8f0 0x7f46780a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 --2- 172.21.15.71:0/1885236350 >> v2:172.21.15.135:3300/0 conn(0x7f467809b510 0x7f46780a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 -- 172.21.15.71:0/1885236350 >> 172.21.15.71:0/1885236350 conn(0x7f46780a4e70 msgr2=0x7f46780a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 -- 172.21.15.71:0/1885236350 shutdown_connections 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.624+0000 7f467ec36640 1 -- 172.21.15.71:0/1885236350 wait complete. 2024-08-19T11:12:06.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.625+0000 7f467ec36640 10 monclient: build_initial_monmap 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.625+0000 7f467ec36640 10 monclient: monmap: 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:06.657 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.625+0000 7f467ec36640 1 Processor -- start 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.625+0000 7f467ec36640 1 -- start start 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.625+0000 7f467ec36640 10 monclient: init 2024-08-19T11:12:06.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient: _add_conns ranks=[5,4,3,1,8,2,6,7,0] 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b510 0x7f46781ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): picked mon.noname-h con 0x7f467809b510 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 0x7f46781ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): picked mon.noname-c con 0x7f467809b8f0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467809bcd0 0x7f4678093c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): picked mon.noname-g con 0x7f467809bcd0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f46780a4800 con 0x7f467809bcd0 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4678069300 con 0x7f467809b8f0 2024-08-19T11:12:06.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f46780a4980 con 0x7f467809b510 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467ec36640 10 monclient(hunting): authenticate will time out at 784.667285s 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 0x7f46781ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 0x7f46781ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:57652/0 (socket says 172.21.15.71:57652) 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 -- 172.21.15.71:0/261792212 learned_addr learned my addr 172.21.15.71:0/261792212 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): get_auth_request con 0x7f467809b8f0 auth_method 0 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:06.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b510 0x7f46781ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467809bcd0 0x7f4678093c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): get_auth_request con 0x7f467809b510 auth_method 0 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): get_auth_request con 0x7f467809bcd0 auth_method 0 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f467d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:06.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient(hunting): handle_auth_done global_id 4819 payload 824 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 -- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b510 msgr2=0x7f46781ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b510 0x7f46781ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 -- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467809bcd0 msgr2=0x7f4678093c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467809bcd0 0x7f4678093c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 monclient: found mon.noname-c 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.626+0000 7f4677fff640 1 -- 172.21.15.71:0/261792212 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46780a4000 con 0x7f467809b8f0 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.628+0000 7f4677fff640 1 -- 172.21.15.71:0/261792212 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 msgr2=0x7f46781ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:06.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.628+0000 7f4677fff640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 0x7f46781ceb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f466800c820 tx=0x7f466800cce0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4668004030 con 0x7f467809b8f0 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: dump: 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:06.664 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:06.665 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: _finish_auth 0 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: _check_auth_tickets 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668004210 con 0x7f467809b8f0 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 5 monclient: authenticate success, global_id 4819 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f46680043c0 con 0x7f467809b8f0 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 10 monclient: _renew_subs 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467809ad90 con 0x7f467809b8f0 2024-08-19T11:12:06.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f4676ffd640 4 set_mon_vals no callback set 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f46757fa640 10 monclient: dump: 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:06.667 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 10 monclient: _renew_subs 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.629+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4678097ae0 con 0x7f467809b8f0 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f467ec36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f467ec36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:06.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f467ec36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46780a0530 con 0x7f467809b8f0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4668007a40 con 0x7f467809b8f0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f46757fa640 1 --2- 172.21.15.71:0/261792212 >> v2:172.21.15.135:6800/726754104 conn(0x7f465803ea80 0x7f4658040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7f4668051c50 con 0x7f467809b8f0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f467c9d2640 1 --2- 172.21.15.71:0/261792212 >> v2:172.21.15.135:6800/726754104 conn(0x7f465803ea80 0x7f4658040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.630+0000 7f467c9d2640 10 monclient: get_auth_request con 0x7f465803ea80 auth_method 0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.633+0000 7f467c9d2640 1 --2- 172.21.15.71:0/261792212 >> v2:172.21.15.135:6800/726754104 conn(0x7f465803ea80 0x7f4658040f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4660003b80 tx=0x7f46600098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:06.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.635+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f4668015020 con 0x7f467809b8f0 2024-08-19T11:12:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.635+0000 7f46757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:06.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.635+0000 7f46757fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f467ec36640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f467ec36640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f467ec36640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46780962e0 con 0x7f467809b8f0 2024-08-19T11:12:06.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f46757fa640 1 -- 172.21.15.71:0/261792212 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f46680509c0 con 0x7f467809b8f0 2024-08-19T11:12:06.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f46757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:06.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.877+0000 7f46757fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:06.879 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 >> v2:172.21.15.135:6800/726754104 conn(0x7f465803ea80 msgr2=0x7f4658040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 --2- 172.21.15.71:0/261792212 >> v2:172.21.15.135:6800/726754104 conn(0x7f465803ea80 0x7f4658040f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4660003b80 tx=0x7f46600098d0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 10 monclient: shutdown 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 msgr2=0x7f46781ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 0x7f46781ceb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f466800c820 tx=0x7f466800cce0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 shutdown_connections 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 --2- 172.21.15.71:0/261792212 >> v2:172.21.15.135:6800/726754104 conn(0x7f465803ea80 0x7f4658040f40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f467809bcd0 0x7f4678093c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f467809b8f0 0x7f46781ceb10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 --2- 172.21.15.71:0/261792212 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f467809b510 0x7f46781ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 >> 172.21.15.71:0/261792212 conn(0x7f46780a4e70 msgr2=0x7f467809c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 shutdown_connections 2024-08-19T11:12:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:06.879+0000 7f467ec36640 1 -- 172.21.15.71:0/261792212 wait complete. 2024-08-19T11:12:09.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.000+0000 7f471802f640 10 monclient: get_monmap_and_config 2024-08-19T11:12:10.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.000+0000 7f471802f640 10 monclient: build_initial_monmap 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.000+0000 7f471802f640 10 monclient: monmap: 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:10.001332+0000 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:10.001332+0000 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:10.002 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:10.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.001+0000 7f471802f640 1 Processor -- start 2024-08-19T11:12:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.001+0000 7f471802f640 1 -- start start 2024-08-19T11:12:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.001+0000 7f471802f640 10 monclient: init 2024-08-19T11:12:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.001+0000 7f471802f640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient: _add_conns ranks=[7,0,10,3,4,6,1,5,9,8,2] 2024-08-19T11:12:10.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 0x7f47100a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): picked mon.noname-i con 0x7f47100a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47100a6e10 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f471013eb10 0x7f4710140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): picked mon.noname-f con 0x7f471013eb10 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47100a4f90 con 0x7f47100a6e10 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f47100a3650 con 0x7f471013eb10 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f47100a6380 con 0x7f47100a6a30 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f471802f640 10 monclient(hunting): authenticate will time out at 788.043123s 2024-08-19T11:12:10.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47155ca640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7f47100a6e10 legacy=0x7f47100a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f471013eb10 0x7f4710140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 0x7f47100a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f471013eb10 0x7f4710140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:58534/0 (socket says 172.21.15.71:58534) 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 0x7f47100a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:40750/0 (socket says 172.21.15.71:40750) 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 -- 172.21.15.71:0/309964958 learned_addr learned my addr 172.21.15.71:0/309964958 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): get_auth_request con 0x7f471013eb10 auth_method 0 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:10.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): get_auth_request con 0x7f47100a6a30 auth_method 0 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:10.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient(hunting): handle_auth_done global_id 4717 payload 274 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 -- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 msgr2=0x7f47100a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 --2- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 0x7f47100a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 -- 172.21.15.71:0/309964958 >> v1:172.21.15.71:6789/0 conn(0x7f47100a6e10 legacy=0x7f47100a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient: _finish_hunting 0 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 monclient: found mon.noname-f 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f47165cc640 1 -- 172.21.15.71:0/309964958 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47100a49d0 con 0x7f471013eb10 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.002+0000 7f4715dcb640 1 --2- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 0x7f47100a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.005+0000 7f47165cc640 1 -- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f471013eb10 msgr2=0x7f4710140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.005+0000 7f47165cc640 1 --2- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f471013eb10 0x7f4710140f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4708009e80 tx=0x7f470802a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=613c6a6f05ef3d12 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 1 -- 172.21.15.71:0/309964958 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4708036070 con 0x7f471013eb10 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: dump: 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:10.016 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:10.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: _finish_auth 0 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 1 -- 172.21.15.71:0/309964958 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4708007a70 con 0x7f471013eb10 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 5 monclient: authenticate success, global_id 4717 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:10.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 1 -- 172.21.15.71:0/309964958 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4708007c60 con 0x7f471013eb10 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 4 set_mon_vals no callback set 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f4714dc9640 10 monclient: dump: 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:10.019 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 10 monclient: shutdown 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 -- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f471013eb10 msgr2=0x7f4710140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 --2- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f471013eb10 0x7f4710140f00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4708009e80 tx=0x7f470802a580 comp rx=0 tx=0).stop 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 -- 172.21.15.71:0/309964958 shutdown_connections 2024-08-19T11:12:10.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 --2- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f471013eb10 0x7f4710140f00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 --2- 172.21.15.71:0/309964958 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6a30 0x7f47100a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 -- 172.21.15.71:0/309964958 >> 172.21.15.71:0/309964958 conn(0x7f47100ac030 msgr2=0x7f47100ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.006+0000 7f471802f640 1 -- 172.21.15.71:0/309964958 shutdown_connections 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.007+0000 7f471802f640 1 -- 172.21.15.71:0/309964958 wait complete. 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.007+0000 7f471802f640 10 monclient: build_initial_monmap 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.007+0000 7f471802f640 10 monclient: monmap: 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:10.021 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.007+0000 7f471802f640 1 Processor -- start 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.007+0000 7f471802f640 1 -- start start 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.007+0000 7f471802f640 10 monclient: init 2024-08-19T11:12:10.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient: _add_conns ranks=[0,7,8,1,3,6,4,5,2] 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47100a6a30 0x7f4710125e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): picked mon.noname-a con 0x7f47100a6a30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6e10 0x7f471013ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): picked mon.noname-i con 0x7f47100a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 0x7f47101ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): picked mon.noname-e con 0x7f471013eb10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4710141440 con 0x7f47100a6a30 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f47100a5d30 con 0x7f47100a6e10 2024-08-19T11:12:10.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f47101415c0 con 0x7f471013eb10 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f471802f640 10 monclient(hunting): authenticate will time out at 788.049387s 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f4715dcb640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47100a6a30 msgr2=0x7f4710125e50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f4715dcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47100a6a30 0x7f4710125e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 0x7f47101ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 0x7f47101ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59380/0 (socket says 172.21.15.71:59380) 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 -- 172.21.15.71:0/2964140395 learned_addr learned my addr 172.21.15.71:0/2964140395 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): get_auth_request con 0x7f471013eb10 auth_method 0 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:10.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47155ca640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6e10 0x7f471013ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47155ca640 10 monclient(hunting): get_auth_request con 0x7f47100a6e10 auth_method 0 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47155ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47155ca640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47155ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient(hunting): handle_auth_done global_id 4859 payload 824 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 -- 172.21.15.71:0/2964140395 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6e10 msgr2=0x7f471013ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6e10 0x7f471013ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 -- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47100a6a30 msgr2=0x7f4710125e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47100a6a30 0x7f4710125e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient: _finish_hunting 0 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 monclient: found mon.noname-e 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.008+0000 7f47165cc640 1 -- 172.21.15.71:0/2964140395 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47101411a0 con 0x7f471013eb10 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47165cc640 1 -- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 msgr2=0x7f47101ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47165cc640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 0x7f47101ce5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4708007fd0 tx=0x7f4708004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4708040020 con 0x7f471013eb10 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: dump: 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:10.026 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:10.027 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: _finish_auth 0 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: _check_auth_tickets 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4708003ba0 con 0x7f471013eb10 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 5 monclient: authenticate success, global_id 4859 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 10 monclient: _renew_subs 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47101252f0 con 0x7f471013eb10 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4708036040 con 0x7f471013eb10 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:10.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f47067fc640 10 monclient: dump: 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:10.029 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f4707fff640 4 set_mon_vals no callback set 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 10 monclient: _renew_subs 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.011+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f471013d960 con 0x7f471013eb10 2024-08-19T11:12:10.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f471802f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f471802f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f471802f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4710126ff0 con 0x7f471013eb10 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4708043020 con 0x7f471013eb10 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f47067fc640 1 --2- 172.21.15.71:0/2964140395 >> v2:172.21.15.135:6800/726754104 conn(0x7f46f403ea80 0x7f46f4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7f47080723f0 con 0x7f471013eb10 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.012+0000 7f4715dcb640 1 --2- 172.21.15.71:0/2964140395 >> v2:172.21.15.135:6800/726754104 conn(0x7f46f403ea80 0x7f46f4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.013+0000 7f4715dcb640 10 monclient: get_auth_request con 0x7f46f403ea80 auth_method 0 2024-08-19T11:12:10.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.015+0000 7f4715dcb640 1 --2- 172.21.15.71:0/2964140395 >> v2:172.21.15.135:6800/726754104 conn(0x7f46f403ea80 0x7f46f4040f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f470c009560 tx=0x7f470c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.017+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f470804a030 con 0x7f471013eb10 2024-08-19T11:12:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.017+0000 7f47067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:10.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.017+0000 7f47067fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:10.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.259+0000 7f471802f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:10.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.259+0000 7f471802f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:10.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.259+0000 7f471802f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.259+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f471006ca70 con 0x7f471013eb10 2024-08-19T11:12:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.260+0000 7f47067fc640 1 -- 172.21.15.71:0/2964140395 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f4708071160 con 0x7f471013eb10 2024-08-19T11:12:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.260+0000 7f47067fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:10.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.260+0000 7f47067fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:10.261 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 >> v2:172.21.15.135:6800/726754104 conn(0x7f46f403ea80 msgr2=0x7f46f4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 --2- 172.21.15.71:0/2964140395 >> v2:172.21.15.135:6800/726754104 conn(0x7f46f403ea80 0x7f46f4040f40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f470c009560 tx=0x7f470c009190 comp rx=0 tx=0).stop 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 10 monclient: shutdown 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 msgr2=0x7f47101ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 0x7f47101ce5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4708007fd0 tx=0x7f4708004a40 comp rx=0 tx=0).stop 2024-08-19T11:12:10.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 shutdown_connections 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 --2- 172.21.15.71:0/2964140395 >> v2:172.21.15.135:6800/726754104 conn(0x7f46f403ea80 0x7f46f4040f40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f471013eb10 0x7f47101ce5b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47100a6e10 0x7f471013ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 --2- 172.21.15.71:0/2964140395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47100a6a30 0x7f4710125e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 >> 172.21.15.71:0/2964140395 conn(0x7f47100ac030 msgr2=0x7f471013e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 shutdown_connections 2024-08-19T11:12:10.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:10.262+0000 7f471802f640 1 -- 172.21.15.71:0/2964140395 wait complete. 2024-08-19T11:12:13.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:13.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.382+0000 7fe8c22fd640 10 monclient: get_monmap_and_config 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.382+0000 7fe8c22fd640 10 monclient: build_initial_monmap 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.382+0000 7fe8c22fd640 10 monclient: monmap: 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:13.384467+0000 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:13.384467+0000 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:13.385 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:13.386 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:13.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.383+0000 7fe8c22fd640 1 Processor -- start 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.383+0000 7fe8c22fd640 1 -- start start 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.383+0000 7fe8c22fd640 10 monclient: init 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient: _add_conns ranks=[8,6,10,5,4,7,2,3,1,0,9] 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): picked mon.noname-e con 0x7fe8bc0a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): picked mon.noname-d con 0x7fe8bc0a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): picked mon.noname-f con 0x7fe8bc139860 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe8bc0a4f90 con 0x7fe8bc139860 2024-08-19T11:12:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a6380 con 0x7fe8bc0a6e10 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a49d0 con 0x7fe8bc0a6a30 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c22fd640 10 monclient(hunting): authenticate will time out at 791.426303s 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59396/0 (socket says 172.21.15.71:59396) 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 learned_addr learned my addr 172.21.15.71:0/2836778092 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6a30 auth_method 0 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6e10 auth_method 0 2024-08-19T11:12:13.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8bc139860 auth_method 0 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6e10 auth_method 0 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6a30 auth_method 0 2024-08-19T11:12:13.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8bc139860 auth_method 0 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.586+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6a30 auth_method 0 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6e10 auth_method 0 2024-08-19T11:12:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8bc139860 auth_method 0 2024-08-19T11:12:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:13.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:13.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:13.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:13.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:13.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:13.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:13.988+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6a30 auth_method 0 2024-08-19T11:12:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:14.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8bc0a6e10 auth_method 0 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:14.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8bc139860 auth_method 0 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.789+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:14.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:14.790+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:16.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): tick 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 msgr2=0x7fe8bc0a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe8bc0a6a30 0x7fe8bc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 msgr2=0x7fe8bc0a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe8bc0a6e10 0x7fe8bc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 msgr2=0x7fe8bc139c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.135:3300/0 conn(0x7fe8bc139860 0x7fe8bc139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient: _add_conns ranks=[0,5,4,9,3,7,1,2] 2024-08-19T11:12:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe8a80037d0 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-h con 0x7fe8a80073e0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-c con 0x7fe8a8009ed0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc0a46f0 con 0x7fe8a80037d0 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.71:6789/0 conn(0x7fe8a80037d0 legacy=0x7fe8a8005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a4f90 con 0x7fe8a8009ed0 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a6380 con 0x7fe8a80073e0 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8b9ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a8009ed0 auth_method 0 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8a80073e0 auth_method 0 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.384+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.71:6789/0 conn(0x7fe8a80037d0 legacy=0x7fe8a8005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a8009ed0 auth_method 0 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:16.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8a80073e0 auth_method 0 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:16.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.585+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.71:6789/0 conn(0x7fe8a80037d0 legacy=0x7fe8a8005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8a80073e0 auth_method 0 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.986+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a8009ed0 auth_method 0 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:16.987+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:17.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.787+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.71:6789/0 conn(0x7fe8a80037d0 legacy=0x7fe8a8005c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:17.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:17.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe8a80073e0 auth_method 0 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a8009ed0 auth_method 0 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:17.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:17.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:17.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:17.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:17.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:17.788+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:19.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): tick 2024-08-19T11:12:19.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:12:19.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:12:19.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe8a80073e0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe8a8009ed0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.71:6789/0 conn(0x7fe8a80037d0 legacy=0x7fe8a8005c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient: _add_conns ranks=[3,9,2,7,1] 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 reap_dead start 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-g con 0x7fe8a800cbf0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 reap_dead start 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 0x7fe8a800c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-a con 0x7fe8a800d5b0 addr v2:172.21.15.71:3300/0 2024-08-19T11:12:19.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fe8a80063d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe8bc0a4f90 con 0x7fe8a800d5b0 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a6380 con 0x7fe8a80063d0 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a49d0 con 0x7fe8a800cbf0 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8b9ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:19.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a80063d0 auth_method 0 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.384+0000 7fe8c089a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a800cbf0 auth_method 0 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:19.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.385+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.585+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:19.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.585+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a80063d0 auth_method 0 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:19.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a800cbf0 auth_method 0 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.586+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.587+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.587+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.587+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:19.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.587+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:19.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.986+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:19.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.986+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:19.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:19.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a80063d0 auth_method 0 2024-08-19T11:12:19.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:19.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:19.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:19.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:19.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:19.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:19.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.987+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:19.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.988+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:19.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.988+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a800cbf0 auth_method 0 2024-08-19T11:12:19.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.988+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:19.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.988+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:19.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.988+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:19.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.989+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:19.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.989+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:19.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.989+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:19.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:19.989+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.787+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.787+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a80063d0 auth_method 0 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:20.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.788+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a800cbf0 auth_method 0 2024-08-19T11:12:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:20.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:20.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:20.791+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 10 monclient(hunting): tick 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 msgr2=0x7fe8a800cfd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8a800cbf0 0x7fe8a800cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8a8009870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8a8009870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 msgr2=0x7fe8a800c390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.384+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> v2:172.21.15.71:3300/0 conn(0x7fe8a800d5b0 0x7fe8a800c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 10 monclient: _add_conns ranks=[7,1] 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-i con 0x7fe8a8006ab0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe8a8005d30 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a800dc80 con 0x7fe8a8005d30 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a4f90 con 0x7fe8a8006ab0 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8b9ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a8006ab0 auth_method 0 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 msgr2=0x7fe8a8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 msgr2=0x7fe8a8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.385+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:22.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.387+0000 7fe8bb7fe640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.135:6789/0 conn(0x7fe8a8005d30 legacy=0x7fe8a8012150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:22.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a8006ab0 auth_method 0 2024-08-19T11:12:22.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:22.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 msgr2=0x7fe8a8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:22.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 msgr2=0x7fe8a8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:22.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:22.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.586+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.776+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562945775 0 0) 0x7fe8a800dc80 con 0x7fe8a8005d30 2024-08-19T11:12:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.776+0000 7fe8baffd640 10 monclient(hunting): _negotiate 2024-08-19T11:12:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.776+0000 7fe8baffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.776+0000 7fe8baffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.776+0000 7fe8baffd640 10 monclient(hunting): my global_id is 4726 2024-08-19T11:12:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.776+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe89c003520 con 0x7fe8a8005d30 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 870074537 0 0) 0x7fe89c003520 con 0x7fe8a8005d30 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 msgr2=0x7fe8a8006e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe8a8006ab0 0x7fe8a8006e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: _finish_hunting 0 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 monclient: found mon.noname-f-legacy 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.135:6789/0 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc0a46f0 con 0x7fe8a8005d30 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7fe8a4017d10 con 0x7fe8a8005d30 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: dump: 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] but i'm connected to v1:172.21.15.135:6789/0, reconnecting 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 >> v1:172.21.15.135:6789/0 conn(0x7fe8a8005d30 legacy=0x7fe8a8012150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient: _add_conns ranks=[2,5,8,7,3,1,0,6,4] 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 1 -- 172.21.15.71:0/2836778092 reap_dead start 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe89c004200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): picked mon.b con 0x7fe8a80063d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe89c004900 0x7fe89c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): picked mon.h con 0x7fe89c004900 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe89c0099b0 0x7fe89c00bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): picked mon.e con 0x7fe89c0099b0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a4f90 con 0x7fe8a80063d0 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe89c00c4d0 con 0x7fe89c004900 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe89c00c680 con 0x7fe89c0099b0 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8baffd640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:12:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe89c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe8a80063d0 auth_method 0 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe89c0099b0 0x7fe89c00bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe89c0099b0 auth_method 0 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe89c004900 0x7fe89c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe89c004900 auth_method 0 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c089a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_done global_id 4726 payload 293 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe89c0099b0 msgr2=0x7fe89c00bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe89c0099b0 0x7fe89c00bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe89c004900 msgr2=0x7fe89c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe89c004900 0x7fe89c004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 monclient: found mon.b 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c003520 con 0x7fe8a80063d0 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient: _finish_auth 0 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c22fd640 5 monclient: authenticate success, global_id 4726 2024-08-19T11:12:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.780+0000 7fe8c22fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:22.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8bbfff640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe89c004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:22.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe89c004200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac003930 tx=0x7fe89c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=491f891a4647411e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:22.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe8ac038070 con 0x7fe8a80063d0 2024-08-19T11:12:22.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:22.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: dump: 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:22.797 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ac031a40 con 0x7fe8a80063d0 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8c22fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 1 -- 172.21.15.71:0/2836778092 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe8ac00f040 con 0x7fe8a80063d0 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8c22fd640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8c22fd640 4 set_mon_vals no callback set 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.783+0000 7fe8baffd640 10 monclient: dump: 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 10 monclient: shutdown 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 -- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe89c004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe89c004200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac003930 tx=0x7fe89c005830 comp rx=0 tx=0).stop 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 -- 172.21.15.71:0/2836778092 shutdown_connections 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe89c0099b0 0x7fe89c00bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe89c004900 0x7fe89c004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/2836778092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe89c004200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 -- 172.21.15.71:0/2836778092 >> 172.21.15.71:0/2836778092 conn(0x7fe8bc0ac030 msgr2=0x7fe8bc0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 -- 172.21.15.71:0/2836778092 shutdown_connections 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.784+0000 7fe8c22fd640 1 -- 172.21.15.71:0/2836778092 wait complete. 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.785+0000 7fe8c22fd640 10 monclient: build_initial_monmap 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.785+0000 7fe8c22fd640 10 monclient: monmap: 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.786+0000 7fe8c22fd640 1 Processor -- start 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.786+0000 7fe8c22fd640 1 -- start start 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.786+0000 7fe8c22fd640 10 monclient: init 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient: _add_conns ranks=[3,6,2,7,1,8,0,4,5] 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89c004900 0x7fe8bc1357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): picked mon.noname-g con 0x7fe89c004900 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe89c0099b0 0x7fe8bc135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): picked mon.noname-d con 0x7fe89c0099b0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8bc09f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): picked mon.noname-b con 0x7fe8a80063d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a5b80 con 0x7fe8a80063d0 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a5a00 con 0x7fe89c004900 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe8bc0a5d00 con 0x7fe89c0099b0 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c22fd640 10 monclient(hunting): authenticate will time out at 800.829294s 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8bc09f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8bc09f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60122/0 (socket says 172.21.15.71:60122) 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe89c0099b0 0x7fe8bc135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 -- 172.21.15.71:0/1862709668 learned_addr learned my addr 172.21.15.71:0/1862709668 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): get_auth_request con 0x7fe8a80063d0 auth_method 0 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request con 0x7fe89c0099b0 auth_method 0 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89c004900 0x7fe8bc1357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request con 0x7fe89c004900 auth_method 0 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient(hunting): handle_auth_done global_id 5015 payload 824 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 -- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe89c0099b0 msgr2=0x7fe8bc135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe89c0099b0 0x7fe8bc135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 -- 172.21.15.71:0/1862709668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89c004900 msgr2=0x7fe8bc1357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89c004900 0x7fe8bc1357b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient: _finish_hunting 0 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 monclient: found mon.noname-b 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8c089a640 1 -- 172.21.15.71:0/1862709668 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc122e90 con 0x7fe8a80063d0 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.787+0000 7fe8bb7fe640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe89c0099b0 0x7fe8bc135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c089a640 1 -- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8bc09f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c089a640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8bc09f930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0a8080 tx=0x7fe8b40046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe8b402b070 con 0x7fe8a80063d0 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: dump: 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b4009610 con 0x7fe8a80063d0 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 5 monclient: authenticate success, global_id 5015 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe8b4025cd0 con 0x7fe8a80063d0 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 10 monclient: _renew_subs 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc123170 con 0x7fe8a80063d0 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8ba7fc640 4 set_mon_vals no callback set 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8b8ff9640 10 monclient: dump: 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 10 monclient: _renew_subs 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.790+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc139f80 con 0x7fe8a80063d0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe8b4005d10 con 0x7fe8a80063d0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8c22fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8c22fd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8c22fd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc0a71f0 con 0x7fe8a80063d0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8b8ff9640 1 --2- 172.21.15.71:0/1862709668 >> v2:172.21.15.135:6800/726754104 conn(0x7fe8a8040190 0x7fe8a8042650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.791+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7fe8b4022040 con 0x7fe8a80063d0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.792+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/1862709668 >> v2:172.21.15.135:6800/726754104 conn(0x7fe8a8040190 0x7fe8a8042650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.792+0000 7fe8bbfff640 10 monclient: get_auth_request con 0x7fe8a8040190 auth_method 0 2024-08-19T11:12:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.794+0000 7fe8bbfff640 1 --2- 172.21.15.71:0/1862709668 >> v2:172.21.15.135:6800/726754104 conn(0x7fe8a8040190 0x7fe8a8042650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009100 tx=0x7fe8ac010040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.796+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fe8b4010040 con 0x7fe8a80063d0 2024-08-19T11:12:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.796+0000 7fe8b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:22.796+0000 7fe8b8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:23.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8c22fd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:23.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8c22fd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:23.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8c22fd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe8bc122c10 con 0x7fe8a80063d0 2024-08-19T11:12:23.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8b8ff9640 1 -- 172.21.15.71:0/1862709668 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3186 (secure 0 0 0) 0x7fe8b40255d0 con 0x7fe8a80063d0 2024-08-19T11:12:23.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8b8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:23.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.041+0000 7fe8b8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:23.044 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":36,"quorum":[1,2,3,4,5,6,7,8],"quorum_names":["f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 >> v2:172.21.15.135:6800/726754104 conn(0x7fe8a8040190 msgr2=0x7fe8a8042650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/1862709668 >> v2:172.21.15.135:6800/726754104 conn(0x7fe8a8040190 0x7fe8a8042650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009100 tx=0x7fe8ac010040 comp rx=0 tx=0).stop 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 10 monclient: shutdown 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 msgr2=0x7fe8bc09f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8bc09f930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0a8080 tx=0x7fe8b40046e0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 shutdown_connections 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/1862709668 >> v2:172.21.15.135:6800/726754104 conn(0x7fe8a8040190 0x7fe8a8042650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe89c0099b0 0x7fe8bc135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8a80063d0 0x7fe8bc09f930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 --2- 172.21.15.71:0/1862709668 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe89c004900 0x7fe8bc1357b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.043+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 >> 172.21.15.71:0/1862709668 conn(0x7fe8bc0ac030 msgr2=0x7fe8bc1390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.044+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 shutdown_connections 2024-08-19T11:12:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.044+0000 7fe8c22fd640 1 -- 172.21.15.71:0/1862709668 wait complete. 2024-08-19T11:12:23.057 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-19T11:12:23.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-19T11:12:23.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:12:23.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.153+0000 7fa00a314640 10 monclient: get_monmap_and_config 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.153+0000 7fa00a314640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.153+0000 7fa00a314640 10 monclient: monmap: 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:23.155311+0000 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:23.155311+0000 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.156 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:23.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.154+0000 7fa00a314640 1 Processor -- start 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.154+0000 7fa00a314640 1 -- start start 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.154+0000 7fa00a314640 10 monclient: init 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.154+0000 7fa00a314640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.154+0000 7fa00a314640 10 monclient: _add_conns ranks=[1,2,10,3,6,8,4,5,0,7,9] 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.154+0000 7fa00a314640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa0040a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 0x7fa00413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 10 monclient(hunting): picked mon.noname-b con 0x7fa0040a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa0040a7440 0x7fa0041410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 10 monclient(hunting): picked mon.noname-f con 0x7fa0040a7440 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040a6380 con 0x7fa0040a6950 2024-08-19T11:12:23.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa0040a5020 con 0x7fa0040a7440 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040a7d40 con 0x7fa0040a57c0 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa00a314640 10 monclient(hunting): authenticate will time out at 801.197089s 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 0x7fa00413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 0x7fa00413eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60134/0 (socket says 172.21.15.71:60134) 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 -- 172.21.15.71:0/2482262064 learned_addr learned my addr 172.21.15.71:0/2482262064 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): get_auth_request con 0x7fa0040a57c0 auth_method 0 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0088b1640 1 --2- 172.21.15.71:0/2482262064 >> v2:172.21.15.135:3300/0 conn(0x7fa0040a7440 0x7fa0041410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0088b1640 10 monclient(hunting): get_auth_request con 0x7fa0040a7440 auth_method 0 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0088b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0088b1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0088b1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient(hunting): handle_auth_done global_id 5024 payload 274 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 -- 172.21.15.71:0/2482262064 >> v2:172.21.15.135:3300/0 conn(0x7fa0040a7440 msgr2=0x7fa0041410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 --2- 172.21.15.71:0/2482262064 >> v2:172.21.15.135:3300/0 conn(0x7fa0040a7440 0x7fa0041410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 -- 172.21.15.71:0/2482262064 >> v1:172.21.15.135:6789/0 conn(0x7fa0040a6950 legacy=0x7fa0040a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 monclient: found mon.noname-b 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.155+0000 7fa0037fe640 1 -- 172.21.15.71:0/2482262064 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0040a3650 con 0x7fa0040a57c0 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa0037fe640 1 -- 172.21.15.71:0/2482262064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 msgr2=0x7fa00413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa0037fe640 1 --2- 172.21.15.71:0/2482262064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 0x7fa00413eb60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80098a0 tx=0x7f9ff802a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da01159d927683d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 1 -- 172.21.15.71:0/2482262064 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ff8037070 con 0x7fa0040a57c0 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: dump: 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 1 -- 172.21.15.71:0/2482262064 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff802adf0 con 0x7fa0040a57c0 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 5 monclient: authenticate success, global_id 5024 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 4 set_mon_vals no callback set 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 1 -- 172.21.15.71:0/2482262064 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ff8030c20 con 0x7fa0040a57c0 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa002ffd640 10 monclient: dump: 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 10 monclient: shutdown 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 -- 172.21.15.71:0/2482262064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 msgr2=0x7fa00413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 --2- 172.21.15.71:0/2482262064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 0x7fa00413eb60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80098a0 tx=0x7f9ff802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 -- 172.21.15.71:0/2482262064 shutdown_connections 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 --2- 172.21.15.71:0/2482262064 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0040a57c0 0x7fa00413eb60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 --2- 172.21.15.71:0/2482262064 >> v2:172.21.15.135:3300/0 conn(0x7fa0040a7440 0x7fa0041410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 -- 172.21.15.71:0/2482262064 >> 172.21.15.71:0/2482262064 conn(0x7fa0040abf50 msgr2=0x7fa0040ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 -- 172.21.15.71:0/2482262064 shutdown_connections 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.158+0000 7fa00a314640 1 -- 172.21.15.71:0/2482262064 wait complete. 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.159+0000 7fa00a314640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.159+0000 7fa00a314640 10 monclient: monmap: 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.159+0000 7fa00a314640 1 Processor -- start 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 -- start start 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient: init 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient: _add_conns ranks=[8,1,0,6,3,4,7,2,5] 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 0x7fa004128b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): picked mon.noname-e con 0x7fa0040a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:23.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0040a6950 0x7fa00413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): picked mon.noname-f con 0x7fa0040a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0040a7440 0x7fa004126520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): picked mon.noname-a con 0x7fa0040a7440 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040a8700 con 0x7fa0040a7440 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0040a84c0 con 0x7fa0040a6950 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa0041415f0 con 0x7fa0040a57c0 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa00a314640 10 monclient(hunting): authenticate will time out at 801.202492s 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa0088b1640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0040a7440 msgr2=0x7fa004126520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa0088b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0040a7440 0x7fa004126520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 0x7fa004128b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 0x7fa004128b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:33848/0 (socket says 172.21.15.71:33848) 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 -- 172.21.15.71:0/755894787 learned_addr learned my addr 172.21.15.71:0/755894787 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): get_auth_request con 0x7fa0040a57c0 auth_method 0 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient(hunting): handle_auth_done global_id 4868 payload 824 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0040a6950 msgr2=0x7fa00413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa0037fe640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0040a6950 0x7fa00413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0040a6950 0x7fa00413f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0040a7440 msgr2=0x7fa004126520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0040a7440 0x7fa004126520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 monclient: found mon.noname-e 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.160+0000 7fa003fff640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00412a340 con 0x7fa0040a57c0 2024-08-19T11:12:23.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa003fff640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 msgr2=0x7fa004128b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa003fff640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 0x7fa004128b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c430 tx=0x7f9ff400c8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ff4011c10 con 0x7fa0040a57c0 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: dump: 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.182 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4017070 con 0x7fa0040a57c0 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 5 monclient: authenticate success, global_id 4868 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ff4011df0 con 0x7fa0040a57c0 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa000ff9640 10 monclient: dump: 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa0027fc640 4 set_mon_vals no callback set 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 10 monclient: _renew_subs 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa004140d30 con 0x7fa0040a57c0 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 10 monclient: _renew_subs 2024-08-19T11:12:23.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.163+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0041294d0 con 0x7fa0040a57c0 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa00a314640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa00a314640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 0x7fa004126e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa004076c60 con 0x7fa004126a60 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9ff40117a0 con 0x7fa0040a57c0 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 0x7fa004126e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient: get_auth_request con 0x7fa004126a60 auth_method 0 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 10 monclient(hunting): handle_auth_done global_id 5033 payload 824 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0037fe640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa004127380 con 0x7fa004126a60 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa000ff9640 1 --2- 172.21.15.71:0/755894787 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ff003eab0 0x7f9ff0040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7f9ff4051b60 con 0x7fa0040a57c0 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0088b1640 1 --2- 172.21.15.71:0/755894787 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ff003eab0 0x7f9ff0040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.164+0000 7fa0088b1640 10 monclient: get_auth_request con 0x7f9ff003eab0 auth_method 0 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.166+0000 7fa0037fe640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 msgr2=0x7fa004126e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.166+0000 7fa0037fe640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 0x7fa004126e40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0040a2e70 tx=0x7f9ff80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.166+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ff8037050 con 0x7fa004126a60 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.166+0000 7fa000ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.166+0000 7fa000ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:23.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.166+0000 7fa000ff9640 10 monclient: dump: 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.188 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9ff8043070 con 0x7fa004126a60 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 msgr2=0x7fa004126e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 0x7fa004126e40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0040a2e70 tx=0x7f9ff80046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 msgr2=0x7fa004126e40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa000ff9640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa004126a60 0x7fa004126e40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.167+0000 7fa0088b1640 1 --2- 172.21.15.71:0/755894787 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ff003eab0 0x7f9ff0040f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009590 tx=0x7f9ffc009450 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa00a314640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa00a314640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 0x7fa004122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa00a314640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa0040a6d30 con 0x7fa0041225a0 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 0x7fa004122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient: get_auth_request con 0x7fa0041225a0 auth_method 0 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 10 monclient(hunting): handle_auth_done global_id 5042 payload 824 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.173+0000 7fa0037fe640 1 -- 172.21.15.71:0/755894787 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa0041cf2b0 con 0x7fa0041225a0 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.175+0000 7fa0037fe640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 msgr2=0x7fa004122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.175+0000 7fa0037fe640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 0x7fa004122980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.175+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ff803edb0 con 0x7fa0041225a0 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.175+0000 7fa000ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.175+0000 7fa000ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.175+0000 7fa000ff9640 10 monclient: dump: 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.191 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.193 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f9ff8038040 con 0x7fa0041225a0 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 msgr2=0x7fa004122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 0x7fa004122980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8008030 comp rx=0 tx=0).stop 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 msgr2=0x7fa004122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa000ff9640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0041225a0 0x7fa004122980 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8008030 comp rx=0 tx=0).stop 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 140055, 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:23.195 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.197 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:23.198 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:23.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.200 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:23.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:23.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:23.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:23.218 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ff003eab0 msgr2=0x7f9ff0040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 --2- 172.21.15.71:0/755894787 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ff003eab0 0x7f9ff0040f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009590 tx=0x7f9ffc009450 comp rx=0 tx=0).stop 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 10 monclient: shutdown 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 msgr2=0x7fa004128b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 --2- 172.21.15.71:0/755894787 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0040a57c0 0x7fa004128b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c430 tx=0x7f9ff400c8f0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa0088b1640 1 -- 172.21.15.71:0/755894787 reap_dead start 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa0088b1640 1 -- 172.21.15.71:0/755894787 reap_dead start 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 shutdown_connections 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 >> 172.21.15.71:0/755894787 conn(0x7fa0040abf50 msgr2=0x7fa00409f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 shutdown_connections 2024-08-19T11:12:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.176+0000 7fa00a314640 1 -- 172.21.15.71:0/755894787 wait complete. 2024-08-19T11:12:23.221 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:23.221 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-19T11:12:23.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:12:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.317+0000 7f23cb3c3640 10 monclient: get_monmap_and_config 2024-08-19T11:12:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.317+0000 7f23cb3c3640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.317+0000 7f23cb3c3640 10 monclient: monmap: 2024-08-19T11:12:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.320 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:23.319257+0000 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:23.319257+0000 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:23.322 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:23.322 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 Processor -- start 2024-08-19T11:12:23.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 -- start start 2024-08-19T11:12:23.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient: init 2024-08-19T11:12:23.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient: _add_conns ranks=[9,5,10,7,3,2,4,6,1,0,8] 2024-08-19T11:12:23.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f23c409b510 0x7f23c40a0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): picked mon.noname-a con 0x7f23c409b510 addr v2:172.21.15.71:3300/0 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 0x7f23c409b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): picked mon.noname-h con 0x7f23c40693a0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23c409be30 0x7f23c40a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): picked mon.noname-f con 0x7f23c409be30 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f23c40a5d60 con 0x7f23c409b510 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f23c409eb90 con 0x7f23c409be30 2024-08-19T11:12:23.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f23c409fa10 con 0x7f23c40693a0 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23c915f640 1 -- >> v2:172.21.15.71:3300/0 conn(0x7f23c409b510 msgr2=0x7f23c40a0460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23cb3c3640 10 monclient(hunting): authenticate will time out at 801.360984s 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.318+0000 7f23c915f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f23c409b510 0x7f23c40a0460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 0x7f23c409b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f23c409be30 0x7f23c40a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 0x7f23c409b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:57674/0 (socket says 172.21.15.71:57674) 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 1 -- 172.21.15.71:0/1327033052 learned_addr learned my addr 172.21.15.71:0/1327033052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): get_auth_request con 0x7f23c40693a0 auth_method 0 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): get_auth_request con 0x7f23c409be30 auth_method 0 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient(hunting): handle_auth_done global_id 4744 payload 274 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 -- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 msgr2=0x7f23c409b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 --2- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 0x7f23c409b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 -- 172.21.15.71:0/1327033052 >> v2:172.21.15.71:3300/0 conn(0x7f23c409b510 msgr2=0x7f23c40a0460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 --2- 172.21.15.71:0/1327033052 >> v2:172.21.15.71:3300/0 conn(0x7f23c409b510 0x7f23c40a0460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 monclient: found mon.noname-f 2024-08-19T11:12:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c9960640 1 -- 172.21.15.71:0/1327033052 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c409fcf0 con 0x7f23c409be30 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.319+0000 7f23c895e640 1 --2- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 0x7f23c409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23c9960640 1 -- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 msgr2=0x7f23c40a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23c9960640 1 --2- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 0x7f23c40a3d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f23c4069810 tx=0x7f23bc02a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d997e2979ef0ab1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 1 -- 172.21.15.71:0/1327033052 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23bc007bc0 con 0x7f23c409be30 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: dump: 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 1 -- 172.21.15.71:0/1327033052 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc007d80 con 0x7f23c409be30 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 1 -- 172.21.15.71:0/1327033052 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23bc031870 con 0x7f23c409be30 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23cb3c3640 5 monclient: authenticate success, global_id 4744 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23cb3c3640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23cb3c3640 4 set_mon_vals no callback set 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.322+0000 7f23bbfff640 10 monclient: dump: 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 10 monclient: shutdown 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 -- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 msgr2=0x7f23c40a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 0x7f23c40a3d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f23c4069810 tx=0x7f23bc02a4d0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 -- 172.21.15.71:0/1327033052 shutdown_connections 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 0x7f23c40a3d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/1327033052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23c40693a0 0x7f23c409b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/1327033052 >> v2:172.21.15.71:3300/0 conn(0x7f23c409b510 0x7f23c40a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 -- 172.21.15.71:0/1327033052 >> 172.21.15.71:0/1327033052 conn(0x7f23c40a4e70 msgr2=0x7f23c40a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 -- 172.21.15.71:0/1327033052 shutdown_connections 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 1 -- 172.21.15.71:0/1327033052 wait complete. 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.323+0000 7f23cb3c3640 10 monclient: monmap: 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 Processor -- start 2024-08-19T11:12:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 -- start start 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient: init 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient: _add_conns ranks=[7,8,1,2,6,3,4,5,0] 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23c40693a0 0x7f23c409c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): picked mon.noname-i con 0x7f23c40693a0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 0x7f23c409c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): picked mon.noname-e con 0x7f23c409b510 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 0x7f23c409cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): picked mon.noname-f con 0x7f23c409be30 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40a4690 con 0x7f23c409be30 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f23c40a4510 con 0x7f23c40693a0 2024-08-19T11:12:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f23c40a4810 con 0x7f23c409b510 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23cb3c3640 10 monclient(hunting): authenticate will time out at 801.366866s 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 0x7f23c409c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 0x7f23c409c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:33858/0 (socket says 172.21.15.71:33858) 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 1 -- 172.21.15.71:0/3157612270 learned_addr learned my addr 172.21.15.71:0/3157612270 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 10 monclient(hunting): get_auth_request con 0x7f23c409b510 auth_method 0 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.324+0000 7f23c895e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23c40693a0 0x7f23c409c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 0x7f23c409cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): get_auth_request con 0x7f23c40693a0 auth_method 0 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): get_auth_request con 0x7f23c409be30 auth_method 0 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c9960640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 10 monclient(hunting): handle_auth_done global_id 4877 payload 824 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23c40693a0 msgr2=0x7f23c409c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23c40693a0 0x7f23c409c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 msgr2=0x7f23c409cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23c409be30 0x7f23c409cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 1 monclient: found mon.noname-e 2024-08-19T11:12:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.325+0000 7f23c895e640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4099730 con 0x7f23c409b510 2024-08-19T11:12:23.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23c895e640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 msgr2=0x7f23c409c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23c895e640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 0x7f23c409c8b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23b400ea30 tx=0x7f23b400ee30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23b4017070 con 0x7f23c409b510 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: dump: 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.349 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b400cc10 con 0x7f23c409b510 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 5 monclient: authenticate success, global_id 4877 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 10 monclient: _renew_subs 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c4096ff0 con 0x7f23c409b510 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23b400cdc0 con 0x7f23c409b510 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23b9ffb640 10 monclient: dump: 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.351 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.352 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 10 monclient: _renew_subs 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23bb7fe640 4 set_mon_vals no callback set 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.327+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c409d9b0 con 0x7f23c409b510 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f23b401a070 con 0x7f23c409b510 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23cb3c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 0x7f23c41ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f23c406a590 con 0x7f23c4097d20 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 0x7f23c41ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient: get_auth_request con 0x7f23c4097d20 auth_method 0 2024-08-19T11:12:23.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23b9ffb640 1 --2- 172.21.15.71:0/3157612270 >> v2:172.21.15.135:6800/726754104 conn(0x7f23a803ea80 0x7f23a8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.328+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(57..57 src has 1..57) ==== 3898+0+0 (secure 0 0 0) 0x7f23b400f040 con 0x7f23c409b510 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.329+0000 7f23c915f640 10 monclient(hunting): handle_auth_done global_id 4828 payload 824 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.329+0000 7f23c915f640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23c40a0460 con 0x7f23c4097d20 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.329+0000 7f23c9960640 1 --2- 172.21.15.71:0/3157612270 >> v2:172.21.15.135:6800/726754104 conn(0x7f23a803ea80 0x7f23a8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.329+0000 7f23c9960640 10 monclient: get_auth_request con 0x7f23a803ea80 auth_method 0 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23c915f640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 msgr2=0x7f23c41ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23c915f640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 0x7f23c41ce300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009610 tx=0x7f23c0009ad0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23c0016070 con 0x7f23c4097d20 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 10 monclient: dump: 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23c9960640 1 --2- 172.21.15.71:0/3157612270 >> v2:172.21.15.135:6800/726754104 conn(0x7f23a803ea80 0x7f23a8040f40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f23bc034000 tx=0x7f23bc02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f23c00128f0 con 0x7f23c4097d20 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 msgr2=0x7f23c41ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 0x7f23c41ce300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009610 tx=0x7f23c0009ad0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 msgr2=0x7f23c41ce300 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.331+0000 7f23b9ffb640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c4097d20 0x7f23c41ce300 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009610 tx=0x7f23c0009ad0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23cb3c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 0x7f23c41cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23cb3c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f23c41cf190 con 0x7f23c41ce840 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 0x7f23c41cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient: get_auth_request con 0x7f23c41ce840 auth_method 0 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.337+0000 7f23c915f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.338+0000 7f23c915f640 10 monclient(hunting): handle_auth_done global_id 4837 payload 824 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.338+0000 7f23c915f640 1 -- 172.21.15.71:0/3157612270 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23c406e5c0 con 0x7f23c41ce840 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23c915f640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 msgr2=0x7f23c41cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23c915f640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 0x7f23c41cec50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23c0017000 tx=0x7f23c00059d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23c0016040 con 0x7f23c41ce840 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 10 monclient: dump: 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9423 (secure 0 0 0) 0x7f23c0006030 con 0x7f23c41ce840 2024-08-19T11:12:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 msgr2=0x7f23c41cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 0x7f23c41cec50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23c0017000 tx=0x7f23c00059d0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 msgr2=0x7f23c41cec50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.340+0000 7f23b9ffb640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23c41ce840 0x7f23c41cec50 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23c0017000 tx=0x7f23c00059d0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 140211, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:23.385 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:23.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 >> v2:172.21.15.135:6800/726754104 conn(0x7f23a803ea80 msgr2=0x7f23a8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/3157612270 >> v2:172.21.15.135:6800/726754104 conn(0x7f23a803ea80 0x7f23a8040f40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f23bc034000 tx=0x7f23bc02f000 comp rx=0 tx=0).stop 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 10 monclient: shutdown 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 msgr2=0x7f23c409c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 0x7f23c409c8b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f23b400ea30 tx=0x7f23b400ee30 comp rx=0 tx=0).stop 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23c9960640 1 -- 172.21.15.71:0/3157612270 reap_dead start 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 shutdown_connections 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 --2- 172.21.15.71:0/3157612270 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23c409b510 0x7f23c409c8b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 >> 172.21.15.71:0/3157612270 conn(0x7f23c40a4e70 msgr2=0x7f23c40a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 shutdown_connections 2024-08-19T11:12:23.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.341+0000 7f23cb3c3640 1 -- 172.21.15.71:0/3157612270 wait complete. 2024-08-19T11:12:23.388 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:23.388 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-08-19T11:12:23.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:12:23.398 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:23.398 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24553]: starting. 2024-08-19T11:12:23.398 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24553]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24517 2024-08-19T11:12:23.398 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24553]: shutting down. 2024-08-19T11:12:23.399 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:23.399 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:23.399 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:12:23.402 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.485+0000 7f83f6884640 10 monclient: get_monmap_and_config 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.485+0000 7f83f6884640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.486+0000 7f83f6884640 10 monclient: monmap: 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:23.487647+0000 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:23.487647+0000 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:23.488 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:23.489 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.486+0000 7f83f6884640 1 Processor -- start 2024-08-19T11:12:23.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.486+0000 7f83f6884640 1 -- start start 2024-08-19T11:12:23.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.486+0000 7f83f6884640 10 monclient: init 2024-08-19T11:12:23.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient: _add_conns ranks=[8,5,3,7,6,9,4,0,10,2,1] 2024-08-19T11:12:23.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 0x7f83f00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): picked mon.noname-e con 0x7f83f00a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83f00a57c0 0x7f83f00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): picked mon.noname-h con 0x7f83f00a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83f0139710 0x7f83f0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): picked mon.noname-g con 0x7f83f0139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f83f00a5020 con 0x7f83f0139710 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f83f00a77b0 con 0x7f83f00a57c0 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f83f00a7d40 con 0x7f83f00a6950 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f6884640 10 monclient(hunting): authenticate will time out at 801.529328s 2024-08-19T11:12:23.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 0x7f83f00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 0x7f83f00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:33860/0 (socket says 172.21.15.71:33860) 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 -- 172.21.15.71:0/4187863646 learned_addr learned my addr 172.21.15.71:0/4187863646 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): get_auth_request con 0x7f83f00a6950 auth_method 0 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83f0139710 0x7f83f0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83f00a57c0 0x7f83f00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): get_auth_request con 0x7f83f0139710 auth_method 0 2024-08-19T11:12:23.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): get_auth_request con 0x7f83f00a57c0 auth_method 0 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83f4e21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient(hunting): handle_auth_done global_id 4895 payload 274 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 -- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83f00a57c0 msgr2=0x7f83f00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83f00a57c0 0x7f83f00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 -- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83f0139710 msgr2=0x7f83f0139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83f0139710 0x7f83f0139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 monclient: found mon.noname-e 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.487+0000 7f83effff640 1 -- 172.21.15.71:0/4187863646 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f00a6380 con 0x7f83f00a6950 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83effff640 1 -- 172.21.15.71:0/4187863646 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 msgr2=0x7f83f00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83effff640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 0x7f83f00a6d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e002a080 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b7f43796a50d2088 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 1 -- 172.21.15.71:0/4187863646 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83e0037070 con 0x7f83f00a6950 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: dump: 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 1 -- 172.21.15.71:0/4187863646 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e002ade0 con 0x7f83f00a6950 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83f6884640 5 monclient: authenticate success, global_id 4895 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83f6884640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83f6884640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 1 -- 172.21.15.71:0/4187863646 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83e0030c20 con 0x7f83f00a6950 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83f6884640 4 set_mon_vals no callback set 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.490+0000 7f83eeffd640 10 monclient: dump: 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.502 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 10 monclient: shutdown 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 -- 172.21.15.71:0/4187863646 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 msgr2=0x7f83f00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 0x7f83f00a6d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e002a080 comp rx=0 tx=0).stop 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 -- 172.21.15.71:0/4187863646 shutdown_connections 2024-08-19T11:12:23.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f83f0139710 0x7f83f0139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83f00a57c0 0x7f83f00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 --2- 172.21.15.71:0/4187863646 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f83f00a6950 0x7f83f00a6d30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 -- 172.21.15.71:0/4187863646 >> 172.21.15.71:0/4187863646 conn(0x7f83f00abf50 msgr2=0x7f83f00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 -- 172.21.15.71:0/4187863646 shutdown_connections 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 1 -- 172.21.15.71:0/4187863646 wait complete. 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.491+0000 7f83f6884640 10 monclient: monmap: 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 Processor -- start 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 -- start start 2024-08-19T11:12:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient: init 2024-08-19T11:12:23.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient: _add_conns ranks=[0,7,2,8,6,1,4,3,5] 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83f00a57c0 0x7f83f01ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): picked mon.noname-a con 0x7f83f00a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83f00a6950 0x7f83f01389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): picked mon.noname-i con 0x7f83f00a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 0x7f83f0138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): picked mon.noname-b con 0x7f83f0139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f83f00a84c0 con 0x7f83f00a57c0 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f83f00a3650 con 0x7f83f0139710 2024-08-19T11:12:23.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f83f00a8700 con 0x7f83f00a6950 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83f6884640 10 monclient(hunting): authenticate will time out at 801.534943s 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83effff640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83f00a57c0 msgr2=0x7f83f01ce300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.492+0000 7f83effff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83f00a57c0 0x7f83f01ce300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 0x7f83f0138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 0x7f83f0138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60162/0 (socket says 172.21.15.71:60162) 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 -- 172.21.15.71:0/3220911932 learned_addr learned my addr 172.21.15.71:0/3220911932 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): get_auth_request con 0x7f83f0139710 auth_method 0 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83f00a6950 0x7f83f01389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): get_auth_request con 0x7f83f00a6950 auth_method 0 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient(hunting): handle_auth_done global_id 5060 payload 824 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83f00a6950 msgr2=0x7f83f01389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83f00a6950 0x7f83f01389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83f00a57c0 msgr2=0x7f83f01ce300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83f00a57c0 0x7f83f01ce300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 monclient: found mon.noname-b 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.493+0000 7f83f4e21640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f0125af0 con 0x7f83f0139710 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83f4e21640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 msgr2=0x7f83f0138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83f4e21640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 0x7f83f0138f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83e800efc0 tx=0x7f83e800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83e8018020 con 0x7f83f0139710 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: dump: 2024-08-19T11:12:23.516 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.517 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e80148f0 con 0x7f83f0139710 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83f6884640 5 monclient: authenticate success, global_id 5060 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83f6884640 10 monclient: _renew_subs 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83e8009e60 con 0x7f83f0139710 2024-08-19T11:12:23.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83f6884640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f013a360 con 0x7f83f0139710 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ecff9640 10 monclient: dump: 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.519 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.495+0000 7f83ee7fc640 4 set_mon_vals no callback set 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 10 monclient: _renew_subs 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f0126390 con 0x7f83f0139710 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 0x7f83f002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.496+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f83f0076c60 con 0x7f83f0122d60 2024-08-19T11:12:23.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f83e8005d10 con 0x7f83f0139710 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 0x7f83f002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient: get_auth_request con 0x7f83f0122d60 auth_method 0 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83ecff9640 1 --2- 172.21.15.71:0/3220911932 >> v2:172.21.15.135:6800/726754104 conn(0x7f83dc03ea80 0x7f83dc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 10 monclient(hunting): handle_auth_done global_id 24351 payload 824 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 3506+0+0 (secure 0 0 0) 0x7f83e80526b0 con 0x7f83f0139710 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83effff640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83f00a6d30 con 0x7f83f0122d60 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83ef7fe640 1 --2- 172.21.15.71:0/3220911932 >> v2:172.21.15.135:6800/726754104 conn(0x7f83dc03ea80 0x7f83dc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.497+0000 7f83ef7fe640 10 monclient: get_auth_request con 0x7f83dc03ea80 auth_method 0 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.499+0000 7f83effff640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 msgr2=0x7f83f002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.499+0000 7f83effff640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 0x7f83f002d1c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83e0034000 tx=0x7f83e00046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.499+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83e0037030 con 0x7f83f0122d60 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.499+0000 7f83ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.499+0000 7f83ecff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.499+0000 7f83ecff9640 10 monclient: dump: 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.522 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.523 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f83e0038040 con 0x7f83f0122d60 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 msgr2=0x7f83f002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 0x7f83f002d1c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83e0034000 tx=0x7f83e00046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 msgr2=0x7f83f002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ecff9640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0122d60 0x7f83f002d1c0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83e0034000 tx=0x7f83e00046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.500+0000 7f83ef7fe640 1 --2- 172.21.15.71:0/3220911932 >> v2:172.21.15.135:6800/726754104 conn(0x7f83dc03ea80 0x7f83dc040f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83f01246a0 tx=0x7f83e4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83f6884640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83f6884640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 0x7f83f002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83f6884640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f83f009e100 con 0x7f83f0123140 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 0x7f83f002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient: get_auth_request con 0x7f83f0123140 auth_method 0 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 10 monclient(hunting): handle_auth_done global_id 24360 payload 824 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.506+0000 7f83effff640 1 -- 172.21.15.71:0/3220911932 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83f01ce840 con 0x7f83f0123140 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.508+0000 7f83effff640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 msgr2=0x7f83f002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.508+0000 7f83effff640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 0x7f83f002d700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e0009240 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.508+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f83e0049030 con 0x7f83f0123140 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.508+0000 7f83ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.508+0000 7f83ecff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.508+0000 7f83ecff9640 10 monclient: dump: 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.526 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9255 (secure 0 0 0) 0x7f83e0030ae0 con 0x7f83f0123140 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 msgr2=0x7f83f002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 0x7f83f002d700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e0009240 comp rx=0 tx=0).stop 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 msgr2=0x7f83f002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83ecff9640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83f0123140 0x7f83f002d700 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e0009240 comp rx=0 tx=0).stop 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 51123, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:23.550 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 >> v2:172.21.15.135:6800/726754104 conn(0x7f83dc03ea80 msgr2=0x7f83dc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 --2- 172.21.15.71:0/3220911932 >> v2:172.21.15.135:6800/726754104 conn(0x7f83dc03ea80 0x7f83dc040f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f83f01246a0 tx=0x7f83e4009190 comp rx=0 tx=0).stop 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 10 monclient: shutdown 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 msgr2=0x7f83f0138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f4e21640 1 -- 172.21.15.71:0/3220911932 reap_dead start 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 0x7f83f0138f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f83e800efc0 tx=0x7f83e800c490 comp rx=0 tx=0).stop 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 shutdown_connections 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 --2- 172.21.15.71:0/3220911932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f83f0139710 0x7f83f0138f10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 >> 172.21.15.71:0/3220911932 conn(0x7f83f00abf50 msgr2=0x7f83f00aab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 shutdown_connections 2024-08-19T11:12:23.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.509+0000 7f83f6884640 1 -- 172.21.15.71:0/3220911932 wait complete. 2024-08-19T11:12:23.553 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:23.553 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-08-19T11:12:23.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.651+0000 7f8eba9e9640 10 monclient: get_monmap_and_config 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.651+0000 7f8eba9e9640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.651+0000 7f8eba9e9640 10 monclient: monmap: 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:23.652869+0000 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:23.652869+0000 2024-08-19T11:12:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:23.654 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.651+0000 7f8eba9e9640 1 Processor -- start 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 1 -- start start 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient: init 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient: _add_conns ranks=[6,0,2,7,10,4,9,1,3,8,5] 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb40a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): picked mon.noname-d con 0x7f8eb40a3cb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8eb40a5020 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 0x7f8eb413a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): picked mon.noname-b con 0x7f8eb40a45d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb40a4da0 con 0x7f8eb40a5020 2024-08-19T11:12:23.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40a13d0 con 0x7f8eb40a45d0 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f8eb4074530 con 0x7f8eb40a3cb0 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eba9e9640 10 monclient(hunting): authenticate will time out at 801.694570s 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb37fe640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7f8eb40a5020 legacy=0x7f8eb4139970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 0x7f8eb413a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb40a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 0x7f8eb413a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60168/0 (socket says 172.21.15.71:60168) 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 1 -- 172.21.15.71:0/936136881 learned_addr learned my addr 172.21.15.71:0/936136881 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): get_auth_request con 0x7f8eb40a3cb0 auth_method 0 2024-08-19T11:12:23.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): get_auth_request con 0x7f8eb40a45d0 auth_method 0 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_done global_id 24369 payload 274 2024-08-19T11:12:23.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 1 -- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 msgr2=0x7f8eb413a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 0x7f8eb413a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 1 -- 172.21.15.71:0/936136881 >> v1:172.21.15.71:6789/0 conn(0x7f8eb40a5020 legacy=0x7f8eb4139970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 1 monclient: found mon.noname-d 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb3fff640 1 -- 172.21.15.71:0/936136881 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb40a0b30 con 0x7f8eb40a3cb0 2024-08-19T11:12:23.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.652+0000 7f8eb8f86640 1 --2- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 0x7f8eb413a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:23.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb3fff640 1 -- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 msgr2=0x7f8eb40a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb40a4090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009800 tx=0x7f8ea4029fe0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1f15b0e615cb77ab server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 1 -- 172.21.15.71:0/936136881 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ea4037070 con 0x7f8eb40a3cb0 2024-08-19T11:12:23.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: dump: 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.668 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 1 -- 172.21.15.71:0/936136881 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea402ad00 con 0x7f8eb40a3cb0 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eba9e9640 5 monclient: authenticate success, global_id 24369 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eba9e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eba9e9640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:23.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eba9e9640 4 set_mon_vals no callback set 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 1 -- 172.21.15.71:0/936136881 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ea4030c20 con 0x7f8eb40a3cb0 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.655+0000 7f8eb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eb2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eb2ffd640 10 monclient: dump: 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.670 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 10 monclient: shutdown 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 -- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 msgr2=0x7f8eb40a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb40a4090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009800 tx=0x7f8ea4029fe0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 -- 172.21.15.71:0/936136881 shutdown_connections 2024-08-19T11:12:23.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a45d0 0x7f8eb413a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/936136881 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb40a4090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 -- 172.21.15.71:0/936136881 >> 172.21.15.71:0/936136881 conn(0x7f8eb40a91d0 msgr2=0x7f8eb40a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 -- 172.21.15.71:0/936136881 shutdown_connections 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.656+0000 7f8eba9e9640 1 -- 172.21.15.71:0/936136881 wait complete. 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.657+0000 7f8eba9e9640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.657+0000 7f8eba9e9640 10 monclient: monmap: 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:23.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.657+0000 7f8eba9e9640 1 Processor -- start 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.657+0000 7f8eba9e9640 1 -- start start 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.657+0000 7f8eba9e9640 10 monclient: init 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient: _add_conns ranks=[7,6,2,1,3,4,8,5,0] 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb41cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): picked mon.noname-i con 0x7f8eb40a3cb0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a45d0 0x7f8eb41cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): picked mon.noname-d con 0x7f8eb40a45d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 0x7f8eb4126250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): picked mon.noname-b con 0x7f8eb40a5020 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40a54f0 con 0x7f8eb40a5020 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f8eb406cb70 con 0x7f8eb40a45d0 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8eb413a5c0 con 0x7f8eb40a3cb0 2024-08-19T11:12:23.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eba9e9640 10 monclient(hunting): authenticate will time out at 801.700192s 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a45d0 0x7f8eb41cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 0x7f8eb4126250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 0x7f8eb4126250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60170/0 (socket says 172.21.15.71:60170) 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a45d0 0x7f8eb41cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:59660/0 (socket says 172.21.15.71:59660) 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 learned_addr learned my addr 172.21.15.71:0/2213207951 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): get_auth_request con 0x7f8eb40a5020 auth_method 0 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): get_auth_request con 0x7f8eb40a45d0 auth_method 0 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb41cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb3fff640 10 monclient(hunting): get_auth_request con 0x7f8eb40a3cb0 auth_method 0 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient(hunting): handle_auth_done global_id 5078 payload 824 2024-08-19T11:12:23.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8eb40a3cb0 msgr2=0x7f8eb41cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8eb40a3cb0 0x7f8eb41cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a45d0 msgr2=0x7f8eb41cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a45d0 0x7f8eb41cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 monclient: found mon.noname-b 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb4129d70 con 0x7f8eb40a5020 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.658+0000 7f8eb37fe640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8eb40a45d0 0x7f8eb41cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 msgr2=0x7f8eb4126250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb8f86640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 0x7f8eb4126250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00efc0 tx=0x7f8eac00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8eac00cdf0 con 0x7f8eb40a5020 2024-08-19T11:12:23.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 10 monclient: dump: 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac0148f0 con 0x7f8eb40a5020 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.660+0000 7f8eba9e9640 5 monclient: authenticate success, global_id 5078 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 10 monclient: _renew_subs 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb412a050 con 0x7f8eb40a5020 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb0ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8eac0073f0 con 0x7f8eb40a5020 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb0ff9640 10 monclient: dump: 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.680 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb27fc640 4 set_mon_vals no callback set 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 10 monclient: _renew_subs 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb40737f0 con 0x7f8eb40a5020 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 0x7f8eb4126b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8eb4076c60 con 0x7f8eb4126790 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.661+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8eac01b070 con 0x7f8eb40a5020 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 0x7f8eb4126b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient: get_auth_request con 0x7f8eb4126790 auth_method 0 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb0ff9640 1 --2- 172.21.15.71:0/2213207951 >> v2:172.21.15.135:6800/726754104 conn(0x7f8e9403ea80 0x7f8e94040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_done global_id 4904 payload 824 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 3506+0+0 (secure 0 0 0) 0x7f8eac019020 con 0x7f8eb40a5020 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb3fff640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8eb40732a0 con 0x7f8eb4126790 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb37fe640 1 --2- 172.21.15.71:0/2213207951 >> v2:172.21.15.135:6800/726754104 conn(0x7f8e9403ea80 0x7f8e94040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.662+0000 7f8eb37fe640 10 monclient: get_auth_request con 0x7f8e9403ea80 auth_method 0 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb3fff640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 msgr2=0x7f8eb4126b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 0x7f8eb4126b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4034000 tx=0x7f8ea40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ea4041070 con 0x7f8eb4126790 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 10 monclient: dump: 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.683 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.684 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb37fe640 1 --2- 172.21.15.71:0/2213207951 >> v2:172.21.15.135:6800/726754104 conn(0x7f8e9403ea80 0x7f8e94040f40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41279b0 tx=0x7f8e9c0090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8ea4003a30 con 0x7f8eb4126790 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 msgr2=0x7f8eb4126b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 0x7f8eb4126b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4034000 tx=0x7f8ea40046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 msgr2=0x7f8eb4126b70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.664+0000 7f8eb0ff9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb4126790 0x7f8eb4126b70 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4034000 tx=0x7f8ea40046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eba9e9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 0x7f8eb409da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eba9e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8eb40a4090 con 0x7f8eb41270b0 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 0x7f8eb409da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient: get_auth_request con 0x7f8eb41270b0 auth_method 0 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 10 monclient(hunting): handle_auth_done global_id 4913 payload 824 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.671+0000 7f8eb3fff640 1 -- 172.21.15.71:0/2213207951 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8eb4127cf0 con 0x7f8eb41270b0 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb3fff640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 msgr2=0x7f8eb409da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb3fff640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 0x7f8eb409da00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ea402a020 tx=0x7f8ea4009190 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ea4037040 con 0x7f8eb41270b0 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 10 monclient: dump: 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.688 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f8ea4047e10 con 0x7f8eb41270b0 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 msgr2=0x7f8eb409da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 0x7f8eb409da00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ea402a020 tx=0x7f8ea4009190 comp rx=0 tx=0).stop 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 msgr2=0x7f8eb409da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.673+0000 7f8eb0ff9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8eb41270b0 0x7f8eb409da00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:23.690 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 140544, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:12:23.691 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.692 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:23.694 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.695 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:23.696 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:23.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.700 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.705 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:23.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:23.712 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 >> v2:172.21.15.135:6800/726754104 conn(0x7f8e9403ea80 msgr2=0x7f8e94040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/2213207951 >> v2:172.21.15.135:6800/726754104 conn(0x7f8e9403ea80 0x7f8e94040f40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8eb41279b0 tx=0x7f8e9c0090e0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 10 monclient: shutdown 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 msgr2=0x7f8eb4126250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 --2- 172.21.15.71:0/2213207951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8eb40a5020 0x7f8eb4126250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00efc0 tx=0x7f8eac00c490 comp rx=0 tx=0).stop 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 reap_dead start 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eb8f86640 1 -- 172.21.15.71:0/2213207951 reap_dead start 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 shutdown_connections 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 >> 172.21.15.71:0/2213207951 conn(0x7f8eb40a91d0 msgr2=0x7f8eb40a74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 shutdown_connections 2024-08-19T11:12:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.674+0000 7f8eba9e9640 1 -- 172.21.15.71:0/2213207951 wait complete. 2024-08-19T11:12:23.715 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:23.715 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-19T11:12:23.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:12:23.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.811+0000 7fa8448c5640 10 monclient: get_monmap_and_config 2024-08-19T11:12:23.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.811+0000 7fa8448c5640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.811+0000 7fa8448c5640 10 monclient: monmap: 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:23.813211+0000 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:23.813211+0000 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.814 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:23.815 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 Processor -- start 2024-08-19T11:12:23.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 -- start start 2024-08-19T11:12:23.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient: init 2024-08-19T11:12:23.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient: _add_conns ranks=[5,0,4,6,9,8,10,2,1,7,3] 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8400a3cd0 0x7fa8400a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): picked mon.noname-h con 0x7fa8400a3cd0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8400a40b0 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 0x7fa8401410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): picked mon.noname-c con 0x7fa84013ed00 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8400a0ae0 con 0x7fa8400a40b0 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa8400a1410 con 0x7fa84013ed00 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa8400a0dc0 con 0x7fa8400a3cd0 2024-08-19T11:12:23.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa835d9b640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7fa8400a40b0 legacy=0x7fa8400a44d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa8448c5640 10 monclient(hunting): authenticate will time out at 801.854860s 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.812+0000 7fa83ed9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 0x7fa8401410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 0x7fa8401410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:42786/0 (socket says 172.21.15.71:42786) 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 -- 172.21.15.71:0/3261468399 learned_addr learned my addr 172.21.15.71:0/3261468399 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): get_auth_request con 0x7fa84013ed00 auth_method 0 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83e59c640 1 --2- 172.21.15.71:0/3261468399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8400a3cd0 0x7fa8400a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83e59c640 10 monclient(hunting): get_auth_request con 0x7fa8400a3cd0 auth_method 0 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_done global_id 4864 payload 274 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 -- 172.21.15.71:0/3261468399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8400a3cd0 msgr2=0x7fa8400a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 --2- 172.21.15.71:0/3261468399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8400a3cd0 0x7fa8400a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 -- 172.21.15.71:0/3261468399 >> v1:172.21.15.71:6789/0 conn(0x7fa8400a40b0 legacy=0x7fa8400a44d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 monclient: found mon.noname-c 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:12:23.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.813+0000 7fa83ed9d640 1 -- 172.21.15.71:0/3261468399 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8400a10a0 con 0x7fa84013ed00 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.815+0000 7fa83ed9d640 1 -- 172.21.15.71:0/3261468399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 msgr2=0x7fa8401410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83ed9d640 1 --2- 172.21.15.71:0/3261468399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 0x7fa8401410f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e80 tx=0x7fa83802a530 comp rx=0 tx=0).ready entity=mon.4 client_cookie=f2cc26f9a6f8bbce server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 1 -- 172.21.15.71:0/3261468399 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa838036070 con 0x7fa84013ed00 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: dump: 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.826 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 1 -- 172.21.15.71:0/3261468399 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838007a70 con 0x7fa84013ed00 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 5 monclient: authenticate success, global_id 4864 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 1 -- 172.21.15.71:0/3261468399 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa838007ca0 con 0x7fa84013ed00 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 4 set_mon_vals no callback set 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa83dd9b640 10 monclient: dump: 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.829 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 10 monclient: shutdown 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 -- 172.21.15.71:0/3261468399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 msgr2=0x7fa8401410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 --2- 172.21.15.71:0/3261468399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 0x7fa8401410f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e80 tx=0x7fa83802a530 comp rx=0 tx=0).stop 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 -- 172.21.15.71:0/3261468399 shutdown_connections 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 --2- 172.21.15.71:0/3261468399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa84013ed00 0x7fa8401410f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 --2- 172.21.15.71:0/3261468399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8400a3cd0 0x7fa8400a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 -- 172.21.15.71:0/3261468399 >> 172.21.15.71:0/3261468399 conn(0x7fa8400a91d0 msgr2=0x7fa8400a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 -- 172.21.15.71:0/3261468399 shutdown_connections 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.816+0000 7fa8448c5640 1 -- 172.21.15.71:0/3261468399 wait complete. 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.817+0000 7fa8448c5640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.817+0000 7fa8448c5640 10 monclient: monmap: 2024-08-19T11:12:23.830 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.831 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 Processor -- start 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 -- start start 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient: init 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient: _add_conns ranks=[6,4,3,0,1,5,8,7,2] 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 0x7fa84013b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): picked mon.noname-d con 0x7fa8400a3cd0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:23.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8400a40b0 0x7fa84013bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): picked mon.noname-c con 0x7fa8400a40b0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84013ed00 0x7fa84013c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): picked mon.noname-g con 0x7fa84013ed00 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400a1f40 con 0x7fa84013ed00 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa8400a1dc0 con 0x7fa8400a40b0 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa840141630 con 0x7fa8400a3cd0 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa8448c5640 10 monclient(hunting): authenticate will time out at 801.860572s 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 0x7fa84013b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8400a40b0 0x7fa84013bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 0x7fa84013b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:59664/0 (socket says 172.21.15.71:59664) 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 -- 172.21.15.71:0/404796843 learned_addr learned my addr 172.21.15.71:0/404796843 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): get_auth_request con 0x7fa8400a3cd0 auth_method 0 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): get_auth_request con 0x7fa8400a40b0 auth_method 0 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84013ed00 0x7fa84013c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): get_auth_request con 0x7fa84013ed00 auth_method 0 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient(hunting): handle_auth_done global_id 24387 payload 824 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8400a40b0 msgr2=0x7fa84013bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8400a40b0 0x7fa84013bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84013ed00 msgr2=0x7fa84013c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa84013ed00 0x7fa84013c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 monclient: found mon.noname-d 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:23.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa83e59c640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa840124040 con 0x7fa8400a3cd0 2024-08-19T11:12:23.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.818+0000 7fa835d9b640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8400a40b0 0x7fa84013bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:23.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa83e59c640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 msgr2=0x7fa84013b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa83e59c640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 0x7fa84013b700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa83000d800 tx=0x7fa83000dcc0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa83000bd40 con 0x7fa8400a3cd0 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: dump: 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.842 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.843 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 5 monclient: authenticate success, global_id 24387 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa830019070 con 0x7fa8400a3cd0 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 10 monclient: _renew_subs 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8400a59a0 con 0x7fa8400a3cd0 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8300148a0 con 0x7fa8400a3cd0 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa83d59a640 4 set_mon_vals no callback set 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8377fe640 10 monclient: dump: 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.845 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 10 monclient: _renew_subs 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.821+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84013e6b0 con 0x7fa8400a3cd0 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8448c5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8448c5640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 0x7fa8401ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa840076c60 con 0x7fa8401ce540 2024-08-19T11:12:23.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa830014430 con 0x7fa8400a3cd0 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 0x7fa8401ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient: get_auth_request con 0x7fa8401ce540 auth_method 0 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8377fe640 1 --2- 172.21.15.71:0/404796843 >> v2:172.21.15.135:6800/726754104 conn(0x7fa82003ea80 0x7fa820040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(58..58 src has 1..58) ==== 3506+0+0 (secure 0 0 0) 0x7fa83000f040 con 0x7fa8400a3cd0 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 10 monclient(hunting): handle_auth_done global_id 4780 payload 824 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa83ed9d640 1 --2- 172.21.15.71:0/404796843 >> v2:172.21.15.135:6800/726754104 conn(0x7fa82003ea80 0x7fa820040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa835d9b640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8400a1880 con 0x7fa8401ce540 2024-08-19T11:12:23.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.822+0000 7fa83ed9d640 10 monclient: get_auth_request con 0x7fa82003ea80 auth_method 0 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa835d9b640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 msgr2=0x7fa8401ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa835d9b640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 0x7fa8401ce920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8400a4d40 tx=0x7fa828005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa828016070 con 0x7fa8401ce540 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa83ed9d640 1 --2- 172.21.15.71:0/404796843 >> v2:172.21.15.135:6800/726754104 conn(0x7fa82003ea80 0x7fa820040f40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa838033000 tx=0x7fa838009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 10 monclient: dump: 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.848 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa82800ecc0 con 0x7fa8401ce540 2024-08-19T11:12:23.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 msgr2=0x7fa8401ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 0x7fa8401ce920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa8400a4d40 tx=0x7fa828005710 comp rx=0 tx=0).stop 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 msgr2=0x7fa8401ce920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.825+0000 7fa8377fe640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401ce540 0x7fa8401ce920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.831+0000 7fa8448c5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.831+0000 7fa8448c5640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 0x7fa840070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.831+0000 7fa8448c5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.831+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa84006ed40 con 0x7fa8401cee60 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 0x7fa840070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient: get_auth_request con 0x7fa8401cee60 auth_method 0 2024-08-19T11:12:23.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 10 monclient(hunting): handle_auth_done global_id 4789 payload 824 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.832+0000 7fa835d9b640 1 -- 172.21.15.71:0/404796843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa84013e020 con 0x7fa8401cee60 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.834+0000 7fa835d9b640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 msgr2=0x7fa840070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.834+0000 7fa835d9b640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 0x7fa840070e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa828018000 tx=0x7fa8280059a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.834+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa828016040 con 0x7fa8401cee60 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.834+0000 7fa8377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.834+0000 7fa8377fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.834+0000 7fa8377fe640 10 monclient: dump: 2024-08-19T11:12:23.851 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.852 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9425 (secure 0 0 0) 0x7fa82801d270 con 0x7fa8401cee60 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 msgr2=0x7fa840070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 0x7fa840070e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa828018000 tx=0x7fa8280059a0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 msgr2=0x7fa840070e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8377fe640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8401cee60 0x7fa840070e10 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa828018000 tx=0x7fa8280059a0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:23.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 140675, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:23.854 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.855 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.856 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:23.857 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:23.858 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.859 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:23.877 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 >> v2:172.21.15.135:6800/726754104 conn(0x7fa82003ea80 msgr2=0x7fa820040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 --2- 172.21.15.71:0/404796843 >> v2:172.21.15.135:6800/726754104 conn(0x7fa82003ea80 0x7fa820040f40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa838033000 tx=0x7fa838009000 comp rx=0 tx=0).stop 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 10 monclient: shutdown 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 msgr2=0x7fa84013b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 0x7fa84013b700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa83000d800 tx=0x7fa83000dcc0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa83ed9d640 1 -- 172.21.15.71:0/404796843 reap_dead start 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 shutdown_connections 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 --2- 172.21.15.71:0/404796843 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8400a3cd0 0x7fa84013b700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 >> 172.21.15.71:0/404796843 conn(0x7fa8400a91d0 msgr2=0x7fa84013f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 shutdown_connections 2024-08-19T11:12:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.835+0000 7fa8448c5640 1 -- 172.21.15.71:0/404796843 wait complete. 2024-08-19T11:12:23.880 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:23.880 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-19T11:12:23.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:12:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.977+0000 7ff572c27640 10 monclient: get_monmap_and_config 2024-08-19T11:12:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.977+0000 7ff572c27640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.977+0000 7ff572c27640 10 monclient: monmap: 2024-08-19T11:12:23.979 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:23.979043+0000 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:23.979043+0000 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.980 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:23.981 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:23.981 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 Processor -- start 2024-08-19T11:12:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 -- start start 2024-08-19T11:12:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient: init 2024-08-19T11:12:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:23.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient: _add_conns ranks=[8,10,3,5,2,4,0,9,7,1,6] 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 0x7ff56c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): picked mon.noname-e con 0x7ff56c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff56c0a57c0 0x7ff56c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): picked mon.noname-f con 0x7ff56c0a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c139710 0x7ff56c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): picked mon.noname-g con 0x7ff56c139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff56c0a5020 con 0x7ff56c0a57c0 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c0a77b0 con 0x7ff56c139710 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff56c0a7d40 con 0x7ff56c0a6950 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff572c27640 10 monclient(hunting): authenticate will time out at 802.020827s 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 0x7ff56c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 0x7ff56c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:33882/0 (socket says 172.21.15.71:33882) 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 1 -- 172.21.15.71:0/1101003421 learned_addr learned my addr 172.21.15.71:0/1101003421 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 10 monclient(hunting): get_auth_request con 0x7ff56c0a6950 auth_method 0 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.978+0000 7ff5709c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 1 --2- 172.21.15.71:0/1101003421 >> v2:172.21.15.135:3300/0 conn(0x7ff56c0a57c0 0x7ff56c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 1 --2- 172.21.15.71:0/1101003421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c139710 0x7ff56c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): get_auth_request con 0x7ff56c0a57c0 auth_method 0 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): get_auth_request con 0x7ff56c139710 auth_method 0 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff56bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5711c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 10 monclient(hunting): handle_auth_done global_id 4922 payload 274 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 1 -- 172.21.15.71:0/1101003421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c139710 msgr2=0x7ff56c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 1 --2- 172.21.15.71:0/1101003421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c139710 0x7ff56c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 1 -- 172.21.15.71:0/1101003421 >> v2:172.21.15.135:3300/0 conn(0x7ff56c0a57c0 msgr2=0x7ff56c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 1 --2- 172.21.15.71:0/1101003421 >> v2:172.21.15.135:3300/0 conn(0x7ff56c0a57c0 0x7ff56c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 10 monclient: _finish_hunting 0 2024-08-19T11:12:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 1 monclient: found mon.noname-e 2024-08-19T11:12:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:12:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.979+0000 7ff5709c3640 1 -- 172.21.15.71:0/1101003421 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c0a6380 con 0x7ff56c0a6950 2024-08-19T11:12:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff5709c3640 1 -- 172.21.15.71:0/1101003421 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 msgr2=0x7ff56c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff5709c3640 1 --2- 172.21.15.71:0/1101003421 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 0x7ff56c0a6d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5540098a0 tx=0x7ff55402a0d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7a185459be343580 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 1 -- 172.21.15.71:0/1101003421 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff554037070 con 0x7ff56c0a6950 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: dump: 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.991 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:12:23.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 5 monclient: authenticate success, global_id 4922 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 1 -- 172.21.15.71:0/1101003421 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55402adf0 con 0x7ff56c0a6950 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 4 set_mon_vals no callback set 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 1 -- 172.21.15.71:0/1101003421 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff554030c20 con 0x7ff56c0a6950 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff56b7fe640 10 monclient: dump: 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:23.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:23.994 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 10 monclient: shutdown 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 -- 172.21.15.71:0/1101003421 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 msgr2=0x7ff56c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 --2- 172.21.15.71:0/1101003421 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 0x7ff56c0a6d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5540098a0 tx=0x7ff55402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 -- 172.21.15.71:0/1101003421 shutdown_connections 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 --2- 172.21.15.71:0/1101003421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c139710 0x7ff56c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 --2- 172.21.15.71:0/1101003421 >> v2:172.21.15.135:3300/0 conn(0x7ff56c0a57c0 0x7ff56c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 --2- 172.21.15.71:0/1101003421 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff56c0a6950 0x7ff56c0a6d30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:23.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 -- 172.21.15.71:0/1101003421 >> 172.21.15.71:0/1101003421 conn(0x7ff56c0abf50 msgr2=0x7ff56c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:23.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 -- 172.21.15.71:0/1101003421 shutdown_connections 2024-08-19T11:12:23.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.982+0000 7ff572c27640 1 -- 172.21.15.71:0/1101003421 wait complete. 2024-08-19T11:12:23.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.983+0000 7ff572c27640 10 monclient: build_initial_monmap 2024-08-19T11:12:23.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.983+0000 7ff572c27640 10 monclient: monmap: 2024-08-19T11:12:23.996 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:23.996 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:23.997 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.983+0000 7ff572c27640 1 Processor -- start 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.983+0000 7ff572c27640 1 -- start start 2024-08-19T11:12:23.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.983+0000 7ff572c27640 10 monclient: init 2024-08-19T11:12:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient: _add_conns ranks=[1,0,2,7,3,6,5,8,4] 2024-08-19T11:12:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff56c0a57c0 0x7ff56c1ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): picked mon.noname-f con 0x7ff56c0a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:12:24.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c0a6950 0x7ff56c1cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): picked mon.noname-a con 0x7ff56c0a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 0x7ff56c1cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): picked mon.noname-b con 0x7ff56c139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c0a84c0 con 0x7ff56c0a6950 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c0a3650 con 0x7ff56c0a57c0 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c0a8700 con 0x7ff56c139710 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:24.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff572c27640 10 monclient(hunting): authenticate will time out at 802.026506s 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff56bfff640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c0a6950 msgr2=0x7ff56c1cee80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff56bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c0a6950 0x7ff56c1cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 0x7ff56c1cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 0x7ff56c1cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60172/0 (socket says 172.21.15.71:60172) 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 learned_addr learned my addr 172.21.15.71:0/2424309073 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): get_auth_request con 0x7ff56c139710 auth_method 0 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient(hunting): handle_auth_done global_id 5087 payload 824 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff56c0a57c0 msgr2=0x7ff56c1ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff56c0a57c0 0x7ff56c1ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c0a6950 msgr2=0x7ff56c1cee80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff56c0a6950 0x7ff56c1cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient: _finish_hunting 0 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 monclient: found mon.noname-b 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.984+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c13a170 con 0x7ff56c139710 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 msgr2=0x7ff56c1cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5711c4640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 0x7ff56c1cf3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff56400efc0 tx=0x7ff56400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff564018020 con 0x7ff56c139710 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: dump: 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: _finish_auth 0 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: _check_auth_tickets 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5640148f0 con 0x7ff56c139710 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 5 monclient: authenticate success, global_id 5087 2024-08-19T11:12:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 10 monclient: _renew_subs 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c127d60 con 0x7ff56c139710 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff5640133e0 con 0x7ff56c139710 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff5697fa640 10 monclient: dump: 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff56affd640 4 set_mon_vals no callback set 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 10 monclient: _renew_subs 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.987+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c128bd0 con 0x7ff56c139710 2024-08-19T11:12:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff564005d10 con 0x7ff56c139710 2024-08-19T11:12:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff572c27640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff572c27640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 0x7ff56c1252f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c128850 con 0x7ff56c124f10 2024-08-19T11:12:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5697fa640 1 --2- 172.21.15.71:0/2424309073 >> v2:172.21.15.135:6800/726754104 conn(0x7ff54c03ea80 0x7ff54c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 3506+0+0 (secure 0 0 0) 0x7ff564052580 con 0x7ff56c139710 2024-08-19T11:12:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 0x7ff56c1252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient: get_auth_request con 0x7ff56c124f10 auth_method 0 2024-08-19T11:12:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff56bfff640 1 --2- 172.21.15.71:0/2424309073 >> v2:172.21.15.135:6800/726754104 conn(0x7ff54c03ea80 0x7ff54c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff56bfff640 10 monclient: get_auth_request con 0x7ff54c03ea80 auth_method 0 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 10 monclient(hunting): handle_auth_done global_id 4890 payload 824 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.988+0000 7ff5709c3640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff56c0a1f70 con 0x7ff56c124f10 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.990+0000 7ff5709c3640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 msgr2=0x7ff56c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5709c3640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 0x7ff56c1252f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff554034000 tx=0x7ff5540044f0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff56bfff640 1 --2- 172.21.15.71:0/2424309073 >> v2:172.21.15.135:6800/726754104 conn(0x7ff54c03ea80 0x7ff54c040f40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0094c0 tx=0x7ff55c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff554041020 con 0x7ff56c124f10 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 10 monclient: dump: 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.021 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff554003820 con 0x7ff56c124f10 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 msgr2=0x7ff56c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 0x7ff56c1252f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff554034000 tx=0x7ff5540044f0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 msgr2=0x7ff56c1252f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.991+0000 7ff5697fa640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c124f10 0x7ff56c1252f0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff554034000 tx=0x7ff5540044f0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff572c27640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff572c27640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 0x7ff56c09fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff572c27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c076c60 con 0x7ff56c125830 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff5709c3640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 0x7ff56c09fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff5709c3640 10 monclient: get_auth_request con 0x7ff56c125830 auth_method 0 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff5709c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff5709c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.997+0000 7ff5709c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.998+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.998+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.998+0000 7ff5709c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.998+0000 7ff5709c3640 10 monclient(hunting): handle_auth_done global_id 4899 payload 824 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:23.998+0000 7ff5709c3640 1 -- 172.21.15.71:0/2424309073 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff56c0a6d30 con 0x7ff56c125830 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.000+0000 7ff5709c3640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 msgr2=0x7ff56c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.000+0000 7ff5709c3640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 0x7ff56c09fa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff55402e000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.000+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff55404c070 con 0x7ff56c125830 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.000+0000 7ff5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.000+0000 7ff5697fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.000+0000 7ff5697fa640 10 monclient: dump: 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.024 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.025 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9590 (secure 0 0 0) 0x7ff55403d450 con 0x7ff56c125830 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 msgr2=0x7ff56c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 0x7ff56c09fa10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff55402e000 comp rx=0 tx=0).stop 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 msgr2=0x7ff56c09fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:24.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5697fa640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff56c125830 0x7ff56c09fa10 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff554000c00 tx=0x7ff55402e000 comp rx=0 tx=0).stop 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 140853, 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:24.027 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:24.028 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.029 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.031 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.032 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:24.032 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:24.032 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:24.032 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:24.033 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:24.034 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.035 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:24.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:24.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:24.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.051 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:24.052 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.053 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:24.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.055 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:24.056 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 >> v2:172.21.15.135:6800/726754104 conn(0x7ff54c03ea80 msgr2=0x7ff54c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 --2- 172.21.15.71:0/2424309073 >> v2:172.21.15.135:6800/726754104 conn(0x7ff54c03ea80 0x7ff54c040f40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0094c0 tx=0x7ff55c009190 comp rx=0 tx=0).stop 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 10 monclient: shutdown 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 msgr2=0x7ff56c1cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 --2- 172.21.15.71:0/2424309073 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff56c139710 0x7ff56c1cf3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff56400efc0 tx=0x7ff56400c490 comp rx=0 tx=0).stop 2024-08-19T11:12:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 reap_dead start 2024-08-19T11:12:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff5711c4640 1 -- 172.21.15.71:0/2424309073 reap_dead start 2024-08-19T11:12:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 shutdown_connections 2024-08-19T11:12:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 >> 172.21.15.71:0/2424309073 conn(0x7ff56c0abf50 msgr2=0x7ff56c138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 shutdown_connections 2024-08-19T11:12:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.001+0000 7ff572c27640 1 -- 172.21.15.71:0/2424309073 wait complete. 2024-08-19T11:12:24.060 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:24.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-19T11:12:24.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:12:24.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.157+0000 7fa754172640 10 monclient: get_monmap_and_config 2024-08-19T11:12:24.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.157+0000 7fa754172640 10 monclient: build_initial_monmap 2024-08-19T11:12:24.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.157+0000 7fa754172640 10 monclient: monmap: 2024-08-19T11:12:24.160 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:24.160 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.161 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:24.159491+0000 2024-08-19T11:12:24.161 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:24.159491+0000 2024-08-19T11:12:24.161 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:24.161 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.161 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:24.161 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:24.162 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:24.162 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:24.162 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:24.162 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:24.162 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:24.163 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:24.163 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:24.163 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:24.163 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:24.163 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.158+0000 7fa754172640 1 Processor -- start 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.158+0000 7fa754172640 1 -- start start 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.158+0000 7fa754172640 10 monclient: init 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient: _add_conns ranks=[2,0,7,8,3,1,4,6,10,9,5] 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 0x7fa74c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): picked mon.noname-b con 0x7fa74c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa74c0a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a7270 0x7fa74c139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): picked mon.noname-i con 0x7fa74c0a7270 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74c0a6380 con 0x7fa74c0a57c0 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa74c0a5020 con 0x7fa74c0a6950 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa74c0a7d40 con 0x7fa74c0a7270 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa75170d640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7fa74c0a57c0 legacy=0x7fa74c139710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa754172640 10 monclient(hunting): authenticate will time out at 802.201274s 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 0x7fa74c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 0x7fa74c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60186/0 (socket says 172.21.15.71:60186) 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 -- 172.21.15.71:0/1062328676 learned_addr learned my addr 172.21.15.71:0/1062328676 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:24.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): get_auth_request con 0x7fa74c0a6950 auth_method 0 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient(hunting): handle_auth_done global_id 5096 payload 274 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 -- 172.21.15.71:0/1062328676 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a7270 msgr2=0x7fa74c139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 --2- 172.21.15.71:0/1062328676 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a7270 0x7fa74c139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 -- 172.21.15.71:0/1062328676 >> v1:172.21.15.71:6789/0 conn(0x7fa74c0a57c0 legacy=0x7fa74c139710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient: _finish_hunting 0 2024-08-19T11:12:24.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 monclient: found mon.noname-b 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.159+0000 7fa751f0e640 1 -- 172.21.15.71:0/1062328676 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c0a3650 con 0x7fa74c0a6950 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa751f0e640 1 -- 172.21.15.71:0/1062328676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 msgr2=0x7fa74c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa751f0e640 1 --2- 172.21.15.71:0/1062328676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 0x7fa74c0a6d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7480098d0 tx=0x7fa74802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca977fe59640c923 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 1 -- 172.21.15.71:0/1062328676 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa748037070 con 0x7fa74c0a6950 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: dump: 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.179 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.180 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: _finish_auth 0 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: _check_auth_tickets 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 1 -- 172.21.15.71:0/1062328676 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7480307b0 con 0x7fa74c0a6950 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa754172640 5 monclient: authenticate success, global_id 5096 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa754172640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 1 -- 172.21.15.71:0/1062328676 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa748030dd0 con 0x7fa74c0a6950 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa754172640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa754172640 4 set_mon_vals no callback set 2024-08-19T11:12:24.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.162+0000 7fa750f0c640 10 monclient: dump: 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.182 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 10 monclient: shutdown 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 -- 172.21.15.71:0/1062328676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 msgr2=0x7fa74c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 --2- 172.21.15.71:0/1062328676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 0x7fa74c0a6d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7480098d0 tx=0x7fa74802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 -- 172.21.15.71:0/1062328676 shutdown_connections 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 --2- 172.21.15.71:0/1062328676 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a7270 0x7fa74c139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 --2- 172.21.15.71:0/1062328676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa74c0a6950 0x7fa74c0a6d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 -- 172.21.15.71:0/1062328676 >> 172.21.15.71:0/1062328676 conn(0x7fa74c0abf50 msgr2=0x7fa74c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 -- 172.21.15.71:0/1062328676 shutdown_connections 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 1 -- 172.21.15.71:0/1062328676 wait complete. 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 10 monclient: build_initial_monmap 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.163+0000 7fa754172640 10 monclient: monmap: 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:24.184 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 Processor -- start 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 -- start start 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient: init 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient: _add_conns ranks=[7,8,6,5,1,0,2,3,4] 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a57c0 0x7fa74c1ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): picked mon.noname-i con 0x7fa74c0a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa74c0a6950 0x7fa74c1cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): picked mon.noname-e con 0x7fa74c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 0x7fa74c1cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): picked mon.noname-d con 0x7fa74c0a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa74c0a8700 con 0x7fa74c0a7270 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa74c0a84c0 con 0x7fa74c0a57c0 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa74c0a7690 con 0x7fa74c0a6950 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa754172640 10 monclient(hunting): authenticate will time out at 802.206683s 2024-08-19T11:12:24.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 0x7fa74c1cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa74c0a6950 0x7fa74c1cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 0x7fa74c1cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:59668/0 (socket says 172.21.15.71:59668) 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 learned_addr learned my addr 172.21.15.71:0/2040001754 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa74c0a6950 0x7fa74c1cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:33892/0 (socket says 172.21.15.71:33892) 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): get_auth_request con 0x7fa74c0a7270 auth_method 0 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): get_auth_request con 0x7fa74c0a6950 auth_method 0 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa751f0e640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a57c0 0x7fa74c1ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75270f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa75170d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa751f0e640 10 monclient(hunting): get_auth_request con 0x7fa74c0a57c0 auth_method 0 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa751f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa751f0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.164+0000 7fa751f0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 10 monclient(hunting): handle_auth_done global_id 24396 payload 824 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa74c0a6950 msgr2=0x7fa74c1cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa74c0a6950 0x7fa74c1cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a57c0 msgr2=0x7fa74c1ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa74c0a57c0 0x7fa74c1ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 10 monclient: _finish_hunting 0 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 1 monclient: found mon.noname-d 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c129da0 con 0x7fa74c0a7270 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.165+0000 7fa75170d640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa74c0a6950 0x7fa74c1cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 msgr2=0x7fa74c1cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa75270f640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 0x7fa74c1cf3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa74400b970 tx=0x7fa74400bd70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa744019070 con 0x7fa74c0a7270 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: dump: 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: _finish_auth 0 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: _check_auth_tickets 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa744007370 con 0x7fa74c0a7270 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 5 monclient: authenticate success, global_id 24396 2024-08-19T11:12:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 10 monclient: _renew_subs 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c12a930 con 0x7fa74c0a7270 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa744007990 con 0x7fa74c0a7270 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa7427fc640 10 monclient: dump: 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.192 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa743fff640 4 set_mon_vals no callback set 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 10 monclient: _renew_subs 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.167+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c0a9610 con 0x7fa74c0a7270 2024-08-19T11:12:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa754172640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa754172640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 0x7fa74c127240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa74c076c60 con 0x7fa74c126e60 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa744006d10 con 0x7fa74c0a7270 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 0x7fa74c127240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient: get_auth_request con 0x7fa74c126e60 auth_method 0 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa7427fc640 1 --2- 172.21.15.71:0/2040001754 >> v2:172.21.15.135:6800/726754104 conn(0x7fa73003ea80 0x7fa730040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(58..58 src has 1..58) ==== 3506+0+0 (secure 0 0 0) 0x7fa744051430 con 0x7fa74c0a7270 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa75170d640 1 --2- 172.21.15.71:0/2040001754 >> v2:172.21.15.135:6800/726754104 conn(0x7fa73003ea80 0x7fa730040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.168+0000 7fa75170d640 10 monclient: get_auth_request con 0x7fa73003ea80 auth_method 0 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.169+0000 7fa751f0e640 10 monclient(hunting): handle_auth_done global_id 14828 payload 824 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.169+0000 7fa751f0e640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa74c0a6d30 con 0x7fa74c126e60 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa751f0e640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 msgr2=0x7fa74c127240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa751f0e640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 0x7fa74c127240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa748031000 tx=0x7fa7480046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa75170d640 1 --2- 172.21.15.71:0/2040001754 >> v2:172.21.15.135:6800/726754104 conn(0x7fa73003ea80 0x7fa730040f40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa74c1285c0 tx=0x7fa73c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa748037040 con 0x7fa74c126e60 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 10 monclient: dump: 2024-08-19T11:12:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.196 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa748003af0 con 0x7fa74c126e60 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 msgr2=0x7fa74c127240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 0x7fa74c127240 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa748031000 tx=0x7fa7480046c0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 msgr2=0x7fa74c127240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:24.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.171+0000 7fa7427fc640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c126e60 0x7fa74c127240 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.177+0000 7fa754172640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.177+0000 7fa754172640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 0x7fa74c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.177+0000 7fa754172640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.177+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa74c1288b0 con 0x7fa74c127780 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 0x7fa74c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient: get_auth_request con 0x7fa74c127780 auth_method 0 2024-08-19T11:12:24.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 10 monclient(hunting): handle_auth_done global_id 14837 payload 824 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.178+0000 7fa751f0e640 1 -- 172.21.15.71:0/2040001754 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa74c0008d0 con 0x7fa74c127780 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.180+0000 7fa751f0e640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 msgr2=0x7fa74c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.180+0000 7fa751f0e640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 0x7fa74c1225a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa74802a0e0 tx=0x7fa748008030 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa748037040 con 0x7fa74c127780 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:12:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 10 monclient: dump: 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9423 (secure 0 0 0) 0x7fa748047410 con 0x7fa74c127780 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 msgr2=0x7fa74c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 0x7fa74c1225a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa74802a0e0 tx=0x7fa748008030 comp rx=0 tx=0).stop 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 msgr2=0x7fa74c1225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa7427fc640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa74c127780 0x7fa74c1225a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.202 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 141035, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:24.203 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.204 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.205 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.208 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:24.211 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:24.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:24.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.214 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:24.217 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:24.222 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:24.223 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:24.226 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.227 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:24.228 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 >> v2:172.21.15.135:6800/726754104 conn(0x7fa73003ea80 msgr2=0x7fa730040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 --2- 172.21.15.71:0/2040001754 >> v2:172.21.15.135:6800/726754104 conn(0x7fa73003ea80 0x7fa730040f40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa74c1285c0 tx=0x7fa73c009110 comp rx=0 tx=0).stop 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 10 monclient: shutdown 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 msgr2=0x7fa74c1cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 --2- 172.21.15.71:0/2040001754 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa74c0a7270 0x7fa74c1cf3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa74400b970 tx=0x7fa74400bd70 comp rx=0 tx=0).stop 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 reap_dead start 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa75270f640 1 -- 172.21.15.71:0/2040001754 reap_dead start 2024-08-19T11:12:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 shutdown_connections 2024-08-19T11:12:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 >> 172.21.15.71:0/2040001754 conn(0x7fa74c0abf50 msgr2=0x7fa74c0ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 shutdown_connections 2024-08-19T11:12:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.181+0000 7fa754172640 1 -- 172.21.15.71:0/2040001754 wait complete. 2024-08-19T11:12:24.231 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:24.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-19T11:12:24.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:12:24.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.328+0000 7f4cb06de640 10 monclient: get_monmap_and_config 2024-08-19T11:12:24.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.328+0000 7f4cb06de640 10 monclient: build_initial_monmap 2024-08-19T11:12:24.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.328+0000 7f4cb06de640 10 monclient: monmap: 2024-08-19T11:12:24.330 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:24.329749+0000 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:24.329749+0000 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:24.331 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.328+0000 7f4cb06de640 1 Processor -- start 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.328+0000 7f4cb06de640 1 -- start start 2024-08-19T11:12:24.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.328+0000 7f4cb06de640 10 monclient: init 2024-08-19T11:12:24.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:24.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient: _add_conns ranks=[5,10,2,8,0,1,3,6,4,7,9] 2024-08-19T11:12:24.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4ca80a20d0 0x7f4ca80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): picked mon.noname-h con 0x7f4ca80a20d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4ca80a24b0 0x7f4ca80a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): picked mon.noname-f con 0x7f4ca80a24b0 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 0x7f4ca80a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): picked mon.noname-b con 0x7f4ca80a3390 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca80a0c40 con 0x7f4ca80a24b0 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca80a4610 con 0x7f4ca80a3390 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4ca80a05f0 con 0x7f4ca80a20d0 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cb06de640 10 monclient(hunting): authenticate will time out at 802.371377s 2024-08-19T11:12:24.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 0x7f4ca80a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 0x7f4ca80a3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:60194/0 (socket says 172.21.15.71:60194) 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 -- 172.21.15.71:0/2767969629 learned_addr learned my addr 172.21.15.71:0/2767969629 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): get_auth_request con 0x7f4ca80a3390 auth_method 0 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 1 --2- 172.21.15.71:0/2767969629 >> v2:172.21.15.135:3300/0 conn(0x7f4ca80a24b0 0x7f4ca80a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 1 --2- 172.21.15.71:0/2767969629 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4ca80a20d0 0x7f4ca80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): get_auth_request con 0x7f4ca80a20d0 auth_method 0 2024-08-19T11:12:24.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): get_auth_request con 0x7f4ca80a24b0 auth_method 0 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cae47a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient(hunting): handle_auth_done global_id 5105 payload 274 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 -- 172.21.15.71:0/2767969629 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4ca80a20d0 msgr2=0x7f4ca80a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 --2- 172.21.15.71:0/2767969629 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4ca80a20d0 0x7f4ca80a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 -- 172.21.15.71:0/2767969629 >> v2:172.21.15.135:3300/0 conn(0x7f4ca80a24b0 msgr2=0x7f4ca80a2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 --2- 172.21.15.71:0/2767969629 >> v2:172.21.15.135:3300/0 conn(0x7f4ca80a24b0 0x7f4ca80a2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient: _finish_hunting 0 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 monclient: found mon.noname-b 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.329+0000 7f4caec7b640 1 -- 172.21.15.71:0/2767969629 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca80a08d0 con 0x7f4ca80a3390 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4caec7b640 1 -- 172.21.15.71:0/2767969629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 msgr2=0x7f4ca80a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4caec7b640 1 --2- 172.21.15.71:0/2767969629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 0x7f4ca80a3840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009870 tx=0x7f4c9802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8331048601b9f2f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 1 -- 172.21.15.71:0/2767969629 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c98037070 con 0x7f4ca80a3390 2024-08-19T11:12:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: dump: 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: _finish_auth 0 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: _check_auth_tickets 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 1 -- 172.21.15.71:0/2767969629 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9802ae00 con 0x7f4ca80a3390 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 1 -- 172.21.15.71:0/2767969629 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c98030c20 con 0x7f4ca80a3390 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cb06de640 5 monclient: authenticate success, global_id 5105 2024-08-19T11:12:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cb06de640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cb06de640 4 set_mon_vals no callback set 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.332+0000 7f4cad478640 10 monclient: dump: 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 10 monclient: shutdown 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 -- 172.21.15.71:0/2767969629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 msgr2=0x7f4ca80a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 --2- 172.21.15.71:0/2767969629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 0x7f4ca80a3840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009870 tx=0x7f4c9802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 -- 172.21.15.71:0/2767969629 shutdown_connections 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 --2- 172.21.15.71:0/2767969629 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4ca80a3390 0x7f4ca80a3840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 --2- 172.21.15.71:0/2767969629 >> v2:172.21.15.135:3300/0 conn(0x7f4ca80a24b0 0x7f4ca80a2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 --2- 172.21.15.71:0/2767969629 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4ca80a20d0 0x7f4ca80a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 -- 172.21.15.71:0/2767969629 >> 172.21.15.71:0/2767969629 conn(0x7f4ca80a8630 msgr2=0x7f4ca80a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 -- 172.21.15.71:0/2767969629 shutdown_connections 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.333+0000 7f4cb06de640 1 -- 172.21.15.71:0/2767969629 wait complete. 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient: build_initial_monmap 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient: monmap: 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 Processor -- start 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 -- start start 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient: init 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient: _add_conns ranks=[7,1,0,2,6,3,8,4,5] 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 0x7f4ca81ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): picked mon.noname-i con 0x7f4ca80a20d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca80a24b0 0x7f4ca81ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): picked mon.noname-f con 0x7f4ca80a24b0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ca80a3390 0x7f4ca8094e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): picked mon.noname-a con 0x7f4ca80a3390 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80a4a90 con 0x7f4ca80a3390 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80a2890 con 0x7f4ca80a24b0 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4ca80a4c10 con 0x7f4ca80a20d0 2024-08-19T11:12:24.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4cb06de640 10 monclient(hunting): authenticate will time out at 802.376858s 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4caec7b640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ca80a3390 msgr2=0x7f4ca8094e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.334+0000 7f4caec7b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ca80a3390 0x7f4ca8094e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 0x7f4ca81ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca80a24b0 0x7f4ca81ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 0x7f4ca81ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:60678/0 (socket says 172.21.15.71:60678) 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca80a24b0 0x7f4ca81ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:41896/0 (socket says 172.21.15.71:41896) 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 -- 172.21.15.71:0/599894672 learned_addr learned my addr 172.21.15.71:0/599894672 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): get_auth_request con 0x7f4ca80a20d0 auth_method 0 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): get_auth_request con 0x7f4ca80a24b0 auth_method 0 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient(hunting): handle_auth_done global_id 4804 payload 824 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca80a24b0 msgr2=0x7f4ca81ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ca80a24b0 0x7f4ca81ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ca80a3390 msgr2=0x7f4ca8094e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ca80a3390 0x7f4ca8094e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient: _finish_hunting 0 2024-08-19T11:12:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 monclient: found mon.noname-i 2024-08-19T11:12:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:12:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.335+0000 7f4cae47a640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca80989f0 con 0x7f4ca80a20d0 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.337+0000 7f4cae47a640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 msgr2=0x7f4ca81ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.337+0000 7f4cae47a640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 0x7f4ca81ce650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000e9b0 tx=0x7f4ca000ee70 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ca0017070 con 0x7f4ca80a20d0 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: dump: 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.357 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.358 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca000cbb0 con 0x7f4ca80a20d0 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 5 monclient: authenticate success, global_id 4804 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 10 monclient: _renew_subs 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca8098cd0 con 0x7f4ca80a20d0 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4ca000cd60 con 0x7f4ca80a20d0 2024-08-19T11:12:24.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4ca6ffd640 10 monclient: dump: 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.360 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 10 monclient: _renew_subs 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca8096970 con 0x7f4ca80a20d0 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.338+0000 7f4cacc77640 4 set_mon_vals no callback set 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cb06de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cb06de640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 0x7f4ca8095780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4ca8076c60 con 0x7f4ca80953a0 2024-08-19T11:12:24.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 0x7f4ca8095780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient: get_auth_request con 0x7f4ca80953a0 auth_method 0 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 10 monclient(hunting): handle_auth_done global_id 4813 payload 824 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4cadc79640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ca80a2e50 con 0x7f4ca80953a0 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4ca001a070 con 0x7f4ca80a20d0 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4ca6ffd640 1 --2- 172.21.15.71:0/599894672 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c9403ea80 0x7f4c94040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(58..58 src has 1..58) ==== 3506+0+0 (secure 0 0 0) 0x7f4ca000f040 con 0x7f4ca80a20d0 2024-08-19T11:12:24.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.339+0000 7f4caec7b640 1 --2- 172.21.15.71:0/599894672 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c9403ea80 0x7f4c94040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.340+0000 7f4caec7b640 10 monclient: get_auth_request con 0x7f4c9403ea80 auth_method 0 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.341+0000 7f4cadc79640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 msgr2=0x7f4ca8095780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.341+0000 7f4cadc79640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 0x7f4ca8095780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8096fe0 tx=0x7f4c9c00f870 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c9c019070 con 0x7f4ca80953a0 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 10 monclient: dump: 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.363 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4c9c003ba0 con 0x7f4ca80953a0 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:24.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 msgr2=0x7f4ca8095780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 0x7f4ca8095780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8096fe0 tx=0x7f4c9c00f870 comp rx=0 tx=0).stop 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 msgr2=0x7f4ca8095780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4ca6ffd640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80953a0 0x7f4ca8095780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.342+0000 7f4caec7b640 1 --2- 172.21.15.71:0/599894672 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c9403ea80 0x7f4c94040f40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4c98034000 tx=0x7f4c9802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cb06de640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cb06de640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 0x7f4ca8092390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cb06de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4ca8098100 con 0x7f4ca8095cc0 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 0x7f4ca8092390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient: get_auth_request con 0x7f4ca8095cc0 auth_method 0 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.348+0000 7f4cadc79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.349+0000 7f4cadc79640 10 monclient(hunting): handle_auth_done global_id 4822 payload 824 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.349+0000 7f4cadc79640 1 -- 172.21.15.71:0/599894672 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ca806e550 con 0x7f4ca8095cc0 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.351+0000 7f4cadc79640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 msgr2=0x7f4ca8092390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.351+0000 7f4cadc79640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 0x7f4ca8092390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c01b000 tx=0x7f4c9c004a40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.351+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c9c015430 con 0x7f4ca8095cc0 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.351+0000 7f4ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.351+0000 7f4ca6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.351+0000 7f4ca6ffd640 10 monclient: dump: 2024-08-19T11:12:24.366 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f4c9c015430 con 0x7f4ca8095cc0 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 msgr2=0x7f4ca8092390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 0x7f4ca8092390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c01b000 tx=0x7f4c9c004a40 comp rx=0 tx=0).stop 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 msgr2=0x7f4ca8092390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4ca6ffd640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca8095cc0 0x7f4ca8092390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:24.368 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 36, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 141206, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:12:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:12:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:12:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:12:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:12:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:12:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:12:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:12:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5 2024-08-19T11:12:24.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:12:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:12:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:12:24.392 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:12:24.392 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:12:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c9403ea80 msgr2=0x7f4c94040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 --2- 172.21.15.71:0/599894672 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c9403ea80 0x7f4c94040f40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4c98034000 tx=0x7f4c9802e000 comp rx=0 tx=0).stop 2024-08-19T11:12:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 10 monclient: shutdown 2024-08-19T11:12:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 msgr2=0x7f4ca81ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 --2- 172.21.15.71:0/599894672 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ca80a20d0 0x7f4ca81ce650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000e9b0 tx=0x7f4ca000ee70 comp rx=0 tx=0).stop 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4caec7b640 1 -- 172.21.15.71:0/599894672 reap_dead start 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4caec7b640 1 -- 172.21.15.71:0/599894672 reap_dead start 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 shutdown_connections 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 >> 172.21.15.71:0/599894672 conn(0x7f4ca80a8630 msgr2=0x7f4ca809cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 shutdown_connections 2024-08-19T11:12:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:24.352+0000 7f4cb06de640 1 -- 172.21.15.71:0/599894672 wait complete. 2024-08-19T11:12:24.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:12:24.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:12:25.511 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: starting. 2024-08-19T11:12:25.511 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24620 2024-08-19T11:12:25.511 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: created object 0... 2024-08-19T11:12:25.511 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: created object 25... 2024-08-19T11:12:25.511 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: created object 49... 2024-08-19T11:12:25.512 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: finishing. 2024-08-19T11:12:25.512 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24621]: shutting down. 2024-08-19T11:12:26.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24622]: starting. 2024-08-19T11:12:26.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24622]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24620 2024-08-19T11:12:26.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24622]: shutting down. 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: starting. 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24620 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: created object 0... 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: created object 25... 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: created object 49... 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: finishing. 2024-08-19T11:12:28.302 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24657]: shutting down. 2024-08-19T11:12:28.338 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:28.338 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24659]: starting. 2024-08-19T11:12:28.338 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24659]: listing objects. 2024-08-19T11:12:28.338 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24659]: listed object 0... 2024-08-19T11:12:28.339 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24659]: listed object 25... 2024-08-19T11:12:28.339 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24659]: saw 50 objects 2024-08-19T11:12:28.339 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24659]: shutting down. 2024-08-19T11:12:29.193 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:29.193 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24658]: starting. 2024-08-19T11:12:29.193 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24658]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24620 2024-08-19T11:12:29.193 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24658]: shutting down. 2024-08-19T11:12:29.195 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:29.195 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:29.195 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:12:29.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:12:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: starting. 2024-08-19T11:12:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24727 2024-08-19T11:12:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: created object 0... 2024-08-19T11:12:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: created object 25... 2024-08-19T11:12:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: created object 49... 2024-08-19T11:12:31.315 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: finishing. 2024-08-19T11:12:31.316 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24728]: shutting down. 2024-08-19T11:12:32.222 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24729]: starting. 2024-08-19T11:12:32.222 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24729]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24727 2024-08-19T11:12:32.223 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24729]: shutting down. 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: starting. 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24727 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: created object 0... 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: created object 25... 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: created object 49... 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: finishing. 2024-08-19T11:12:34.490 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24764]: shutting down. 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24766]: starting. 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24766]: listing objects. 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24766]: listed object 0... 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24766]: listed object 25... 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24766]: saw 50 objects 2024-08-19T11:12:34.528 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24766]: shutting down. 2024-08-19T11:12:35.399 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:35.399 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24765]: starting. 2024-08-19T11:12:35.399 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24765]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24727 2024-08-19T11:12:35.399 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24765]: shutting down. 2024-08-19T11:12:35.401 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:35.401 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:35.401 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:12:35.403 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:12:37.618 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: starting. 2024-08-19T11:12:37.618 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24834 2024-08-19T11:12:37.618 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: created object 0... 2024-08-19T11:12:37.618 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: created object 25... 2024-08-19T11:12:37.619 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: created object 49... 2024-08-19T11:12:37.619 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: finishing. 2024-08-19T11:12:37.619 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24835]: shutting down. 2024-08-19T11:12:38.198 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24836]: starting. 2024-08-19T11:12:38.198 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24836]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24834 2024-08-19T11:12:38.198 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24836]: shutting down. 2024-08-19T11:12:40.313 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:40.313 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: starting. 2024-08-19T11:12:40.314 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24834 2024-08-19T11:12:40.314 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: created object 0... 2024-08-19T11:12:40.314 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: created object 25... 2024-08-19T11:12:40.314 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: created object 49... 2024-08-19T11:12:40.314 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: finishing. 2024-08-19T11:12:40.314 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24871]: shutting down. 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24873]: starting. 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24873]: listing objects. 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24873]: listed object 0... 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24873]: listed object 25... 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24873]: saw 50 objects 2024-08-19T11:12:40.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24873]: shutting down. 2024-08-19T11:12:41.224 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:41.224 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24872]: starting. 2024-08-19T11:12:41.224 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24872]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24834 2024-08-19T11:12:41.224 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24872]: shutting down. 2024-08-19T11:12:41.225 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:41.225 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:12:41.225 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:12:41.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:12:43.361 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: starting. 2024-08-19T11:12:43.361 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24941 2024-08-19T11:12:43.361 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: created object 0... 2024-08-19T11:12:43.362 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: created object 25... 2024-08-19T11:12:43.362 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: created object 49... 2024-08-19T11:12:43.362 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: finishing. 2024-08-19T11:12:43.362 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[24942]: shutting down. 2024-08-19T11:12:44.254 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24943]: starting. 2024-08-19T11:12:44.254 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24943]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24941 2024-08-19T11:12:44.254 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[24943]: shutting down. 2024-08-19T11:12:44.395 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-19T11:12:44.395 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-19T11:12:44.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-19T11:12:44.398 INFO:tasks.ceph.mon.a:Started 2024-08-19T11:12:44.398 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:12:44.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.502+0000 7fc35fed3640 10 monclient: get_monmap_and_config 2024-08-19T11:12:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.502+0000 7fc35fed3640 10 monclient: build_initial_monmap 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.502+0000 7fc35fed3640 10 monclient: monmap: 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:44.503503+0000 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:44.503503+0000 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.503+0000 7fc35fed3640 1 Processor -- start 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.503+0000 7fc35fed3640 1 -- start start 2024-08-19T11:12:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.503+0000 7fc35fed3640 10 monclient: init 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient: _add_conns ranks=[9,1,7,4,2,3,0,6,8,10,5] 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): picked mon.noname-a con 0x7fc35809b5a0 addr v2:172.21.15.71:3300/0 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc35809b980 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 0x7fc3580a4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): picked mon.noname-i con 0x7fc35809bd90 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3580a00f0 con 0x7fc35809b980 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc358069620 con 0x7fc35809b5a0 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc3580a09e0 con 0x7fc35809bd90 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35fed3640 10 monclient(hunting): authenticate will time out at 822.545204s 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58292/0 (socket says 172.21.15.71:58292) 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 -- 172.21.15.71:0/1595846960 learned_addr learned my addr 172.21.15.71:0/1595846960 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 10 monclient(hunting): get_auth_request con 0x7fc35809b5a0 auth_method 0 2024-08-19T11:12:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 1 --2- 172.21.15.71:0/1595846960 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 0x7fc3580a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): get_auth_request con 0x7fc35809bd90 auth_method 0 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 -- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 msgr2=0x7fc3580a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 -- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 msgr2=0x7fc3580a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 --2- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35dc6f640 1 --2- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient(hunting): handle_auth_done global_id 4939 payload 274 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 1 -- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 msgr2=0x7fc3580a04a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 1 --2- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 1 -- 172.21.15.71:0/1595846960 >> v1:172.21.15.135:6789/0 conn(0x7fc35809b980 legacy=0x7fc3580a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient: _finish_hunting 0 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 1 monclient: found mon.noname-i 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.504+0000 7fc35e470640 1 -- 172.21.15.71:0/1595846960 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3580693a0 con 0x7fc35809bd90 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35e470640 1 -- 172.21.15.71:0/1595846960 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 msgr2=0x7fc3580a4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35e470640 1 --2- 172.21.15.71:0/1595846960 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 0x7fc3580a4490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc350009d90 tx=0x7fc35002a490 comp rx=0 tx=0).ready entity=mon.7 client_cookie=d9843080850b3640 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 1 -- 172.21.15.71:0/1595846960 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc350007bc0 con 0x7fc35809bd90 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: dump: 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: _finish_auth 0 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: _check_auth_tickets 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 1 -- 172.21.15.71:0/1595846960 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc350007d80 con 0x7fc35809bd90 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35fed3640 5 monclient: authenticate success, global_id 4939 2024-08-19T11:12:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35fed3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35fed3640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 1 -- 172.21.15.71:0/1595846960 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc350031870 con 0x7fc35809bd90 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35fed3640 4 set_mon_vals no callback set 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.507+0000 7fc35cc6d640 10 monclient: dump: 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 10 monclient: shutdown 2024-08-19T11:12:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 -- 172.21.15.71:0/1595846960 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 msgr2=0x7fc3580a4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 --2- 172.21.15.71:0/1595846960 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 0x7fc3580a4490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc350009d90 tx=0x7fc35002a490 comp rx=0 tx=0).stop 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 -- 172.21.15.71:0/1595846960 shutdown_connections 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 --2- 172.21.15.71:0/1595846960 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc35809bd90 0x7fc3580a4490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 --2- 172.21.15.71:0/1595846960 >> v2:172.21.15.71:3300/0 conn(0x7fc35809b5a0 0x7fc3580a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 -- 172.21.15.71:0/1595846960 >> 172.21.15.71:0/1595846960 conn(0x7fc3580a4e70 msgr2=0x7fc3580a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 -- 172.21.15.71:0/1595846960 shutdown_connections 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.508+0000 7fc35fed3640 1 -- 172.21.15.71:0/1595846960 wait complete. 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient: build_initial_monmap 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient: monmap: 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 Processor -- start 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 -- start start 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient: init 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient: _add_conns ranks=[0,3,2,1,8,4,5,7,6] 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): picked mon.noname-a con 0x7fc35809b5a0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35809b980 0x7fc3581cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): picked mon.noname-g con 0x7fc35809b980 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 0x7fc35809c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): picked mon.noname-b con 0x7fc35809bd90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc35809f870 con 0x7fc35809b5a0 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc3580a5db0 con 0x7fc35809bd90 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3580a49d0 con 0x7fc35809b980 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.509+0000 7fc35fed3640 10 monclient(hunting): authenticate will time out at 822.550965s 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58294/0 (socket says 172.21.15.71:58294) 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 -- 172.21.15.71:0/108844072 learned_addr learned my addr 172.21.15.71:0/108844072 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 10 monclient(hunting): get_auth_request con 0x7fc35809b5a0 auth_method 0 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 0x7fc35809c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): get_auth_request con 0x7fc35809bd90 auth_method 0 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35809b980 0x7fc3581cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 -- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 msgr2=0x7fc3581ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 -- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 msgr2=0x7fc3581ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): get_auth_request con 0x7fc35809b980 auth_method 0 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35dc6f640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35d46e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient(hunting): handle_auth_done global_id 5240 payload 824 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 -- 172.21.15.71:0/108844072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35809b980 msgr2=0x7fc3581cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35809b980 0x7fc3581cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 -- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 msgr2=0x7fc3581ce6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient: _finish_hunting 0 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 monclient: found mon.noname-b 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.510+0000 7fc35e470640 1 -- 172.21.15.71:0/108844072 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3581bcc30 con 0x7fc35809bd90 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35e470640 1 -- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 msgr2=0x7fc35809c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35e470640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 0x7fc35809c370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc350031000 tx=0x7fc350004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3500046c0 con 0x7fc35809bd90 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: dump: 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:44.530 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 5 monclient: authenticate success, global_id 5240 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 10 monclient: _renew_subs 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35003b410 con 0x7fc35809bd90 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35809e160 con 0x7fc35809bd90 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc35003ba70 con 0x7fc35809bd90 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34a7fc640 10 monclient: dump: 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:44.532 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc34bfff640 4 set_mon_vals no callback set 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 10 monclient: _renew_subs 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.512+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581bc950 con 0x7fc35809bd90 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.513+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc350005d10 con 0x7fc35809bd90 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.513+0000 7fc34a7fc640 1 --2- 172.21.15.71:0/108844072 >> v2:172.21.15.135:6800/726754104 conn(0x7fc33c03ea80 0x7fc33c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc35fed3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc35fed3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc35fed3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3580a04a0 con 0x7fc35809bd90 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 3506+0+0 (secure 0 0 0) 0x7fc350072d10 con 0x7fc35809bd90 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc35dc6f640 1 --2- 172.21.15.71:0/108844072 >> v2:172.21.15.135:6800/726754104 conn(0x7fc33c03ea80 0x7fc33c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.514+0000 7fc35dc6f640 10 monclient: get_auth_request con 0x7fc33c03ea80 auth_method 0 2024-08-19T11:12:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.516+0000 7fc35dc6f640 1 --2- 172.21.15.71:0/108844072 >> v2:172.21.15.135:6800/726754104 conn(0x7fc33c03ea80 0x7fc33c040f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0091d0 tx=0x7fc34c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.518+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc350048030 con 0x7fc35809bd90 2024-08-19T11:12:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.518+0000 7fc34a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.518+0000 7fc34a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.760+0000 7fc35fed3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.760+0000 7fc35fed3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.760+0000 7fc35fed3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.760+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc35806e5c0 con 0x7fc35809bd90 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.761+0000 7fc34a7fc640 1 -- 172.21.15.71:0/108844072 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7fc35003f030 con 0x7fc35809bd90 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.761+0000 7fc34a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:44.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.761+0000 7fc34a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:44.763 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":36,"quorum":[1,2,3,4,5,6,7,8],"quorum_names":["f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:44.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 >> v2:172.21.15.135:6800/726754104 conn(0x7fc33c03ea80 msgr2=0x7fc33c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 --2- 172.21.15.71:0/108844072 >> v2:172.21.15.135:6800/726754104 conn(0x7fc33c03ea80 0x7fc33c040f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0091d0 tx=0x7fc34c008040 comp rx=0 tx=0).stop 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 10 monclient: shutdown 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 msgr2=0x7fc35809c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 0x7fc35809c370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc350031000 tx=0x7fc350004a40 comp rx=0 tx=0).stop 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 shutdown_connections 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 --2- 172.21.15.71:0/108844072 >> v2:172.21.15.135:6800/726754104 conn(0x7fc33c03ea80 0x7fc33c040f40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc35809bd90 0x7fc35809c370 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc35809b980 0x7fc3581cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 --2- 172.21.15.71:0/108844072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc35809b5a0 0x7fc3581ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 >> 172.21.15.71:0/108844072 conn(0x7fc3580a4e70 msgr2=0x7fc358070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 shutdown_connections 2024-08-19T11:12:44.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:44.763+0000 7fc35fed3640 1 -- 172.21.15.71:0/108844072 wait complete. 2024-08-19T11:12:47.776 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:47.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.882+0000 7faaaf7c3640 10 monclient: get_monmap_and_config 2024-08-19T11:12:47.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.882+0000 7faaaf7c3640 10 monclient: build_initial_monmap 2024-08-19T11:12:47.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.882+0000 7faaaf7c3640 10 monclient: monmap: 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:47.883301+0000 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:47.883301+0000 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:47.884 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:47.885 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:47.885 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:47.885 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:47.885 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:47.885 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:47.885 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 Processor -- start 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 -- start start 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient: init 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient: _add_conns ranks=[2,10,1,6,3,9,4,7,5,8,0] 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): picked mon.noname-b con 0x7faaa80a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): picked mon.noname-f con 0x7faaa80a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7faaa8139860 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa80a4f90 con 0x7faaa8139860 2024-08-19T11:12:47.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7faaa80a6380 con 0x7faaa80a6e10 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7faaa80a49d0 con 0x7faaa80a6a30 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.883+0000 7faaaf7c3640 10 monclient(hunting): authenticate will time out at 825.924990s 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38318/0 (socket says 172.21.15.71:38318) 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 learned_addr learned my addr 172.21.15.71:0/1392843501 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faaa80a6a30 auth_method 0 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 10 monclient(hunting): get_auth_request con 0x7faaa80a6e10 auth_method 0 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.884+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:47.886+0000 7faaadd60640 1 -- 172.21.15.71:0/1392843501 >> v1:172.21.15.135:6789/0 conn(0x7faaa8139860 legacy=0x7faaa8139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faaa80a6a30 auth_method 0 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:48.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 10 monclient(hunting): get_auth_request con 0x7faaa80a6e10 auth_method 0 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.086+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 10 monclient(hunting): get_auth_request con 0x7faaa80a6e10 auth_method 0 2024-08-19T11:12:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faaa80a6a30 auth_method 0 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:48.487+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.288+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:49.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.288+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faaa80a6a30 auth_method 0 2024-08-19T11:12:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.288+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.288+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.288+0000 7faaad55f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.288+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 10 monclient(hunting): get_auth_request con 0x7faaa80a6e10 auth_method 0 2024-08-19T11:12:49.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:49.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:49.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:49.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:49.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:49.289+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): tick 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 monclient(hunting): continuing hunt 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 msgr2=0x7faaa80a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaa80a6a30 0x7faaa80a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 -- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 msgr2=0x7faaa80a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 --2- 172.21.15.71:0/1392843501 >> v2:172.21.15.135:3300/0 conn(0x7faaa80a6e10 0x7faaa80a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 -- 172.21.15.71:0/1392843501 >> v1:172.21.15.135:6789/0 conn(0x7faaa8139860 legacy=0x7faaa8139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient: _add_conns ranks=[5,8,4,9,3,6,0,7] 2024-08-19T11:12:50.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): picked mon.noname-h con 0x7faa8c0038c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 0x7faa8c0087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): picked mon.noname-e con 0x7faa8c006370 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 0x7faa8c00b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): picked mon.noname-c con 0x7faa8c008ed0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 -- 172.21.15.71:0/1392843501 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7faaa80a6380 con 0x7faa8c008ed0 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 -- 172.21.15.71:0/1392843501 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7faaa80a49d0 con 0x7faa8c0038c0 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 1 -- 172.21.15.71:0/1392843501 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7faa8c00bae0 con 0x7faa8c006370 2024-08-19T11:12:50.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faa9effd640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 0x7faa8c0087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 10 monclient(hunting): get_auth_request con 0x7faa8c006370 auth_method 0 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 0x7faa8c00b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 10 monclient(hunting): get_auth_request con 0x7faa8c008ed0 auth_method 0 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:50.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 msgr2=0x7faa8c0087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 msgr2=0x7faa8c0087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 0x7faa8c0087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 0x7faa8c0087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faa8c0038c0 auth_method 0 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:50.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 msgr2=0x7faa8c00b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 msgr2=0x7faa8c00b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 0x7faa8c00b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaadd60640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 0x7faa8c00b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 msgr2=0x7faa8c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 msgr2=0x7faa8c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:50.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:50.884+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faa8c0038c0 auth_method 0 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:51.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient(hunting): handle_auth_done global_id 14963 payload 274 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 msgr2=0x7faa8c0087e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c006370 0x7faa8c0087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 msgr2=0x7faa8c00b360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa8c008ed0 0x7faa8c00b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient: _finish_hunting 0 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 monclient: found mon.noname-h 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa80a46f0 con 0x7faa8c0038c0 2024-08-19T11:12:51.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.085+0000 7faaadd60640 1 -- 172.21.15.71:0/1392843501 reap_dead start 2024-08-19T11:12:51.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faaad55f640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 msgr2=0x7faa8c005cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:51.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faaad55f640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faaa4014a40 tx=0x7faaa402b650 comp rx=0 tx=0).ready entity=mon.5 client_cookie=4b72c5898a46192 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 1 -- 172.21.15.71:0/1392843501 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faaa400f040 con 0x7faa8c0038c0 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: dump: 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:51.091 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:51.092 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: _finish_auth 0 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 1 -- 172.21.15.71:0/1392843501 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa40044a0 con 0x7faa8c0038c0 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 1 -- 172.21.15.71:0/1392843501 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faaa4003a80 con 0x7faa8c0038c0 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faaaf7c3640 5 monclient: authenticate success, global_id 14963 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faaaf7c3640 10 monclient: get_monmap_and_config success 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faaaf7c3640 4 set_mon_vals no callback set 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.089+0000 7faa9ffff640 10 monclient: dump: 2024-08-19T11:12:51.093 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:51.094 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 10 monclient: shutdown 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 msgr2=0x7faa8c005cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faaa4014a40 tx=0x7faaa402b650 comp rx=0 tx=0).stop 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1392843501 shutdown_connections 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1392843501 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa8c0038c0 0x7faa8c005cd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1392843501 >> 172.21.15.71:0/1392843501 conn(0x7faaa80ac030 msgr2=0x7faaa80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:51.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1392843501 shutdown_connections 2024-08-19T11:12:51.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.090+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1392843501 wait complete. 2024-08-19T11:12:51.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.091+0000 7faaaf7c3640 10 monclient: build_initial_monmap 2024-08-19T11:12:51.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.091+0000 7faaaf7c3640 10 monclient: monmap: 2024-08-19T11:12:51.102 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:51.102 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:51.103 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.091+0000 7faaaf7c3640 1 Processor -- start 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 -- start start 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient: init 2024-08-19T11:12:51.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient: _add_conns ranks=[8,6,3,7,5,4,0,1,2] 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): picked mon.noname-e con 0x7faa8c0038c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): picked mon.noname-d con 0x7faaa81cf180 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 0x7faaa8123670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): picked mon.noname-g con 0x7faaa81cf5a0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faaa80a5b80 con 0x7faaa81cf5a0 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7faaa80a5a00 con 0x7faaa81cf180 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7faaa80a5d00 con 0x7faa8c0038c0 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaaf7c3640 10 monclient(hunting): authenticate will time out at 829.133597s 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:43712/0 (socket says 172.21.15.71:43712) 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 -- 172.21.15.71:0/1820189075 learned_addr learned my addr 172.21.15.71:0/1820189075 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 10 monclient(hunting): get_auth_request con 0x7faaa81cf180 auth_method 0 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:51.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:51.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:44750/0 (socket says 172.21.15.71:44750) 2024-08-19T11:12:51.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:51.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 10 monclient(hunting): get_auth_request con 0x7faa8c0038c0 auth_method 0 2024-08-19T11:12:51.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:51.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:51.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:51.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaadd60640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 0x7faaa8123670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:51.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 msgr2=0x7faaa81cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:12:51.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 msgr2=0x7faaa81cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:12:51.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaadd60640 10 monclient(hunting): get_auth_request con 0x7faaa81cf5a0 auth_method 0 2024-08-19T11:12:51.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaadd60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaadd60640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaadd60640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 msgr2=0x7faaa8123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 msgr2=0x7faaa8123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaad55f640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.092+0000 7faaacd5e640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:12:51.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 10 monclient(hunting): handle_auth_done global_id 5025 payload 824 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 msgr2=0x7faaa81cec40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 msgr2=0x7faaa8123130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 10 monclient: _finish_hunting 0 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 1 monclient: found mon.noname-g 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.093+0000 7faaadd60640 1 -- 172.21.15.71:0/1820189075 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa81363d0 con 0x7faaa81cf5a0 2024-08-19T11:12:51.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faaadd60640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 msgr2=0x7faaa8123670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faaadd60640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 0x7faaa8123670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faaa809ca80 tx=0x7faaa000eb90 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faaa0005d50 con 0x7faaa81cf5a0 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: dump: 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: _finish_auth 0 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:12:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa0018070 con 0x7faaa81cf5a0 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faaaf7c3640 5 monclient: authenticate success, global_id 5025 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faaaf7c3640 10 monclient: _renew_subs 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faaaf7c3640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa8126e10 con 0x7faaa81cf5a0 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faaa00070d0 con 0x7faaa81cf5a0 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.095+0000 7faa9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.096+0000 7faa9dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:12:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.096+0000 7faa9dffb640 10 monclient: dump: 2024-08-19T11:12:51.114 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:12:51.114 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:51.114 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.114 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:12:51.114 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:12:51.115 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.096+0000 7faaaf7c3640 10 monclient: _renew_subs 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.096+0000 7faa9f7fe640 4 set_mon_vals no callback set 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.096+0000 7faaaf7c3640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.096+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa8139f40 con 0x7faaa81cf5a0 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.097+0000 7faaaf7c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.097+0000 7faaaf7c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.097+0000 7faaaf7c3640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.097+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa80a71f0 con 0x7faaa81cf5a0 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.097+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7faaa0007270 con 0x7faaa81cf5a0 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.098+0000 7faa9dffb640 1 --2- 172.21.15.71:0/1820189075 >> v2:172.21.15.135:6800/726754104 conn(0x7faa8c03ff30 0x7faa8c0423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.098+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(80..80 src has 1..80) ==== 3898+0+0 (secure 0 0 0) 0x7faaa0010040 con 0x7faaa81cf5a0 2024-08-19T11:12:51.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.098+0000 7faaad55f640 1 --2- 172.21.15.71:0/1820189075 >> v2:172.21.15.135:6800/726754104 conn(0x7faa8c03ff30 0x7faa8c0423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:51.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.098+0000 7faaad55f640 10 monclient: get_auth_request con 0x7faa8c03ff30 auth_method 0 2024-08-19T11:12:51.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.100+0000 7faaad55f640 1 --2- 172.21.15.71:0/1820189075 >> v2:172.21.15.135:6800/726754104 conn(0x7faa8c03ff30 0x7faa8c0423f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009100 tx=0x7faaa4036040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:12:51.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.103+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7faaa0007980 con 0x7faaa81cf5a0 2024-08-19T11:12:51.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.103+0000 7faa9dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:12:51.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.103+0000 7faa9dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:12:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.349+0000 7faaaf7c3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:12:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.349+0000 7faaaf7c3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.349+0000 7faaaf7c3640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:12:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.349+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faaa80a3c50 con 0x7faaa81cf5a0 2024-08-19T11:12:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.350+0000 7faa9dffb640 1 -- 172.21.15.71:0/1820189075 <== mon.3 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7faaa0007740 con 0x7faaa81cf5a0 2024-08-19T11:12:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.350+0000 7faa9dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:12:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.350+0000 7faa9dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:12:51.351 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":40,"quorum":[0,1,3,4,5,7],"quorum_names":["a","f","g","c","h","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:12:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 >> v2:172.21.15.135:6800/726754104 conn(0x7faa8c03ff30 msgr2=0x7faa8c0423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1820189075 >> v2:172.21.15.135:6800/726754104 conn(0x7faa8c03ff30 0x7faa8c0423f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009100 tx=0x7faaa4036040 comp rx=0 tx=0).stop 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 10 monclient: shutdown 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 msgr2=0x7faaa8123670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 0x7faaa8123670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faaa809ca80 tx=0x7faaa000eb90 comp rx=0 tx=0).stop 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 shutdown_connections 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1820189075 >> v2:172.21.15.135:6800/726754104 conn(0x7faa8c03ff30 0x7faa8c0423f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faaa81cf5a0 0x7faaa8123670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faaa81cf180 0x7faaa8123130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 --2- 172.21.15.71:0/1820189075 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faa8c0038c0 0x7faaa81cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 >> 172.21.15.71:0/1820189075 conn(0x7faaa80ac030 msgr2=0x7faaa809cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:12:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 shutdown_connections 2024-08-19T11:12:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:51.352+0000 7faaaf7c3640 1 -- 172.21.15.71:0/1820189075 wait complete. 2024-08-19T11:12:54.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:12:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.472+0000 7f1edbede640 10 monclient: get_monmap_and_config 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.472+0000 7f1edbede640 10 monclient: build_initial_monmap 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.473+0000 7f1edbede640 10 monclient: monmap: 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:12:54.473606+0000 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:12:54.473606+0000 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:12:54.474 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:12:54.475 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.473+0000 7f1edbede640 1 Processor -- start 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.473+0000 7f1edbede640 1 -- start start 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.473+0000 7f1edbede640 10 monclient: init 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient: _reopen_session rank -1 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient: _add_conns ranks=[9,4,1,6,2,7,5,10,0,3,8] 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:54.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): picked mon.noname-a con 0x7f1ed40a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): picked mon.noname-c con 0x7f1ed40a6e10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f1ed4139860 addr v1:172.21.15.135:6789/0 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed40a4f90 con 0x7f1ed4139860 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed40a6380 con 0x7f1ed40a6a30 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1ed40a49d0 con 0x7f1ed40a6e10 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1edbede640 10 monclient(hunting): authenticate will time out at 832.515481s 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:54.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49192/0 (socket says 172.21.15.71:49192) 2024-08-19T11:12:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 learned_addr learned my addr 172.21.15.71:0/701139708 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:12:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6a30 auth_method 0 2024-08-19T11:12:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6e10 auth_method 0 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.474+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.477+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> v1:172.21.15.135:6789/0 conn(0x7f1ed4139860 legacy=0x7f1ed4139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:12:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6a30 auth_method 0 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6e10 auth_method 0 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:54.675+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:55.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:55.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:55.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6e10 auth_method 0 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6a30 auth_method 0 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:55.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:55.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:55.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:55.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.076+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6a30 auth_method 0 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:55.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1ed40a6e10 auth_method 0 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:55.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:55.877+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:57.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): tick 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 monclient(hunting): continuing hunt 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 msgr2=0x7f1ed40a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1ed40a6e10 0x7f1ed40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 msgr2=0x7f1ed40a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> v2:172.21.15.71:3300/0 conn(0x7f1ed40a6a30 0x7f1ed40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 >> v1:172.21.15.135:6789/0 conn(0x7f1ed4139860 legacy=0x7f1ed4139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient: _add_conns ranks=[2,7,6,5,10,0,3,8] 2024-08-19T11:12:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f1eb80038a0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): picked mon.noname-i con 0x7f1eb8006370 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f1eb8008ed0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed40a6380 con 0x7f1eb80038a0 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1ed40a49d0 con 0x7f1eb8008ed0 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): start opening mon connection 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1eb800bae0 con 0x7f1eb8006370 2024-08-19T11:12:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ecb7fe640 10 monclient(hunting): _renew_subs 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1eb80038a0 auth_method 0 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008ed0 auth_method 0 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.474+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8006370 auth_method 0 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:57.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.475+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1eb80038a0 auth_method 0 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008ed0 auth_method 0 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:57.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.675+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8006370 auth_method 0 2024-08-19T11:12:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:57.676+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1eb80038a0 auth_method 0 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008ed0 auth_method 0 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:58.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8006370 auth_method 0 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.077+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.078+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.078+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:58.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.078+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:12:58.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1eb80038a0 auth_method 0 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008ed0 auth_method 0 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:58.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:58.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.878+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:12:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:12:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8006370 auth_method 0 2024-08-19T11:12:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:12:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:12:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:12:58.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:12:58.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:12:58.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:12:58.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:12:58.880+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:00.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): tick 2024-08-19T11:13:00.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:13:00.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 monclient(hunting): continuing hunt 2024-08-19T11:13:00.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 msgr2=0x7f1eb80087e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1eb8006370 0x7f1eb80087e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 msgr2=0x7f1eb800b360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1eb8008ed0 0x7f1eb800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 msgr2=0x7f1eb8005cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1eb80038a0 0x7f1eb8005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 reap_dead start 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient: _add_conns ranks=[0,3,8,10,5] 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 reap_dead start 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1eb8003ce0 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): picked mon.noname-g con 0x7f1eb8007ef0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:00.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): picked mon.noname-e con 0x7f1eb8008350 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed40a46f0 con 0x7f1eb8003ce0 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed40a6380 con 0x7f1eb8007ef0 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f1ed40a49d0 con 0x7f1eb8008350 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1ecb7fe640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.474+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008350 auth_method 0 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:00.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8007ef0 auth_method 0 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:00.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.475+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:00.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.477+0000 7f1ed9c7a640 1 -- 172.21.15.71:0/701139708 >> v1:172.21.15.71:6789/0 conn(0x7f1eb8003ce0 legacy=0x7f1eb80067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:00.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.676+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.676+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008350 auth_method 0 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.676+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.676+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.676+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8007ef0 auth_method 0 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:00.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:00.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:00.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:00.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:00.677+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:01.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008350 auth_method 0 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8007ef0 auth_method 0 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:01.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.078+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8008350 auth_method 0 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1eb8007ef0 auth_method 0 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.879+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:01.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.949+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018861546 0 0) 0x7f1ed40a46f0 con 0x7f1eb8003ce0 2024-08-19T11:13:01.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.949+0000 7f1ed8c78640 10 monclient(hunting): _negotiate 2024-08-19T11:13:01.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.949+0000 7f1ed8c78640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.949+0000 7f1ed8c78640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:01.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.949+0000 7f1ed8c78640 10 monclient(hunting): my global_id is 34101 2024-08-19T11:13:01.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.949+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ec0003520 con 0x7f1eb8003ce0 2024-08-19T11:13:01.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3588032579 0 0) 0x7f1ec0003520 con 0x7f1eb8003ce0 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 msgr2=0x7f1eb80087b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1eb8008350 0x7f1eb80087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1eb800b2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1eb800b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: _finish_hunting 0 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb800f1b0 con 0x7f1eb8003ce0 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: _finish_auth 0 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: _check_auth_tickets 2024-08-19T11:13:01.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f1ed000f040 con 0x7f1eb8003ce0 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: dump: 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:01.956 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 >> v1:172.21.15.71:6789/0 conn(0x7f1eb8003ce0 legacy=0x7f1eb80067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient: _add_conns ranks=[1,7,3,0,6,8,4,2,5] 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec0004200 0x7f1ec0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): picked mon.f con 0x7f1ec0004200 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1ec0004e10 0x7f1ec0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): picked mon.i con 0x7f1ec0004e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1ec000bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): picked mon.g con 0x7f1eb8007ef0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed40a6380 con 0x7f1ec0004200 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed40a49d0 con 0x7f1eb8007ef0 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1ec000c3a0 con 0x7f1ec0004e10 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.951+0000 7f1ed8c78640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:13:01.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1ec000bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1eb8007ef0 auth_method 0 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec0004200 0x7f1ec0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1ec0004e10 0x7f1ec0005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1ec0004200 auth_method 0 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1ec0004e10 auth_method 0 2024-08-19T11:13:01.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9c7a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient(hunting): handle_auth_done global_id 34101 payload 293 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1ec0004e10 msgr2=0x7f1ec0005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1ec0004e10 0x7f1ec0005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec0004200 msgr2=0x7f1ec0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ec0004200 0x7f1ec0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient: _finish_hunting 0 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 monclient: found mon.g 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec0003520 con 0x7f1eb8007ef0 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient: _finish_auth 0 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 10 monclient: _check_auth_tickets 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1eda47b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:01.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1edbede640 5 monclient: authenticate success, global_id 34101 2024-08-19T11:13:01.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1edbede640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:01.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.952+0000 7f1ed9479640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1ec0004e10 0x7f1ec0005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:01.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.955+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1ec000bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:01.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.955+0000 7f1eda47b640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1ec000bc60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40a35e0 tx=0x7f1ec0005830 comp rx=0 tx=0).ready entity=mon.3 client_cookie=d2dd514f34989844 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:01.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ecc039070 con 0x7f1eb8007ef0 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: dump: 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0337e0 con 0x7f1eb8007ef0 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1edbede640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1edbede640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 1 -- 172.21.15.71:0/701139708 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ecc005db0 con 0x7f1eb8007ef0 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1edbede640 4 set_mon_vals no callback set 2024-08-19T11:13:01.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.958+0000 7f1ed8c78640 10 monclient: dump: 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:01.970 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 10 monclient: shutdown 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 1 -- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 msgr2=0x7f1ec000bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 1 --2- 172.21.15.71:0/701139708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1eb8007ef0 0x7f1ec000bc60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40a35e0 tx=0x7f1ec0005830 comp rx=0 tx=0).stop 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1eda47b640 1 -- 172.21.15.71:0/701139708 reap_dead start 2024-08-19T11:13:01.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 1 -- 172.21.15.71:0/701139708 shutdown_connections 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 1 -- 172.21.15.71:0/701139708 >> 172.21.15.71:0/701139708 conn(0x7f1ed40ac030 msgr2=0x7f1ed40ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 1 -- 172.21.15.71:0/701139708 shutdown_connections 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.959+0000 7f1edbede640 1 -- 172.21.15.71:0/701139708 wait complete. 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 10 monclient: build_initial_monmap 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 10 monclient: monmap: 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:01.972 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 1 Processor -- start 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 1 -- start start 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 10 monclient: init 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.960+0000 7f1edbede640 10 monclient: _add_conns ranks=[5,6,1,2,0,4,8,3,7] 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1ed41ce110 0x7f1ed4138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): picked mon.noname-h con 0x7f1ed41ce110 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): picked mon.noname-d con 0x7f1ed41393f0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 0x7f1ed41232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): picked mon.noname-f con 0x7f1ed4122e60 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed40a5b80 con 0x7f1ed4122e60 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1ed40a5a00 con 0x7f1ed41ce110 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1ed40a5d00 con 0x7f1ed41393f0 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1edbede640 10 monclient(hunting): authenticate will time out at 840.002064s 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:52804/0 (socket says 172.21.15.71:52804) 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 -- 172.21.15.71:0/4173554217 learned_addr learned my addr 172.21.15.71:0/4173554217 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 10 monclient(hunting): get_auth_request con 0x7f1ed41393f0 auth_method 0 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 0x7f1ed41232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1ed41ce110 0x7f1ed4138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): get_auth_request con 0x7f1ed4122e60 auth_method 0 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request con 0x7f1ed41ce110 auth_method 0 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 -- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 msgr2=0x7f1ed4122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 -- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 msgr2=0x7f1ed4122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9479640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:01.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient(hunting): handle_auth_done global_id 4915 payload 824 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 -- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 msgr2=0x7f1ed4122920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 -- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1ed41ce110 msgr2=0x7f1ed4138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1ed41ce110 0x7f1ed4138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient: _finish_hunting 0 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 monclient: found mon.noname-f 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1eda47b640 1 -- 172.21.15.71:0/4173554217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed413a140 con 0x7f1ed4122e60 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.961+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1ed41ce110 0x7f1ed4138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eda47b640 1 -- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 msgr2=0x7f1ed41232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eda47b640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 0x7f1ed41232e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc007fd0 tx=0x7f1ecc001830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ecc039040 con 0x7f1ed4122e60 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: dump: 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 5 monclient: authenticate success, global_id 4915 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc033db0 con 0x7f1ed4122e60 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 10 monclient: _renew_subs 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ec4017a50 con 0x7f1ed4122e60 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed4125520 con 0x7f1ed4122e60 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1ecbfff640 4 set_mon_vals no callback set 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1eca7fc640 10 monclient: dump: 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 10 monclient: _renew_subs 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.964+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed4126640 con 0x7f1ed4122e60 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.965+0000 7f1edbede640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.965+0000 7f1edbede640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.965+0000 7f1edbede640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.965+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed4126440 con 0x7f1ed4122e60 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.966+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1ecc046030 con 0x7f1ed4122e60 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.966+0000 7f1eca7fc640 1 --2- 172.21.15.71:0/4173554217 >> v2:172.21.15.135:6800/726754104 conn(0x7f1eb803fe30 0x7f1eb80422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.966+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 3898+0+0 (secure 0 0 0) 0x7f1ecc044020 con 0x7f1ed4122e60 2024-08-19T11:13:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.966+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/4173554217 >> v2:172.21.15.135:6800/726754104 conn(0x7f1eb803fe30 0x7f1eb80422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.966+0000 7f1ed9c7a640 10 monclient: get_auth_request con 0x7f1eb803fe30 auth_method 0 2024-08-19T11:13:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.969+0000 7f1ed9c7a640 1 --2- 172.21.15.71:0/4173554217 >> v2:172.21.15.135:6800/726754104 conn(0x7f1eb803fe30 0x7f1eb80422f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0016520 tx=0x7f1ed001d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.971+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f1ecc04d060 con 0x7f1ed4122e60 2024-08-19T11:13:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.971+0000 7f1eca7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:01.971+0000 7f1eca7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:02.070 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:02.070 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: starting. 2024-08-19T11:13:02.070 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-24941 2024-08-19T11:13:02.070 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: created object 0... 2024-08-19T11:13:02.071 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: created object 25... 2024-08-19T11:13:02.071 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: created object 49... 2024-08-19T11:13:02.071 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: finishing. 2024-08-19T11:13:02.071 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[24978]: shutting down. 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24980]: starting. 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24980]: listing objects. 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24980]: listed object 0... 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24980]: listed object 25... 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24980]: saw 50 objects 2024-08-19T11:13:02.114 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[24980]: shutting down. 2024-08-19T11:13:02.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.233+0000 7f1edbede640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:02.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.233+0000 7f1edbede640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:02.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.233+0000 7f1edbede640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:02.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.233+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1ed409e1c0 con 0x7f1ed4122e60 2024-08-19T11:13:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.234+0000 7f1eca7fc640 1 -- 172.21.15.71:0/4173554217 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3180 (secure 0 0 0) 0x7f1ecc03d400 con 0x7f1ed4122e60 2024-08-19T11:13:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.234+0000 7f1eca7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.234+0000 7f1eca7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:02.235 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":52,"quorum":[0,1,2,3,4,5,7],"quorum_names":["a","f","b","g","c","h","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 >> v2:172.21.15.135:6800/726754104 conn(0x7f1eb803fe30 msgr2=0x7f1eb80422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 --2- 172.21.15.71:0/4173554217 >> v2:172.21.15.135:6800/726754104 conn(0x7f1eb803fe30 0x7f1eb80422f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0016520 tx=0x7f1ed001d040 comp rx=0 tx=0).stop 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 10 monclient: shutdown 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 msgr2=0x7f1ed41232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 0x7f1ed41232e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc007fd0 tx=0x7f1ecc001830 comp rx=0 tx=0).stop 2024-08-19T11:13:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 shutdown_connections 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 --2- 172.21.15.71:0/4173554217 >> v2:172.21.15.135:6800/726754104 conn(0x7f1eb803fe30 0x7f1eb80422f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ed4122e60 0x7f1ed41232e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1ed41393f0 0x7f1ed4122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 --2- 172.21.15.71:0/4173554217 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1ed41ce110 0x7f1ed4138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 >> 172.21.15.71:0/4173554217 conn(0x7f1ed40ac030 msgr2=0x7f1ed40aa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 shutdown_connections 2024-08-19T11:13:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:02.236+0000 7f1edbede640 1 -- 172.21.15.71:0/4173554217 wait complete. 2024-08-19T11:13:05.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.356+0000 7f514da6e640 10 monclient: get_monmap_and_config 2024-08-19T11:13:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.356+0000 7f514da6e640 10 monclient: build_initial_monmap 2024-08-19T11:13:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.356+0000 7f514da6e640 10 monclient: monmap: 2024-08-19T11:13:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:05.357 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:05.356969+0000 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:05.356969+0000 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:05.358 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:05.359 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:05.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 Processor -- start 2024-08-19T11:13:05.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 -- start start 2024-08-19T11:13:05.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient: init 2024-08-19T11:13:05.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:05.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient: _add_conns ranks=[5,3,7,1,6,0,4,9,2,8,10] 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): picked mon.noname-h con 0x7f51480a57d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): picked mon.noname-g con 0x7f5148072400 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): picked mon.noname-i con 0x7f51480a60f0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5148072880 con 0x7f5148072400 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:05.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f51480741c0 con 0x7f51480a57d0 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f51480a6530 con 0x7f51480a60f0 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.357+0000 7f514da6e640 10 monclient(hunting): authenticate will time out at 843.398992s 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:45666/0 (socket says 172.21.15.71:45666) 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:42028/0 (socket says 172.21.15.71:42028) 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:42874/0 (socket says 172.21.15.71:42874) 2024-08-19T11:13:05.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 learned_addr learned my addr 172.21.15.71:0/3878993200 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f51480a57d0 auth_method 0 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5148072400 auth_method 0 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f51480a60f0 auth_method 0 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:05.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:05.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:05.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:05.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.358+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f51480a60f0 auth_method 0 2024-08-19T11:13:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f51480a57d0 auth_method 0 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5148072400 auth_method 0 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.559+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5148072400 auth_method 0 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f51480a60f0 auth_method 0 2024-08-19T11:13:05.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f51480a57d0 auth_method 0 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:05.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:05.960+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f51480a57d0 auth_method 0 2024-08-19T11:13:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f51480a60f0 auth_method 0 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5148072400 auth_method 0 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:06.761+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:08.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): tick 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 msgr2=0x7f5148137580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f51480a60f0 0x7f5148137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 msgr2=0x7f51480a17d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f51480a57d0 0x7f51480a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 msgr2=0x7f51480a5bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5148072400 0x7f51480a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:08.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient: _add_conns ranks=[1,8,0,2,10,4,9,6] 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5134003830 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f5134007440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5134009f70 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 -- 172.21.15.71:0/3878993200 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51480a72a0 con 0x7f5134009f70 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 -- 172.21.15.71:0/3878993200 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513400ecd0 con 0x7f5134003830 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 1 -- 172.21.15.71:0/3878993200 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f51480741c0 con 0x7f5134007440 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f5145ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5134007440 auth_method 0 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:08.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.358+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.360+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 >> v1:172.21.15.71:6789/0 conn(0x7f5134009f70 legacy=0x7f513400c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:08.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.360+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> v1:172.21.15.135:6789/0 conn(0x7f5134003830 legacy=0x7f5134005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5134007440 auth_method 0 2024-08-19T11:13:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.559+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5134007440 auth_method 0 2024-08-19T11:13:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:08.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:08.960+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5134007440 auth_method 0 2024-08-19T11:13:09.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:09.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.760+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.941+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972375853 0 0) 0x7f513400ecd0 con 0x7f5134003830 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.941+0000 7f5146ffd640 10 monclient(hunting): _negotiate 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.941+0000 7f5146ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.941+0000 7f5146ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.941+0000 7f5146ffd640 10 monclient(hunting): my global_id is 4924 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.941+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5128003520 con 0x7f5134003830 2024-08-19T11:13:09.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2930478772 0 0) 0x7f5128003520 con 0x7f5134003830 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 msgr2=0x7f51340098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5134007440 0x7f51340098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 >> v1:172.21.15.71:6789/0 conn(0x7f5134009f70 legacy=0x7f513400c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 monclient: found mon.noname-f-legacy 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.135:6789/0 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 1 -- 172.21.15.71:0/3878993200 reap_dead start 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513400ff70 con 0x7f5134003830 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f513800f040 con 0x7f5134003830 2024-08-19T11:13:09.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: dump: 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:09.948 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] but i'm connected to v1:172.21.15.135:6789/0, reconnecting 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 >> v1:172.21.15.135:6789/0 conn(0x7f5134003830 legacy=0x7f5134005c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient: _add_conns ranks=[2,8,3,0,7,6,4,5,1] 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 0x7f5128004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): picked mon.b con 0x7f5128004280 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128004e90 0x7f51280099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): picked mon.e con 0x7f5128004e90 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5128009ef0 0x7f512800c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): picked mon.g con 0x7f5128009ef0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51480741c0 con 0x7f5128004280 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f512800cad0 con 0x7f5128009ef0 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f512800cc80 con 0x7f5128004e90 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5146ffd640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 0x7f5128004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f5128004280 auth_method 0 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5128009ef0 0x7f512800c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128004e90 0x7f51280099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f5128009ef0 auth_method 0 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5128004e90 auth_method 0 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f513ffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.942+0000 7f51477fe640 10 monclient(hunting): handle_auth_done global_id 4924 payload 293 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128004e90 msgr2=0x7f51280099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128004e90 0x7f51280099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5128009ef0 msgr2=0x7f512800c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5128009ef0 0x7f512800c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:09.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 1 monclient: found mon.b 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5128003520 con 0x7f5128004280 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f51477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f514da6e640 5 monclient: authenticate success, global_id 4924 2024-08-19T11:13:09.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.943+0000 7f514da6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.946+0000 7f51477fe640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 msgr2=0x7f5128004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.946+0000 7f51477fe640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 0x7f5128004800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5138006e90 tx=0x7f5128005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e03c3e7fa58b647 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5138031070 con 0x7f5128004280 2024-08-19T11:13:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: dump: 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513802bc80 con 0x7f5128004280 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f514da6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f514da6e640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 1 -- 172.21.15.71:0/3878993200 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f513800cc70 con 0x7f5128004280 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f514da6e640 4 set_mon_vals no callback set 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.948+0000 7f5146ffd640 10 monclient: dump: 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 10 monclient: shutdown 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 -- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 msgr2=0x7f5128004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 0x7f5128004800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5138006e90 tx=0x7f5128005830 comp rx=0 tx=0).stop 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 -- 172.21.15.71:0/3878993200 shutdown_connections 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128004e90 0x7f51280099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5128009ef0 0x7f512800c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 --2- 172.21.15.71:0/3878993200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004280 0x7f5128004800 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 -- 172.21.15.71:0/3878993200 >> 172.21.15.71:0/3878993200 conn(0x7f51480aa3f0 msgr2=0x7f51480a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:09.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 -- 172.21.15.71:0/3878993200 shutdown_connections 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 1 -- 172.21.15.71:0/3878993200 wait complete. 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.949+0000 7f514da6e640 10 monclient: build_initial_monmap 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient: monmap: 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:09.963 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 Processor -- start 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 -- start start 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient: init 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient: _add_conns ranks=[6,2,8,1,0,3,4,7,5] 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 0x7f51481c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): picked mon.noname-d con 0x7f5128004280 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004e90 0x7f51481367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): picked mon.noname-b con 0x7f5128004e90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128009ef0 0x7f5148136d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): picked mon.noname-e con 0x7f5128009ef0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51480a5f40 con 0x7f5128004e90 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f51480a5dc0 con 0x7f5128004280 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f51480a17d0 con 0x7f5128009ef0 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.950+0000 7f514da6e640 10 monclient(hunting): authenticate will time out at 847.992946s 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 0x7f51481c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004e90 0x7f51481367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 0x7f51481c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50776/0 (socket says 172.21.15.71:50776) 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 -- 172.21.15.71:0/3031231155 learned_addr learned my addr 172.21.15.71:0/3031231155 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f5128004280 auth_method 0 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128009ef0 0x7f5148136d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): get_auth_request con 0x7f5128004e90 auth_method 0 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f5128009ef0 auth_method 0 2024-08-19T11:13:09.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient(hunting): handle_auth_done global_id 24468 payload 824 2024-08-19T11:13:09.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 -- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128009ef0 msgr2=0x7f5148136d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128009ef0 0x7f5148136d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 -- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004e90 msgr2=0x7f51481367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004e90 0x7f51481367e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 monclient: found mon.noname-d 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f51477fe640 1 -- 172.21.15.71:0/3031231155 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51481241a0 con 0x7f5128004280 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f513ffff640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004e90 0x7f51481367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.951+0000 7f5147fff640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128009ef0 0x7f5148136d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f51477fe640 1 -- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 msgr2=0x7f51481c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f51477fe640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 0x7f51481c9c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5138006e90 tx=0x7f51380046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5138044020 con 0x7f5128004280 2024-08-19T11:13:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 10 monclient: dump: 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:09.969 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 10 monclient: _finish_auth 0 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5138006bd0 con 0x7f5128004280 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.953+0000 7f514da6e640 5 monclient: authenticate success, global_id 24468 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f514da6e640 10 monclient: _renew_subs 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f514da6e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51480a2e50 con 0x7f5128004280 2024-08-19T11:13:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f5144ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f513800cc70 con 0x7f5128004280 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f5144ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f5144ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f5144ff9640 10 monclient: dump: 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f51467fc640 4 set_mon_vals no callback set 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f514da6e640 10 monclient: _renew_subs 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f514da6e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5148121e40 con 0x7f5128004280 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.954+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5138047020 con 0x7f5128004280 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f514da6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f514da6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f514da6e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148072b30 con 0x7f5128004280 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f5144ff9640 1 --2- 172.21.15.71:0/3031231155 >> v2:172.21.15.135:6800/726754104 conn(0x7f513403f8c0 0x7f5134041d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (secure 0 0 0) 0x7f5138072eb0 con 0x7f5128004280 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f513ffff640 1 --2- 172.21.15.71:0/3031231155 >> v2:172.21.15.135:6800/726754104 conn(0x7f513403f8c0 0x7f5134041d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.955+0000 7f513ffff640 10 monclient: get_auth_request con 0x7f513403f8c0 auth_method 0 2024-08-19T11:13:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.957+0000 7f513ffff640 1 --2- 172.21.15.71:0/3031231155 >> v2:172.21.15.135:6800/726754104 conn(0x7f513403f8c0 0x7f5134041d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5148121b00 tx=0x7f5130020040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:09.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.960+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f5148072b30 con 0x7f5128004280 2024-08-19T11:13:09.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.960+0000 7f5144ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:09.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:09.960+0000 7f5144ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f514da6e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f514da6e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f514da6e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5148123ab0 con 0x7f5128004280 2024-08-19T11:13:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f5144ff9640 1 -- 172.21.15.71:0/3031231155 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f5148123ab0 con 0x7f5128004280 2024-08-19T11:13:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f5144ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:10.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.203+0000 7f5144ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:10.206 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":62,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:10.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 >> v2:172.21.15.135:6800/726754104 conn(0x7f513403f8c0 msgr2=0x7f5134041d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 --2- 172.21.15.71:0/3031231155 >> v2:172.21.15.135:6800/726754104 conn(0x7f513403f8c0 0x7f5134041d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5148121b00 tx=0x7f5130020040 comp rx=0 tx=0).stop 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 10 monclient: shutdown 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 msgr2=0x7f51481c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 0x7f51481c9c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5138006e90 tx=0x7f51380046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 shutdown_connections 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 --2- 172.21.15.71:0/3031231155 >> v2:172.21.15.135:6800/726754104 conn(0x7f513403f8c0 0x7f5134041d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5128009ef0 0x7f5148136d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5128004e90 0x7f51481367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 --2- 172.21.15.71:0/3031231155 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5128004280 0x7f51481c9c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.205+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 >> 172.21.15.71:0/3031231155 conn(0x7f51480aa3f0 msgr2=0x7f51480a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.206+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 shutdown_connections 2024-08-19T11:13:10.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.206+0000 7f514da6e640 1 -- 172.21.15.71:0/3031231155 wait complete. 2024-08-19T11:13:10.218 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:13:10.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:13:10.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.315+0000 7fd18caa6640 10 monclient: get_monmap_and_config 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.315+0000 7fd18caa6640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.315+0000 7fd18caa6640 10 monclient: monmap: 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:10.316868+0000 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:10.316868+0000 2024-08-19T11:13:10.317 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:10.318 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.315+0000 7fd18caa6640 1 Processor -- start 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 -- start start 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient: init 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient: _add_conns ranks=[3,6,9,10,5,7,1,8,4,2,0] 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1881377e0 0x7fd188137bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): picked mon.noname-g con 0x7fd1881377e0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 0x7fd1880a4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): picked mon.noname-d con 0x7fd1880a2950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 0x7fd1880a5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): picked mon.noname-a con 0x7fd1880a4b80 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd1880a2dd0 con 0x7fd1880a4b80 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880a26d0 con 0x7fd1881377e0 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd18809fd40 con 0x7fd1880a2950 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18caa6640 10 monclient(hunting): authenticate will time out at 848.358564s 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 0x7fd1880a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 0x7fd1880a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 0x7fd1880a5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38996/0 (socket says 172.21.15.71:38996) 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 0x7fd1880a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50778/0 (socket says 172.21.15.71:50778) 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 1 -- 172.21.15.71:0/743592411 learned_addr learned my addr 172.21.15.71:0/743592411 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): get_auth_request con 0x7fd1880a4b80 auth_method 0 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): get_auth_request con 0x7fd1880a2950 auth_method 0 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd186d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18659c640 1 --2- 172.21.15.71:0/743592411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1881377e0 0x7fd188137bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18659c640 10 monclient(hunting): get_auth_request con 0x7fd1881377e0 auth_method 0 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd18659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 10 monclient(hunting): handle_auth_done global_id 24477 payload 274 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 1 -- 172.21.15.71:0/743592411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1881377e0 msgr2=0x7fd188137bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.316+0000 7fd17ffff640 1 --2- 172.21.15.71:0/743592411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1881377e0 0x7fd188137bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 1 -- 172.21.15.71:0/743592411 >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 msgr2=0x7fd1880a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 1 --2- 172.21.15.71:0/743592411 >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 0x7fd1880a5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 1 monclient: found mon.noname-d 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd17ffff640 1 -- 172.21.15.71:0/743592411 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18806d700 con 0x7fd1880a2950 2024-08-19T11:13:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.317+0000 7fd186d9d640 1 --2- 172.21.15.71:0/743592411 >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 0x7fd1880a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:10.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.319+0000 7fd17ffff640 1 -- 172.21.15.71:0/743592411 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 msgr2=0x7fd1880a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.319+0000 7fd17ffff640 1 --2- 172.21.15.71:0/743592411 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 0x7fd1880a4640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1700097a0 tx=0x7fd17002a050 comp rx=0 tx=0).ready entity=mon.6 client_cookie=d16fb8f0b5f1ee56 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.319+0000 7fd185d9b640 1 -- 172.21.15.71:0/743592411 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd170037070 con 0x7fd1880a2950 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.319+0000 7fd185d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: dump: 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 5 monclient: authenticate success, global_id 24477 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 1 -- 172.21.15.71:0/743592411 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17002adb0 con 0x7fd1880a2950 2024-08-19T11:13:10.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 4 set_mon_vals no callback set 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 1 -- 172.21.15.71:0/743592411 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd170030c20 con 0x7fd1880a2950 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd185d9b640 10 monclient: dump: 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 10 monclient: shutdown 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 -- 172.21.15.71:0/743592411 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 msgr2=0x7fd1880a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 --2- 172.21.15.71:0/743592411 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 0x7fd1880a4640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1700097a0 tx=0x7fd17002a050 comp rx=0 tx=0).stop 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 -- 172.21.15.71:0/743592411 shutdown_connections 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 --2- 172.21.15.71:0/743592411 >> v2:172.21.15.71:3300/0 conn(0x7fd1880a4b80 0x7fd1880a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 --2- 172.21.15.71:0/743592411 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd1880a2950 0x7fd1880a4640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 --2- 172.21.15.71:0/743592411 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1881377e0 0x7fd188137bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 -- 172.21.15.71:0/743592411 >> 172.21.15.71:0/743592411 conn(0x7fd18806dfe0 msgr2=0x7fd1880a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 -- 172.21.15.71:0/743592411 shutdown_connections 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.320+0000 7fd18caa6640 1 -- 172.21.15.71:0/743592411 wait complete. 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.321+0000 7fd18caa6640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.321+0000 7fd18caa6640 10 monclient: monmap: 2024-08-19T11:13:10.338 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.339 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.321+0000 7fd18caa6640 1 Processor -- start 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.321+0000 7fd18caa6640 1 -- start start 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.321+0000 7fd18caa6640 10 monclient: init 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient: _add_conns ranks=[3,8,0,2,5,1,6,4,7] 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1880a2950 0x7fd1881cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): picked mon.noname-g con 0x7fd1880a2950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd1880a4b80 0x7fd1881cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): picked mon.noname-e con 0x7fd1880a4b80 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 0x7fd1881ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): picked mon.noname-a con 0x7fd1881377e0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880a3010 con 0x7fd1881377e0 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd188138100 con 0x7fd1880a2950 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd188125a10 con 0x7fd1880a4b80 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18caa6640 10 monclient(hunting): authenticate will time out at 848.364314s 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 0x7fd1881ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd1880a4b80 0x7fd1881cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 0x7fd1881ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39006/0 (socket says 172.21.15.71:39006) 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 -- 172.21.15.71:0/1014830733 learned_addr learned my addr 172.21.15.71:0/1014830733 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): get_auth_request con 0x7fd1881377e0 auth_method 0 2024-08-19T11:13:10.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): get_auth_request con 0x7fd1880a4b80 auth_method 0 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1880a2950 0x7fd1881cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): get_auth_request con 0x7fd1880a2950 auth_method 0 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient(hunting): handle_auth_done global_id 34119 payload 824 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd1880a4b80 msgr2=0x7fd1881cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd1880a4b80 0x7fd1881cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1880a2950 msgr2=0x7fd1881cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1880a2950 0x7fd1881cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 monclient: found mon.noname-a 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd186d9d640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1880a7c40 con 0x7fd1881377e0 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.322+0000 7fd17ffff640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd1880a4b80 0x7fd1881cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.324+0000 7fd186d9d640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 msgr2=0x7fd1881ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.324+0000 7fd186d9d640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 0x7fd1881ccd30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd18000efc0 tx=0x7fd18000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd18000cdf0 con 0x7fd1881377e0 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: dump: 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.344 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.345 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800148f0 con 0x7fd1881377e0 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd1800073f0 con 0x7fd1881377e0 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd17effd640 10 monclient: dump: 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.346 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18559a640 4 set_mon_vals no callback set 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 5 monclient: authenticate success, global_id 34119 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 10 monclient: _renew_subs 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd188124ba0 con 0x7fd1881377e0 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 10 monclient: _renew_subs 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd188125730 con 0x7fd1881377e0 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 0x7fd188121bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.325+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd18806a590 con 0x7fd188125e30 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd18001b070 con 0x7fd1881377e0 2024-08-19T11:13:10.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 0x7fd188121bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient: get_auth_request con 0x7fd188125e30 auth_method 0 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 10 monclient(hunting): handle_auth_done global_id 34128 payload 824 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd18659c640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1880a4640 con 0x7fd188125e30 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd17effd640 1 --2- 172.21.15.71:0/1014830733 >> v2:172.21.15.135:6800/726754104 conn(0x7fd16803ea80 0x7fd168040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (secure 0 0 0) 0x7fd180019020 con 0x7fd1881377e0 2024-08-19T11:13:10.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd17ffff640 1 --2- 172.21.15.71:0/1014830733 >> v2:172.21.15.135:6800/726754104 conn(0x7fd16803ea80 0x7fd168040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.326+0000 7fd17ffff640 10 monclient: get_auth_request con 0x7fd16803ea80 auth_method 0 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd18659c640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 msgr2=0x7fd188121bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd18659c640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 0x7fd188121bc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd178010820 tx=0x7fd178010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd178018020 con 0x7fd188125e30 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 10 monclient: dump: 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.350 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd178004450 con 0x7fd188125e30 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:10.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 msgr2=0x7fd188121bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 0x7fd188121bc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd178010820 tx=0x7fd178010ce0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 msgr2=0x7fd188121bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.328+0000 7fd17effd640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188125e30 0x7fd188121bc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.329+0000 7fd17ffff640 1 --2- 172.21.15.71:0/1014830733 >> v2:172.21.15.135:6800/726754104 conn(0x7fd16803ea80 0x7fd168040f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1880a8c00 tx=0x7fd17002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18caa6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18caa6640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 0x7fd188122510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18caa6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880a3190 con 0x7fd188122100 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 0x7fd188122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient: get_auth_request con 0x7fd188122100 auth_method 0 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 10 monclient(hunting): handle_auth_done global_id 34137 payload 824 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.335+0000 7fd18659c640 1 -- 172.21.15.71:0/1014830733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd188122a50 con 0x7fd188122100 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.337+0000 7fd18659c640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 msgr2=0x7fd188122510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.337+0000 7fd18659c640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 0x7fd188122510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd178019000 tx=0x7fd1780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.337+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd178018040 con 0x7fd188122100 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.337+0000 7fd17effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.337+0000 7fd17effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.337+0000 7fd17effd640 10 monclient: dump: 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.355 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fd178020e50 con 0x7fd188122100 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:10.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 msgr2=0x7fd188122510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 0x7fd188122510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd178019000 tx=0x7fd1780046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 msgr2=0x7fd188122510 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd17effd640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd188122100 0x7fd188122510 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd178019000 tx=0x7fd1780046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 25854, 2024-08-19T11:13:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:10.380 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 >> v2:172.21.15.135:6800/726754104 conn(0x7fd16803ea80 msgr2=0x7fd168040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 --2- 172.21.15.71:0/1014830733 >> v2:172.21.15.135:6800/726754104 conn(0x7fd16803ea80 0x7fd168040f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1880a8c00 tx=0x7fd17002e000 comp rx=0 tx=0).stop 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 10 monclient: shutdown 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 msgr2=0x7fd1881ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd186d9d640 1 -- 172.21.15.71:0/1014830733 reap_dead start 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 0x7fd1881ccd30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd18000efc0 tx=0x7fd18000c490 comp rx=0 tx=0).stop 2024-08-19T11:13:10.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 shutdown_connections 2024-08-19T11:13:10.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 --2- 172.21.15.71:0/1014830733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1881377e0 0x7fd1881ccd30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 >> 172.21.15.71:0/1014830733 conn(0x7fd18806dfe0 msgr2=0x7fd188074060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 shutdown_connections 2024-08-19T11:13:10.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.338+0000 7fd18caa6640 1 -- 172.21.15.71:0/1014830733 wait complete. 2024-08-19T11:13:10.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:10.383 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:13:10.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:13:10.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.480+0000 7fee7249f640 10 monclient: get_monmap_and_config 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.480+0000 7fee7249f640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.480+0000 7fee7249f640 10 monclient: monmap: 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:10.482361+0000 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:10.482361+0000 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.483 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:10.484 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 1 Processor -- start 2024-08-19T11:13:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 1 -- start start 2024-08-19T11:13:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 10 monclient: init 2024-08-19T11:13:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 10 monclient: _add_conns ranks=[0,3,4,9,5,6,10,8,2,7,1] 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fee6c0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 10 monclient(hunting): picked mon.noname-g con 0x7fee6c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.481+0000 7fee7249f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 0x7fee6c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 10 monclient(hunting): picked mon.noname-c con 0x7fee6c0a7440 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c0a6380 con 0x7fee6c0a6950 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c0a5020 con 0x7fee6c0a57c0 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fee6c0a7d40 con 0x7fee6c0a7440 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee7249f640 10 monclient(hunting): authenticate will time out at 848.524036s 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 0x7fee6c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee6bfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fee6c0a6950 0x7fee6c0a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38604/0 (socket says 172.21.15.71:38604) 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee6bfff640 1 -- 172.21.15.71:0/3074449425 learned_addr learned my addr 172.21.15.71:0/3074449425 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): get_auth_request con 0x7fee6c0a7440 auth_method 0 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient(hunting): handle_auth_done global_id 4990 payload 274 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 1 -- 172.21.15.71:0/3074449425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 msgr2=0x7fee6c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 1 --2- 172.21.15.71:0/3074449425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 1 -- 172.21.15.71:0/3074449425 >> v1:172.21.15.71:6789/0 conn(0x7fee6c0a6950 legacy=0x7fee6c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 1 monclient: found mon.noname-c 2024-08-19T11:13:10.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:10.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.482+0000 7fee70a3c640 1 -- 172.21.15.71:0/3074449425 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c0a3650 con 0x7fee6c0a7440 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee70a3c640 1 -- 172.21.15.71:0/3074449425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 msgr2=0x7fee6c1410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee70a3c640 1 --2- 172.21.15.71:0/3074449425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 0x7fee6c1410b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee64009df0 tx=0x7fee6402a4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=dfa02fd61ccc0d61 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 1 -- 172.21.15.71:0/3074449425 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee64007ca0 con 0x7fee6c0a7440 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: dump: 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 1 -- 172.21.15.71:0/3074449425 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee64031400 con 0x7fee6c0a7440 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 5 monclient: authenticate success, global_id 4990 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 1 -- 172.21.15.71:0/3074449425 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee64007e60 con 0x7fee6c0a7440 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 4 set_mon_vals no callback set 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee6affd640 10 monclient: dump: 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.497 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.498 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 10 monclient: shutdown 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 -- 172.21.15.71:0/3074449425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 msgr2=0x7fee6c1410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 --2- 172.21.15.71:0/3074449425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 0x7fee6c1410b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee64009df0 tx=0x7fee6402a4b0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 -- 172.21.15.71:0/3074449425 shutdown_connections 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 --2- 172.21.15.71:0/3074449425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 --2- 172.21.15.71:0/3074449425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee6c0a7440 0x7fee6c1410b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 -- 172.21.15.71:0/3074449425 >> 172.21.15.71:0/3074449425 conn(0x7fee6c0abf50 msgr2=0x7fee6c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 -- 172.21.15.71:0/3074449425 shutdown_connections 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.485+0000 7fee7249f640 1 -- 172.21.15.71:0/3074449425 wait complete. 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.486+0000 7fee7249f640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.486+0000 7fee7249f640 10 monclient: monmap: 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.500 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.486+0000 7fee7249f640 1 Processor -- start 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 -- start start 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient: init 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient: _add_conns ranks=[3,5,1,2,6,7,8,4,0] 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c128d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): picked mon.noname-g con 0x7fee6c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee6c0a6950 0x7fee6c13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): picked mon.noname-h con 0x7fee6c0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee6c0a7440 0x7fee6c1266f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): picked mon.noname-f con 0x7fee6c0a7440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c0a8700 con 0x7fee6c0a7440 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c0a84c0 con 0x7fee6c0a57c0 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fee6c1415f0 con 0x7fee6c0a6950 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee7249f640 10 monclient(hunting): authenticate will time out at 848.529461s 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c128d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee6c0a7440 0x7fee6c1266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee6c0a6950 0x7fee6c13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c128d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:42116/0 (socket says 172.21.15.71:42116) 2024-08-19T11:13:10.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 1 -- 172.21.15.71:0/129326599 learned_addr learned my addr 172.21.15.71:0/129326599 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): get_auth_request con 0x7fee6c0a57c0 auth_method 0 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): get_auth_request con 0x7fee6c0a7440 auth_method 0 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): get_auth_request con 0x7fee6c0a6950 auth_method 0 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee70a3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.487+0000 7fee6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 10 monclient(hunting): handle_auth_done global_id 4933 payload 824 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee6c0a6950 msgr2=0x7fee6c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee6c0a6950 0x7fee6c13fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 msgr2=0x7fee6c128d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c128d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 1 monclient: found mon.noname-f 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee70a3c640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c1296a0 con 0x7fee6c0a7440 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.488+0000 7fee6bfff640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee6c0a57c0 0x7fee6c128d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee70a3c640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee6c0a7440 msgr2=0x7fee6c1266f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee70a3c640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee6c0a7440 0x7fee6c1266f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee64004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee640044b0 con 0x7fee6c0a7440 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: dump: 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.506 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee640046b0 con 0x7fee6c0a7440 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 5 monclient: authenticate success, global_id 4933 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 10 monclient: _renew_subs 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c12a510 con 0x7fee6c0a7440 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee64004860 con 0x7fee6c0a7440 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:10.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee68ff9640 10 monclient: dump: 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.508 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 10 monclient: _renew_subs 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c1281b0 con 0x7fee6c0a7440 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.490+0000 7fee6a7fc640 4 set_mon_vals no callback set 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee7249f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee7249f640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 0x7fee6c127010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c076c60 con 0x7fee6c126c30 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 0x7fee6c127010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient: get_auth_request con 0x7fee6c126c30 auth_method 0 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 10 monclient(hunting): handle_auth_done global_id 5258 payload 824 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.491+0000 7fee6bfff640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee6c127550 con 0x7fee6c126c30 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.492+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fee64004040 con 0x7fee6c0a7440 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.492+0000 7fee68ff9640 1 --2- 172.21.15.71:0/129326599 >> v2:172.21.15.135:6800/726754104 conn(0x7fee5803ea80 0x7fee58040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.492+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (secure 0 0 0) 0x7fee64072dd0 con 0x7fee6c0a7440 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.492+0000 7fee6b7fe640 1 --2- 172.21.15.71:0/129326599 >> v2:172.21.15.135:6800/726754104 conn(0x7fee5803ea80 0x7fee58040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.492+0000 7fee6b7fe640 10 monclient: get_auth_request con 0x7fee5803ea80 auth_method 0 2024-08-19T11:13:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee6bfff640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 msgr2=0x7fee6c127010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee6bfff640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 0x7fee6c127010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0072e0 tx=0x7fee5c0077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee5c00fd40 con 0x7fee6c126c30 2024-08-19T11:13:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:10.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 10 monclient: dump: 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.514 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fee5c00fd40 con 0x7fee6c126c30 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 msgr2=0x7fee6c127010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 0x7fee6c127010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0072e0 tx=0x7fee5c0077a0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 msgr2=0x7fee6c127010 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee68ff9640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c126c30 0x7fee6c127010 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0072e0 tx=0x7fee5c0077a0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.494+0000 7fee6b7fe640 1 --2- 172.21.15.71:0/129326599 >> v2:172.21.15.135:6800/726754104 conn(0x7fee5803ea80 0x7fee58040f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee6c128820 tx=0x7fee60009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee7249f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:10.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee7249f640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 0x7fee6c122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee7249f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c140ed0 con 0x7fee6c1225a0 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 0x7fee6c122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient: get_auth_request con 0x7fee6c1225a0 auth_method 0 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.500+0000 7fee6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.501+0000 7fee6bfff640 10 monclient(hunting): handle_auth_done global_id 5267 payload 824 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.501+0000 7fee6bfff640 1 -- 172.21.15.71:0/129326599 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fee6c0a6d30 con 0x7fee6c1225a0 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee6bfff640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 msgr2=0x7fee6c122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee6bfff640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 0x7fee6c122980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0072e0 tx=0x7fee5c004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee5c0133f0 con 0x7fee6c1225a0 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 10 monclient: dump: 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fee5c006450 con 0x7fee6c1225a0 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 msgr2=0x7fee6c122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 0x7fee6c122980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0072e0 tx=0x7fee5c004940 comp rx=0 tx=0).stop 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 msgr2=0x7fee6c122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee68ff9640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fee6c1225a0 0x7fee6c122980 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0072e0 tx=0x7fee5c004940 comp rx=0 tx=0).stop 2024-08-19T11:13:10.519 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:10.519 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 187383, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:10.520 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.521 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.522 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:10.523 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.524 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:10.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:10.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:10.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.538 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.540 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.542 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:10.542 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:10.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 >> v2:172.21.15.135:6800/726754104 conn(0x7fee5803ea80 msgr2=0x7fee58040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee7249f640 1 --2- 172.21.15.71:0/129326599 >> v2:172.21.15.135:6800/726754104 conn(0x7fee5803ea80 0x7fee58040f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee6c128820 tx=0x7fee60009110 comp rx=0 tx=0).stop 2024-08-19T11:13:10.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee7249f640 10 monclient: shutdown 2024-08-19T11:13:10.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee7249f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee6c0a7440 msgr2=0x7fee6c1266f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee7249f640 1 --2- 172.21.15.71:0/129326599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee6c0a7440 0x7fee6c1266f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee64034000 tx=0x7fee64004a40 comp rx=0 tx=0).stop 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.503+0000 7fee70a3c640 1 -- 172.21.15.71:0/129326599 reap_dead start 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.504+0000 7fee70a3c640 1 -- 172.21.15.71:0/129326599 reap_dead start 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.504+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 shutdown_connections 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.504+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 >> 172.21.15.71:0/129326599 conn(0x7fee6c0abf50 msgr2=0x7fee6c09f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.504+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 shutdown_connections 2024-08-19T11:13:10.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.504+0000 7fee7249f640 1 -- 172.21.15.71:0/129326599 wait complete. 2024-08-19T11:13:10.544 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:10.544 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:13:10.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.641+0000 7f464a1b8640 10 monclient: get_monmap_and_config 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.641+0000 7f464a1b8640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.641+0000 7f464a1b8640 10 monclient: monmap: 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:10.643577+0000 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:10.643577+0000 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:10.645 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.642+0000 7f464a1b8640 1 Processor -- start 2024-08-19T11:13:10.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.642+0000 7f464a1b8640 1 -- start start 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.642+0000 7f464a1b8640 10 monclient: init 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient: _add_conns ranks=[3,5,0,4,10,8,6,2,7,1,9] 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 0x7f4644136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): picked mon.noname-g con 0x7f46440a3d80 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4644136ab0 0x7f4644136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): picked mon.noname-h con 0x7f4644136ab0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f46440a4160 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46440a24d0 con 0x7f46440a4160 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f46440a1fa0 con 0x7f46440a3d80 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f464409fe70 con 0x7f4644136ab0 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f464a1b8640 10 monclient(hunting): authenticate will time out at 848.685365s 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4643fff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f46440a4160 0x7f46440a45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38610/0 (socket says 172.21.15.71:38610) 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4643fff640 1 -- 172.21.15.71:0/4045805290 learned_addr learned my addr 172.21.15.71:0/4045805290 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 0x7f4644136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): get_auth_request con 0x7f46440a3d80 auth_method 0 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4644136ab0 0x7f4644136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): get_auth_request con 0x7f4644136ab0 auth_method 0 2024-08-19T11:13:10.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient(hunting): handle_auth_done global_id 5061 payload 274 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 1 -- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4644136ab0 msgr2=0x7f4644136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4644136ab0 0x7f4644136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 1 -- 172.21.15.71:0/4045805290 >> v1:172.21.15.71:6789/0 conn(0x7f46440a4160 legacy=0x7f46440a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 1 monclient: found mon.noname-g 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.643+0000 7f46437fe640 1 -- 172.21.15.71:0/4045805290 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46440a0b70 con 0x7f46440a3d80 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46437fe640 1 -- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 msgr2=0x7f4644136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46437fe640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 0x7f4644136570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4634009dc0 tx=0x7f463402a480 comp rx=0 tx=0).ready entity=mon.3 client_cookie=eb88a417817b3907 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 1 -- 172.21.15.71:0/4045805290 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4634007bc0 con 0x7f46440a3d80 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 10 monclient: dump: 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.653 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.654 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 1 -- 172.21.15.71:0/4045805290 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4634007d80 con 0x7f46440a3d80 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f464a1b8640 5 monclient: authenticate success, global_id 5061 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f464a1b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f464a1b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.646+0000 7f46427fc640 1 -- 172.21.15.71:0/4045805290 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4634031870 con 0x7f46440a3d80 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f46427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 4 set_mon_vals no callback set 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f46427fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:10.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f46427fc640 10 monclient: dump: 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.656 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 10 monclient: shutdown 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 -- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 msgr2=0x7f4644136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 0x7f4644136570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4634009dc0 tx=0x7f463402a480 comp rx=0 tx=0).stop 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 -- 172.21.15.71:0/4045805290 shutdown_connections 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4644136ab0 0x7f4644136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 --2- 172.21.15.71:0/4045805290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46440a3d80 0x7f4644136570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 -- 172.21.15.71:0/4045805290 >> 172.21.15.71:0/4045805290 conn(0x7f46440a91d0 msgr2=0x7f46440a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 -- 172.21.15.71:0/4045805290 shutdown_connections 2024-08-19T11:13:10.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.647+0000 7f464a1b8640 1 -- 172.21.15.71:0/4045805290 wait complete. 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.648+0000 7f464a1b8640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.648+0000 7f464a1b8640 10 monclient: monmap: 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.658 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.659 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.659 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.659 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.659 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.659 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.648+0000 7f464a1b8640 1 Processor -- start 2024-08-19T11:13:10.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.648+0000 7f464a1b8640 1 -- start start 2024-08-19T11:13:10.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.648+0000 7f464a1b8640 10 monclient: init 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient: _add_conns ranks=[8,4,3,5,6,7,1,2,0] 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 0x7f4644121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): picked mon.noname-e con 0x7f46440a3d80 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f46440a4160 0x7f4644122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): picked mon.noname-c con 0x7f46440a4160 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4644136ab0 0x7f46441225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): picked mon.noname-g con 0x7f4644136ab0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f46440a08c0 con 0x7f4644136ab0 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f46441373d0 con 0x7f46440a4160 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f46440a2ca0 con 0x7f46440a3d80 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f464a1b8640 10 monclient(hunting): authenticate will time out at 848.691237s 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 0x7f4644121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 0x7f4644121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45504/0 (socket says 172.21.15.71:45504) 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 -- 172.21.15.71:0/2151990830 learned_addr learned my addr 172.21.15.71:0/2151990830 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): get_auth_request con 0x7f46440a3d80 auth_method 0 2024-08-19T11:13:10.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f46440a4160 0x7f4644122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): get_auth_request con 0x7f46440a4160 auth_method 0 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4644136ab0 0x7f46441225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): get_auth_request con 0x7f4644136ab0 auth_method 0 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4643fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient(hunting): handle_auth_done global_id 4985 payload 824 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f46440a4160 msgr2=0x7f4644122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f46440a4160 0x7f4644122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4644136ab0 msgr2=0x7f46441225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4644136ab0 0x7f46441225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 monclient: found mon.noname-e 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f46437fe640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4644125950 con 0x7f46440a3d80 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.649+0000 7f4642ffd640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f46440a4160 0x7f4644122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.651+0000 7f46437fe640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 msgr2=0x7f4644121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.651+0000 7f46437fe640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 0x7f4644121b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f463402a4c0 tx=0x7f4634004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4634040070 con 0x7f46440a3d80 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: dump: 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.671 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 5 monclient: authenticate success, global_id 4985 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46340046c0 con 0x7f46440a3d80 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f463403c890 con 0x7f46440a3d80 2024-08-19T11:13:10.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 10 monclient: _renew_subs 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4644136e90 con 0x7f46440a3d80 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f4641ffb640 4 set_mon_vals no callback set 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f462bfff640 10 monclient: dump: 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.673 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 10 monclient: _renew_subs 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:10.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f46441235f0 con 0x7f46440a3d80 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 0x7f464411f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.652+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4644076c60 con 0x7f464411f400 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 0x7f464411f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient: get_auth_request con 0x7f464411f400 auth_method 0 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4634043070 con 0x7f46440a3d80 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 10 monclient(hunting): handle_auth_done global_id 5008 payload 824 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f462bfff640 1 --2- 172.21.15.71:0/2151990830 >> v2:172.21.15.135:6800/726754104 conn(0x7f463003ea80 0x7f4630040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4642ffd640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46440a8560 con 0x7f464411f400 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (secure 0 0 0) 0x7f46340730d0 con 0x7f46440a3d80 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4643fff640 1 --2- 172.21.15.71:0/2151990830 >> v2:172.21.15.135:6800/726754104 conn(0x7f463003ea80 0x7f4630040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.653+0000 7f4643fff640 10 monclient: get_auth_request con 0x7f463003ea80 auth_method 0 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f4642ffd640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 msgr2=0x7f464411f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f4642ffd640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 0x7f464411f7e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4644123c60 tx=0x7f463800f610 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4638019070 con 0x7f464411f400 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:10.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 10 monclient: dump: 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.677 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4638004240 con 0x7f464411f400 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 msgr2=0x7f464411f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 0x7f464411f7e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4644123c60 tx=0x7f463800f610 comp rx=0 tx=0).stop 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 msgr2=0x7f464411f7e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.655+0000 7f462bfff640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411f400 0x7f464411f7e0 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4644123c60 tx=0x7f463800f610 comp rx=0 tx=0).stop 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.656+0000 7f4643fff640 1 --2- 172.21.15.71:0/2151990830 >> v2:172.21.15.135:6800/726754104 conn(0x7f463003ea80 0x7f4630040f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f463c007c90 tx=0x7f463c007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f464a1b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:10.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f464a1b8640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 0x7f46441d65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f464a1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4644136570 con 0x7f464411fd20 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 0x7f46441d65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient: get_auth_request con 0x7f464411fd20 auth_method 0 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 10 monclient(hunting): handle_auth_done global_id 5017 payload 824 2024-08-19T11:13:10.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.662+0000 7f4642ffd640 1 -- 172.21.15.71:0/2151990830 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4644134280 con 0x7f464411fd20 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.664+0000 7f4642ffd640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 msgr2=0x7f46441d65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.664+0000 7f4642ffd640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 0x7f46441d65f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f463801b000 tx=0x7f46380046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.664+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4638019040 con 0x7f464411fd20 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.664+0000 7f462bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.664+0000 7f462bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.664+0000 7f462bfff640 10 monclient: dump: 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.681 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f46380044d0 con 0x7f464411fd20 2024-08-19T11:13:10.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 msgr2=0x7f46441d65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 0x7f46441d65f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f463801b000 tx=0x7f46380046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 msgr2=0x7f46441d65f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f462bfff640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f464411fd20 0x7f46441d65f0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f463801b000 tx=0x7f46380046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:10.683 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 187535, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:10.684 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.686 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:10.688 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.689 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:10.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:10.692 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.697 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:10.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.704 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.706 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:10.708 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 >> v2:172.21.15.135:6800/726754104 conn(0x7f463003ea80 msgr2=0x7f4630040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 --2- 172.21.15.71:0/2151990830 >> v2:172.21.15.135:6800/726754104 conn(0x7f463003ea80 0x7f4630040f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f463c007c90 tx=0x7f463c007be0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 10 monclient: shutdown 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 msgr2=0x7f4644121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 --2- 172.21.15.71:0/2151990830 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f46440a3d80 0x7f4644121b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f463402a4c0 tx=0x7f4634004a40 comp rx=0 tx=0).stop 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f4643fff640 1 -- 172.21.15.71:0/2151990830 reap_dead start 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f4643fff640 1 -- 172.21.15.71:0/2151990830 reap_dead start 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 shutdown_connections 2024-08-19T11:13:10.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 >> 172.21.15.71:0/2151990830 conn(0x7f46440a91d0 msgr2=0x7f46440a70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 shutdown_connections 2024-08-19T11:13:10.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.665+0000 7f464a1b8640 1 -- 172.21.15.71:0/2151990830 wait complete. 2024-08-19T11:13:10.711 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:10.711 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:13:10.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.808+0000 7f1841753640 10 monclient: get_monmap_and_config 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.808+0000 7f1841753640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.808+0000 7f1841753640 10 monclient: monmap: 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:10.809766+0000 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:10.809766+0000 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.810 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:10.811 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.808+0000 7f1841753640 1 Processor -- start 2024-08-19T11:13:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.808+0000 7f1841753640 1 -- start start 2024-08-19T11:13:10.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.808+0000 7f1841753640 10 monclient: init 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient: _add_conns ranks=[6,0,8,5,4,2,3,10,9,7,1] 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1378e0 0x7f183c137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): picked mon.noname-d con 0x7f183c1378e0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f183c138200 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 0x7f183c0a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): picked mon.noname-e con 0x7f183c0a5540 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c074110 con 0x7f183c138200 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f183c073b50 con 0x7f183c1378e0 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f183c0720f0 con 0x7f183c0a5540 2024-08-19T11:13:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f1841753640 10 monclient(hunting): authenticate will time out at 848.851368s 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 0x7f183c0a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183a7fc640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f183c138200 0x7f183c0a4e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38612/0 (socket says 172.21.15.71:38612) 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183a7fc640 1 -- 172.21.15.71:0/3817393220 learned_addr learned my addr 172.21.15.71:0/3817393220 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1378e0 0x7f183c137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): get_auth_request con 0x7f183c0a5540 auth_method 0 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): get_auth_request con 0x7f183c1378e0 auth_method 0 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient(hunting): handle_auth_done global_id 4994 payload 274 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 1 -- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1378e0 msgr2=0x7f183c137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 1 --2- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1378e0 0x7f183c137cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 1 -- 172.21.15.71:0/3817393220 >> v1:172.21.15.71:6789/0 conn(0x7f183c138200 legacy=0x7f183c0a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 1 monclient: found mon.noname-e 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183b7fe640 1 -- 172.21.15.71:0/3817393220 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c073870 con 0x7f183c0a5540 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.809+0000 7f183affd640 1 --2- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1378e0 0x7f183c137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f183b7fe640 1 -- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 msgr2=0x7f183c0a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f183b7fe640 1 --2- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 0x7f183c0a59d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1834009dc0 tx=0x7f183402a480 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f58d43c1c485aa17 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 1 -- 172.21.15.71:0/3817393220 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1834007bc0 con 0x7f183c0a5540 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: dump: 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 1 -- 172.21.15.71:0/3817393220 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834007d80 con 0x7f183c0a5540 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1841753640 5 monclient: authenticate success, global_id 4994 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1841753640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 1 -- 172.21.15.71:0/3817393220 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1834031870 con 0x7f183c0a5540 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1841753640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1841753640 4 set_mon_vals no callback set 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.812+0000 7f1839ffb640 10 monclient: dump: 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.822 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 10 monclient: shutdown 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 -- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 msgr2=0x7f183c0a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 --2- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 0x7f183c0a59d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1834009dc0 tx=0x7f183402a480 comp rx=0 tx=0).stop 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 -- 172.21.15.71:0/3817393220 shutdown_connections 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 --2- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f183c0a5540 0x7f183c0a59d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 --2- 172.21.15.71:0/3817393220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1378e0 0x7f183c137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 -- 172.21.15.71:0/3817393220 >> 172.21.15.71:0/3817393220 conn(0x7f183c0aa2a0 msgr2=0x7f183c0aa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 -- 172.21.15.71:0/3817393220 shutdown_connections 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 1 -- 172.21.15.71:0/3817393220 wait complete. 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.813+0000 7f1841753640 10 monclient: monmap: 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.824 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.825 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.825 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.825 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.825 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.825 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 Processor -- start 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 -- start start 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient: init 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient: _add_conns ranks=[7,3,2,5,0,1,6,8,4] 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f183c0a5540 0x7f183c1cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): picked mon.noname-i con 0x7f183c0a5540 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c1378e0 0x7f183c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): picked mon.noname-g con 0x7f183c1378e0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 0x7f183c1c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): picked mon.noname-b con 0x7f183c138200 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:10.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0a1880 con 0x7f183c138200 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f183c0727d0 con 0x7f183c1378e0 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f183c0a1a00 con 0x7f183c0a5540 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.814+0000 7f1841753640 10 monclient(hunting): authenticate will time out at 848.856961s 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 0x7f183c1c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 0x7f183c1c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:59374/0 (socket says 172.21.15.71:59374) 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 learned_addr learned my addr 172.21.15.71:0/1356300884 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): get_auth_request con 0x7f183c138200 auth_method 0 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183a7fc640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c1378e0 0x7f183c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183affd640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f183c0a5540 0x7f183c1cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient(hunting): handle_auth_done global_id 5276 payload 824 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f183c0a5540 msgr2=0x7f183c1cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f183c0a5540 0x7f183c1cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c1378e0 msgr2=0x7f183c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f183c1378e0 0x7f183c136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 monclient: found mon.noname-b 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.815+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c124600 con 0x7f183c138200 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 msgr2=0x7f183c1c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f183b7fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 0x7f183c1c8f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f183402a9a0 tx=0x7f1834004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1834040070 con 0x7f183c138200 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: dump: 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.838 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.839 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18340046c0 con 0x7f183c138200 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 5 monclient: authenticate success, global_id 5276 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 10 monclient: _renew_subs 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c0a32e0 con 0x7f183c138200 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f183403c890 con 0x7f183c138200 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18237fe640 10 monclient: dump: 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 10 monclient: _renew_subs 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f18397fa640 4 set_mon_vals no callback set 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.817+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c124320 con 0x7f183c138200 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f1841753640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f1841753640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 0x7f183c1c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f183c0a3810 con 0x7f183c122e00 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1834039040 con 0x7f183c138200 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 0x7f183c1c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient: get_auth_request con 0x7f183c122e00 auth_method 0 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.818+0000 7f18237fe640 1 --2- 172.21.15.71:0/1356300884 >> v2:172.21.15.135:6800/726754104 conn(0x7f182803eab0 0x7f1828040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.819+0000 7f183affd640 10 monclient(hunting): handle_auth_done global_id 24495 payload 824 2024-08-19T11:13:10.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.819+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (secure 0 0 0) 0x7f1834072af0 con 0x7f183c138200 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.819+0000 7f183affd640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f183c072a80 con 0x7f183c122e00 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.819+0000 7f183a7fc640 1 --2- 172.21.15.71:0/1356300884 >> v2:172.21.15.135:6800/726754104 conn(0x7f182803eab0 0x7f1828040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.819+0000 7f183a7fc640 10 monclient: get_auth_request con 0x7f182803eab0 auth_method 0 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f183affd640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 msgr2=0x7f183c1c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f183affd640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 0x7f183c1c9490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f182c0107c0 tx=0x7f182c010c80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f182c00f040 con 0x7f183c122e00 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 10 monclient: dump: 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.844 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f182c010e90 con 0x7f183c122e00 2024-08-19T11:13:10.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 msgr2=0x7f183c1c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 0x7f183c1c9490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f182c0107c0 tx=0x7f182c010c80 comp rx=0 tx=0).stop 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 msgr2=0x7f183c1c9490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f18237fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c122e00 0x7f183c1c9490 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f182c0107c0 tx=0x7f182c010c80 comp rx=0 tx=0).stop 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.821+0000 7f183a7fc640 1 --2- 172.21.15.71:0/1356300884 >> v2:172.21.15.135:6800/726754104 conn(0x7f182803eab0 0x7f1828040f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f183c0a0970 tx=0x7f1830008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f1841753640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f1841753640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 0x7f183c09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f1841753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f183c1c9de0 con 0x7f183c1c99d0 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 0x7f183c09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient: get_auth_request con 0x7f183c1c99d0 auth_method 0 2024-08-19T11:13:10.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.827+0000 7f183affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.828+0000 7f183affd640 10 monclient(hunting): handle_auth_done global_id 24504 payload 824 2024-08-19T11:13:10.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.828+0000 7f183affd640 1 -- 172.21.15.71:0/1356300884 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f183c072ed0 con 0x7f183c1c99d0 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f183affd640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 msgr2=0x7f183c09c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f183affd640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 0x7f183c09c9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f182c0107c0 tx=0x7f182c0046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f182c021570 con 0x7f183c1c99d0 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 10 monclient: dump: 2024-08-19T11:13:10.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.849 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f182c01cb50 con 0x7f183c1c99d0 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 msgr2=0x7f183c09c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 0x7f183c09c9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f182c0107c0 tx=0x7f182c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 msgr2=0x7f183c09c9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.830+0000 7f18237fe640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f183c1c99d0 0x7f183c09c9f0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f182c0107c0 tx=0x7f182c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:10.850 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 98445, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:10.858 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:10.864 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.869 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:10.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.873 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:10.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:10.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:10.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:10.875 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:10.875 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 >> v2:172.21.15.135:6800/726754104 conn(0x7f182803eab0 msgr2=0x7f1828040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 --2- 172.21.15.71:0/1356300884 >> v2:172.21.15.135:6800/726754104 conn(0x7f182803eab0 0x7f1828040f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f183c0a0970 tx=0x7f1830008040 comp rx=0 tx=0).stop 2024-08-19T11:13:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 10 monclient: shutdown 2024-08-19T11:13:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:10.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 msgr2=0x7f183c1c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 --2- 172.21.15.71:0/1356300884 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f183c138200 0x7f183c1c8f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f183402a9a0 tx=0x7f1834004a40 comp rx=0 tx=0).stop 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 reap_dead start 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f183b7fe640 1 -- 172.21.15.71:0/1356300884 reap_dead start 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 shutdown_connections 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 >> 172.21.15.71:0/1356300884 conn(0x7f183c0aa2a0 msgr2=0x7f183c0a2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 shutdown_connections 2024-08-19T11:13:10.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.831+0000 7f1841753640 1 -- 172.21.15.71:0/1356300884 wait complete. 2024-08-19T11:13:10.877 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:10.877 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:13:10.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:13:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.976+0000 7fc39efc9640 10 monclient: get_monmap_and_config 2024-08-19T11:13:10.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.976+0000 7fc39efc9640 10 monclient: build_initial_monmap 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.976+0000 7fc39efc9640 10 monclient: monmap: 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:10.978249+0000 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:10.978249+0000 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:10.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:10.980 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 1 Processor -- start 2024-08-19T11:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 1 -- start start 2024-08-19T11:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient: init 2024-08-19T11:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient: _add_conns ranks=[9,1,0,5,7,8,10,4,2,3,6] 2024-08-19T11:13:10.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3980a6950 0x7fc3980a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient(hunting): picked mon.noname-a con 0x7fc3980a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc3980a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc3980a7270 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3980a6380 con 0x7fc3980a7270 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc39813a530 con 0x7fc3980a57c0 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc3980a5020 con 0x7fc3980a6950 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.977+0000 7fc39efc9640 10 monclient(hunting): authenticate will time out at 849.019975s 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3980a6950 0x7fc3980a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3980a6950 0x7fc3980a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39046/0 (socket says 172.21.15.71:39046) 2024-08-19T11:13:10.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 -- 172.21.15.71:0/1672085788 learned_addr learned my addr 172.21.15.71:0/1672085788 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): get_auth_request con 0x7fc3980a6950 auth_method 0 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39d566640 1 --1- 172.21.15.71:0/1672085788 >> v1:172.21.15.71:6789/0 conn(0x7fc3980a7270 0x7fc398139e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38622/0 (socket says 172.21.15.71:38622) 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient(hunting): handle_auth_done global_id 34146 payload 274 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 -- 172.21.15.71:0/1672085788 >> v1:172.21.15.135:6789/0 conn(0x7fc3980a57c0 legacy=0x7fc398139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 -- 172.21.15.71:0/1672085788 >> v1:172.21.15.71:6789/0 conn(0x7fc3980a7270 legacy=0x7fc398139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient: _finish_hunting 0 2024-08-19T11:13:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 monclient: found mon.noname-a 2024-08-19T11:13:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:10.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.978+0000 7fc39cd65640 1 -- 172.21.15.71:0/1672085788 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3980a3650 con 0x7fc3980a6950 2024-08-19T11:13:10.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39cd65640 1 -- 172.21.15.71:0/1672085788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980a6950 msgr2=0x7fc3980a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:10.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39cd65640 1 --2- 172.21.15.71:0/1672085788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980a6950 0x7fc3980a6d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009870 tx=0x7fc38c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1a95270e062ab4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 1 -- 172.21.15.71:0/1672085788 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc38c037070 con 0x7fc3980a6950 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: dump: 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:10.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:10.998 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:10.998 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:10.998 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:10.998 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:10.998 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:10.999 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:10.999 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:10.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:10.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:10.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:10.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 1 -- 172.21.15.71:0/1672085788 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38c0307b0 con 0x7fc3980a6950 2024-08-19T11:13:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 5 monclient: authenticate success, global_id 34146 2024-08-19T11:13:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 1 -- 172.21.15.71:0/1672085788 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc38c030e50 con 0x7fc3980a6950 2024-08-19T11:13:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc3977fe640 10 monclient: dump: 2024-08-19T11:13:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.001 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.002 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 4 set_mon_vals no callback set 2024-08-19T11:13:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 10 monclient: shutdown 2024-08-19T11:13:11.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 1 -- 172.21.15.71:0/1672085788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980a6950 msgr2=0x7fc3980a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 1 --2- 172.21.15.71:0/1672085788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980a6950 0x7fc3980a6d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009870 tx=0x7fc38c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 1 -- 172.21.15.71:0/1672085788 shutdown_connections 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 1 --2- 172.21.15.71:0/1672085788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980a6950 0x7fc3980a6d30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 1 -- 172.21.15.71:0/1672085788 >> 172.21.15.71:0/1672085788 conn(0x7fc3980abf50 msgr2=0x7fc3980ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.981+0000 7fc39efc9640 1 -- 172.21.15.71:0/1672085788 shutdown_connections 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.982+0000 7fc39efc9640 1 -- 172.21.15.71:0/1672085788 wait complete. 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.982+0000 7fc39efc9640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.982+0000 7fc39efc9640 10 monclient: monmap: 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:11.004 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.005 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.982+0000 7fc39efc9640 1 Processor -- start 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.982+0000 7fc39efc9640 1 -- start start 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.982+0000 7fc39efc9640 10 monclient: init 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient: _add_conns ranks=[4,7,5,0,8,6,3,2,1] 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 0x7fc398125e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): picked mon.noname-c con 0x7fc3980a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3980a6950 0x7fc398126340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): picked mon.noname-i con 0x7fc3980a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:11.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3980a7270 0x7fc398126880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): picked mon.noname-h con 0x7fc3980a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc3980a84c0 con 0x7fc3980a57c0 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc3980a7d40 con 0x7fc3980a7270 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc3980a8700 con 0x7fc3980a6950 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39efc9640 10 monclient(hunting): authenticate will time out at 849.025519s 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 0x7fc398125e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 0x7fc398125e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47838/0 (socket says 172.21.15.71:47838) 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 -- 172.21.15.71:0/2722617306 learned_addr learned my addr 172.21.15.71:0/2722617306 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): get_auth_request con 0x7fc3980a57c0 auth_method 0 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc397fff640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3980a6950 0x7fc398126340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc397fff640 10 monclient(hunting): get_auth_request con 0x7fc3980a6950 auth_method 0 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39d566640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3980a7270 0x7fc398126880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc397fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc397fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc397fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient(hunting): handle_auth_done global_id 5026 payload 824 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3980a6950 msgr2=0x7fc398126340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3980a6950 0x7fc398126340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3980a7270 msgr2=0x7fc398126880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3980a7270 0x7fc398126880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 monclient: found mon.noname-c 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39cd65640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc398129a90 con 0x7fc3980a57c0 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39d566640 10 monclient: get_auth_request con 0x7fc3980a7270 auth_method 0 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.983+0000 7fc39d566640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3980a7270 0x7fc398126880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39cd65640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 msgr2=0x7fc398125e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39cd65640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 0x7fc398125e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc38c000c00 tx=0x7fc38c0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc38c037040 con 0x7fc3980a57c0 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: dump: 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.010 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38c042070 con 0x7fc3980a57c0 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 5 monclient: authenticate success, global_id 5026 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc38c003a80 con 0x7fc3980a57c0 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 10 monclient: _renew_subs 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3980a1e50 con 0x7fc3980a57c0 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc396ffd640 4 set_mon_vals no callback set 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc3957fa640 10 monclient: dump: 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.012 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 10 monclient: _renew_subs 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.986+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fc398128c20 con 0x7fc3980a57c0 2024-08-19T11:13:11.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc39efc9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc39efc9640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 0x7fc398122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc38c003c20 con 0x7fc3980a57c0 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc39efc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc398076c60 con 0x7fc3981225a0 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 0x7fc398122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient: get_auth_request con 0x7fc3981225a0 auth_method 0 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc3957fa640 1 --2- 172.21.15.71:0/2722617306 >> v2:172.21.15.135:6800/726754104 conn(0x7fc37c03ea80 0x7fc37c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (secure 0 0 0) 0x7fc38c072330 con 0x7fc3980a57c0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 10 monclient(hunting): handle_auth_done global_id 5003 payload 824 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc397fff640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3980a7670 con 0x7fc3981225a0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc39d566640 1 --2- 172.21.15.71:0/2722617306 >> v2:172.21.15.135:6800/726754104 conn(0x7fc37c03ea80 0x7fc37c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.987+0000 7fc39d566640 10 monclient: get_auth_request con 0x7fc37c03ea80 auth_method 0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.989+0000 7fc397fff640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 msgr2=0x7fc398122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.989+0000 7fc397fff640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 0x7fc398122980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc398127da0 tx=0x7fc38400e960 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc384006c40 con 0x7fc3981225a0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 10 monclient: dump: 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.015 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc384007450 con 0x7fc3981225a0 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 msgr2=0x7fc398122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 0x7fc398122980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc398127da0 tx=0x7fc38400e960 comp rx=0 tx=0).stop 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 msgr2=0x7fc398122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc3957fa640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3981225a0 0x7fc398122980 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc398127da0 tx=0x7fc38400e960 comp rx=0 tx=0).stop 2024-08-19T11:13:11.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.990+0000 7fc39d566640 1 --2- 172.21.15.71:0/2722617306 >> v2:172.21.15.135:6800/726754104 conn(0x7fc37c03ea80 0x7fc37c040f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc390007df0 tx=0x7fc390007300 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc39efc9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc39efc9640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 0x7fc3981d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc39efc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc398127730 con 0x7fc398122ec0 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 0x7fc3981d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient: get_auth_request con 0x7fc398122ec0 auth_method 0 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 10 monclient(hunting): handle_auth_done global_id 5012 payload 824 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.996+0000 7fc397fff640 1 -- 172.21.15.71:0/2722617306 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc39806ca70 con 0x7fc398122ec0 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.998+0000 7fc397fff640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 msgr2=0x7fc3981d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.998+0000 7fc397fff640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 0x7fc3981d8990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc398127da0 tx=0x7fc384003760 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc38401ede0 con 0x7fc398122ec0 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 10 monclient: dump: 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.020 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.021 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fc38401e970 con 0x7fc398122ec0 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 msgr2=0x7fc3981d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 0x7fc3981d8990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc398127da0 tx=0x7fc384003760 comp rx=0 tx=0).stop 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 msgr2=0x7fc3981d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc3957fa640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc398122ec0 0x7fc3981d8990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.022 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 187870, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:11.026 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.027 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.028 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.030 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.032 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.039 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:11.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:11.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.046 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:11.048 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 >> v2:172.21.15.135:6800/726754104 conn(0x7fc37c03ea80 msgr2=0x7fc37c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 --2- 172.21.15.71:0/2722617306 >> v2:172.21.15.135:6800/726754104 conn(0x7fc37c03ea80 0x7fc37c040f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc390007df0 tx=0x7fc390007300 comp rx=0 tx=0).stop 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 10 monclient: shutdown 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 msgr2=0x7fc398125e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 --2- 172.21.15.71:0/2722617306 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3980a57c0 0x7fc398125e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc38c000c00 tx=0x7fc38c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39d566640 1 -- 172.21.15.71:0/2722617306 reap_dead start 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39d566640 1 -- 172.21.15.71:0/2722617306 reap_dead start 2024-08-19T11:13:11.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 shutdown_connections 2024-08-19T11:13:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 >> 172.21.15.71:0/2722617306 conn(0x7fc3980abf50 msgr2=0x7fc398139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 shutdown_connections 2024-08-19T11:13:11.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:10.999+0000 7fc39efc9640 1 -- 172.21.15.71:0/2722617306 wait complete. 2024-08-19T11:13:11.051 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:11.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:13:11.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:13:11.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.147+0000 7fb99895a640 10 monclient: get_monmap_and_config 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.147+0000 7fb99895a640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.147+0000 7fb99895a640 10 monclient: monmap: 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:11.149432+0000 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:11.149432+0000 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:11.150 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:11.151 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.148+0000 7fb99895a640 1 Processor -- start 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.148+0000 7fb99895a640 1 -- start start 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.148+0000 7fb99895a640 10 monclient: init 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.148+0000 7fb99895a640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient: _add_conns ranks=[4,6,10,9,3,5,1,8,7,2,0] 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 0x7fb9940a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): picked mon.noname-c con 0x7fb9940a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 0x7fb9940a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): picked mon.noname-d con 0x7fb9940a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb994139710 0x7fb994139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): picked mon.noname-f con 0x7fb994139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb9940a5020 con 0x7fb994139710 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb9940a77b0 con 0x7fb9940a6950 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb9940a7d40 con 0x7fb9940a57c0 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99895a640 10 monclient(hunting): authenticate will time out at 849.191074s 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 0x7fb9940a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 0x7fb9940a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 0x7fb9940a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47844/0 (socket says 172.21.15.71:47844) 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 -- 172.21.15.71:0/669621934 learned_addr learned my addr 172.21.15.71:0/669621934 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 0x7fb9940a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50816/0 (socket says 172.21.15.71:50816) 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): get_auth_request con 0x7fb9940a6950 auth_method 0 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): get_auth_request con 0x7fb9940a57c0 auth_method 0 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb992d9d640 1 --2- 172.21.15.71:0/669621934 >> v2:172.21.15.135:3300/0 conn(0x7fb994139710 0x7fb994139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb992d9d640 10 monclient(hunting): get_auth_request con 0x7fb994139710 auth_method 0 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb992d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb992d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb992d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient(hunting): handle_auth_done global_id 5035 payload 274 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 -- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 msgr2=0x7fb9940a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 --2- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 0x7fb9940a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 -- 172.21.15.71:0/669621934 >> v2:172.21.15.135:3300/0 conn(0x7fb994139710 msgr2=0x7fb994139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 --2- 172.21.15.71:0/669621934 >> v2:172.21.15.135:3300/0 conn(0x7fb994139710 0x7fb994139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 monclient: found mon.noname-c 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb99259c640 1 -- 172.21.15.71:0/669621934 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940a6380 con 0x7fb9940a6950 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.149+0000 7fb991d9b640 1 --2- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 0x7fb9940a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99259c640 1 -- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 msgr2=0x7fb9940a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99259c640 1 --2- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 0x7fb9940a6d30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098a0 tx=0x7fb98c02a0d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=1038c3d13c9cdfb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 1 -- 172.21.15.71:0/669621934 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb98c037070 con 0x7fb9940a6950 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: dump: 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 5 monclient: authenticate success, global_id 5035 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 1 -- 172.21.15.71:0/669621934 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c02adf0 con 0x7fb9940a6950 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 4 set_mon_vals no callback set 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 1 -- 172.21.15.71:0/669621934 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb98c030c20 con 0x7fb9940a6950 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99159a640 10 monclient: dump: 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 10 monclient: shutdown 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 1 -- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 msgr2=0x7fb9940a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.152+0000 7fb99895a640 1 --2- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 0x7fb9940a6d30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098a0 tx=0x7fb98c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 -- 172.21.15.71:0/669621934 shutdown_connections 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 --2- 172.21.15.71:0/669621934 >> v2:172.21.15.135:3300/0 conn(0x7fb994139710 0x7fb994139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 --2- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a57c0 0x7fb9940a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 --2- 172.21.15.71:0/669621934 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb9940a6950 0x7fb9940a6d30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 -- 172.21.15.71:0/669621934 >> 172.21.15.71:0/669621934 conn(0x7fb9940abf50 msgr2=0x7fb9940ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 -- 172.21.15.71:0/669621934 shutdown_connections 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 1 -- 172.21.15.71:0/669621934 wait complete. 2024-08-19T11:13:11.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.153+0000 7fb99895a640 10 monclient: monmap: 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 Processor -- start 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 -- start start 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient: init 2024-08-19T11:13:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient: _add_conns ranks=[5,6,4,1,0,3,8,2,7] 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb9940a57c0 0x7fb9941ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): picked mon.noname-h con 0x7fb9940a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a6950 0x7fb9941388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): picked mon.noname-d con 0x7fb9940a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 0x7fb994138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): picked mon.noname-c con 0x7fb994139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb9940a84c0 con 0x7fb994139710 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb9940a3650 con 0x7fb9940a57c0 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb9940a8700 con 0x7fb9940a6950 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99895a640 10 monclient(hunting): authenticate will time out at 849.196624s 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a6950 0x7fb9941388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 0x7fb994138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a6950 0x7fb9941388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50828/0 (socket says 172.21.15.71:50828) 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 1 -- 172.21.15.71:0/3913229391 learned_addr learned my addr 172.21.15.71:0/3913229391 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): get_auth_request con 0x7fb9940a6950 auth_method 0 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): get_auth_request con 0x7fb994139710 auth_method 0 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb991d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99259c640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb9940a57c0 0x7fb9941ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99259c640 10 monclient(hunting): get_auth_request con 0x7fb9940a57c0 auth_method 0 2024-08-19T11:13:11.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb99259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 10 monclient(hunting): handle_auth_done global_id 5044 payload 824 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a6950 msgr2=0x7fb9941388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.154+0000 7fb992d9d640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a6950 0x7fb9941388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb9940a57c0 msgr2=0x7fb9941ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb9940a57c0 0x7fb9941ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 1 monclient: found mon.noname-c 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb992d9d640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994123f20 con 0x7fb994139710 2024-08-19T11:13:11.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb991d9b640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb9940a6950 0x7fb9941388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.155+0000 7fb99259c640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb9940a57c0 0x7fb9941ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb992d9d640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 msgr2=0x7fb994138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb992d9d640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 0x7fb994138e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb984007dc0 tx=0x7fb98400e4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb984014890 con 0x7fb994139710 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: dump: 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.177 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984014a70 con 0x7fb994139710 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 5 monclient: authenticate success, global_id 5044 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 10 monclient: _renew_subs 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9940a1f00 con 0x7fb994139710 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb984014c20 con 0x7fb994139710 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb982ffd640 10 monclient: dump: 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.179 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.180 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 10 monclient: _renew_subs 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941259e0 con 0x7fb994139710 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.157+0000 7fb990d99640 4 set_mon_vals no callback set 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99895a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99895a640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 0x7fb99402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb994076c60 con 0x7fb994122d60 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb992d9d640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 0x7fb994138e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb984007dc0 tx=0x7fb98400e4b0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fb98401b030 mgrmap(e 5) 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb98401b030 con 0x7fb994139710 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 0x7fb99402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb982ffd640 1 --2- 172.21.15.71:0/3913229391 >> v2:172.21.15.135:6800/726754104 conn(0x7fb97403ea80 0x7fb974040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient: get_auth_request con 0x7fb994122d60 auth_method 0 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb991d9b640 1 --2- 172.21.15.71:0/3913229391 >> v2:172.21.15.135:6800/726754104 conn(0x7fb97403ea80 0x7fb974040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.158+0000 7fb991d9b640 10 monclient: get_auth_request con 0x7fb97403ea80 auth_method 0 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.159+0000 7fb99259c640 10 monclient(hunting): handle_auth_done global_id 4951 payload 824 2024-08-19T11:13:11.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.159+0000 7fb99259c640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb99413a340 con 0x7fb994122d60 2024-08-19T11:13:11.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb991d9b640 1 --2- 172.21.15.71:0/3913229391 >> v2:172.21.15.135:6800/726754104 conn(0x7fb97403ea80 0x7fb974040f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb994124a10 tx=0x7fb988009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb99259c640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 msgr2=0x7fb99402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb99259c640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 0x7fb99402d1c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb98c034000 tx=0x7fb98c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb98c041070 con 0x7fb994122d60 2024-08-19T11:13:11.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 10 monclient: dump: 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.186 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb98c003900 con 0x7fb994122d60 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 msgr2=0x7fb99402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 0x7fb99402d1c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb98c034000 tx=0x7fb98c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 msgr2=0x7fb99402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.161+0000 7fb982ffd640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994122d60 0x7fb99402d1c0 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb98c034000 tx=0x7fb98c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.167+0000 7fb99895a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.167+0000 7fb99895a640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 0x7fb99402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.167+0000 7fb99895a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.167+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940a6d30 con 0x7fb994123140 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 0x7fb99402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient: get_auth_request con 0x7fb994123140 auth_method 0 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 10 monclient(hunting): handle_auth_done global_id 4960 payload 824 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.168+0000 7fb99259c640 1 -- 172.21.15.71:0/3913229391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb99409e100 con 0x7fb994123140 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99259c640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 msgr2=0x7fb99402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99259c640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 0x7fb99402d700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb98c040000 tx=0x7fb98c009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb98c037040 con 0x7fb994123140 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 10 monclient: dump: 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.189 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.190 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fb98c03cda0 con 0x7fb994123140 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 msgr2=0x7fb99402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 0x7fb99402d700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb98c040000 tx=0x7fb98c009240 comp rx=0 tx=0).stop 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 msgr2=0x7fb99402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb994123140 0x7fb99402d700 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb98c040000 tx=0x7fb98c009240 comp rx=0 tx=0).stop 2024-08-19T11:13:11.191 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 188012, 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:11.192 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.193 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.194 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.195 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:11.196 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:11.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.207 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.209 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:11.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:11.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:11.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:11.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:11.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.218 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.219 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:11.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.221 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.222 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:11.224 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 >> v2:172.21.15.135:6800/726754104 conn(0x7fb97403ea80 msgr2=0x7fb974040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 --2- 172.21.15.71:0/3913229391 >> v2:172.21.15.135:6800/726754104 conn(0x7fb97403ea80 0x7fb974040f40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb994124a10 tx=0x7fb988009190 comp rx=0 tx=0).stop 2024-08-19T11:13:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 10 monclient: shutdown 2024-08-19T11:13:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 msgr2=0x7fb994138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 --2- 172.21.15.71:0/3913229391 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb994139710 0x7fb994138e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb984007dc0 tx=0x7fb98400e4b0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb992d9d640 1 -- 172.21.15.71:0/3913229391 reap_dead start 2024-08-19T11:13:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb992d9d640 1 -- 172.21.15.71:0/3913229391 reap_dead start 2024-08-19T11:13:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb982ffd640 1 -- 172.21.15.71:0/3913229391 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (unknown 0 0 0) 0x7fb984019020 con 0x7fb994139710 2024-08-19T11:13:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 shutdown_connections 2024-08-19T11:13:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 >> 172.21.15.71:0/3913229391 conn(0x7fb9940abf50 msgr2=0x7fb9940aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.171+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 shutdown_connections 2024-08-19T11:13:11.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.172+0000 7fb99895a640 1 -- 172.21.15.71:0/3913229391 wait complete. 2024-08-19T11:13:11.229 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:11.229 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:13:11.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.326+0000 7f077a763640 10 monclient: get_monmap_and_config 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.326+0000 7f077a763640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.326+0000 7f077a763640 10 monclient: monmap: 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:11.327929+0000 2024-08-19T11:13:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:11.327929+0000 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:11.330 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:11.330 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 Processor -- start 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 -- start start 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient: init 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient: _add_conns ranks=[2,9,3,5,1,6,10,4,8,0,7] 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0774069060 0x7f07741365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): picked mon.noname-b con 0x7f0774069060 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): picked mon.noname-a con 0x7f0774136ae0 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077409f950 0x7f077409fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): picked mon.noname-g con 0x7f077409f950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f07740a4cf0 con 0x7f0774136ae0 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f07740a4710 con 0x7f0774069060 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0774069440 con 0x7f077409f950 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f077a763640 10 monclient(hunting): authenticate will time out at 849.369550s 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0774069060 0x7f07741365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39060/0 (socket says 172.21.15.71:39060) 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0774069060 0x7f07741365a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:59376/0 (socket says 172.21.15.71:59376) 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 learned_addr learned my addr 172.21.15.71:0/1333977021 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): get_auth_request con 0x7f0774136ae0 auth_method 0 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): get_auth_request con 0x7f0774069060 auth_method 0 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0778d00640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077409f950 0x7f077409fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0778d00640 10 monclient(hunting): get_auth_request con 0x7f077409f950 auth_method 0 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0778d00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0778d00640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0778d00640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient(hunting): handle_auth_done global_id 34155 payload 274 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077409f950 msgr2=0x7f077409fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077409f950 0x7f077409fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0774069060 msgr2=0x7f07741365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0774069060 0x7f07741365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 monclient: found mon.noname-a 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07740a0ae0 con 0x7f0774136ae0 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0778d00640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077409f950 0x7f077409fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.327+0000 7f0773fff640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0774069060 0x7f07741365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.328+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 msgr2=0x7f0774136f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.328+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 msgr2=0x7f0774136f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.328+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076802a0a0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:11.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.328+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:11.393 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:11.393 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24979]: starting. 2024-08-19T11:13:11.393 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24979]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-24941 2024-08-19T11:13:11.394 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[24979]: shutting down. 2024-08-19T11:13:11.394 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:11.394 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:11.394 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:13:11.397 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient: get_auth_request con 0x7f0774136ae0 auth_method 0 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 0 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient: ms_handle_reset current mon v2:172.21.15.71:3300/0 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 msgr2=0x7f0774136f00 unknown :-1 s=STATE_CLOSED l=0).mark_down 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.71:3300/0 conn(0x7f0774136ae0 0x7f0774136f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient: _add_conns ranks=[10,8,5,6,0,7,4,1] 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.135:3300/0 conn(0x7f075c003630 0x7f075c005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): picked mon.noname-f con 0x7f075c003630 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 0x7f075c008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f075c0062a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c009100 0x7f075c00b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f075c009100 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f075c00bf40 con 0x7f075c003630 2024-08-19T11:13:11.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f075c00c0c0 con 0x7f075c009100 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f075c00c2c0 con 0x7f075c0062a0 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0772ffd640 10 monclient(hunting): ms_handle_reset stray mon v2:172.21.15.71:3300/0 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 0x7f075c008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): get_auth_request con 0x7f075c0062a0 auth_method 0 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0773fff640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.135:3300/0 conn(0x7f075c003630 0x7f075c005a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0773fff640 10 monclient(hunting): get_auth_request con 0x7f075c003630 auth_method 0 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0773fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0773fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0778d00640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c009100 0x7f075c00b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0778d00640 10 monclient(hunting): get_auth_request con 0x7f075c009100 auth_method 0 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0778d00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0778d00640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0778d00640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient(hunting): handle_auth_done global_id 34155 payload 293 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c009100 msgr2=0x7f075c00b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c009100 0x7f075c00b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> v2:172.21.15.135:3300/0 conn(0x7f075c003630 msgr2=0x7f075c005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.135:3300/0 conn(0x7f075c003630 0x7f075c005a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 monclient: found mon.noname-e 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075c00c580 con 0x7f075c0062a0 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0778d00640 1 -- 172.21.15.71:0/1333977021 reap_dead start 2024-08-19T11:13:11.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.529+0000 7f0773fff640 1 --2- 172.21.15.71:0/1333977021 >> v2:172.21.15.135:3300/0 conn(0x7f075c003630 0x7f075c005a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:13:11.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.531+0000 7f07737fe640 1 -- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 msgr2=0x7f075c008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.531+0000 7f07737fe640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 0x7f075c008730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f0768009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=49aec9c3bdc6af30 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0768033430 con 0x7f075c0062a0 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: dump: 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 5 monclient: authenticate success, global_id 34155 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07680044a0 con 0x7f075c0062a0 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 1 -- 172.21.15.71:0/1333977021 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0768033bc0 con 0x7f075c0062a0 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 4 set_mon_vals no callback set 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f0772ffd640 10 monclient: dump: 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 10 monclient: shutdown 2024-08-19T11:13:11.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 -- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 msgr2=0x7f075c008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 0x7f075c008730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f0768009240 comp rx=0 tx=0).stop 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 -- 172.21.15.71:0/1333977021 shutdown_connections 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 --2- 172.21.15.71:0/1333977021 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f075c0062a0 0x7f075c008730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 -- 172.21.15.71:0/1333977021 >> 172.21.15.71:0/1333977021 conn(0x7f07740a8630 msgr2=0x7f07740a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 -- 172.21.15.71:0/1333977021 shutdown_connections 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.532+0000 7f077a763640 1 -- 172.21.15.71:0/1333977021 wait complete. 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.533+0000 7f077a763640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.533+0000 7f077a763640 10 monclient: monmap: 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.533+0000 7f077a763640 1 Processor -- start 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 -- start start 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient: init 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient: _add_conns ranks=[5,6,7,2,1,3,0,4,8] 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c0062a0 0x7f07741ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): picked mon.noname-h con 0x7f075c0062a0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 0x7f077412efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): picked mon.noname-d con 0x7f07741cad90 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f07741cb1d0 0x7f077412f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): picked mon.noname-i con 0x7f07741cb1d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f07740a1ca0 con 0x7f075c0062a0 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f07740a19c0 con 0x7f07741cad90 2024-08-19T11:13:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f07741365a0 con 0x7f07741cb1d0 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f077a763640 10 monclient(hunting): authenticate will time out at 849.576589s 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 0x7f077412efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c0062a0 0x7f07741ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c0062a0 0x7f07741ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:45724/0 (socket says 172.21.15.71:45724) 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 0x7f077412efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50834/0 (socket says 172.21.15.71:50834) 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 1 -- 172.21.15.71:0/423961342 learned_addr learned my addr 172.21.15.71:0/423961342 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): get_auth_request con 0x7f075c0062a0 auth_method 0 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): get_auth_request con 0x7f07741cad90 auth_method 0 2024-08-19T11:13:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f07741cb1d0 0x7f077412f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): get_auth_request con 0x7f07741cb1d0 auth_method 0 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f0778d00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 10 monclient(hunting): handle_auth_done global_id 24540 payload 824 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f07741cb1d0 msgr2=0x7f077412f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f07741cb1d0 0x7f077412f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c0062a0 msgr2=0x7f07741ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.534+0000 7f07737fe640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f075c0062a0 0x7f07741ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.535+0000 7f07737fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.535+0000 7f07737fe640 1 monclient: found mon.noname-d 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.535+0000 7f07737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.535+0000 7f07737fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.535+0000 7f07737fe640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0774132a50 con 0x7f07741cad90 2024-08-19T11:13:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f07737fe640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 msgr2=0x7f077412efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f07737fe640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 0x7f077412efb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0768008000 tx=0x7f07680046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0768005990 con 0x7f07741cad90 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: dump: 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 5 monclient: authenticate success, global_id 24540 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0768005b70 con 0x7f07741cad90 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0768005d20 con 0x7f07741cad90 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 10 monclient: _renew_subs 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0774132d30 con 0x7f07741cad90 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0771ffb640 4 set_mon_vals no callback set 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f0770ff9640 10 monclient: dump: 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 10 monclient: _renew_subs 2024-08-19T11:13:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.537+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f0774132770 con 0x7f07741cad90 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f077a763640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f077a763640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 0x7f077412fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f07740a19c0 con 0x7f077412fa30 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0768033a00 con 0x7f07741cad90 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 0x7f077412fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient: get_auth_request con 0x7f077412fa30 auth_method 0 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0770ff9640 1 --2- 172.21.15.71:0/423961342 >> v2:172.21.15.135:6800/726754104 conn(0x7f076003ea80 0x7f0760040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (secure 0 0 0) 0x7f0768039030 con 0x7f07741cad90 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0778d00640 1 --2- 172.21.15.71:0/423961342 >> v2:172.21.15.135:6800/726754104 conn(0x7f076003ea80 0x7f0760040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0778d00640 10 monclient: get_auth_request con 0x7f076003ea80 auth_method 0 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 10 monclient(hunting): handle_auth_done global_id 5088 payload 824 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.538+0000 7f0773fff640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0774131530 con 0x7f077412fa30 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0773fff640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 msgr2=0x7f077412fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0773fff640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 0x7f077412fe10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0764003870 tx=0x7f076400d400 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0778d00640 1 --2- 172.21.15.71:0/423961342 >> v2:172.21.15.135:6800/726754104 conn(0x7f076003ea80 0x7f0760040f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07740a2420 tx=0x7f076c003b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f076401a8a0 con 0x7f077412fa30 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 10 monclient: dump: 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f076401a430 con 0x7f077412fa30 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 msgr2=0x7f077412fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 0x7f077412fe10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0764003870 tx=0x7f076400d400 comp rx=0 tx=0).stop 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 msgr2=0x7f077412fe10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.541+0000 7f0770ff9640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f077412fa30 0x7f077412fe10 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0764003870 tx=0x7f076400d400 comp rx=0 tx=0).stop 2024-08-19T11:13:11.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.547+0000 7f077a763640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.547+0000 7f077a763640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 0x7f07740730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.547+0000 7f077a763640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.547+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f077406a590 con 0x7f0774072ce0 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 0x7f07740730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient: get_auth_request con 0x7f0774072ce0 auth_method 0 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 10 monclient(hunting): handle_auth_done global_id 5097 payload 824 2024-08-19T11:13:11.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.548+0000 7f0773fff640 1 -- 172.21.15.71:0/423961342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f077409c4e0 con 0x7f0774072ce0 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.550+0000 7f0773fff640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 msgr2=0x7f07740730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.550+0000 7f0773fff640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 0x7f07740730f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0764003870 tx=0x7f0764004730 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0764022e20 con 0x7f0774072ce0 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 10 monclient: dump: 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7f076402c3f0 con 0x7f0774072ce0 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 msgr2=0x7f07740730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 0x7f07740730f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0764003870 tx=0x7f0764004730 comp rx=0 tx=0).stop 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 msgr2=0x7f07740730f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0770ff9640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0774072ce0 0x7f07740730f0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0764003870 tx=0x7f0764004730 comp rx=0 tx=0).stop 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:11.568 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 188404, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:11.569 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.571 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.572 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.573 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:11.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.575 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:11.575 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:11.575 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.576 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.578 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.580 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.585 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:11.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.590 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.591 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.592 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:11.593 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 >> v2:172.21.15.135:6800/726754104 conn(0x7f076003ea80 msgr2=0x7f0760040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 1 --2- 172.21.15.71:0/423961342 >> v2:172.21.15.135:6800/726754104 conn(0x7f076003ea80 0x7f0760040f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07740a2420 tx=0x7f076c003b90 comp rx=0 tx=0).stop 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 10 monclient: shutdown 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 msgr2=0x7f077412efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 1 --2- 172.21.15.71:0/423961342 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f07741cad90 0x7f077412efb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0768008000 tx=0x7f07680046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0778d00640 1 -- 172.21.15.71:0/423961342 reap_dead start 2024-08-19T11:13:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f0778d00640 1 -- 172.21.15.71:0/423961342 reap_dead start 2024-08-19T11:13:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 shutdown_connections 2024-08-19T11:13:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.551+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 >> 172.21.15.71:0/423961342 conn(0x7f07740a8630 msgr2=0x7f077409b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.552+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 shutdown_connections 2024-08-19T11:13:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.552+0000 7f077a763640 1 -- 172.21.15.71:0/423961342 wait complete. 2024-08-19T11:13:11.596 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:11.596 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:13:11.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.693+0000 7f625f9b8640 10 monclient: get_monmap_and_config 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.693+0000 7f625f9b8640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.693+0000 7f625f9b8640 10 monclient: monmap: 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:11.694827+0000 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:11.694827+0000 2024-08-19T11:13:11.695 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:11.696 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.693+0000 7f625f9b8640 1 Processor -- start 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.693+0000 7f625f9b8640 1 -- start start 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.693+0000 7f625f9b8640 10 monclient: init 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient: _add_conns ranks=[3,1,2,9,10,5,4,0,8,7,6] 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62580a57d0 0x7f62580a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): picked mon.noname-g con 0x7f62580a57d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f62580a5bb0 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 0x7f625813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): picked mon.noname-b con 0x7f625813c9d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62580728a0 con 0x7f62580a5bb0 2024-08-19T11:13:11.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f62580a41b0 con 0x7f625813c9d0 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6258072620 con 0x7f62580a57d0 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625f9b8640 10 monclient(hunting): authenticate will time out at 849.736515s 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 0x7f625813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 0x7f625813edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:59380/0 (socket says 172.21.15.71:59380) 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 -- 172.21.15.71:0/1201763859 learned_addr learned my addr 172.21.15.71:0/1201763859 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): get_auth_request con 0x7f625813c9d0 auth_method 0 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625d754640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62580a57d0 0x7f62580a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625d754640 10 monclient(hunting): get_auth_request con 0x7f62580a57d0 auth_method 0 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625d754640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625d754640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625d754640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient(hunting): handle_auth_done global_id 5303 payload 274 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 -- 172.21.15.71:0/1201763859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62580a57d0 msgr2=0x7f62580a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62580a57d0 0x7f62580a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 -- 172.21.15.71:0/1201763859 >> v1:172.21.15.135:6789/0 conn(0x7f62580a5bb0 legacy=0x7f62580a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 monclient: found mon.noname-b 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625df55640 1 -- 172.21.15.71:0/1201763859 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6258073940 con 0x7f625813c9d0 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.694+0000 7f625d754640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62580a57d0 0x7f62580a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f625df55640 1 -- 172.21.15.71:0/1201763859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 msgr2=0x7f625813edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f625df55640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 0x7f625813edc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e80 tx=0x7f625002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9522bb92e208d603 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 1 -- 172.21.15.71:0/1201763859 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6250036070 con 0x7f625813c9d0 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: dump: 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.708 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 1 -- 172.21.15.71:0/1201763859 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6250007860 con 0x7f625813c9d0 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f625f9b8640 5 monclient: authenticate success, global_id 5303 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f625f9b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f625f9b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 1 -- 172.21.15.71:0/1201763859 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6250030360 con 0x7f625813c9d0 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f625f9b8640 4 set_mon_vals no callback set 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.697+0000 7f624ffff640 10 monclient: dump: 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.711 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 10 monclient: shutdown 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 -- 172.21.15.71:0/1201763859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 msgr2=0x7f625813edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 0x7f625813edc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e80 tx=0x7f625002a5d0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 -- 172.21.15.71:0/1201763859 shutdown_connections 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f625813c9d0 0x7f625813edc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 --2- 172.21.15.71:0/1201763859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f62580a57d0 0x7f62580a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 -- 172.21.15.71:0/1201763859 >> 172.21.15.71:0/1201763859 conn(0x7f62580aa3f0 msgr2=0x7f62580a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 -- 172.21.15.71:0/1201763859 shutdown_connections 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.698+0000 7f625f9b8640 1 -- 172.21.15.71:0/1201763859 wait complete. 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient: monmap: 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:11.713 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 Processor -- start 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 -- start start 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient: init 2024-08-19T11:13:11.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient: _add_conns ranks=[1,4,3,6,2,0,7,8,5] 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580a57d0 0x7f6258124820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): picked mon.noname-f con 0x7f62580a57d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 0x7f6258124d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): picked mon.noname-c con 0x7f62580a5bb0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f625813c9d0 0x7f62581252a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): picked mon.noname-g con 0x7f625813c9d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f625813f480 con 0x7f62580a57d0 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f625813f300 con 0x7f625813c9d0 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f625813f600 con 0x7f62580a5bb0 2024-08-19T11:13:11.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625f9b8640 10 monclient(hunting): authenticate will time out at 849.741902s 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.699+0000 7f625cf53640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 0x7f6258124d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 0x7f6258124d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47880/0 (socket says 172.21.15.71:47880) 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 -- 172.21.15.71:0/2847538107 learned_addr learned my addr 172.21.15.71:0/2847538107 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): get_auth_request con 0x7f62580a5bb0 auth_method 0 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625d754640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580a57d0 0x7f6258124820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient(hunting): handle_auth_done global_id 5071 payload 824 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625df55640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f625813c9d0 0x7f62581252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f625813c9d0 msgr2=0x7f62581252a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f625813c9d0 0x7f62581252a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580a57d0 msgr2=0x7f6258124820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580a57d0 0x7f6258124820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 monclient: found mon.noname-c 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625cf53640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62580a0100 con 0x7f62580a5bb0 2024-08-19T11:13:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625d754640 10 monclient: get_auth_request con 0x7f62580a57d0 auth_method 0 2024-08-19T11:13:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625d754640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580a57d0 0x7f6258124820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625df55640 10 monclient: get_auth_request con 0x7f625813c9d0 auth_method 0 2024-08-19T11:13:11.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.700+0000 7f625df55640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f625813c9d0 0x7f62581252a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625cf53640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 msgr2=0x7f6258124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625cf53640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 0x7f6258124d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f624800c400 tx=0x7f624800c8c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6248011c10 con 0x7f62580a5bb0 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: dump: 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 5 monclient: authenticate success, global_id 5071 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6248017070 con 0x7f62580a5bb0 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6248011e10 con 0x7f62580a5bb0 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 10 monclient: _renew_subs 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6258126ff0 con 0x7f62580a5bb0 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624f7fe640 4 set_mon_vals no callback set 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f624dffb640 10 monclient: dump: 2024-08-19T11:13:11.726 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.727 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 10 monclient: _renew_subs 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.702+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f625813b940 con 0x7f62580a5bb0 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f62480117c0 con 0x7f62580a5bb0 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f625f9b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f625f9b8640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 0x7f625802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f625806a590 con 0x7f62581cecf0 2024-08-19T11:13:11.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f624dffb640 1 --2- 172.21.15.71:0/2847538107 >> v2:172.21.15.135:6800/726754104 conn(0x7f623c03ea80 0x7f623c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.703+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (secure 0 0 0) 0x7f6248051ad0 con 0x7f62580a5bb0 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 0x7f625802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient: get_auth_request con 0x7f62581cecf0 auth_method 0 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625df55640 1 --2- 172.21.15.71:0/2847538107 >> v2:172.21.15.135:6800/726754104 conn(0x7f623c03ea80 0x7f623c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625df55640 10 monclient: get_auth_request con 0x7f623c03ea80 auth_method 0 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 10 monclient(hunting): handle_auth_done global_id 15026 payload 824 2024-08-19T11:13:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.704+0000 7f625d754640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f625813f0d0 con 0x7f62581cecf0 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f625d754640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 msgr2=0x7f625802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f625d754640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 0x7f625802d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f625400f4b0 tx=0x7f625400f970 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f625df55640 1 --2- 172.21.15.71:0/2847538107 >> v2:172.21.15.135:6800/726754104 conn(0x7f623c03ea80 0x7f623c040f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6250033000 tx=0x7f6250009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6254018070 con 0x7f62581cecf0 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f624dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f624dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.706+0000 7f624dffb640 10 monclient: dump: 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6254014980 con 0x7f62581cecf0 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 msgr2=0x7f625802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 0x7f625802d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f625400f4b0 tx=0x7f625400f970 comp rx=0 tx=0).stop 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 msgr2=0x7f625802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.707+0000 7f624dffb640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cecf0 0x7f625802d1c0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f625400f4b0 tx=0x7f625400f970 comp rx=0 tx=0).stop 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625f9b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625f9b8640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 0x7f625802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625f9b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6258076c60 con 0x7f62581cf0d0 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 0x7f625802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient: get_auth_request con 0x7f62581cf0d0 auth_method 0 2024-08-19T11:13:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 10 monclient(hunting): handle_auth_done global_id 15035 payload 824 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.713+0000 7f625d754640 1 -- 172.21.15.71:0/2847538107 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f62580a1780 con 0x7f62581cf0d0 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625d754640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 msgr2=0x7f625802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625d754640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 0x7f625802d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f625400f4b0 tx=0x7f6254004730 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f62540288a0 con 0x7f62581cf0d0 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 10 monclient: dump: 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f6254028430 con 0x7f62581cf0d0 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 msgr2=0x7f625802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 0x7f625802d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f625400f4b0 tx=0x7f6254004730 comp rx=0 tx=0).stop 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 msgr2=0x7f625802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f624dffb640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f62581cf0d0 0x7f625802d700 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:11.736 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 188571, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:11.737 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.738 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.739 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:11.740 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:11.741 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.742 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:11.746 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:11.748 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.751 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:11.755 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.758 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.760 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.761 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:11.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.761 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:11.761 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 >> v2:172.21.15.135:6800/726754104 conn(0x7f623c03ea80 msgr2=0x7f623c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625f9b8640 1 --2- 172.21.15.71:0/2847538107 >> v2:172.21.15.135:6800/726754104 conn(0x7f623c03ea80 0x7f623c040f40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6250033000 tx=0x7f6250009000 comp rx=0 tx=0).stop 2024-08-19T11:13:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625f9b8640 10 monclient: shutdown 2024-08-19T11:13:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625f9b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 msgr2=0x7f6258124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625f9b8640 1 --2- 172.21.15.71:0/2847538107 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f62580a5bb0 0x7f6258124d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f624800c400 tx=0x7f624800c8c0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.716+0000 7f625df55640 1 -- 172.21.15.71:0/2847538107 reap_dead start 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.717+0000 7f625df55640 1 -- 172.21.15.71:0/2847538107 reap_dead start 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.717+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 shutdown_connections 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.717+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 >> 172.21.15.71:0/2847538107 conn(0x7f62580aa3f0 msgr2=0x7f62580a2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.717+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 shutdown_connections 2024-08-19T11:13:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.717+0000 7f625f9b8640 1 -- 172.21.15.71:0/2847538107 wait complete. 2024-08-19T11:13:11.763 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:11.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:13:11.764 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:13:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.860+0000 7f0b86ccc640 10 monclient: get_monmap_and_config 2024-08-19T11:13:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.860+0000 7f0b86ccc640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.860+0000 7f0b86ccc640 10 monclient: monmap: 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:11.861803+0000 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:11.861803+0000 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.860+0000 7f0b86ccc640 1 Processor -- start 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.860+0000 7f0b86ccc640 1 -- start start 2024-08-19T11:13:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.860+0000 7f0b86ccc640 10 monclient: init 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient: _add_conns ranks=[0,10,3,5,6,9,7,8,2,4,1] 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0b800a57d0 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b800a62c0 0x7f0b800a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): picked mon.noname-f con 0x7f0b800a62c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 0x7f0b8013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): picked mon.noname-g con 0x7f0b8013c9d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b800728a0 con 0x7f0b800a57d0 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0b800a41b0 con 0x7f0b800a62c0 2024-08-19T11:13:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80072620 con 0x7f0b8013c9d0 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b86ccc640 10 monclient(hunting): authenticate will time out at 849.903438s 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b84a68640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0b800a57d0 0x7f0b800a5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38630/0 (socket says 172.21.15.71:38630) 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b84a68640 1 -- 172.21.15.71:0/546831844 learned_addr learned my addr 172.21.15.71:0/546831844 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b85269640 1 --2- 172.21.15.71:0/546831844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 0x7f0b8013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b7ffff640 1 --2- 172.21.15.71:0/546831844 >> v2:172.21.15.135:3300/0 conn(0x7f0b800a62c0 0x7f0b800a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b85269640 10 monclient(hunting): get_auth_request con 0x7f0b8013c9d0 auth_method 0 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b85269640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b85269640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b85269640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b7ffff640 10 monclient(hunting): get_auth_request con 0x7f0b800a62c0 auth_method 0 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b7ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.861+0000 7f0b7ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 10 monclient(hunting): handle_auth_done global_id 5115 payload 274 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 1 -- 172.21.15.71:0/546831844 >> v2:172.21.15.135:3300/0 conn(0x7f0b800a62c0 msgr2=0x7f0b800a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 1 --2- 172.21.15.71:0/546831844 >> v2:172.21.15.135:3300/0 conn(0x7f0b800a62c0 0x7f0b800a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 1 -- 172.21.15.71:0/546831844 >> v1:172.21.15.71:6789/0 conn(0x7f0b800a57d0 legacy=0x7f0b800a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 1 monclient: found mon.noname-g 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b85269640 1 -- 172.21.15.71:0/546831844 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b80073940 con 0x7f0b8013c9d0 2024-08-19T11:13:11.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.862+0000 7f0b7ffff640 1 --2- 172.21.15.71:0/546831844 >> v2:172.21.15.135:3300/0 conn(0x7f0b800a62c0 0x7f0b800a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:11.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b85269640 1 -- 172.21.15.71:0/546831844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 msgr2=0x7f0b8013edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b85269640 1 --2- 172.21.15.71:0/546831844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 0x7f0b8013edc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009d90 tx=0x7f0b7802a530 comp rx=0 tx=0).ready entity=mon.3 client_cookie=d078b9a489e83d61 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 1 -- 172.21.15.71:0/546831844 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b78007bc0 con 0x7f0b8013c9d0 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: dump: 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.879 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 1 -- 172.21.15.71:0/546831844 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b78007d80 con 0x7f0b8013c9d0 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 5 monclient: authenticate success, global_id 5115 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 1 -- 172.21.15.71:0/546831844 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b78031870 con 0x7f0b8013c9d0 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 4 set_mon_vals no callback set 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b7f7fe640 10 monclient: dump: 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.882 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 10 monclient: shutdown 2024-08-19T11:13:11.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 -- 172.21.15.71:0/546831844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 msgr2=0x7f0b8013edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/546831844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 0x7f0b8013edc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009d90 tx=0x7f0b7802a530 comp rx=0 tx=0).stop 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 -- 172.21.15.71:0/546831844 shutdown_connections 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/546831844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8013c9d0 0x7f0b8013edc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/546831844 >> v2:172.21.15.135:3300/0 conn(0x7f0b800a62c0 0x7f0b800a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 -- 172.21.15.71:0/546831844 >> 172.21.15.71:0/546831844 conn(0x7f0b800aa3f0 msgr2=0x7f0b800a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 -- 172.21.15.71:0/546831844 shutdown_connections 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.865+0000 7f0b86ccc640 1 -- 172.21.15.71:0/546831844 wait complete. 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.866+0000 7f0b86ccc640 10 monclient: build_initial_monmap 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.866+0000 7f0b86ccc640 10 monclient: monmap: 2024-08-19T11:13:11.884 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:11.885 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.866+0000 7f0b86ccc640 1 Processor -- start 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.866+0000 7f0b86ccc640 1 -- start start 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.866+0000 7f0b86ccc640 10 monclient: init 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient: _add_conns ranks=[5,2,7,0,8,4,6,1,3] 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b800a57d0 0x7f0b80124a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): picked mon.noname-h con 0x7f0b800a57d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 0x7f0b8013b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f0b800a62c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8013c9d0 0x7f0b80122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): picked mon.noname-i con 0x7f0b8013c9d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8013f480 con 0x7f0b800a62c0 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0b8013f300 con 0x7f0b800a57d0 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0b8013f600 con 0x7f0b8013c9d0 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:11.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b86ccc640 10 monclient(hunting): authenticate will time out at 849.909449s 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 0x7f0b8013b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 0x7f0b8013b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:59384/0 (socket says 172.21.15.71:59384) 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 -- 172.21.15.71:0/4067543497 learned_addr learned my addr 172.21.15.71:0/4067543497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): get_auth_request con 0x7f0b800a62c0 auth_method 0 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b800a57d0 0x7f0b80124a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8013c9d0 0x7f0b80122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): get_auth_request con 0x7f0b800a57d0 auth_method 0 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): get_auth_request con 0x7f0b8013c9d0 auth_method 0 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b85269640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient(hunting): handle_auth_done global_id 5312 payload 824 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8013c9d0 msgr2=0x7f0b80122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8013c9d0 0x7f0b80122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b800a57d0 msgr2=0x7f0b80124a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b800a57d0 0x7f0b80124a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:13:11.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 monclient: found mon.noname-b 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.867+0000 7f0b7ffff640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b80126210 con 0x7f0b800a62c0 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7ffff640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 msgr2=0x7f0b8013b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7ffff640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 0x7f0b8013b880 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00ebe0 tx=0x7f0b6c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b6c017070 con 0x7f0b800a62c0 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: dump: 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.891 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.892 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00ce40 con 0x7f0b800a62c0 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 5 monclient: authenticate success, global_id 5312 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 10 monclient: _renew_subs 2024-08-19T11:13:11.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b800a90e0 con 0x7f0b800a62c0 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b6c013d50 con 0x7f0b800a62c0 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7d7fa640 10 monclient: dump: 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.894 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 10 monclient: _renew_subs 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b7effd640 4 set_mon_vals no callback set 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.870+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b801253a0 con 0x7f0b800a62c0 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b86ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 0x7f0b80122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0b80125bb0 con 0x7f0b80122a40 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0b6c01a070 con 0x7f0b800a62c0 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 0x7f0b80122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b7d7fa640 1 --2- 172.21.15.71:0/4067543497 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b6403ea80 0x7f0b64040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient: get_auth_request con 0x7f0b80122a40 auth_method 0 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (secure 0 0 0) 0x7f0b6c00f040 con 0x7f0b800a62c0 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b85269640 1 --2- 172.21.15.71:0/4067543497 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b6403ea80 0x7f0b64040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b85269640 10 monclient: get_auth_request con 0x7f0b6403ea80 auth_method 0 2024-08-19T11:13:11.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 10 monclient(hunting): handle_auth_done global_id 4993 payload 824 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.871+0000 7f0b84a68640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b800a9310 con 0x7f0b80122a40 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b84a68640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 msgr2=0x7f0b80122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b84a68640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 0x7f0b80122e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400ea70 tx=0x7f0b7400ef30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b85269640 1 --2- 172.21.15.71:0/4067543497 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b6403ea80 0x7f0b64040f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b78034000 tx=0x7f0b7802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b7401a070 con 0x7f0b80122a40 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 10 monclient: dump: 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.898 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.899 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0b7400cc50 con 0x7f0b80122a40 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 msgr2=0x7f0b80122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 0x7f0b80122e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400ea70 tx=0x7f0b7400ef30 comp rx=0 tx=0).stop 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 msgr2=0x7f0b80122e20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.874+0000 7f0b7d7fa640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b80122a40 0x7f0b80122e20 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400ea70 tx=0x7f0b7400ef30 comp rx=0 tx=0).stop 2024-08-19T11:13:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b86ccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 0x7f0b8009ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:11.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b86ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0b80076c60 con 0x7f0b8009ea00 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 0x7f0b8009ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient: get_auth_request con 0x7f0b8009ea00 auth_method 0 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.880+0000 7f0b84a68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:11.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.881+0000 7f0b84a68640 10 monclient(hunting): handle_auth_done global_id 5002 payload 824 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.881+0000 7f0b84a68640 1 -- 172.21.15.71:0/4067543497 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0b80123360 con 0x7f0b8009ea00 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b84a68640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 msgr2=0x7f0b8009ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b84a68640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 0x7f0b8009ee10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b74017000 tx=0x7f0b74004940 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b7401a070 con 0x7f0b8009ea00 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b7d7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b7d7fa640 10 monclient: dump: 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.904 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:11.905 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.883+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f0b7401b040 con 0x7f0b8009ea00 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b7d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b7d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 msgr2=0x7f0b8009ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b7d7fa640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 0x7f0b8009ee10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b74017000 tx=0x7f0b74004940 comp rx=0 tx=0).stop 2024-08-19T11:13:11.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b7d7fa640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 msgr2=0x7f0b8009ee10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b7d7fa640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b8009ea00 0x7f0b8009ee10 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b74017000 tx=0x7f0b74004940 comp rx=0 tx=0).stop 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 188738, 2024-08-19T11:13:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:11.934 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b6403ea80 msgr2=0x7f0b64040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/4067543497 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b6403ea80 0x7f0b64040f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b78034000 tx=0x7f0b7802f000 comp rx=0 tx=0).stop 2024-08-19T11:13:11.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 10 monclient: shutdown 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 msgr2=0x7f0b8013b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 0x7f0b8013b880 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00ebe0 tx=0x7f0b6c00c520 comp rx=0 tx=0).stop 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b85269640 1 -- 172.21.15.71:0/4067543497 reap_dead start 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 shutdown_connections 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 --2- 172.21.15.71:0/4067543497 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b800a62c0 0x7f0b8013b880 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 >> 172.21.15.71:0/4067543497 conn(0x7f0b800aa3f0 msgr2=0x7f0b800a35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 shutdown_connections 2024-08-19T11:13:11.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:11.884+0000 7f0b86ccc640 1 -- 172.21.15.71:0/4067543497 wait complete. 2024-08-19T11:13:11.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:11.938 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:13:11.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.032+0000 7fd3d5238640 10 monclient: get_monmap_and_config 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.032+0000 7fd3d5238640 10 monclient: build_initial_monmap 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.032+0000 7fd3d5238640 10 monclient: monmap: 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:12.034334+0000 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:12.034334+0000 2024-08-19T11:13:12.035 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:12.036 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:12.037 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:12.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 Processor -- start 2024-08-19T11:13:12.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 -- start start 2024-08-19T11:13:12.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient: init 2024-08-19T11:13:12.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:12.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient: _add_conns ranks=[9,0,6,3,8,7,1,10,5,4,2] 2024-08-19T11:13:12.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 0x7fd3d00a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): picked mon.noname-a con 0x7fd3d00a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd3d00a6e10 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 0x7fd3d0140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): picked mon.noname-d con 0x7fd3d013eb10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d00a4f90 con 0x7fd3d00a6e10 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d00a3650 con 0x7fd3d00a6a30 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd3d00a6380 con 0x7fd3d013eb10 2024-08-19T11:13:12.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3d5238640 10 monclient(hunting): authenticate will time out at 850.075810s 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3cf59e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 0x7fd3d0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 0x7fd3d00a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 0x7fd3d00a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39074/0 (socket says 172.21.15.71:39074) 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3cf59e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 0x7fd3d0140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50836/0 (socket says 172.21.15.71:50836) 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 1 -- 172.21.15.71:0/1670606317 learned_addr learned my addr 172.21.15.71:0/1670606317 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 10 monclient(hunting): get_auth_request con 0x7fd3d00a6a30 auth_method 0 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3ced9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:12.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3cf59e640 10 monclient(hunting): get_auth_request con 0x7fd3d013eb10 auth_method 0 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3cf59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3cf59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.033+0000 7fd3cf59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:12.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 10 monclient(hunting): handle_auth_done global_id 24549 payload 274 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 1 -- 172.21.15.71:0/1670606317 >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 msgr2=0x7fd3d00a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 1 --2- 172.21.15.71:0/1670606317 >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 0x7fd3d00a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 1 -- 172.21.15.71:0/1670606317 >> v1:172.21.15.71:6789/0 conn(0x7fd3d00a6e10 legacy=0x7fd3d00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 10 monclient: _finish_hunting 0 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 1 monclient: found mon.noname-d 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3cf59e640 1 -- 172.21.15.71:0/1670606317 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d00a49d0 con 0x7fd3d013eb10 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.034+0000 7fd3ced9d640 1 --2- 172.21.15.71:0/1670606317 >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 0x7fd3d00a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:12.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.036+0000 7fd3cf59e640 1 -- 172.21.15.71:0/1670606317 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 msgr2=0x7fd3d0140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.036+0000 7fd3cf59e640 1 --2- 172.21.15.71:0/1670606317 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 0x7fd3d0140f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009d90 tx=0x7fd3c802a490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=45c6effa784fdc15 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 1 -- 172.21.15.71:0/1670606317 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3c8007bc0 con 0x7fd3d013eb10 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: dump: 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:12.050 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:12.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: _finish_auth 0 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: _check_auth_tickets 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 1 -- 172.21.15.71:0/1670606317 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c8007d80 con 0x7fd3d013eb10 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 5 monclient: authenticate success, global_id 24549 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 1 -- 172.21.15.71:0/1670606317 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3c8031870 con 0x7fd3d013eb10 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 4 set_mon_vals no callback set 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:12.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3ce59c640 10 monclient: dump: 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:12.053 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 10 monclient: shutdown 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 -- 172.21.15.71:0/1670606317 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 msgr2=0x7fd3d0140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 --2- 172.21.15.71:0/1670606317 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 0x7fd3d0140f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009d90 tx=0x7fd3c802a490 comp rx=0 tx=0).stop 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 -- 172.21.15.71:0/1670606317 shutdown_connections 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 --2- 172.21.15.71:0/1670606317 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd3d013eb10 0x7fd3d0140f00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 --2- 172.21.15.71:0/1670606317 >> v2:172.21.15.71:3300/0 conn(0x7fd3d00a6a30 0x7fd3d00a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 -- 172.21.15.71:0/1670606317 >> 172.21.15.71:0/1670606317 conn(0x7fd3d00ac030 msgr2=0x7fd3d00ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 -- 172.21.15.71:0/1670606317 shutdown_connections 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.037+0000 7fd3d5238640 1 -- 172.21.15.71:0/1670606317 wait complete. 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.038+0000 7fd3d5238640 10 monclient: build_initial_monmap 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.038+0000 7fd3d5238640 10 monclient: monmap: 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:12.055 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:12.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.038+0000 7fd3d5238640 1 Processor -- start 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.038+0000 7fd3d5238640 1 -- start start 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.038+0000 7fd3d5238640 10 monclient: init 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient: _add_conns ranks=[4,3,5,8,1,0,2,7,6] 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 0x7fd3d0125a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): picked mon.noname-c con 0x7fd3d00a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3d00a6e10 0x7fd3d01ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): picked mon.noname-g con 0x7fd3d00a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd3d013eb10 0x7fd3d01234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): picked mon.noname-h con 0x7fd3d013eb10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:12.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d0141440 con 0x7fd3d00a6e10 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd3d00a5d30 con 0x7fd3d00a6a30 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd3d01415c0 con 0x7fd3d013eb10 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3d5238640 10 monclient(hunting): authenticate will time out at 850.081355s 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 0x7fd3d0125a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 0x7fd3d0125a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47892/0 (socket says 172.21.15.71:47892) 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 -- 172.21.15.71:0/3950013359 learned_addr learned my addr 172.21.15.71:0/3950013359 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): get_auth_request con 0x7fd3d00a6a30 auth_method 0 2024-08-19T11:13:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3cf59e640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd3d013eb10 0x7fd3d01234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3cf59e640 10 monclient(hunting): get_auth_request con 0x7fd3d013eb10 auth_method 0 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3cf59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3cf59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3cf59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3c659c640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3d00a6e10 0x7fd3d01ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3c659c640 10 monclient(hunting): get_auth_request con 0x7fd3d00a6e10 auth_method 0 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3c659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3c659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient(hunting): handle_auth_done global_id 5080 payload 824 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 -- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd3d013eb10 msgr2=0x7fd3d01234e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd3d013eb10 0x7fd3d01234e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 -- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3d00a6e10 msgr2=0x7fd3d01ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3d00a6e10 0x7fd3d01ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 monclient: found mon.noname-c 2024-08-19T11:13:12.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.039+0000 7fd3ced9d640 1 -- 172.21.15.71:0/3950013359 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d00ac540 con 0x7fd3d00a6a30 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.041+0000 7fd3ced9d640 1 -- 172.21.15.71:0/3950013359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 msgr2=0x7fd3d0125a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.041+0000 7fd3ced9d640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 0x7fd3d0125a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e9d0 tx=0x7fd3c000ee90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3c0017070 con 0x7fd3d00a6a30 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: dump: 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.061 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:12.062 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:12.066 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:12.066 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:12.066 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:12.066 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: _finish_auth 0 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 5 monclient: authenticate success, global_id 5080 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c000cc70 con 0x7fd3d00a6a30 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 10 monclient: _renew_subs 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d01263d0 con 0x7fd3d00a6a30 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd3c000ce20 con 0x7fd3d00a6a30 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:12.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3cdd9b640 4 set_mon_vals no callback set 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3c7fff640 10 monclient: dump: 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:12.068 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 10 monclient: _renew_subs 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.042+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d01269a0 con 0x7fd3d00a6a30 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd3c001a070 con 0x7fd3d00a6a30 2024-08-19T11:13:12.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3c7fff640 1 --2- 172.21.15.71:0/3950013359 >> v2:172.21.15.135:6800/726754104 conn(0x7fd3b003ea80 0x7fd3b0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3d5238640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3d5238640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (secure 0 0 0) 0x7fd3c000f040 con 0x7fd3d00a6a30 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3d5238640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d00ac7b0 con 0x7fd3d00a6a30 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3c659c640 1 --2- 172.21.15.71:0/3950013359 >> v2:172.21.15.135:6800/726754104 conn(0x7fd3b003ea80 0x7fd3b0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:12.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.043+0000 7fd3c659c640 10 monclient: get_auth_request con 0x7fd3b003ea80 auth_method 0 2024-08-19T11:13:12.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.045+0000 7fd3c659c640 1 --2- 172.21.15.71:0/3950013359 >> v2:172.21.15.135:6800/726754104 conn(0x7fd3b003ea80 0x7fd3b0040f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0125550 tx=0x7fd3b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:12.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.048+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fd3d00ac7b0 con 0x7fd3d00a6a30 2024-08-19T11:13:12.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.048+0000 7fd3c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:12.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.048+0000 7fd3c7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:12.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.292+0000 7fd3d5238640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:13:12.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.292+0000 7fd3d5238640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:13:12.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.292+0000 7fd3d5238640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:12.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.292+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd3d0126d40 con 0x7fd3d00a6a30 2024-08-19T11:13:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.294+0000 7fd3c7fff640 1 -- 172.21.15.71:0/3950013359 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fd3c0021070 con 0x7fd3d00a6a30 2024-08-19T11:13:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.294+0000 7fd3c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:13:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.294+0000 7fd3c7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:12.301 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.301 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.301 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=8,config=2,health=10,kv=12,logm=68} crc {auth=2992866548,config=2586702516,health=4283849203,kv=3646823213,logm=2480138033}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=1,health=12,kv=11,logm=66} crc {auth=2942238501,config=1228700967,health=591300065,kv=803884263,logm=464820885}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=2519250839,logm=3946987408}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=10,config=1,health=12,kv=9,logm=68} crc {auth=2942238501,config=1747058506,health=591300065,kv=3481452362,logm=1689172556}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.302 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=10,config=2,health=11,kv=11,logm=66} crc {auth=2942238501,config=2586702516,health=2326697343,kv=3646823213,logm=1934137598}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=10,config=1,health=12,kv=12,logm=65} crc {auth=2942238501,config=1747058506,health=591300065,kv=3646823213,logm=2045665194}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=10,config=2,health=10,kv=12,logm=66} crc {auth=2942238501,config=2586702516,health=4015052517,kv=3646823213,logm=1844490058}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=1938844153}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.295+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=2942238501,config=2586702516,health=591300065,kv=3646823213,logm=3938980079}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2874776922}) 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.303 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233525412}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3234904896}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2030362734}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.296+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=981125987}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2938901906}) 2024-08-19T11:13:12.304 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.305 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.305 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1962038435}) 2024-08-19T11:13:12.305 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.305 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548286348}) 2024-08-19T11:13:12.305 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.297+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=987752911}) 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 >> v2:172.21.15.135:6800/726754104 conn(0x7fd3b003ea80 msgr2=0x7fd3b0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 --2- 172.21.15.71:0/3950013359 >> v2:172.21.15.135:6800/726754104 conn(0x7fd3b003ea80 0x7fd3b0040f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0125550 tx=0x7fd3b8009040 comp rx=0 tx=0).stop 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 10 monclient: shutdown 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 msgr2=0x7fd3d0125a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 0x7fd3d0125a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e9d0 tx=0x7fd3c000ee90 comp rx=0 tx=0).stop 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 shutdown_connections 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 --2- 172.21.15.71:0/3950013359 >> v2:172.21.15.135:6800/726754104 conn(0x7fd3b003ea80 0x7fd3b0040f40 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0125550 tx=0x7fd3b8009040 comp rx=0 tx=0).stop 2024-08-19T11:13:12.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd3d013eb10 0x7fd3d01234e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd3d00a6e10 0x7fd3d01ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 --2- 172.21.15.71:0/3950013359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd3d00a6a30 0x7fd3d0125a40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:12.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.297+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 >> 172.21.15.71:0/3950013359 conn(0x7fd3d00ac030 msgr2=0x7fd3d013fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:12.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.298+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 shutdown_connections 2024-08-19T11:13:12.307 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:12.298+0000 7fd3d5238640 1 -- 172.21.15.71:0/3950013359 wait complete. 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=152537893}) 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1447054593}) 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=187372701}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=78481835}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=286792689}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2102246295}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=771414835}) 2024-08-19T11:13:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3166461269}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.298+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2556217887}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2329774326}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2929197267}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3780883524}) 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1709990361}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1115520838}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4070511913}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1303371136}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323547464}) 2024-08-19T11:13:12.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.299+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=277812929}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=800052715}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1149091653}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4249315014}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2791869452}) 2024-08-19T11:13:12.327 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2555839686}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2039128222}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=546878446}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566591118}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.301+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1844710794}) 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.328 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2982453288}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3208692194}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=974050513}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1144430182}) 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1342992197}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2358444573}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=41739071}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838068325}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.302+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2364110240}) 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2810743895}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1826997474}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1291573370}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1596055562}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2544245699}) 2024-08-19T11:13:12.331 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=135190900}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3334339533}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714220706}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.303+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3449207930}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2394401180}) 2024-08-19T11:13:12.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2339573000}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1523362864}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1771453450}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1135193493}) 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=342295787}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1573196470}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559520773}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.305+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2804664141}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3301254821}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2855470820}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1443340789}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2331066101}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4104249000}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1039073631}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=876399576}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3111333774}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.306+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4236048895}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3160616081}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.336 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3818415913}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2171845063}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3277050798}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1961881403}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2293463496}) 2024-08-19T11:13:12.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=832235623}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1056990632}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.308+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4228422777}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2427986415}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1062553174}) 2024-08-19T11:13:12.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3269166141}) 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3663989770}) 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3856044587}) 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4208507354}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1775935282}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3884265293}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.309+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2560291556}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=17,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=1027883481,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3680581026,mon_config_key=2720761110,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=642303947,osd_snap=421676469,osdmap=1972697630}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=10,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=3210650588,mdsmap=4081106307,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=2720761110,monmap=1080203527,osd_metadata=3462306538,osd_pg_creating=642303947,osd_snap=421676469,osdmap=1217659589}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727127,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=2720761111,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=642303947,osd_snap=421676469,osdmap=956783582}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=562596590,mdsmap=4204236774,mgr=7801448,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1260537491,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=642303947,osd_snap=421676469,osdmap=3455686707}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=10,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=15,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=2337978771,mdsmap=4204236774,mgr=4091103352,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4262317341,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=642303947,osd_snap=421676469,osdmap=1809164074}) 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2803346265,mon_config_key=221826564,monmap=1080203526,osd_metadata=306360182,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2636281917}) 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=10,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=3140514009,mgr=4091103352,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2378763893}) 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=2337978771,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=4042291128,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=642303947,osd_snap=421676469,osdmap=2075968790}) 2024-08-19T11:13:12.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=3261514932,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=158608921,mon_config_key=1063231117,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=642303947,osd_snap=421676469,osdmap=3711560420}) 2024-08-19T11:13:12.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=97} crc {osdmap=3661885139}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=92} crc {osdmap=3163976723}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=97} crc {osdmap=2707212949}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=98} crc {osdmap=1527504588}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=98} crc {osdmap=3316628013}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=481530212}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=96} crc {osdmap=4201344090}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=97} crc {osdmap=3909277863}) 2024-08-19T11:13:12.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:13:12.315+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=98} crc {osdmap=1045678804}) 2024-08-19T11:13:13.344 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:13:13.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:13.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.460+0000 7f1c3bd7f640 10 monclient: get_monmap_and_config 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.460+0000 7f1c3bd7f640 10 monclient: build_initial_monmap 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.460+0000 7f1c3bd7f640 10 monclient: monmap: 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:13.462265+0000 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:13.462265+0000 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:13.463 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 Processor -- start 2024-08-19T11:13:13.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 -- start start 2024-08-19T11:13:13.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient: init 2024-08-19T11:13:13.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient: _add_conns ranks=[3,10,4,1,2,0,6,5,9,8,7] 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c340a3740 0x7f1c340a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): picked mon.noname-g con 0x7f1c340a3740 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1c340a0840 0x7f1c340a4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): picked mon.noname-f con 0x7f1c340a0840 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 0x7f1c341369c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): picked mon.noname-c con 0x7f1c34136570 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3409f930 con 0x7f1c340a0840 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3409e2e0 con 0x7f1c340a3740 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1c340a45a0 con 0x7f1c34136570 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.461+0000 7f1c3bd7f640 10 monclient(hunting): authenticate will time out at 851.503955s 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 0x7f1c341369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 0x7f1c341369c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47904/0 (socket says 172.21.15.71:47904) 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 -- 172.21.15.71:0/3063935370 learned_addr learned my addr 172.21.15.71:0/3063935370 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): get_auth_request con 0x7f1c34136570 auth_method 0 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c39b1b640 1 --2- 172.21.15.71:0/3063935370 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c340a3740 0x7f1c340a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c39b1b640 10 monclient(hunting): get_auth_request con 0x7f1c340a3740 auth_method 0 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c39b1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c39b1b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c39b1b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3931a640 1 --2- 172.21.15.71:0/3063935370 >> v2:172.21.15.135:3300/0 conn(0x7f1c340a0840 0x7f1c340a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_done global_id 5089 payload 274 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 -- 172.21.15.71:0/3063935370 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c340a3740 msgr2=0x7f1c340a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 --2- 172.21.15.71:0/3063935370 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c340a3740 0x7f1c340a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 -- 172.21.15.71:0/3063935370 >> v2:172.21.15.135:3300/0 conn(0x7f1c340a0840 msgr2=0x7f1c340a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 --2- 172.21.15.71:0/3063935370 >> v2:172.21.15.135:3300/0 conn(0x7f1c340a0840 0x7f1c340a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 monclient: found mon.noname-c 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3a31c640 1 -- 172.21.15.71:0/3063935370 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3409fe60 con 0x7f1c34136570 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3931a640 10 monclient: get_auth_request con 0x7f1c340a0840 auth_method 0 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.462+0000 7f1c3931a640 1 --2- 172.21.15.71:0/3063935370 >> v2:172.21.15.135:3300/0 conn(0x7f1c340a0840 0x7f1c340a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3a31c640 1 -- 172.21.15.71:0/3063935370 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 msgr2=0x7f1c341369c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3a31c640 1 --2- 172.21.15.71:0/3063935370 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 0x7f1c341369c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009e50 tx=0x7f1c2c02a560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=aed516749418dbb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 1 -- 172.21.15.71:0/3063935370 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c036070 con 0x7f1c34136570 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: dump: 2024-08-19T11:13:13.472 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.473 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: _finish_auth 0 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: _check_auth_tickets 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 1 -- 172.21.15.71:0/3063935370 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c007a70 con 0x7f1c34136570 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 5 monclient: authenticate success, global_id 5089 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 1 -- 172.21.15.71:0/3063935370 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c007ca0 con 0x7f1c34136570 2024-08-19T11:13:13.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 4 set_mon_vals no callback set 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c38b19640 10 monclient: dump: 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.475 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 10 monclient: shutdown 2024-08-19T11:13:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/3063935370 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 msgr2=0x7f1c341369c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/3063935370 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 0x7f1c341369c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009e50 tx=0x7f1c2c02a560 comp rx=0 tx=0).stop 2024-08-19T11:13:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/3063935370 shutdown_connections 2024-08-19T11:13:13.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/3063935370 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c34136570 0x7f1c341369c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/3063935370 >> v2:172.21.15.135:3300/0 conn(0x7f1c340a0840 0x7f1c340a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/3063935370 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1c340a3740 0x7f1c340a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.465+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/3063935370 >> 172.21.15.71:0/3063935370 conn(0x7f1c3406d080 msgr2=0x7f1c340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.466+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/3063935370 shutdown_connections 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.466+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/3063935370 wait complete. 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.466+0000 7f1c3bd7f640 10 monclient: build_initial_monmap 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.466+0000 7f1c3bd7f640 10 monclient: monmap: 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:13.478 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.466+0000 7f1c3bd7f640 1 Processor -- start 2024-08-19T11:13:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 -- start start 2024-08-19T11:13:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient: init 2024-08-19T11:13:13.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:13.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient: _add_conns ranks=[8,1,4,6,5,3,2,0,7] 2024-08-19T11:13:13.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 0x7f1c34134b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): picked mon.noname-e con 0x7f1c340a3740 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c34136570 0x7f1c34135080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): picked mon.noname-f con 0x7f1c34136570 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 0x7f1c3413d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): picked mon.noname-c con 0x7f1c341355c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c34050c10 con 0x7f1c34136570 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1c3406b310 con 0x7f1c341355c0 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f1c3409f5c0 con 0x7f1c340a3740 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3bd7f640 10 monclient(hunting): authenticate will time out at 851.509570s 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 0x7f1c34134b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 0x7f1c3413d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 0x7f1c34134b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45556/0 (socket says 172.21.15.71:45556) 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 1 -- 172.21.15.71:0/2457518213 learned_addr learned my addr 172.21.15.71:0/2457518213 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): get_auth_request con 0x7f1c340a3740 auth_method 0 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): get_auth_request con 0x7f1c341355c0 auth_method 0 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c34136570 0x7f1c34135080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): get_auth_request con 0x7f1c34136570 auth_method 0 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3931a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient(hunting): handle_auth_done global_id 5098 payload 824 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 -- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 msgr2=0x7f1c34134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 0x7f1c34134b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 -- 172.21.15.71:0/2457518213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c34136570 msgr2=0x7f1c34135080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c34136570 0x7f1c34135080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 monclient: found mon.noname-c 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c3a31c640 1 -- 172.21.15.71:0/2457518213 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c340a7600 con 0x7f1c341355c0 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.467+0000 7f1c39b1b640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 0x7f1c34134b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3a31c640 1 -- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 msgr2=0x7f1c3413d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3a31c640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 0x7f1c3413d830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c3409e460 tx=0x7f1c2c004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c036050 con 0x7f1c341355c0 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: dump: 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 5 monclient: authenticate success, global_id 5098 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c042070 con 0x7f1c341355c0 2024-08-19T11:13:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 10 monclient: _renew_subs 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3413bd80 con 0x7f1c341355c0 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c2c003db0 con 0x7f1c341355c0 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2a7fc640 10 monclient: dump: 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c2bfff640 4 set_mon_vals no callback set 2024-08-19T11:13:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 10 monclient: _renew_subs 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.470+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3413f150 con 0x7f1c341355c0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c3bd7f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c3bd7f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1c2c004040 con 0x7f1c341355c0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c3bd7f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c34136980 con 0x7f1c341355c0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c2a7fc640 1 --2- 172.21.15.71:0/2457518213 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c1803eab0 0x7f1c18040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(85..85 src has 1..85) ==== 3898+0+0 (secure 0 0 0) 0x7f1c2c072a60 con 0x7f1c341355c0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c39b1b640 1 --2- 172.21.15.71:0/2457518213 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c1803eab0 0x7f1c18040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.471+0000 7f1c39b1b640 10 monclient: get_auth_request con 0x7f1c1803eab0 auth_method 0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.474+0000 7f1c39b1b640 1 --2- 172.21.15.71:0/2457518213 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c1803eab0 0x7f1c18040f70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c30006fd0 tx=0x7f1c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.476+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f1c34136980 con 0x7f1c341355c0 2024-08-19T11:13:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.476+0000 7f1c2a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.476+0000 7f1c2a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:13.557 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: starting. 2024-08-19T11:13:13.557 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25048 2024-08-19T11:13:13.557 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: created object 0... 2024-08-19T11:13:13.557 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: created object 25... 2024-08-19T11:13:13.557 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: created object 49... 2024-08-19T11:13:13.558 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: finishing. 2024-08-19T11:13:13.558 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25049]: shutting down. 2024-08-19T11:13:13.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c3bd7f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:13.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c3bd7f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:13.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c3bd7f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:13.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1c340a72e0 con 0x7f1c341355c0 2024-08-19T11:13:13.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c2a7fc640 1 -- 172.21.15.71:0/2457518213 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f1c340a72e0 con 0x7f1c341355c0 2024-08-19T11:13:13.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c2a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:13.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.728+0000 7f1c2a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:13.731 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":62,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:13.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c1803eab0 msgr2=0x7f1c18040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/2457518213 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c1803eab0 0x7f1c18040f70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c30006fd0 tx=0x7f1c30008040 comp rx=0 tx=0).stop 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 10 monclient: shutdown 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 msgr2=0x7f1c3413d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 0x7f1c3413d830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c3409e460 tx=0x7f1c2c004a40 comp rx=0 tx=0).stop 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 shutdown_connections 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/2457518213 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c1803eab0 0x7f1c18040f70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c34136570 0x7f1c34135080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1c341355c0 0x7f1c3413d830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 --2- 172.21.15.71:0/2457518213 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1c340a3740 0x7f1c34134b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 >> 172.21.15.71:0/2457518213 conn(0x7f1c3406d080 msgr2=0x7f1c3413d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 shutdown_connections 2024-08-19T11:13:13.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.730+0000 7f1c3bd7f640 1 -- 172.21.15.71:0/2457518213 wait complete. 2024-08-19T11:13:13.743 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:13:13.743 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:13:13.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:13:13.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:13:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.839+0000 7ff6fce0b640 10 monclient: get_monmap_and_config 2024-08-19T11:13:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.839+0000 7ff6fce0b640 10 monclient: build_initial_monmap 2024-08-19T11:13:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.839+0000 7ff6fce0b640 10 monclient: monmap: 2024-08-19T11:13:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:13.841166+0000 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:13.841166+0000 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:13.843 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 Processor -- start 2024-08-19T11:13:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 -- start start 2024-08-19T11:13:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient: init 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient: _add_conns ranks=[10,8,9,7,1,5,2,4,3,0,6] 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff6f80a6950 0x7ff6f80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): picked mon.noname-f con 0x7ff6f80a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 0x7ff6f80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): picked mon.noname-e con 0x7ff6f80a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff6f8139710 0x7ff6f8139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): picked mon.noname-a con 0x7ff6f8139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f80a5020 con 0x7ff6f8139710 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff6f80a77b0 con 0x7ff6f80a6950 2024-08-19T11:13:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff6f80a7d40 con 0x7ff6f80a57c0 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6fce0b640 10 monclient(hunting): authenticate will time out at 851.882765s 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff6f8139710 0x7ff6f8139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f5d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 0x7ff6f80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff6f8139710 0x7ff6f8139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39086/0 (socket says 172.21.15.71:39086) 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f5d9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 0x7ff6f80a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45572/0 (socket says 172.21.15.71:45572) 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/1982730586 learned_addr learned my addr 172.21.15.71:0/1982730586 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 10 monclient(hunting): get_auth_request con 0x7ff6f8139710 auth_method 0 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f5d9b640 10 monclient(hunting): get_auth_request con 0x7ff6f80a57c0 auth_method 0 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.840+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f659c640 1 --2- 172.21.15.71:0/1982730586 >> v2:172.21.15.135:3300/0 conn(0x7ff6f80a6950 0x7ff6f80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f659c640 10 monclient(hunting): get_auth_request con 0x7ff6f80a6950 auth_method 0 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_done global_id 34173 payload 274 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 msgr2=0x7ff6f80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 1 --2- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 0x7ff6f80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/1982730586 >> v2:172.21.15.135:3300/0 conn(0x7ff6f80a6950 msgr2=0x7ff6f80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 1 --2- 172.21.15.71:0/1982730586 >> v2:172.21.15.135:3300/0 conn(0x7ff6f80a6950 0x7ff6f80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 1 monclient: found mon.noname-a 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/1982730586 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f80a6380 con 0x7ff6f8139710 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.841+0000 7ff6f5d9b640 1 --2- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 0x7ff6f80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.843+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8139710 msgr2=0x7ff6f8139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.843+0000 7ff6f6d9d640 1 --2- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8139710 0x7ff6f8139b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a2e70 tx=0x7ff6f002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c923882153082c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 1 -- 172.21.15.71:0/1982730586 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6f0036070 con 0x7ff6f8139710 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: dump: 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: _finish_auth 0 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: _check_auth_tickets 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 1 -- 172.21.15.71:0/1982730586 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0007a70 con 0x7ff6f8139710 2024-08-19T11:13:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 5 monclient: authenticate success, global_id 34173 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 1 -- 172.21.15.71:0/1982730586 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6f0007c60 con 0x7ff6f8139710 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 4 set_mon_vals no callback set 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6f559a640 10 monclient: dump: 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 10 monclient: shutdown 2024-08-19T11:13:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 -- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8139710 msgr2=0x7ff6f8139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8139710 0x7ff6f8139b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a2e70 tx=0x7ff6f002a5b0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 -- 172.21.15.71:0/1982730586 shutdown_connections 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8139710 0x7ff6f8139b60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/1982730586 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6f80a57c0 0x7ff6f80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/1982730586 >> v2:172.21.15.135:3300/0 conn(0x7ff6f80a6950 0x7ff6f80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 -- 172.21.15.71:0/1982730586 >> 172.21.15.71:0/1982730586 conn(0x7ff6f80abf50 msgr2=0x7ff6f80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 -- 172.21.15.71:0/1982730586 shutdown_connections 2024-08-19T11:13:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.844+0000 7ff6fce0b640 1 -- 172.21.15.71:0/1982730586 wait complete. 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.845+0000 7ff6fce0b640 10 monclient: build_initial_monmap 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.845+0000 7ff6fce0b640 10 monclient: monmap: 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.845+0000 7ff6fce0b640 1 Processor -- start 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.845+0000 7ff6fce0b640 1 -- start start 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.845+0000 7ff6fce0b640 10 monclient: init 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient: _add_conns ranks=[6,1,3,0,4,5,8,7,2] 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 0x7ff6f8138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): picked mon.noname-d con 0x7ff6f80a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f80a6950 0x7ff6f8138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): picked mon.noname-f con 0x7ff6f80a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f8139710 0x7ff6f81227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): picked mon.noname-g con 0x7ff6f8139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f80a84c0 con 0x7ff6f80a6950 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f80a3650 con 0x7ff6f8139710 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff6f80a8700 con 0x7ff6f80a57c0 2024-08-19T11:13:13.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6fce0b640 10 monclient(hunting): authenticate will time out at 851.888240s 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 0x7ff6f8138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 0x7ff6f8138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50846/0 (socket says 172.21.15.71:50846) 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 -- 172.21.15.71:0/987905059 learned_addr learned my addr 172.21.15.71:0/987905059 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): get_auth_request con 0x7ff6f80a57c0 auth_method 0 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f80a6950 0x7ff6f8138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f8139710 0x7ff6f81227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): get_auth_request con 0x7ff6f80a6950 auth_method 0 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): get_auth_request con 0x7ff6f8139710 auth_method 0 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient(hunting): handle_auth_done global_id 24558 payload 824 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f8139710 msgr2=0x7ff6f81227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f8139710 0x7ff6f81227d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f80a6950 msgr2=0x7ff6f8138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f80a6950 0x7ff6f8138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 monclient: found mon.noname-d 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.846+0000 7ff6f659c640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f8126310 con 0x7ff6f80a57c0 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.848+0000 7ff6f659c640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 msgr2=0x7ff6f8138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.848+0000 7ff6f659c640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 0x7ff6f8138930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800d830 tx=0x7ff6e800dcf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.848+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e800bce0 con 0x7ff6f80a57c0 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: dump: 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.867 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 5 monclient: authenticate success, global_id 24558 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e8019070 con 0x7ff6f80a57c0 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6e80148a0 con 0x7ff6f80a57c0 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6f4d99640 4 set_mon_vals no callback set 2024-08-19T11:13:13.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6e6ffd640 10 monclient: dump: 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.869 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 10 monclient: _renew_subs 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f813a1c0 con 0x7ff6f80a57c0 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 10 monclient: _renew_subs 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f8123fb0 con 0x7ff6f80a57c0 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 0x7ff6f802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8076c60 con 0x7ff6f8125ee0 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6f5d9b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 0x7ff6f802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6f5d9b640 10 monclient: get_auth_request con 0x7ff6f8125ee0 auth_method 0 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6f5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.849+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff6e8014430 con 0x7ff6f80a57c0 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_done global_id 34182 payload 824 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f5d9b640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6f8125cb0 con 0x7ff6f8125ee0 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6e6ffd640 1 --2- 172.21.15.71:0/987905059 >> v2:172.21.15.135:6800/726754104 conn(0x7ff6d803ea80 0x7ff6d8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(85..85 src has 1..85) ==== 3898+0+0 (secure 0 0 0) 0x7ff6e800f040 con 0x7ff6f80a57c0 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f6d9d640 1 --2- 172.21.15.71:0/987905059 >> v2:172.21.15.135:6800/726754104 conn(0x7ff6d803ea80 0x7ff6d8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.850+0000 7ff6f6d9d640 10 monclient: get_auth_request con 0x7ff6d803ea80 auth_method 0 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6f5d9b640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 msgr2=0x7ff6f802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6f5d9b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 0x7ff6f802d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a1a10 tx=0x7ff6ec011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6ec019070 con 0x7ff6f8125ee0 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 10 monclient: dump: 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.872 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff6ec00f890 con 0x7ff6f8125ee0 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 msgr2=0x7ff6f802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 0x7ff6f802d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a1a10 tx=0x7ff6ec011d40 comp rx=0 tx=0).stop 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 msgr2=0x7ff6f802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.852+0000 7ff6e6ffd640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f8125ee0 0x7ff6f802d1c0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a1a10 tx=0x7ff6ec011d40 comp rx=0 tx=0).stop 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.853+0000 7ff6f6d9d640 1 --2- 172.21.15.71:0/987905059 >> v2:172.21.15.135:6800/726754104 conn(0x7ff6d803ea80 0x7ff6d8040f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806c930 tx=0x7ff6f0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.858+0000 7ff6fce0b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.858+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 0x7ff6f802db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.858+0000 7ff6fce0b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.858+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8125ad0 con 0x7ff6f802d700 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 0x7ff6f802db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient: get_auth_request con 0x7ff6f802d700 auth_method 0 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:13.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 10 monclient(hunting): handle_auth_done global_id 34191 payload 824 2024-08-19T11:13:13.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.859+0000 7ff6f5d9b640 1 -- 172.21.15.71:0/987905059 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff6f80a6d30 con 0x7ff6f802d700 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6f5d9b640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 msgr2=0x7ff6f802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6f5d9b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 0x7ff6f802db10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec01b000 tx=0x7ff6ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff6ec019040 con 0x7ff6f802d700 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 10 monclient: dump: 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:13.876 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:13.877 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7ff6ec01e450 con 0x7ff6f802d700 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 msgr2=0x7ff6f802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 0x7ff6f802db10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec01b000 tx=0x7ff6ec0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 msgr2=0x7ff6f802db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.861+0000 7ff6e6ffd640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f802d700 0x7ff6f802db10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 29378, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:13.888 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.889 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.890 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:13.891 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:13.892 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:13.893 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.895 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.896 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.897 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.899 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:13.900 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:13.901 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 >> v2:172.21.15.135:6800/726754104 conn(0x7ff6d803ea80 msgr2=0x7ff6d8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/987905059 >> v2:172.21.15.135:6800/726754104 conn(0x7ff6d803ea80 0x7ff6d8040f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806c930 tx=0x7ff6f0009000 comp rx=0 tx=0).stop 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 10 monclient: shutdown 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 msgr2=0x7ff6f8138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 --2- 172.21.15.71:0/987905059 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff6f80a57c0 0x7ff6f8138930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800d830 tx=0x7ff6e800dcf0 comp rx=0 tx=0).stop 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/987905059 reap_dead start 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6f6d9d640 1 -- 172.21.15.71:0/987905059 reap_dead start 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 shutdown_connections 2024-08-19T11:13:13.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 >> 172.21.15.71:0/987905059 conn(0x7ff6f80abf50 msgr2=0x7ff6f80aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 shutdown_connections 2024-08-19T11:13:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:13.862+0000 7ff6fce0b640 1 -- 172.21.15.71:0/987905059 wait complete. 2024-08-19T11:13:13.904 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:13.904 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:13:13.904 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:13:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.000+0000 7f21f5ec5640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.000+0000 7f21f5ec5640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.000+0000 7f21f5ec5640 10 monclient: monmap: 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.002242+0000 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.002242+0000 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.004 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 Processor -- start 2024-08-19T11:13:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 -- start start 2024-08-19T11:13:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient: init 2024-08-19T11:13:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient: _add_conns ranks=[10,9,6,2,4,3,7,0,5,1,8] 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f21f00a6950 0x7f21f00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): picked mon.noname-f con 0x7f21f00a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 0x7f21f00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): picked mon.noname-a con 0x7f21f00a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 0x7f21f0139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): picked mon.noname-d con 0x7f21f0139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f21f00a5020 con 0x7f21f00a57c0 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f21f00a77b0 con 0x7f21f00a6950 2024-08-19T11:13:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f21f00a7d40 con 0x7f21f0139710 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.001+0000 7f21f5ec5640 10 monclient(hunting): authenticate will time out at 852.043921s 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 0x7f21f00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 0x7f21f0139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 0x7f21f00a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39096/0 (socket says 172.21.15.71:39096) 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 0x7f21f0139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50852/0 (socket says 172.21.15.71:50852) 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 1 -- 172.21.15.71:0/3084045445 learned_addr learned my addr 172.21.15.71:0/3084045445 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): get_auth_request con 0x7f21f00a57c0 auth_method 0 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): get_auth_request con 0x7f21f0139710 auth_method 0 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21ef7fe640 1 --2- 172.21.15.71:0/3084045445 >> v2:172.21.15.135:3300/0 conn(0x7f21f00a6950 0x7f21f00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient(hunting): handle_auth_done global_id 24567 payload 274 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 -- 172.21.15.71:0/3084045445 >> v2:172.21.15.135:3300/0 conn(0x7f21f00a6950 msgr2=0x7f21f00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 --2- 172.21.15.71:0/3084045445 >> v2:172.21.15.135:3300/0 conn(0x7f21f00a6950 0x7f21f00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 -- 172.21.15.71:0/3084045445 >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 msgr2=0x7f21f00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 --2- 172.21.15.71:0/3084045445 >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 0x7f21f00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 monclient: found mon.noname-d 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21effff640 1 -- 172.21.15.71:0/3084045445 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f00a6380 con 0x7f21f0139710 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.002+0000 7f21eeffd640 1 --2- 172.21.15.71:0/3084045445 >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 0x7f21f00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21effff640 1 -- 172.21.15.71:0/3084045445 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 msgr2=0x7f21f0139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21effff640 1 --2- 172.21.15.71:0/3084045445 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 0x7f21f0139b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009d90 tx=0x7f21e802a4e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c9cbb685934f44c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 1 -- 172.21.15.71:0/3084045445 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f21e8007bc0 con 0x7f21f0139710 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:14.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: dump: 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.013 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 1 -- 172.21.15.71:0/3084045445 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e8007d80 con 0x7f21f0139710 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 5 monclient: authenticate success, global_id 24567 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 4 set_mon_vals no callback set 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 1 -- 172.21.15.71:0/3084045445 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f21e8031870 con 0x7f21f0139710 2024-08-19T11:13:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21ee7fc640 10 monclient: dump: 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.015 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 10 monclient: shutdown 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 -- 172.21.15.71:0/3084045445 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 msgr2=0x7f21f0139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/3084045445 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 0x7f21f0139b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009d90 tx=0x7f21e802a4e0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 -- 172.21.15.71:0/3084045445 shutdown_connections 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/3084045445 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f0139710 0x7f21f0139b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/3084045445 >> v2:172.21.15.71:3300/0 conn(0x7f21f00a57c0 0x7f21f00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/3084045445 >> v2:172.21.15.135:3300/0 conn(0x7f21f00a6950 0x7f21f00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 -- 172.21.15.71:0/3084045445 >> 172.21.15.71:0/3084045445 conn(0x7f21f00abf50 msgr2=0x7f21f00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 -- 172.21.15.71:0/3084045445 shutdown_connections 2024-08-19T11:13:14.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.005+0000 7f21f5ec5640 1 -- 172.21.15.71:0/3084045445 wait complete. 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.006+0000 7f21f5ec5640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.006+0000 7f21f5ec5640 10 monclient: monmap: 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.006+0000 7f21f5ec5640 1 Processor -- start 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.006+0000 7f21f5ec5640 1 -- start start 2024-08-19T11:13:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.006+0000 7f21f5ec5640 10 monclient: init 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient: _add_conns ranks=[6,4,3,5,7,2,1,0,8] 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 0x7f21f01388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): picked mon.noname-d con 0x7f21f00a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f21f00a6950 0x7f21f0138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): picked mon.noname-c con 0x7f21f00a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f0139710 0x7f21f01225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): picked mon.noname-g con 0x7f21f0139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f21f00a84c0 con 0x7f21f0139710 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f21f00a3650 con 0x7f21f00a6950 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f21f00a8700 con 0x7f21f00a57c0 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21f5ec5640 10 monclient(hunting): authenticate will time out at 852.049468s 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 0x7f21f01388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f21f00a6950 0x7f21f0138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 0x7f21f01388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50860/0 (socket says 172.21.15.71:50860) 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 -- 172.21.15.71:0/4008350518 learned_addr learned my addr 172.21.15.71:0/4008350518 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): get_auth_request con 0x7f21f00a57c0 auth_method 0 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): get_auth_request con 0x7f21f00a6950 auth_method 0 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21effff640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f0139710 0x7f21f01225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21effff640 10 monclient(hunting): get_auth_request con 0x7f21f0139710 auth_method 0 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21effff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21effff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient(hunting): handle_auth_done global_id 24576 payload 824 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f21f00a6950 msgr2=0x7f21f0138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f21f00a6950 0x7f21f0138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f0139710 msgr2=0x7f21f01225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f21f0139710 0x7f21f01225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 monclient: found mon.noname-d 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21ef7fe640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f013a2f0 con 0x7f21f00a57c0 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.007+0000 7f21eeffd640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f21f00a6950 0x7f21f0138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21ef7fe640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 msgr2=0x7f21f01388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21ef7fe640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 0x7f21f01388d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c820 tx=0x7f21e000cce0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f21e0015070 con 0x7f21f00a57c0 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: dump: 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.029 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 5 monclient: authenticate success, global_id 24576 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e000ce10 con 0x7f21f00a57c0 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 10 monclient: _renew_subs 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f0123f30 con 0x7f21f00a57c0 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f21e0011860 con 0x7f21f00a57c0 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21d7fff640 10 monclient: dump: 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.031 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21edffb640 4 set_mon_vals no callback set 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 10 monclient: _renew_subs 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.010+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f01259f0 con 0x7f21f00a57c0 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21f5ec5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 0x7f21f002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f21f006a590 con 0x7f21f01ce3c0 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f21e00113f0 con 0x7f21f00a57c0 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 0x7f21f002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient: get_auth_request con 0x7f21f01ce3c0 auth_method 0 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21d7fff640 1 --2- 172.21.15.71:0/4008350518 >> v2:172.21.15.135:6800/726754104 conn(0x7f21dc03ea80 0x7f21dc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 10 monclient(hunting): handle_auth_done global_id 5321 payload 824 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(85..85 src has 1..85) ==== 3898+0+0 (secure 0 0 0) 0x7f21e00516b0 con 0x7f21f00a57c0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21eeffd640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21f00a1eb0 con 0x7f21f01ce3c0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21effff640 1 --2- 172.21.15.71:0/4008350518 >> v2:172.21.15.135:6800/726754104 conn(0x7f21dc03ea80 0x7f21dc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.011+0000 7f21effff640 10 monclient: get_auth_request con 0x7f21dc03ea80 auth_method 0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.013+0000 7f21eeffd640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 msgr2=0x7f21f002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.013+0000 7f21eeffd640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 0x7f21f002d1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21f0123be0 tx=0x7f21e400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.013+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f21e4014ac0 con 0x7f21f01ce3c0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.013+0000 7f21d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.013+0000 7f21d7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.013+0000 7f21d7fff640 10 monclient: dump: 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.035 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f21e4014650 con 0x7f21f01ce3c0 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 msgr2=0x7f21f002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 0x7f21f002d1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21f0123be0 tx=0x7f21e400f610 comp rx=0 tx=0).stop 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 msgr2=0x7f21f002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21d7fff640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f01ce3c0 0x7f21f002d1c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.014+0000 7f21effff640 1 --2- 172.21.15.71:0/4008350518 >> v2:172.21.15.135:6800/726754104 conn(0x7f21dc03ea80 0x7f21dc040f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009d90 tx=0x7f21e802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21f5ec5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 0x7f21f002dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21f5ec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f21f01cf080 con 0x7f21f002d700 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 0x7f21f002dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient: get_auth_request con 0x7f21f002d700 auth_method 0 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 10 monclient(hunting): handle_auth_done global_id 5330 payload 824 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.020+0000 7f21eeffd640 1 -- 172.21.15.71:0/4008350518 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f21f0125e60 con 0x7f21f002d700 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.022+0000 7f21eeffd640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 msgr2=0x7f21f002dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.022+0000 7f21eeffd640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 0x7f21f002dae0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009630 tx=0x7f21e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.022+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f21e4000e60 con 0x7f21f002d700 2024-08-19T11:13:14.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.022+0000 7f21d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.022+0000 7f21d7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.022+0000 7f21d7fff640 10 monclient: dump: 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.038 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f21e402c410 con 0x7f21f002d700 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 msgr2=0x7f21f002dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 0x7f21f002dae0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009630 tx=0x7f21e40046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 msgr2=0x7f21f002dae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21d7fff640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21f002d700 0x7f21f002dae0 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009630 tx=0x7f21e40046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 190902, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:14.062 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 >> v2:172.21.15.135:6800/726754104 conn(0x7f21dc03ea80 msgr2=0x7f21dc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/4008350518 >> v2:172.21.15.135:6800/726754104 conn(0x7f21dc03ea80 0x7f21dc040f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009d90 tx=0x7f21e802f000 comp rx=0 tx=0).stop 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 10 monclient: shutdown 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 msgr2=0x7f21f01388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 --2- 172.21.15.71:0/4008350518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21f00a57c0 0x7f21f01388d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c820 tx=0x7f21e000cce0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21effff640 1 -- 172.21.15.71:0/4008350518 reap_dead start 2024-08-19T11:13:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21effff640 1 -- 172.21.15.71:0/4008350518 reap_dead start 2024-08-19T11:13:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 shutdown_connections 2024-08-19T11:13:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 >> 172.21.15.71:0/4008350518 conn(0x7f21f00abf50 msgr2=0x7f21f00aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 shutdown_connections 2024-08-19T11:13:14.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.023+0000 7f21f5ec5640 1 -- 172.21.15.71:0/4008350518 wait complete. 2024-08-19T11:13:14.064 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:14.064 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:13:14.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:13:14.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.160+0000 7f928627e640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.160+0000 7f928627e640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.160+0000 7f928627e640 10 monclient: monmap: 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.162299+0000 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.162299+0000 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.163 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.164 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 Processor -- start 2024-08-19T11:13:14.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 -- start start 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient: init 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient: _add_conns ranks=[1,10,3,2,5,9,0,8,4,6,7] 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f92800a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92800a57c0 0x7f928013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): picked mon.noname-f con 0x7f92800a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f92801410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): picked mon.noname-g con 0x7f92800a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92800a6380 con 0x7f92800a6950 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f92800a5020 con 0x7f92800a57c0 2024-08-19T11:13:14.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f92800a7d40 con 0x7f92800a7440 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.161+0000 7f928627e640 10 monclient(hunting): authenticate will time out at 852.203965s 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f92801410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92800a57c0 0x7f928013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92800a57c0 0x7f928013eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:47864/0 (socket says 172.21.15.71:47864) 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f92801410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:42220/0 (socket says 172.21.15.71:42220) 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 -- 172.21.15.71:0/71961841 learned_addr learned my addr 172.21.15.71:0/71961841 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): get_auth_request con 0x7f92800a57c0 auth_method 0 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): get_auth_request con 0x7f92800a7440 auth_method 0 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f928481b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient(hunting): handle_auth_done global_id 5023 payload 274 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 -- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 msgr2=0x7f92801410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 --2- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f92801410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 -- 172.21.15.71:0/71961841 >> v1:172.21.15.135:6789/0 conn(0x7f92800a6950 legacy=0x7f92800a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 monclient: found mon.noname-f 2024-08-19T11:13:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:13:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.162+0000 7f927f7fe640 1 -- 172.21.15.71:0/71961841 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92800a3650 con 0x7f92800a57c0 2024-08-19T11:13:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927f7fe640 1 -- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92800a57c0 msgr2=0x7f928013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927f7fe640 1 --2- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92800a57c0 0x7f928013eb60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92740098a0 tx=0x7f927402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75fef4c79331115 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 1 -- 172.21.15.71:0/71961841 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9274037070 con 0x7f92800a57c0 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: dump: 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 1 -- 172.21.15.71:0/71961841 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927402adf0 con 0x7f92800a57c0 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 1 -- 172.21.15.71:0/71961841 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9274030c20 con 0x7f92800a57c0 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f927effd640 10 monclient: dump: 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f928627e640 5 monclient: authenticate success, global_id 5023 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f928627e640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.165+0000 7f928627e640 4 set_mon_vals no callback set 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 10 monclient: shutdown 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 -- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92800a57c0 msgr2=0x7f928013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 --2- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92800a57c0 0x7f928013eb60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92740098a0 tx=0x7f927402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 -- 172.21.15.71:0/71961841 shutdown_connections 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 --2- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f92801410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 --2- 172.21.15.71:0/71961841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92800a57c0 0x7f928013eb60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 -- 172.21.15.71:0/71961841 >> 172.21.15.71:0/71961841 conn(0x7f92800abf50 msgr2=0x7f92800ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 -- 172.21.15.71:0/71961841 shutdown_connections 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 1 -- 172.21.15.71:0/71961841 wait complete. 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.166+0000 7f928627e640 10 monclient: monmap: 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 Processor -- start 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 -- start start 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient: init 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient: _add_conns ranks=[6,0,3,8,1,7,5,2,4] 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f92800a57c0 0x7f9280128a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): picked mon.noname-d con 0x7f92800a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 0x7f92801cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): picked mon.noname-a con 0x7f92800a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f9280126500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): picked mon.noname-g con 0x7f92800a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92800a8700 con 0x7f92800a6950 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f92800a84c0 con 0x7f92800a7440 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f92801415f0 con 0x7f92800a57c0 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.167+0000 7f928627e640 10 monclient(hunting): authenticate will time out at 852.209967s 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f92800a57c0 0x7f9280128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f92800a57c0 0x7f9280128a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50872/0 (socket says 172.21.15.71:50872) 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 1 -- 172.21.15.71:0/545686024 learned_addr learned my addr 172.21.15.71:0/545686024 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 0x7f92801cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): get_auth_request con 0x7f92800a57c0 auth_method 0 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): get_auth_request con 0x7f92800a6950 auth_method 0 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f9280126500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): get_auth_request con 0x7f92800a7440 auth_method 0 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f928481b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient(hunting): handle_auth_done global_id 34209 payload 824 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f92800a57c0 msgr2=0x7f9280128a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f92800a57c0 0x7f9280128a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 msgr2=0x7f9280126500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f92800a7440 0x7f9280126500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 monclient: found mon.noname-a 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927f7fe640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9280129fa0 con 0x7f92800a6950 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.168+0000 7f927ffff640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f92800a57c0 0x7f9280128a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927f7fe640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 msgr2=0x7f92801cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927f7fe640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 0x7f92801cebe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92800a2e70 tx=0x7f92740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9274041030 con 0x7f92800a6950 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: dump: 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 5 monclient: authenticate success, global_id 34209 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9274003c50 con 0x7f92800a6950 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9274037040 con 0x7f92800a6950 2024-08-19T11:13:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 10 monclient: _renew_subs 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928012a280 con 0x7f92800a6950 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927e7fc640 4 set_mon_vals no callback set 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f927cff9640 10 monclient: dump: 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.191 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 10 monclient: _renew_subs 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.170+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9280129410 con 0x7f92800a6950 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f928627e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f928627e640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 0x7f9280126a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9280140c30 con 0x7f92801cf120 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9274032440 con 0x7f92800a6950 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 0x7f9280126a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient: get_auth_request con 0x7f92801cf120 auth_method 0 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.171+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.172+0000 7f927cff9640 1 --2- 172.21.15.71:0/545686024 >> v2:172.21.15.135:6800/726754104 conn(0x7f926c03ea80 0x7f926c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.172+0000 7f927ffff640 10 monclient(hunting): handle_auth_done global_id 5116 payload 824 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.172+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 3898+0+0 (secure 0 0 0) 0x7f9274042070 con 0x7f92800a6950 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.172+0000 7f927ffff640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92800a6d30 con 0x7f92801cf120 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.172+0000 7f928481b640 1 --2- 172.21.15.71:0/545686024 >> v2:172.21.15.135:6800/726754104 conn(0x7f926c03ea80 0x7f926c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.172+0000 7f928481b640 10 monclient: get_auth_request con 0x7f926c03ea80 auth_method 0 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927ffff640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 msgr2=0x7f9280126a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927ffff640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 0x7f9280126a40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f927000fb10 tx=0x7f9270004580 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9270018020 con 0x7f92801cf120 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 10 monclient: dump: 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.195 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f928481b640 1 --2- 172.21.15.71:0/545686024 >> v2:172.21.15.135:6800/726754104 conn(0x7f926c03ea80 0x7f926c040f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9278011340 tx=0x7f927800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f927000de50 con 0x7f92801cf120 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 msgr2=0x7f9280126a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 0x7f9280126a40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f927000fb10 tx=0x7f9270004580 comp rx=0 tx=0).stop 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 msgr2=0x7f9280126a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.174+0000 7f927cff9640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f92801cf120 0x7f9280126a40 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f927000fb10 tx=0x7f9270004580 comp rx=0 tx=0).stop 2024-08-19T11:13:14.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f928627e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:14.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f928627e640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 0x7f92801225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f928627e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9280076c60 con 0x7f9280126f80 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f927ffff640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 0x7f92801225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f927ffff640 10 monclient: get_auth_request con 0x7f9280126f80 auth_method 0 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f927ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f927ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.180+0000 7f927ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.181+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.181+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.181+0000 7f927ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.181+0000 7f927ffff640 10 monclient(hunting): handle_auth_done global_id 5125 payload 824 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.181+0000 7f927ffff640 1 -- 172.21.15.71:0/545686024 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9280127360 con 0x7f9280126f80 2024-08-19T11:13:14.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.183+0000 7f927ffff640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 msgr2=0x7f92801225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.183+0000 7f927ffff640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 0x7f92801225a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9270019000 tx=0x7f9270003760 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.183+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9270018040 con 0x7f9280126f80 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.183+0000 7f927cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.183+0000 7f927cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.183+0000 7f927cff9640 10 monclient: dump: 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.200 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f9270007020 con 0x7f9280126f80 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 msgr2=0x7f92801225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 0x7f92801225a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9270019000 tx=0x7f9270003760 comp rx=0 tx=0).stop 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 msgr2=0x7f92801225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f927cff9640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9280126f80 0x7f92801225a0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9270019000 tx=0x7f9270003760 comp rx=0 tx=0).stop 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 191054, 2024-08-19T11:13:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.218 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.222 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.224 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.225 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:14.226 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 >> v2:172.21.15.135:6800/726754104 conn(0x7f926c03ea80 msgr2=0x7f926c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 --2- 172.21.15.71:0/545686024 >> v2:172.21.15.135:6800/726754104 conn(0x7f926c03ea80 0x7f926c040f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9278011340 tx=0x7f927800b040 comp rx=0 tx=0).stop 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 10 monclient: shutdown 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 msgr2=0x7f92801cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 0x7f92801cebe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f92800a2e70 tx=0x7f92740046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928481b640 1 -- 172.21.15.71:0/545686024 reap_dead start 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 shutdown_connections 2024-08-19T11:13:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 --2- 172.21.15.71:0/545686024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92800a6950 0x7f92801cebe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 >> 172.21.15.71:0/545686024 conn(0x7f92800abf50 msgr2=0x7f928009f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 shutdown_connections 2024-08-19T11:13:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.184+0000 7f928627e640 1 -- 172.21.15.71:0/545686024 wait complete. 2024-08-19T11:13:14.228 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:14.228 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:13:14.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.325+0000 7fcd0e0bc640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.325+0000 7fcd0e0bc640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.325+0000 7fcd0e0bc640 10 monclient: monmap: 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.326957+0000 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.326957+0000 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.328 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 Processor -- start 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 -- start start 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient: init 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient: _add_conns ranks=[0,8,4,7,2,9,3,5,6,1,10] 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcd080a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 0x7fcd0813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): picked mon.noname-e con 0x7fcd080a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd080a7440 0x7fcd081410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): picked mon.noname-c con 0x7fcd080a7440 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd080a6380 con 0x7fcd080a6950 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcd080a5020 con 0x7fcd080a7440 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcd080a7d40 con 0x7fcd080a57c0 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd0e0bc640 10 monclient(hunting): authenticate will time out at 852.368613s 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 0x7fcd0813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd080a7440 0x7fcd081410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd077fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcd080a6950 0x7fcd080a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38638/0 (socket says 172.21.15.71:38638) 2024-08-19T11:13:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): get_auth_request con 0x7fcd080a57c0 auth_method 0 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd077fe640 1 -- 172.21.15.71:0/2693410338 learned_addr learned my addr 172.21.15.71:0/2693410338 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): get_auth_request con 0x7fcd080a7440 auth_method 0 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_done global_id 5057 payload 274 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 1 -- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd080a7440 msgr2=0x7fcd081410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 1 --2- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd080a7440 0x7fcd081410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.326+0000 7fcd06ffd640 1 -- 172.21.15.71:0/2693410338 >> v1:172.21.15.71:6789/0 conn(0x7fcd080a6950 legacy=0x7fcd080a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.327+0000 7fcd06ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.327+0000 7fcd06ffd640 1 monclient: found mon.noname-e 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.327+0000 7fcd06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.327+0000 7fcd06ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.327+0000 7fcd06ffd640 1 -- 172.21.15.71:0/2693410338 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd080a3650 con 0x7fcd080a57c0 2024-08-19T11:13:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.327+0000 7fcd07fff640 1 --2- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd080a7440 0x7fcd081410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.329+0000 7fcd06ffd640 1 -- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 msgr2=0x7fcd0813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.329+0000 7fcd06ffd640 1 --2- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 0x7fcd0813eb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009df0 tx=0x7fccfc02a4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=560007ce60024c01 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 1 -- 172.21.15.71:0/2693410338 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccfc007bc0 con 0x7fcd080a57c0 2024-08-19T11:13:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: dump: 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 5 monclient: authenticate success, global_id 5057 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 1 -- 172.21.15.71:0/2693410338 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccfc007d80 con 0x7fcd080a57c0 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 4 set_mon_vals no callback set 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 1 -- 172.21.15.71:0/2693410338 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccfc031870 con 0x7fcd080a57c0 2024-08-19T11:13:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd067fc640 10 monclient: dump: 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 10 monclient: shutdown 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 msgr2=0x7fcd0813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 0x7fcd0813eb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009df0 tx=0x7fccfc02a4b0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/2693410338 shutdown_connections 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd080a7440 0x7fcd081410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/2693410338 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcd080a57c0 0x7fcd0813eb60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/2693410338 >> 172.21.15.71:0/2693410338 conn(0x7fcd080abf50 msgr2=0x7fcd080ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/2693410338 shutdown_connections 2024-08-19T11:13:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.330+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/2693410338 wait complete. 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.331+0000 7fcd0e0bc640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.331+0000 7fcd0e0bc640 10 monclient: monmap: 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.331+0000 7fcd0e0bc640 1 Processor -- start 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.331+0000 7fcd0e0bc640 1 -- start start 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.331+0000 7fcd0e0bc640 10 monclient: init 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient: _add_conns ranks=[6,2,1,5,4,8,7,3,0] 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 0x7fcd081366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): picked mon.noname-d con 0x7fcd080a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd080a6950 0x7fcd08136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): picked mon.noname-b con 0x7fcd080a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd080a7440 0x7fcd08137160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): picked mon.noname-f con 0x7fcd080a7440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd080a8700 con 0x7fcd080a7440 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcd080a84c0 con 0x7fcd080a6950 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd081415f0 con 0x7fcd080a57c0 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd0e0bc640 10 monclient(hunting): authenticate will time out at 852.374232s 2024-08-19T11:13:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 0x7fcd081366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd080a6950 0x7fcd08136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 0x7fcd081366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50882/0 (socket says 172.21.15.71:50882) 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd080a6950 0x7fcd08136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:59404/0 (socket says 172.21.15.71:59404) 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 -- 172.21.15.71:0/3633263432 learned_addr learned my addr 172.21.15.71:0/3633263432 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): get_auth_request con 0x7fcd080a57c0 auth_method 0 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): get_auth_request con 0x7fcd080a6950 auth_method 0 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient(hunting): handle_auth_done global_id 24594 payload 824 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd080a6950 msgr2=0x7fcd08136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcd080a6950 0x7fcd08136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd07fff640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd080a7440 0x7fcd08137160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd080a7440 msgr2=0x7fcd08137160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd080a7440 0x7fcd08137160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 monclient: found mon.noname-d 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.332+0000 7fcd077fe640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0813f710 con 0x7fcd080a57c0 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.334+0000 7fcd077fe640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 msgr2=0x7fcd081366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.334+0000 7fcd077fe640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 0x7fcd081366e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccf800c490 tx=0x7fccf800c950 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.334+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccf8005cf0 con 0x7fcd080a57c0 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.334+0000 7fcceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: dump: 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 5 monclient: authenticate success, global_id 24594 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf80074e0 con 0x7fcd080a57c0 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 10 monclient: _renew_subs 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0813d3b0 con 0x7fcd080a57c0 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccf8007690 con 0x7fcd080a57c0 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 10 monclient: dump: 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd05ffb640 4 set_mon_vals no callback set 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 10 monclient: _renew_subs 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0813ee70 con 0x7fcd080a57c0 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 0x7fcd0813b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd08076c60 con 0x7fcd0813df10 2024-08-19T11:13:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.335+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fccf8007070 con 0x7fcd080a57c0 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 0x7fcd0813b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient: get_auth_request con 0x7fcd0813df10 auth_method 0 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcceffff640 1 --2- 172.21.15.71:0/3633263432 >> v2:172.21.15.135:6800/726754104 conn(0x7fccf403ea80 0x7fccf4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_done global_id 24603 payload 824 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd06ffd640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd08140e60 con 0x7fcd0813df10 2024-08-19T11:13:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(85..85 src has 1..85) ==== 3898+0+0 (secure 0 0 0) 0x7fccf80518c0 con 0x7fcd080a57c0 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd07fff640 1 --2- 172.21.15.71:0/3633263432 >> v2:172.21.15.135:6800/726754104 conn(0x7fccf403ea80 0x7fccf4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.336+0000 7fcd07fff640 10 monclient: get_auth_request con 0x7fccf403ea80 auth_method 0 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcd06ffd640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 msgr2=0x7fcd0813b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcd06ffd640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 0x7fcd0813b9b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd080a2e70 tx=0x7fccfc004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccfc0044b0 con 0x7fcd0813df10 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 10 monclient: dump: 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fccfc004040 con 0x7fcd0813df10 2024-08-19T11:13:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 msgr2=0x7fcd0813b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 0x7fcd0813b9b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd080a2e70 tx=0x7fccfc004a40 comp rx=0 tx=0).stop 2024-08-19T11:13:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 msgr2=0x7fcd0813b9b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcd07fff640 1 --2- 172.21.15.71:0/3633263432 >> v2:172.21.15.135:6800/726754104 conn(0x7fccf403ea80 0x7fccf4040f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd0813d110 tx=0x7fcd00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.338+0000 7fcceffff640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813df10 0x7fcd0813b9b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.344+0000 7fcd0e0bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 0x7fcd0813bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd0e0bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd080a6d30 con 0x7fcd0813fe80 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 0x7fcd0813bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient: get_auth_request con 0x7fcd0813fe80 auth_method 0 2024-08-19T11:13:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 10 monclient(hunting): handle_auth_done global_id 24612 payload 824 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.345+0000 7fcd06ffd640 1 -- 172.21.15.71:0/3633263432 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd0806ca70 con 0x7fcd0813fe80 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcd06ffd640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 msgr2=0x7fcd0813bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcd06ffd640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 0x7fcd0813bef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fccfc042000 tx=0x7fccfc030000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccfc004850 con 0x7fcd0813fe80 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 10 monclient: dump: 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fccfc04bbd0 con 0x7fcd0813fe80 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 msgr2=0x7fcd0813bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 0x7fcd0813bef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fccfc042000 tx=0x7fccfc030000 comp rx=0 tx=0).stop 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 msgr2=0x7fcd0813bef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.347+0000 7fcceffff640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd0813fe80 0x7fcd0813bef0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fccfc042000 tx=0x7fccfc030000 comp rx=0 tx=0).stop 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 101962, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:14.379 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.382 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.384 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:14.387 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 >> v2:172.21.15.135:6800/726754104 conn(0x7fccf403ea80 msgr2=0x7fccf4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/3633263432 >> v2:172.21.15.135:6800/726754104 conn(0x7fccf403ea80 0x7fccf4040f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcd0813d110 tx=0x7fcd00008040 comp rx=0 tx=0).stop 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 10 monclient: shutdown 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 msgr2=0x7fcd081366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 --2- 172.21.15.71:0/3633263432 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd080a57c0 0x7fcd081366e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccf800c490 tx=0x7fccf800c950 comp rx=0 tx=0).stop 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd07fff640 1 -- 172.21.15.71:0/3633263432 reap_dead start 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd07fff640 1 -- 172.21.15.71:0/3633263432 reap_dead start 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 shutdown_connections 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 >> 172.21.15.71:0/3633263432 conn(0x7fcd080abf50 msgr2=0x7fcd0809d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 shutdown_connections 2024-08-19T11:13:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.348+0000 7fcd0e0bc640 1 -- 172.21.15.71:0/3633263432 wait complete. 2024-08-19T11:13:14.390 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:14.390 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:13:14.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:13:14.483 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25050]: starting. 2024-08-19T11:13:14.483 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25050]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25048 2024-08-19T11:13:14.483 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25050]: shutting down. 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.493+0000 7f271431b640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.493+0000 7f271431b640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.493+0000 7f271431b640 10 monclient: monmap: 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.494758+0000 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.494758+0000 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.494+0000 7f271431b640 1 Processor -- start 2024-08-19T11:13:14.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.494+0000 7f271431b640 1 -- start start 2024-08-19T11:13:14.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.494+0000 7f271431b640 10 monclient: init 2024-08-19T11:13:14.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient: _add_conns ranks=[2,4,1,0,6,5,10,7,8,9,3] 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f270c0a6950 0x7f270c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): picked mon.noname-b con 0x7f270c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c0a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): picked mon.noname-c con 0x7f270c0a6d30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f270c13dee0 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f270c0a8700 con 0x7f270c13dee0 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f270c0a7d40 con 0x7f270c0a6950 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f270c0a84c0 con 0x7f270c0a6d30 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.495+0000 7f271431b640 10 monclient(hunting): authenticate will time out at 852.537269s 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c0a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c0a7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47966/0 (socket says 172.21.15.71:47966) 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 -- 172.21.15.71:0/3335090932 learned_addr learned my addr 172.21.15.71:0/3335090932 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): get_auth_request con 0x7f270c0a6d30 auth_method 0 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 1 --2- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f270c0a6950 0x7f270c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): get_auth_request con 0x7f270c0a6950 auth_method 0 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27120b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient(hunting): handle_auth_done global_id 5152 payload 274 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 -- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f270c0a6950 msgr2=0x7f270c0a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 --2- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f270c0a6950 0x7f270c0a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 -- 172.21.15.71:0/3335090932 >> v1:172.21.15.135:6789/0 conn(0x7f270c13dee0 legacy=0x7f270c13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 monclient: found mon.noname-c 2024-08-19T11:13:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.496+0000 7f27118b6640 1 -- 172.21.15.71:0/3335090932 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c0a4210 con 0x7f270c0a6d30 2024-08-19T11:13:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.499+0000 7f27118b6640 1 -- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 msgr2=0x7f270c0a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.499+0000 7f27118b6640 1 --2- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c0a7110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098a0 tx=0x7f26fc02a080 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c14b91430b309d21 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 1 -- 172.21.15.71:0/3335090932 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26fc037070 con 0x7f270c0a6d30 2024-08-19T11:13:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: dump: 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 1 -- 172.21.15.71:0/3335090932 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26fc02ade0 con 0x7f270c0a6d30 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 1 -- 172.21.15.71:0/3335090932 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26fc030c20 con 0x7f270c0a6d30 2024-08-19T11:13:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f27110b5640 10 monclient: dump: 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f271431b640 5 monclient: authenticate success, global_id 5152 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f271431b640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.502+0000 7f271431b640 4 set_mon_vals no callback set 2024-08-19T11:13:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 10 monclient: shutdown 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 -- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 msgr2=0x7f270c0a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 --2- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c0a7110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098a0 tx=0x7f26fc02a080 comp rx=0 tx=0).stop 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 -- 172.21.15.71:0/3335090932 shutdown_connections 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 --2- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c0a7110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 --2- 172.21.15.71:0/3335090932 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f270c0a6950 0x7f270c0a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 -- 172.21.15.71:0/3335090932 >> 172.21.15.71:0/3335090932 conn(0x7f270c0abf50 msgr2=0x7f270c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 -- 172.21.15.71:0/3335090932 shutdown_connections 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.503+0000 7f271431b640 1 -- 172.21.15.71:0/3335090932 wait complete. 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.504+0000 7f271431b640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.504+0000 7f271431b640 10 monclient: monmap: 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.504+0000 7f271431b640 1 Processor -- start 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.505+0000 7f271431b640 1 -- start start 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.505+0000 7f271431b640 10 monclient: init 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.505+0000 7f271431b640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.505+0000 7f271431b640 10 monclient: _add_conns ranks=[8,4,5,2,1,3,7,0,6] 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 0x7f270c1cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): picked mon.noname-e con 0x7f270c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c13d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): picked mon.noname-c con 0x7f270c0a6d30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f270c13dee0 0x7f270c1d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): picked mon.noname-h con 0x7f270c13dee0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f270c0a3650 con 0x7f270c0a6d30 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f270c0a46f0 con 0x7f270c13dee0 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f270c0a7650 con 0x7f270c0a6950 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.507+0000 7f271431b640 10 monclient(hunting): authenticate will time out at 852.549348s 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 0x7f270c1cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 0x7f270c1cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45590/0 (socket says 172.21.15.71:45590) 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 -- 172.21.15.71:0/335715662 learned_addr learned my addr 172.21.15.71:0/335715662 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): get_auth_request con 0x7f270c0a6950 auth_method 0 2024-08-19T11:13:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c13d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): get_auth_request con 0x7f270c0a6d30 auth_method 0 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient(hunting): handle_auth_done global_id 5084 payload 824 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f270c13dee0 msgr2=0x7f270c1d2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f270c13dee0 0x7f270c1d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 msgr2=0x7f270c13d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c13d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 monclient: found mon.noname-e 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27120b7640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270c12af90 con 0x7f270c0a6950 2024-08-19T11:13:14.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.508+0000 7f27118b6640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f270c0a6d30 0x7f270c13d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.510+0000 7f27120b7640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 msgr2=0x7f270c1cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.510+0000 7f27120b7640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 0x7f270c1cf7f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f270400efc0 tx=0x7f270400c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2704018020 con 0x7f270c0a6950 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: dump: 2024-08-19T11:13:14.521 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.522 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27040148f0 con 0x7f270c0a6950 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 5 monclient: authenticate success, global_id 5084 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 10 monclient: _renew_subs 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270c073180 con 0x7f270c0a6950 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27040133e0 con 0x7f270c0a6950 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f2702ffd640 10 monclient: dump: 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.524 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f27108b4640 4 set_mon_vals no callback set 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 10 monclient: _renew_subs 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.511+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f270c0a3ca0 con 0x7f270c0a6950 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f270401b020 con 0x7f270c0a6950 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f271431b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f271431b640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 0x7f270c1d3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f270c0a0980 con 0x7f270c1d3270 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f2702ffd640 1 --2- 172.21.15.71:0/335715662 >> v2:172.21.15.135:6800/726754104 conn(0x7f26f003ea80 0x7f26f0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f2704052330 con 0x7f270c0a6950 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 0x7f270c1d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient: get_auth_request con 0x7f270c1d3270 auth_method 0 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.512+0000 7f27118b6640 10 monclient(hunting): handle_auth_done global_id 5093 payload 824 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.513+0000 7f27118b6640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f270c1d3b90 con 0x7f270c1d3270 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.513+0000 7f27128b8640 1 --2- 172.21.15.71:0/335715662 >> v2:172.21.15.135:6800/726754104 conn(0x7f26f003ea80 0x7f26f0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.514+0000 7f27128b8640 10 monclient: get_auth_request con 0x7f26f003ea80 auth_method 0 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.515+0000 7f27118b6640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 msgr2=0x7f270c1d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.515+0000 7f27118b6640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 0x7f270c1d3650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f270c0a6610 tx=0x7f26fc0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26fc037040 con 0x7f270c1d3270 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 10 monclient: dump: 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.527 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.528 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f26fc02ade0 con 0x7f270c1d3270 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 msgr2=0x7f270c1d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 0x7f270c1d3650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f270c0a6610 tx=0x7f26fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 msgr2=0x7f270c1d3650 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.516+0000 7f2702ffd640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c1d3270 0x7f270c1d3650 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f270c0a6610 tx=0x7f26fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.517+0000 7f27128b8640 1 --2- 172.21.15.71:0/335715662 >> v2:172.21.15.135:6800/726754104 conn(0x7f26f003ea80 0x7f26f0040f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f270c0a1180 tx=0x7f2708007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.523+0000 7f271431b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:14.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.523+0000 7f271431b640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 0x7f270c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.523+0000 7f271431b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.523+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f270c076c60 con 0x7f270c070bd0 2024-08-19T11:13:14.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 0x7f270c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient: get_auth_request con 0x7f270c070bd0 auth_method 0 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 10 monclient(hunting): handle_auth_done global_id 5102 payload 824 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.524+0000 7f27118b6640 1 -- 172.21.15.71:0/335715662 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f270c06a300 con 0x7f270c070bd0 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.526+0000 7f27118b6640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 msgr2=0x7f270c070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.526+0000 7f27118b6640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 0x7f270c070fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26fc02a0c0 tx=0x7f26fc009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.526+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26fc037040 con 0x7f270c070bd0 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.526+0000 7f2702ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.526+0000 7f2702ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.526+0000 7f2702ffd640 10 monclient: dump: 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.533 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f26fc0456b0 con 0x7f270c070bd0 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 msgr2=0x7f270c070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 0x7f270c070fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26fc02a0c0 tx=0x7f26fc009240 comp rx=0 tx=0).stop 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 msgr2=0x7f270c070fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f2702ffd640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c070bd0 0x7f270c070fe0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26fc02a0c0 tx=0x7f26fc009240 comp rx=0 tx=0).stop 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 191398, 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:14.558 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 >> v2:172.21.15.135:6800/726754104 conn(0x7f26f003ea80 msgr2=0x7f26f0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 --2- 172.21.15.71:0/335715662 >> v2:172.21.15.135:6800/726754104 conn(0x7f26f003ea80 0x7f26f0040f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f270c0a1180 tx=0x7f2708007990 comp rx=0 tx=0).stop 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 10 monclient: shutdown 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 msgr2=0x7f270c1cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 --2- 172.21.15.71:0/335715662 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f270c0a6950 0x7f270c1cf7f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f270400efc0 tx=0x7f270400c490 comp rx=0 tx=0).stop 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f27128b8640 1 -- 172.21.15.71:0/335715662 reap_dead start 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f27128b8640 1 -- 172.21.15.71:0/335715662 reap_dead start 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 shutdown_connections 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 >> 172.21.15.71:0/335715662 conn(0x7f270c0abf50 msgr2=0x7f270c1c6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 shutdown_connections 2024-08-19T11:13:14.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.527+0000 7f271431b640 1 -- 172.21.15.71:0/335715662 wait complete. 2024-08-19T11:13:14.561 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:14.561 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:13:14.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:13:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.658+0000 7f2728248640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.658+0000 7f2728248640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.658+0000 7f2728248640 10 monclient: monmap: 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.660272+0000 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.660272+0000 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 Processor -- start 2024-08-19T11:13:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 -- start start 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient: init 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient: _add_conns ranks=[9,3,1,8,0,7,5,10,2,6,4] 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27200a6950 0x7f27200a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): picked mon.noname-a con 0x7f27200a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27200a57c0 0x7f27200a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): picked mon.noname-g con 0x7f27200a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2720139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27200a6380 con 0x7f2720139710 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f27200a5020 con 0x7f27200a6950 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f27200a77b0 con 0x7f27200a57c0 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.659+0000 7f2728248640 10 monclient(hunting): authenticate will time out at 852.701933s 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27200a6950 0x7f27200a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27200a6950 0x7f27200a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39124/0 (socket says 172.21.15.71:39124) 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 -- 172.21.15.71:0/2390895695 learned_addr learned my addr 172.21.15.71:0/2390895695 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): get_auth_request con 0x7f27200a6950 auth_method 0 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f27257e3640 1 --2- 172.21.15.71:0/2390895695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27200a57c0 0x7f27200a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f27257e3640 10 monclient(hunting): get_auth_request con 0x7f27200a57c0 auth_method 0 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f27257e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f27257e3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f27257e3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient(hunting): handle_auth_done global_id 34236 payload 274 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 -- 172.21.15.71:0/2390895695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27200a57c0 msgr2=0x7f27200a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 --2- 172.21.15.71:0/2390895695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27200a57c0 0x7f27200a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 -- 172.21.15.71:0/2390895695 >> v1:172.21.15.135:6789/0 conn(0x7f2720139710 legacy=0x7f2720139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 monclient: found mon.noname-a 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.660+0000 7f2725fe4640 1 -- 172.21.15.71:0/2390895695 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27200a3650 con 0x7f27200a6950 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2725fe4640 1 -- 172.21.15.71:0/2390895695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27200a6950 msgr2=0x7f27200a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2725fe4640 1 --2- 172.21.15.71:0/2390895695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27200a6950 0x7f27200a6d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f271c009870 tx=0x7f271c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b7e967b19d3778 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 1 -- 172.21.15.71:0/2390895695 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f271c037070 con 0x7f27200a6950 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: dump: 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 5 monclient: authenticate success, global_id 34236 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 1 -- 172.21.15.71:0/2390895695 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c02ae00 con 0x7f27200a6950 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 4 set_mon_vals no callback set 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 1 -- 172.21.15.71:0/2390895695 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f271c030c20 con 0x7f27200a6950 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2724fe2640 10 monclient: dump: 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 10 monclient: shutdown 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 -- 172.21.15.71:0/2390895695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27200a6950 msgr2=0x7f27200a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 --2- 172.21.15.71:0/2390895695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27200a6950 0x7f27200a6d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f271c009870 tx=0x7f271c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 -- 172.21.15.71:0/2390895695 shutdown_connections 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 --2- 172.21.15.71:0/2390895695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27200a57c0 0x7f27200a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 --2- 172.21.15.71:0/2390895695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27200a6950 0x7f27200a6d30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 -- 172.21.15.71:0/2390895695 >> 172.21.15.71:0/2390895695 conn(0x7f27200abf50 msgr2=0x7f27200ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 -- 172.21.15.71:0/2390895695 shutdown_connections 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.663+0000 7f2728248640 1 -- 172.21.15.71:0/2390895695 wait complete. 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.664+0000 7f2728248640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.664+0000 7f2728248640 10 monclient: monmap: 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.664+0000 7f2728248640 1 Processor -- start 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.664+0000 7f2728248640 1 -- start start 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.664+0000 7f2728248640 10 monclient: init 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient: _add_conns ranks=[5,8,4,1,6,2,0,7,3] 2024-08-19T11:13:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27200a57c0 0x7f2720138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): picked mon.noname-h con 0x7f27200a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 0x7f2720138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): picked mon.noname-e con 0x7f27200a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2720139710 0x7f2720122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): picked mon.noname-c con 0x7f2720139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f27200a84c0 con 0x7f2720139710 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f27200a7d40 con 0x7f27200a57c0 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f27200a8700 con 0x7f27200a6950 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2728248640 10 monclient(hunting): authenticate will time out at 852.707296s 2024-08-19T11:13:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 0x7f2720138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2720139710 0x7f2720122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2720139710 0x7f2720122610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47982/0 (socket says 172.21.15.71:47982) 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 0x7f2720138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45618/0 (socket says 172.21.15.71:45618) 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 1 -- 172.21.15.71:0/3577612503 learned_addr learned my addr 172.21.15.71:0/3577612503 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): get_auth_request con 0x7f2720139710 auth_method 0 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): get_auth_request con 0x7f27200a6950 auth_method 0 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2725fe4640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27200a57c0 0x7f2720138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2725fe4640 10 monclient(hunting): get_auth_request con 0x7f27200a57c0 auth_method 0 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2725fe4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2725fe4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2725fe4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient(hunting): handle_auth_done global_id 5111 payload 824 2024-08-19T11:13:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27200a57c0 msgr2=0x7f2720138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27200a57c0 0x7f2720138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2720139710 msgr2=0x7f2720122610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2720139710 0x7f2720122610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 monclient: found mon.noname-e 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27257e3640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2720123f90 con 0x7f27200a6950 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f27267e5640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2720139710 0x7f2720122610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.665+0000 7f2725fe4640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27200a57c0 0x7f2720138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:13:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.667+0000 7f27257e3640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 msgr2=0x7f2720138e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.667+0000 7f27257e3640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 0x7f2720138e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f271000d550 tx=0x7f271000da10 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2710012c70 con 0x7f27200a6950 2024-08-19T11:13:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:14.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: dump: 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.688 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2710019070 con 0x7f27200a6950 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 5 monclient: authenticate success, global_id 5111 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 10 monclient: _renew_subs 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27201262f0 con 0x7f27200a6950 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2710012e50 con 0x7f27200a6950 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f27167fc640 10 monclient: dump: 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.690 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2717fff640 4 set_mon_vals no callback set 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 10 monclient: _renew_subs 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2720124af0 con 0x7f27200a6950 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 0x7f272002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.668+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f272006a590 con 0x7f27201ce4b0 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2710012800 con 0x7f27200a6950 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 0x7f272002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient: get_auth_request con 0x7f27201ce4b0 auth_method 0 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f27167fc640 1 --2- 172.21.15.71:0/3577612503 >> v2:172.21.15.135:6800/726754104 conn(0x7f270403ec50 0x7f2704041110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f271000f040 con 0x7f27200a6950 2024-08-19T11:13:14.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f27267e5640 1 --2- 172.21.15.71:0/3577612503 >> v2:172.21.15.135:6800/726754104 conn(0x7f270403ec50 0x7f2704041110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f27267e5640 10 monclient: get_auth_request con 0x7f270403ec50 auth_method 0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 10 monclient(hunting): handle_auth_done global_id 5050 payload 824 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.669+0000 7f2725fe4640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f272013a310 con 0x7f27201ce4b0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.671+0000 7f2725fe4640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 msgr2=0x7f272002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.671+0000 7f2725fe4640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 0x7f272002d1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.671+0000 7f27267e5640 1 --2- 172.21.15.71:0/3577612503 >> v2:172.21.15.135:6800/726754104 conn(0x7f270403ec50 0x7f2704041110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2718007fd0 tx=0x7f2718003de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f271c041070 con 0x7f27201ce4b0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 10 monclient: dump: 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.693 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.694 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f271c003a30 con 0x7f27201ce4b0 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 msgr2=0x7f272002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 0x7f272002d1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 msgr2=0x7f272002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.672+0000 7f27167fc640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27201ce4b0 0x7f272002d1c0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.678+0000 7f2728248640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.678+0000 7f2728248640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 0x7f272002db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.678+0000 7f2728248640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.678+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2720076c60 con 0x7f272002d700 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 0x7f272002db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient: get_auth_request con 0x7f272002d700 auth_method 0 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 10 monclient(hunting): handle_auth_done global_id 5059 payload 824 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.679+0000 7f2725fe4640 1 -- 172.21.15.71:0/3577612503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27200a20c0 con 0x7f272002d700 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.681+0000 7f2725fe4640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 msgr2=0x7f272002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.681+0000 7f2725fe4640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 0x7f272002db10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f271c000c00 tx=0x7f271c009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.681+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f271c037040 con 0x7f272002d700 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.681+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.681+0000 7f27167fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.681+0000 7f27167fc640 10 monclient: dump: 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.697 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f271c032440 con 0x7f272002d700 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 msgr2=0x7f272002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 0x7f272002db10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f271c000c00 tx=0x7f271c009240 comp rx=0 tx=0).stop 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 msgr2=0x7f272002db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27167fc640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f272002d700 0x7f272002db10 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f271c000c00 tx=0x7f271c009240 comp rx=0 tx=0).stop 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 191523, 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:14.723 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 >> v2:172.21.15.135:6800/726754104 conn(0x7f270403ec50 msgr2=0x7f2704041110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 --2- 172.21.15.71:0/3577612503 >> v2:172.21.15.135:6800/726754104 conn(0x7f270403ec50 0x7f2704041110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2718007fd0 tx=0x7f2718003de0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 10 monclient: shutdown 2024-08-19T11:13:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 msgr2=0x7f2720138e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 0x7f2720138e70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f271000d550 tx=0x7f271000da10 comp rx=0 tx=0).stop 2024-08-19T11:13:14.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f27267e5640 1 -- 172.21.15.71:0/3577612503 reap_dead start 2024-08-19T11:13:14.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 shutdown_connections 2024-08-19T11:13:14.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 --2- 172.21.15.71:0/3577612503 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f27200a6950 0x7f2720138e70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 >> 172.21.15.71:0/3577612503 conn(0x7f27200abf50 msgr2=0x7f27200aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 shutdown_connections 2024-08-19T11:13:14.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.682+0000 7f2728248640 1 -- 172.21.15.71:0/3577612503 wait complete. 2024-08-19T11:13:14.726 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:14.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:13:14.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:13:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.825+0000 7f8fb7b04640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.825+0000 7f8fb7b04640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.825+0000 7f8fb7b04640 10 monclient: monmap: 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.827227+0000 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.827227+0000 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.829 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 1 Processor -- start 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 1 -- start start 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient: init 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient: _add_conns ranks=[0,6,1,8,9,5,10,2,4,3,7] 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8fb00a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 0x7f8fb013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient(hunting): picked mon.noname-d con 0x7f8fb00a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f8fb00a7440 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb00a6380 con 0x7f8fb00a6950 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb00a3650 con 0x7f8fb00a7440 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f8fb00a5020 con 0x7f8fb00a57c0 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.826+0000 7f8fb7b04640 10 monclient(hunting): authenticate will time out at 852.868922s 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb58a0640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8fb00a6950 0x7f8fb00a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54260/0 (socket says 172.21.15.71:54260) 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 0x7f8fb013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb58a0640 1 -- 172.21.15.71:0/1697318723 learned_addr learned my addr 172.21.15.71:0/1697318723 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): get_auth_request con 0x7f8fb00a57c0 auth_method 0 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient(hunting): handle_auth_done global_id 24630 payload 274 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 1 -- 172.21.15.71:0/1697318723 >> v1:172.21.15.135:6789/0 conn(0x7f8fb00a7440 legacy=0x7f8fb01410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 1 -- 172.21.15.71:0/1697318723 >> v1:172.21.15.71:6789/0 conn(0x7f8fb00a6950 legacy=0x7f8fb00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 1 monclient: found mon.noname-d 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.827+0000 7f8fb509f640 1 -- 172.21.15.71:0/1697318723 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb00a84c0 con 0x7f8fb00a57c0 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb509f640 1 -- 172.21.15.71:0/1697318723 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 msgr2=0x7f8fb013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb509f640 1 --2- 172.21.15.71:0/1697318723 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 0x7f8fb013eb60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40097d0 tx=0x7f8fa4029fb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=9ff7a2e475f2732e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 1 -- 172.21.15.71:0/1697318723 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fa4037070 con 0x7f8fb00a57c0 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: dump: 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 1 -- 172.21.15.71:0/1697318723 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa402adf0 con 0x7f8fb00a57c0 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 5 monclient: authenticate success, global_id 24630 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 1 -- 172.21.15.71:0/1697318723 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fa4030c20 con 0x7f8fb00a57c0 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 4 set_mon_vals no callback set 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb489e640 10 monclient: dump: 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 10 monclient: shutdown 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 -- 172.21.15.71:0/1697318723 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 msgr2=0x7f8fb013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 --2- 172.21.15.71:0/1697318723 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 0x7f8fb013eb60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40097d0 tx=0x7f8fa4029fb0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 -- 172.21.15.71:0/1697318723 shutdown_connections 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 --2- 172.21.15.71:0/1697318723 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8fb00a57c0 0x7f8fb013eb60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 -- 172.21.15.71:0/1697318723 >> 172.21.15.71:0/1697318723 conn(0x7f8fb00abf50 msgr2=0x7f8fb00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 -- 172.21.15.71:0/1697318723 shutdown_connections 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.830+0000 7f8fb7b04640 1 -- 172.21.15.71:0/1697318723 wait complete. 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.831+0000 7f8fb7b04640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.831+0000 7f8fb7b04640 10 monclient: monmap: 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.831+0000 7f8fb7b04640 1 Processor -- start 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.831+0000 7f8fb7b04640 1 -- start start 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.831+0000 7f8fb7b04640 10 monclient: init 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient: _add_conns ranks=[2,0,4,3,5,7,1,6,8] 2024-08-19T11:13:14.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8fb00a57c0 0x7f8fb0128a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): picked mon.noname-b con 0x7f8fb00a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 0x7f8fb01ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): picked mon.noname-a con 0x7f8fb00a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8fb00a7440 0x7f8fb01266f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): picked mon.noname-c con 0x7f8fb00a7440 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb00a8700 con 0x7f8fb00a6950 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb00a7d40 con 0x7f8fb00a57c0 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f8fb01427d0 con 0x7f8fb00a7440 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb7b04640 10 monclient(hunting): authenticate will time out at 852.874296s 2024-08-19T11:13:14.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 0x7f8fb01ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8fb00a57c0 0x7f8fb0128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 0x7f8fb01ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58480/0 (socket says 172.21.15.71:58480) 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 -- 172.21.15.71:0/2680958982 learned_addr learned my addr 172.21.15.71:0/2680958982 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): get_auth_request con 0x7f8fb00a6950 auth_method 0 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): get_auth_request con 0x7f8fb00a57c0 auth_method 0 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8fb00a7440 0x7f8fb01266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): get_auth_request con 0x7f8fb00a7440 auth_method 0 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb60a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient(hunting): handle_auth_done global_id 34245 payload 824 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8fb00a7440 msgr2=0x7f8fb01266f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8fb00a7440 0x7f8fb01266f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8fb00a57c0 msgr2=0x7f8fb0128a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8fb00a57c0 0x7f8fb0128a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient: _finish_hunting 0 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 monclient: found mon.noname-a 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb509f640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0129410 con 0x7f8fb00a6950 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.832+0000 7f8fb58a0640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8fb00a57c0 0x7f8fb0128a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.834+0000 7f8fb509f640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 msgr2=0x7f8fb01ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.834+0000 7f8fb509f640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 0x7f8fb01ced90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4035040 tx=0x7f8fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fa4041020 con 0x7f8fb00a6950 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: dump: 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.851 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 5 monclient: authenticate success, global_id 34245 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa4003bb0 con 0x7f8fb00a6950 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 10 monclient: _renew_subs 2024-08-19T11:13:14.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fa4037040 con 0x7f8fb00a6950 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb01c7660 con 0x7f8fb00a6950 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fae7fc640 10 monclient: dump: 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.853 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8faffff640 4 set_mon_vals no callback set 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 10 monclient: _renew_subs 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.835+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb012a280 con 0x7f8fb00a6950 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8fa4044020 con 0x7f8fb00a6950 2024-08-19T11:13:14.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb7b04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb7b04640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 0x7f8fb002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb7b04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb006a590 con 0x7f8fb01cf2d0 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fae7fc640 1 --2- 172.21.15.71:0/2680958982 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f9c03ea80 0x7f8f9c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f8fa4071ef0 con 0x7f8fb00a6950 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 0x7f8fb002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient: get_auth_request con 0x7f8fb01cf2d0 auth_method 0 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb60a1640 1 --2- 172.21.15.71:0/2680958982 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f9c03ea80 0x7f8f9c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb60a1640 10 monclient: get_auth_request con 0x7f8f9c03ea80 auth_method 0 2024-08-19T11:13:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_done global_id 5205 payload 824 2024-08-19T11:13:14.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.836+0000 7f8fb58a0640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fb00a6d30 con 0x7f8fb01cf2d0 2024-08-19T11:13:14.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fb60a1640 1 --2- 172.21.15.71:0/2680958982 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f9c03ea80 0x7f8f9c040f40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009f60 tx=0x7f8fa800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fb58a0640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 msgr2=0x7f8fb002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fb58a0640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 0x7f8fb002d1c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0007270 tx=0x7f8fa0007730 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fa0017020 con 0x7f8fb01cf2d0 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 10 monclient: dump: 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.859 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8fa000fd00 con 0x7f8fb01cf2d0 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:14.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 msgr2=0x7f8fb002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 0x7f8fb002d1c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0007270 tx=0x7f8fa0007730 comp rx=0 tx=0).stop 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 msgr2=0x7f8fb002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.839+0000 7f8fae7fc640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb01cf2d0 0x7f8fb002d1c0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0007270 tx=0x7f8fa0007730 comp rx=0 tx=0).stop 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb7b04640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb7b04640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 0x7f8fb002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb7b04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb0076c60 con 0x7f8fb0127f60 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb58a0640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 0x7f8fb002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb58a0640 10 monclient: get_auth_request con 0x7f8fb0127f60 auth_method 0 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb58a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb58a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.845+0000 7f8fb58a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.846+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.846+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.846+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.846+0000 7f8fb58a0640 10 monclient(hunting): handle_auth_done global_id 5214 payload 824 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.846+0000 7f8fb58a0640 1 -- 172.21.15.71:0/2680958982 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8fb00a1f70 con 0x7f8fb0127f60 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fb58a0640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 msgr2=0x7f8fb002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fb58a0640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 0x7f8fb002d700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0018000 tx=0x7f8fa0004940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fa0017040 con 0x7f8fb0127f60 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 10 monclient: dump: 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7f8fa0013b10 con 0x7f8fb0127f60 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 msgr2=0x7f8fb002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 0x7f8fb002d700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0018000 tx=0x7f8fa0004940 comp rx=0 tx=0).stop 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 msgr2=0x7f8fb002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.848+0000 7f8fae7fc640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fb0127f60 0x7f8fb002d700 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0018000 tx=0x7f8fa0004940 comp rx=0 tx=0).stop 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:14.864 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 191701, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:14.865 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.866 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.867 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:14.868 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:14.869 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:14.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:14.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.877 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.881 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:14.883 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:14.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.887 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.888 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:14.889 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:14.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f9c03ea80 msgr2=0x7f8f9c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 --2- 172.21.15.71:0/2680958982 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f9c03ea80 0x7f8f9c040f40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009f60 tx=0x7f8fa800d040 comp rx=0 tx=0).stop 2024-08-19T11:13:14.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 10 monclient: shutdown 2024-08-19T11:13:14.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:14.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 msgr2=0x7f8fb01ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:14.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 --2- 172.21.15.71:0/2680958982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb00a6950 0x7f8fb01ced90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4035040 tx=0x7f8fa40046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:14.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb60a1640 1 -- 172.21.15.71:0/2680958982 reap_dead start 2024-08-19T11:13:14.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb60a1640 1 -- 172.21.15.71:0/2680958982 reap_dead start 2024-08-19T11:13:14.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 shutdown_connections 2024-08-19T11:13:14.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 >> 172.21.15.71:0/2680958982 conn(0x7f8fb00abf50 msgr2=0x7f8fb009dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:14.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 shutdown_connections 2024-08-19T11:13:14.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.849+0000 7f8fb7b04640 1 -- 172.21.15.71:0/2680958982 wait complete. 2024-08-19T11:13:14.892 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:14.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:13:14.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.989+0000 7fec691f4640 10 monclient: get_monmap_and_config 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.989+0000 7fec691f4640 10 monclient: build_initial_monmap 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.989+0000 7fec691f4640 10 monclient: monmap: 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:14.991519+0000 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:14.991519+0000 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:14.992 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:14.993 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:14.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 Processor -- start 2024-08-19T11:13:14.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 -- start start 2024-08-19T11:13:14.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient: init 2024-08-19T11:13:14.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:14.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient: _add_conns ranks=[2,4,5,9,0,3,7,6,8,10,1] 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 0x7fec640a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): picked mon.noname-b con 0x7fec640a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec640a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): picked mon.noname-c con 0x7fec640a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64139710 0x7fec64139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): picked mon.noname-h con 0x7fec64139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fec640a5020 con 0x7fec640a6950 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fec640a77b0 con 0x7fec640a57c0 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:14.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fec640a7d40 con 0x7fec64139710 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.990+0000 7fec691f4640 10 monclient(hunting): authenticate will time out at 853.032998s 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 0x7fec640a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec640a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 0x7fec640a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:54206/0 (socket says 172.21.15.71:54206) 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 1 -- 172.21.15.71:0/2564388892 learned_addr learned my addr 172.21.15.71:0/2564388892 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): get_auth_request con 0x7fec640a57c0 auth_method 0 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): get_auth_request con 0x7fec640a6950 auth_method 0 2024-08-19T11:13:14.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient(hunting): handle_auth_done global_id 5197 payload 274 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6359e640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64139710 0x7fec64139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 -- 172.21.15.71:0/2564388892 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64139710 msgr2=0x7fec64139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64139710 0x7fec64139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 -- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 msgr2=0x7fec640a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 0x7fec640a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 monclient: found mon.noname-c 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec6259c640 1 -- 172.21.15.71:0/2564388892 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec640a6380 con 0x7fec640a57c0 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.991+0000 7fec62d9d640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 0x7fec640a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec6259c640 1 -- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 msgr2=0x7fec640a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec6259c640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec640a7270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec58009800 tx=0x7fec58029fe0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=80cd4ae2c8abdca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 1 -- 172.21.15.71:0/2564388892 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec58037070 con 0x7fec640a57c0 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:15.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: dump: 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.002 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: _finish_auth 0 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 1 -- 172.21.15.71:0/2564388892 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5802ad00 con 0x7fec640a57c0 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 5 monclient: authenticate success, global_id 5197 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 1 -- 172.21.15.71:0/2564388892 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec58030c20 con 0x7fec640a57c0 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:15.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 4 set_mon_vals no callback set 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec61d9b640 10 monclient: dump: 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.004 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 10 monclient: shutdown 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 -- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 msgr2=0x7fec640a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec640a7270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec58009800 tx=0x7fec58029fe0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 -- 172.21.15.71:0/2564388892 shutdown_connections 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64139710 0x7fec64139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec640a7270 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 --2- 172.21.15.71:0/2564388892 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fec640a6950 0x7fec640a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 -- 172.21.15.71:0/2564388892 >> 172.21.15.71:0/2564388892 conn(0x7fec640abf50 msgr2=0x7fec640ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 -- 172.21.15.71:0/2564388892 shutdown_connections 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.994+0000 7fec691f4640 1 -- 172.21.15.71:0/2564388892 wait complete. 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.995+0000 7fec691f4640 10 monclient: build_initial_monmap 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.995+0000 7fec691f4640 10 monclient: monmap: 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:15.006 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:15.007 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 Processor -- start 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 -- start start 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient: init 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient: _add_conns ranks=[4,1,3,0,8,2,6,5,7] 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec641ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): picked mon.noname-c con 0x7fec640a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec640a6950 0x7fec64138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): picked mon.noname-f con 0x7fec640a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:15.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec64139710 0x7fec64138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): picked mon.noname-g con 0x7fec64139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec640a84c0 con 0x7fec640a6950 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fec640a3650 con 0x7fec64139710 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fec640a8700 con 0x7fec640a57c0 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec691f4640 10 monclient(hunting): authenticate will time out at 853.038667s 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec641ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec641ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:47378/0 (socket says 172.21.15.71:47378) 2024-08-19T11:13:15.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 1 -- 172.21.15.71:0/3139220850 learned_addr learned my addr 172.21.15.71:0/3139220850 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): get_auth_request con 0x7fec640a57c0 auth_method 0 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec62d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6259c640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec640a6950 0x7fec64138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6359e640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec64139710 0x7fec64138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6359e640 10 monclient(hunting): get_auth_request con 0x7fec64139710 auth_method 0 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6359e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6359e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6259c640 10 monclient(hunting): get_auth_request con 0x7fec640a6950 auth_method 0 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.996+0000 7fec6259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec6359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec6359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec6359e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 10 monclient(hunting): handle_auth_done global_id 5206 payload 824 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec64139710 msgr2=0x7fec64138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec64139710 0x7fec64138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec640a6950 msgr2=0x7fec64138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec640a6950 0x7fec64138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 1 monclient: found mon.noname-c 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.997+0000 7fec62d9d640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec64126420 con 0x7fec640a57c0 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec62d9d640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 msgr2=0x7fec641ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec62d9d640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec641ce400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ea00 tx=0x7fec5400eec0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec54017070 con 0x7fec640a57c0 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: dump: 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.020 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5400cc70 con 0x7fec640a57c0 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 5 monclient: authenticate success, global_id 5206 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 10 monclient: _renew_subs 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec641251e0 con 0x7fec640a57c0 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:15.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec5400ce20 con 0x7fec640a57c0 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec4b7fe640 10 monclient: dump: 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.022 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 10 monclient: _renew_subs 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec6159a640 4 set_mon_vals no callback set 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:14.999+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fec64125b80 con 0x7fec640a57c0 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec691f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec691f4640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 0x7fec6402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fec6406a590 con 0x7fec64122f90 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fec5401a070 con 0x7fec640a57c0 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 0x7fec6402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient: get_auth_request con 0x7fec64122f90 auth_method 0 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec4b7fe640 1 --2- 172.21.15.71:0/3139220850 >> v2:172.21.15.135:6800/726754104 conn(0x7fec5003ea80 0x7fec50040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7fec5400f040 con 0x7fec640a57c0 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6359e640 1 --2- 172.21.15.71:0/3139220850 >> v2:172.21.15.135:6800/726754104 conn(0x7fec5003ea80 0x7fec50040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6359e640 10 monclient: get_auth_request con 0x7fec5003ea80 auth_method 0 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 10 monclient(hunting): handle_auth_done global_id 15080 payload 824 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.000+0000 7fec6259c640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec640a3f10 con 0x7fec64122f90 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec6259c640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 msgr2=0x7fec6402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec6259c640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 0x7fec6402d1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec580097d0 tx=0x7fec580046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec6359e640 1 --2- 172.21.15.71:0/3139220850 >> v2:172.21.15.135:6800/726754104 conn(0x7fec5003ea80 0x7fec50040f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec640abe80 tx=0x7fec5c007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec58037040 con 0x7fec64122f90 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 10 monclient: dump: 2024-08-19T11:13:15.025 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.026 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fec58003a30 con 0x7fec64122f90 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 msgr2=0x7fec6402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 0x7fec6402d1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec580097d0 tx=0x7fec580046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 msgr2=0x7fec6402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.003+0000 7fec4b7fe640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64122f90 0x7fec6402d1c0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec580097d0 tx=0x7fec580046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec691f4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:15.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec691f4640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 0x7fec6402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec691f4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fec64076c60 con 0x7fec64123370 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec6259c640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 0x7fec6402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec6259c640 10 monclient: get_auth_request con 0x7fec64123370 auth_method 0 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec6259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec6259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.009+0000 7fec6259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.010+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.010+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.010+0000 7fec6259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.010+0000 7fec6259c640 10 monclient(hunting): handle_auth_done global_id 15089 payload 824 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.010+0000 7fec6259c640 1 -- 172.21.15.71:0/3139220850 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fec640a6d30 con 0x7fec64123370 2024-08-19T11:13:15.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec6259c640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 msgr2=0x7fec6402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec6259c640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 0x7fec6402d700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec5802a020 tx=0x7fec58008030 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec58037030 con 0x7fec64123370 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 10 monclient: dump: 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.029 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fec58049d30 con 0x7fec64123370 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.012+0000 7fec4b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:15.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 msgr2=0x7fec6402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec4b7fe640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 0x7fec6402d700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec5802a020 tx=0x7fec58008030 comp rx=0 tx=0).stop 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec4b7fe640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 msgr2=0x7fec6402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec4b7fe640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fec64123370 0x7fec6402d700 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec5802a020 tx=0x7fec58008030 comp rx=0 tx=0).stop 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 191868, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:13:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:15.057 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 >> v2:172.21.15.135:6800/726754104 conn(0x7fec5003ea80 msgr2=0x7fec50040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 --2- 172.21.15.71:0/3139220850 >> v2:172.21.15.135:6800/726754104 conn(0x7fec5003ea80 0x7fec50040f40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec640abe80 tx=0x7fec5c007670 comp rx=0 tx=0).stop 2024-08-19T11:13:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 10 monclient: shutdown 2024-08-19T11:13:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 msgr2=0x7fec641ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec641ce400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ea00 tx=0x7fec5400eec0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec6359e640 1 -- 172.21.15.71:0/3139220850 reap_dead start 2024-08-19T11:13:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 shutdown_connections 2024-08-19T11:13:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 --2- 172.21.15.71:0/3139220850 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec640a57c0 0x7fec641ce400 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 >> 172.21.15.71:0/3139220850 conn(0x7fec640abf50 msgr2=0x7fec640aaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 shutdown_connections 2024-08-19T11:13:15.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.013+0000 7fec691f4640 1 -- 172.21.15.71:0/3139220850 wait complete. 2024-08-19T11:13:15.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:15.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:13:15.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:13:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.156+0000 7f1a400b1640 10 monclient: get_monmap_and_config 2024-08-19T11:13:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.156+0000 7f1a400b1640 10 monclient: build_initial_monmap 2024-08-19T11:13:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.156+0000 7f1a400b1640 10 monclient: monmap: 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:15.157980+0000 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:15.157980+0000 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:15.160 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.156+0000 7f1a400b1640 1 Processor -- start 2024-08-19T11:13:15.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 1 -- start start 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient: init 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient: _add_conns ranks=[7,8,0,4,6,2,1,3,10,5,9] 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a380a6950 0x7f1a380a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): picked mon.noname-i con 0x7f1a380a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 0x7f1a380a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): picked mon.noname-e con 0x7f1a380a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1a38139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a380a6380 con 0x7f1a38139710 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1a380a5020 con 0x7f1a380a6950 2024-08-19T11:13:15.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f1a380a77b0 con 0x7f1a380a57c0 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a400b1640 10 monclient(hunting): authenticate will time out at 853.199650s 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 0x7f1a380a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3e64e640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1a38139710 0x7f1a38139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54262/0 (socket says 172.21.15.71:54262) 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3e64e640 1 -- 172.21.15.71:0/423401136 learned_addr learned my addr 172.21.15.71:0/423401136 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): get_auth_request con 0x7f1a380a57c0 auth_method 0 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.157+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a380a6950 0x7f1a380a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_done global_id 5120 payload 274 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 1 -- 172.21.15.71:0/423401136 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a380a6950 msgr2=0x7f1a380a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a380a6950 0x7f1a380a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 1 -- 172.21.15.71:0/423401136 >> v1:172.21.15.71:6789/0 conn(0x7f1a38139710 legacy=0x7f1a38139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 1 monclient: found mon.noname-e 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3d64c640 1 -- 172.21.15.71:0/423401136 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a380a3650 con 0x7f1a380a57c0 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3de4d640 10 monclient: get_auth_request con 0x7f1a380a6950 auth_method 0 2024-08-19T11:13:15.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.158+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a380a6950 0x7f1a380a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.160+0000 7f1a3d64c640 1 -- 172.21.15.71:0/423401136 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 msgr2=0x7f1a380a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.160+0000 7f1a3d64c640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 0x7f1a380a7270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009800 tx=0x7f1a28029fe0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=94fb403ca281eb59 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.160+0000 7f1a3ce4b640 1 -- 172.21.15.71:0/423401136 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a28037070 con 0x7f1a380a57c0 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: dump: 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.167 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: _finish_auth 0 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: _check_auth_tickets 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 1 -- 172.21.15.71:0/423401136 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2802ade0 con 0x7f1a380a57c0 2024-08-19T11:13:15.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 5 monclient: authenticate success, global_id 5120 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 1 -- 172.21.15.71:0/423401136 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a28030c20 con 0x7f1a380a57c0 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 4 set_mon_vals no callback set 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a3ce4b640 10 monclient: dump: 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 10 monclient: shutdown 2024-08-19T11:13:15.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 -- 172.21.15.71:0/423401136 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 msgr2=0x7f1a380a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 0x7f1a380a7270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009800 tx=0x7f1a28029fe0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 -- 172.21.15.71:0/423401136 shutdown_connections 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1a380a57c0 0x7f1a380a7270 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 --2- 172.21.15.71:0/423401136 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a380a6950 0x7f1a380a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 -- 172.21.15.71:0/423401136 >> 172.21.15.71:0/423401136 conn(0x7f1a380abf50 msgr2=0x7f1a380ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 -- 172.21.15.71:0/423401136 shutdown_connections 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.161+0000 7f1a400b1640 1 -- 172.21.15.71:0/423401136 wait complete. 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 10 monclient: build_initial_monmap 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 10 monclient: monmap: 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:15.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:15.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 1 Processor -- start 2024-08-19T11:13:15.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 1 -- start start 2024-08-19T11:13:15.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 10 monclient: init 2024-08-19T11:13:15.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:15.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 10 monclient: _add_conns ranks=[6,0,1,3,7,8,4,2,5] 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a380a57c0 0x7f1a381ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.162+0000 7f1a400b1640 10 monclient(hunting): picked mon.noname-d con 0x7f1a380a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 0x7f1a38138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): picked mon.noname-a con 0x7f1a380a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a38139710 0x7f1a38138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): picked mon.noname-f con 0x7f1a38139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a380a84c0 con 0x7f1a380a6950 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a380a7d40 con 0x7f1a38139710 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1a380a8700 con 0x7f1a380a57c0 2024-08-19T11:13:15.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a400b1640 10 monclient(hunting): authenticate will time out at 853.205038s 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 0x7f1a38138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 0x7f1a38138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58494/0 (socket says 172.21.15.71:58494) 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 -- 172.21.15.71:0/4213693407 learned_addr learned my addr 172.21.15.71:0/4213693407 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): get_auth_request con 0x7f1a380a6950 auth_method 0 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a380a57c0 0x7f1a381ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): get_auth_request con 0x7f1a380a57c0 auth_method 0 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3e64e640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a38139710 0x7f1a38138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient(hunting): handle_auth_done global_id 34254 payload 824 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a380a57c0 msgr2=0x7f1a381ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a380a57c0 0x7f1a381ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a38139710 msgr2=0x7f1a38138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a38139710 0x7f1a38138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 monclient: found mon.noname-a 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3d64c640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a381262e0 con 0x7f1a380a6950 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3e64e640 10 monclient: get_auth_request con 0x7f1a38139710 auth_method 0 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.163+0000 7f1a3e64e640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a38139710 0x7f1a38138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a3d64c640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 msgr2=0x7f1a38138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a3d64c640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 0x7f1a38138920 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009920 tx=0x7f1a28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a28037040 con 0x7f1a380a6950 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: dump: 2024-08-19T11:13:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 5 monclient: authenticate success, global_id 34254 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a28042070 con 0x7f1a380a6950 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a28030c20 con 0x7f1a380a6950 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 10 monclient: _renew_subs 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a380a20b0 con 0x7f1a380a6950 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2e7fc640 10 monclient: dump: 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a2ffff640 4 set_mon_vals no callback set 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 10 monclient: _renew_subs 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.165+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3813a490 con 0x7f1a380a6950 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.166+0000 7f1a400b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.166+0000 7f1a400b1640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 0x7f1a3802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.166+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.166+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1a3806a590 con 0x7f1a38122f90 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.166+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1a28003bb0 con 0x7f1a380a6950 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.166+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 0x7f1a3802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient: get_auth_request con 0x7f1a38122f90 auth_method 0 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a2e7fc640 1 --2- 172.21.15.71:0/4213693407 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a1c03ea80 0x7f1a1c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f1a28071f70 con 0x7f1a380a6950 2024-08-19T11:13:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3e64e640 1 --2- 172.21.15.71:0/4213693407 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a1c03ea80 0x7f1a1c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3e64e640 10 monclient: get_auth_request con 0x7f1a1c03ea80 auth_method 0 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_done global_id 5029 payload 824 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.167+0000 7f1a3de4d640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a380a6d30 con 0x7f1a38122f90 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a3de4d640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 msgr2=0x7f1a3802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 0x7f1a3802d1c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400f880 tx=0x7f1a3400fd40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a3e64e640 1 --2- 172.21.15.71:0/4213693407 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a1c03ea80 0x7f1a1c040f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a38124800 tx=0x7f1a30008330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a3400dc30 con 0x7f1a38122f90 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a2e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.169+0000 7f1a2e7fc640 10 monclient: dump: 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a3400dc30 con 0x7f1a38122f90 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 msgr2=0x7f1a3802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 0x7f1a3802d1c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400f880 tx=0x7f1a3400fd40 comp rx=0 tx=0).stop 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 msgr2=0x7f1a3802d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.170+0000 7f1a2e7fc640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38122f90 0x7f1a3802d1c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a400b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a400b1640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 0x7f1a3802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a400b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1a38125c80 con 0x7f1a38123370 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 0x7f1a3802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient: get_auth_request con 0x7f1a38123370 auth_method 0 2024-08-19T11:13:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 10 monclient(hunting): handle_auth_done global_id 5038 payload 824 2024-08-19T11:13:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.176+0000 7f1a3de4d640 1 -- 172.21.15.71:0/4213693407 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a3809e100 con 0x7f1a38123370 2024-08-19T11:13:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a3de4d640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 msgr2=0x7f1a3802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a3de4d640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 0x7f1a3802d700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400f880 tx=0x7f1a340046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a34004490 con 0x7f1a38123370 2024-08-19T11:13:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:13:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 10 monclient: dump: 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f1a34013440 con 0x7f1a38123370 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 msgr2=0x7f1a3802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 0x7f1a3802d700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400f880 tx=0x7f1a340046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 msgr2=0x7f1a3802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a2e7fc640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1a38123370 0x7f1a3802d700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 62, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 192034, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:15.195 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:15.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:15.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:15.198 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:15.199 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:15.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:15.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:15.218 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:15.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a1c03ea80 msgr2=0x7f1a1c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 1 --2- 172.21.15.71:0/4213693407 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a1c03ea80 0x7f1a1c040f40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a38124800 tx=0x7f1a30008330 comp rx=0 tx=0).stop 2024-08-19T11:13:15.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 10 monclient: shutdown 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 msgr2=0x7f1a38138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 1 --2- 172.21.15.71:0/4213693407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a380a6950 0x7f1a38138920 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009920 tx=0x7f1a28004730 comp rx=0 tx=0).stop 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a3e64e640 1 -- 172.21.15.71:0/4213693407 reap_dead start 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a3e64e640 1 -- 172.21.15.71:0/4213693407 reap_dead start 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 shutdown_connections 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.179+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 >> 172.21.15.71:0/4213693407 conn(0x7f1a380abf50 msgr2=0x7f1a380aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.180+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 shutdown_connections 2024-08-19T11:13:15.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.180+0000 7f1a400b1640 1 -- 172.21.15.71:0/4213693407 wait complete. 2024-08-19T11:13:15.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:15.221 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['h', 'g', 'c'] 2024-08-19T11:13:15.221 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-19T11:13:15.221 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-08-19T11:13:15.221 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-08-19T11:13:15.221 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-08-19T11:13:15.221 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:13:15.235 INFO:tasks.ceph.mon.h:Stopped 2024-08-19T11:13:15.235 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-08-19T11:13:15.235 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-08-19T11:13:15.235 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-08-19T11:13:15.235 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:13:15.290 INFO:tasks.ceph.mon.g:Stopped 2024-08-19T11:13:15.290 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-19T11:13:15.290 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-19T11:13:15.290 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-19T11:13:15.290 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:13:15.301 INFO:tasks.ceph.mon.c:Stopped 2024-08-19T11:13:15.301 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-08-19T11:13:15.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:15.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.440+0000 7f6a853de640 10 monclient: get_monmap_and_config 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.440+0000 7f6a853de640 10 monclient: build_initial_monmap 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.440+0000 7f6a853de640 10 monclient: monmap: 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:15.442372+0000 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:15.442372+0000 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:15.443 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:15.444 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 Processor -- start 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 -- start start 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient: init 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient: _add_conns ranks=[7,6,4,1,10,2,9,0,8,5,3] 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6a800a6a30 0x7f6a800a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): picked mon.noname-i con 0x7f6a800a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 0x7f6a800a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): picked mon.noname-d con 0x7f6a800a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a80139860 0x7f6a80139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): picked mon.noname-c con 0x7f6a80139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:15.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6a800a4f90 con 0x7f6a80139860 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f6a800a6380 con 0x7f6a800a6e10 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6a800a49d0 con 0x7f6a800a6a30 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.441+0000 7f6a853de640 10 monclient(hunting): authenticate will time out at 853.483992s 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7f7fe640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a80139860 msgr2=0x7f6a80139c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a80139860 0x7f6a80139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 0x7f6a800a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 0x7f6a800a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:52066/0 (socket says 172.21.15.71:52066) 2024-08-19T11:13:15.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 -- 172.21.15.71:0/1961505812 learned_addr learned my addr 172.21.15.71:0/1961505812 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): get_auth_request con 0x7f6a800a6e10 auth_method 0 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7effd640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6a800a6a30 0x7f6a800a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7effd640 10 monclient(hunting): get_auth_request con 0x7f6a800a6a30 auth_method 0 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a7effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient(hunting): handle_auth_done global_id 24648 payload 274 2024-08-19T11:13:15.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 -- 172.21.15.71:0/1961505812 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6a800a6a30 msgr2=0x7f6a800a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6a800a6a30 0x7f6a800a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 -- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a80139860 msgr2=0x7f6a80139c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a80139860 0x7f6a80139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient: _finish_hunting 0 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 monclient: found mon.noname-d 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.442+0000 7f6a77fff640 1 -- 172.21.15.71:0/1961505812 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a800a46f0 con 0x7f6a800a6e10 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a77fff640 1 -- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 msgr2=0x7f6a800a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a77fff640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 0x7f6a800a71f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a680098d0 tx=0x7f6a6802a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=2fc73073bd5fd031 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 1 -- 172.21.15.71:0/1961505812 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a68037070 con 0x7f6a800a6e10 2024-08-19T11:13:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: dump: 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 5 monclient: authenticate success, global_id 24648 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 1 -- 172.21.15.71:0/1961505812 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6802adf0 con 0x7f6a800a6e10 2024-08-19T11:13:15.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:15.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:15.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 1 -- 172.21.15.71:0/1961505812 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a68030c20 con 0x7f6a800a6e10 2024-08-19T11:13:15.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 4 set_mon_vals no callback set 2024-08-19T11:13:15.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a7e7fc640 10 monclient: dump: 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.456 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 10 monclient: shutdown 2024-08-19T11:13:15.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 -- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 msgr2=0x7f6a800a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 0x7f6a800a71f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a680098d0 tx=0x7f6a6802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 -- 172.21.15.71:0/1961505812 shutdown_connections 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a80139860 0x7f6a80139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a800a6e10 0x7f6a800a71f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 --2- 172.21.15.71:0/1961505812 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6a800a6a30 0x7f6a800a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.445+0000 7f6a853de640 1 -- 172.21.15.71:0/1961505812 >> 172.21.15.71:0/1961505812 conn(0x7f6a800ac030 msgr2=0x7f6a800ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 1 -- 172.21.15.71:0/1961505812 shutdown_connections 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 1 -- 172.21.15.71:0/1961505812 wait complete. 2024-08-19T11:13:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 10 monclient: build_initial_monmap 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 10 monclient: monmap: 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 1 Processor -- start 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 1 -- start start 2024-08-19T11:13:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.446+0000 7f6a853de640 10 monclient: init 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient: _add_conns ranks=[1,8,5,0,4,6,2,7,3] 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a800a6a30 0x7f6a80138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): picked mon.noname-f con 0x7f6a800a6a30 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 0x7f6a801228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): picked mon.noname-e con 0x7f6a800a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a80139860 0x7f6a80122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): picked mon.noname-h con 0x7f6a80139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6a800a7730 con 0x7f6a800a6a30 2024-08-19T11:13:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6a8013a1a0 con 0x7f6a80139860 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6a800a2740 con 0x7f6a800a6e10 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a853de640 10 monclient(hunting): authenticate will time out at 853.489454s 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7f7fe640 1 -- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a80139860 msgr2=0x7f6a80122e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3302/0 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7f7fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a80139860 0x7f6a80122e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 0x7f6a801228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 0x7f6a801228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:43628/0 (socket says 172.21.15.71:43628) 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 -- 172.21.15.71:0/1566826498 learned_addr learned my addr 172.21.15.71:0/1566826498 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): get_auth_request con 0x7f6a800a6e10 auth_method 0 2024-08-19T11:13:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a800a6a30 0x7f6a80138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): get_auth_request con 0x7f6a800a6a30 auth_method 0 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient(hunting): handle_auth_done global_id 5129 payload 824 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 -- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a80139860 msgr2=0x7f6a80122e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a80139860 0x7f6a80122e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 -- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a800a6a30 msgr2=0x7f6a80138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a800a6a30 0x7f6a80138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient: _finish_hunting 0 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 monclient: found mon.noname-e 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.447+0000 7f6a77fff640 1 -- 172.21.15.71:0/1566826498 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a80139c40 con 0x7f6a800a6e10 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a77fff640 1 -- 172.21.15.71:0/1566826498 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 msgr2=0x7f6a801228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a77fff640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 0x7f6a801228e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a680098d0 tx=0x7f6a680046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a68041030 con 0x7f6a800a6e10 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: dump: 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 5 monclient: authenticate success, global_id 5129 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a68003bd0 con 0x7f6a800a6e10 2024-08-19T11:13:15.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a68037040 con 0x7f6a800a6e10 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 10 monclient: _renew_subs 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a80126550 con 0x7f6a800a6e10 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a7dffb640 4 set_mon_vals no callback set 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a777fe640 10 monclient: dump: 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:15.471 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 10 monclient: _renew_subs 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:15.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.450+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a80125310 con 0x7f6a800a6e10 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6a68044070 con 0x7f6a800a6e10 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a777fe640 1 --2- 172.21.15.71:0/1566826498 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a6003ea80 0x7f6a60040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a853de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a853de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a853de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f6a68042070 con 0x7f6a800a6e10 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8013a500 con 0x7f6a800a6e10 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a7effd640 1 --2- 172.21.15.71:0/1566826498 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a6003ea80 0x7f6a60040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.451+0000 7f6a7effd640 10 monclient: get_auth_request con 0x7f6a6003ea80 auth_method 0 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.454+0000 7f6a7effd640 1 --2- 172.21.15.71:0/1566826498 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a6003ea80 0x7f6a60040f40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6a70006fd0 tx=0x7f6a70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.456+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f6a80139c40 con 0x7f6a800a6e10 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.456+0000 7f6a777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:15.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.456+0000 7f6a777fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:15.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a853de640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:15.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a853de640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:15.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a853de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:15.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6a8006ca70 con 0x7f6a800a6e10 2024-08-19T11:13:15.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a777fe640 1 -- 172.21.15.71:0/1566826498 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f6a68003d80 con 0x7f6a800a6e10 2024-08-19T11:13:15.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:15.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.702+0000 7f6a777fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:15.705 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":62,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a6003ea80 msgr2=0x7f6a60040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 --2- 172.21.15.71:0/1566826498 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a6003ea80 0x7f6a60040f40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6a70006fd0 tx=0x7f6a70008040 comp rx=0 tx=0).stop 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 10 monclient: shutdown 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 msgr2=0x7f6a801228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 0x7f6a801228e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a680098d0 tx=0x7f6a680046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 shutdown_connections 2024-08-19T11:13:15.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 --2- 172.21.15.71:0/1566826498 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a6003ea80 0x7f6a60040f40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6a800a6e10 0x7f6a801228e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a80139860 0x7f6a80122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 --2- 172.21.15.71:0/1566826498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a800a6a30 0x7f6a80138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:15.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 >> 172.21.15.71:0/1566826498 conn(0x7f6a800ac030 msgr2=0x7f6a801c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:15.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 shutdown_connections 2024-08-19T11:13:15.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:15.704+0000 7f6a853de640 1 -- 172.21.15.71:0/1566826498 wait complete. 2024-08-19T11:13:18.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:18.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.826+0000 7f8335341640 10 monclient: get_monmap_and_config 2024-08-19T11:13:18.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.826+0000 7f8335341640 10 monclient: build_initial_monmap 2024-08-19T11:13:18.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.826+0000 7f8335341640 10 monclient: monmap: 2024-08-19T11:13:18.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:18.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:18.827754+0000 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:18.827754+0000 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:18.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:18.830 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.826+0000 7f8335341640 1 Processor -- start 2024-08-19T11:13:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.826+0000 7f8335341640 1 -- start start 2024-08-19T11:13:18.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.826+0000 7f8335341640 10 monclient: init 2024-08-19T11:13:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient: _add_conns ranks=[7,6,5,3,1,4,10,8,0,2,9] 2024-08-19T11:13:18.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83300a57d0 0x7f83300a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): picked mon.noname-i con 0x7f83300a57d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 0x7f83300a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): picked mon.noname-d con 0x7f8330072400 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83300a60f0 0x7f8330137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): picked mon.noname-h con 0x7f83300a60f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8330072880 con 0x7f83300a60f0 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f83300741c0 con 0x7f8330072400 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:18.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f83300a6530 con 0x7f83300a57d0 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f8335341640 10 monclient(hunting): authenticate will time out at 856.869280s 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 0x7f83300a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832f7fe640 1 -- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83300a60f0 msgr2=0x7f8330137580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3302/0 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 0x7f83300a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:52080/0 (socket says 172.21.15.71:52080) 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 -- 172.21.15.71:0/4132400265 learned_addr learned my addr 172.21.15.71:0/4132400265 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): get_auth_request con 0x7f8330072400 auth_method 0 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832f7fe640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83300a60f0 0x7f8330137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:18.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832effd640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83300a57d0 0x7f83300a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832effd640 10 monclient(hunting): get_auth_request con 0x7f83300a57d0 auth_method 0 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient(hunting): handle_auth_done global_id 24657 payload 274 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 -- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83300a57d0 msgr2=0x7f83300a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83300a57d0 0x7f83300a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 -- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83300a60f0 msgr2=0x7f8330137580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83300a60f0 0x7f8330137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:13:18.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 monclient: found mon.noname-d 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.827+0000 7f832e7fc640 1 -- 172.21.15.71:0/4132400265 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83300a72a0 con 0x7f8330072400 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832e7fc640 1 -- 172.21.15.71:0/4132400265 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 msgr2=0x7f83300a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832e7fc640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 0x7f83300a5bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8318009eb0 tx=0x7f831802a580 comp rx=0 tx=0).ready entity=mon.6 client_cookie=252770856bfb8080 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 1 -- 172.21.15.71:0/4132400265 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8318036070 con 0x7f8330072400 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: dump: 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:18.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: _finish_auth 0 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 1 -- 172.21.15.71:0/4132400265 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8318007a70 con 0x7f8330072400 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f8335341640 5 monclient: authenticate success, global_id 24657 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f8335341640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f8335341640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f8335341640 4 set_mon_vals no callback set 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 1 -- 172.21.15.71:0/4132400265 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8318007ca0 con 0x7f8330072400 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:18.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.830+0000 7f832dffb640 10 monclient: dump: 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:18.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 10 monclient: shutdown 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 -- 172.21.15.71:0/4132400265 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 msgr2=0x7f83300a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 0x7f83300a5bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8318009eb0 tx=0x7f831802a580 comp rx=0 tx=0).stop 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 -- 172.21.15.71:0/4132400265 shutdown_connections 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f83300a60f0 0x7f8330137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8330072400 0x7f83300a5bb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 --2- 172.21.15.71:0/4132400265 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f83300a57d0 0x7f83300a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 -- 172.21.15.71:0/4132400265 >> 172.21.15.71:0/4132400265 conn(0x7f83300aa3f0 msgr2=0x7f83300a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 -- 172.21.15.71:0/4132400265 shutdown_connections 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 1 -- 172.21.15.71:0/4132400265 wait complete. 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 10 monclient: build_initial_monmap 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.831+0000 7f8335341640 10 monclient: monmap: 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:18.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 1 Processor -- start 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 1 -- start start 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 10 monclient: init 2024-08-19T11:13:18.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 10 monclient: _add_conns ranks=[4,1,6,7,2,0,8,5,3] 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8330072400 0x7f83301367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.832+0000 7f8335341640 10 monclient(hunting): picked mon.noname-c con 0x7f8330072400 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83300a57d0 0x7f8330136d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): picked mon.noname-f con 0x7f83300a57d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 0x7f8330120410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): picked mon.noname-d con 0x7f83300a60f0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8330137e50 con 0x7f83300a57d0 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f8330137cd0 con 0x7f8330072400 2024-08-19T11:13:18.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f8330137fd0 con 0x7f83300a60f0 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f8335341640 10 monclient(hunting): authenticate will time out at 856.875047s 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832effd640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8330072400 msgr2=0x7f83301367d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8330072400 0x7f83301367d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 0x7f8330120410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 0x7f8330120410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:52086/0 (socket says 172.21.15.71:52086) 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 -- 172.21.15.71:0/2925961821 learned_addr learned my addr 172.21.15.71:0/2925961821 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): get_auth_request con 0x7f83300a60f0 auth_method 0 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:18.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832e7fc640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83300a57d0 0x7f8330136d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832e7fc640 10 monclient(hunting): get_auth_request con 0x7f83300a57d0 auth_method 0 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient(hunting): handle_auth_done global_id 24666 payload 824 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 -- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8330072400 msgr2=0x7f83301367d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8330072400 0x7f83301367d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 -- 172.21.15.71:0/2925961821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83300a57d0 msgr2=0x7f8330136d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:18.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83300a57d0 0x7f8330136d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:18.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:13:18.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 monclient: found mon.noname-d 2024-08-19T11:13:18.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:18.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:18.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832f7fe640 1 -- 172.21.15.71:0/2925961821 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83300a5cd0 con 0x7f83300a60f0 2024-08-19T11:13:18.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.833+0000 7f832e7fc640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83300a57d0 0x7f8330136d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.835+0000 7f832f7fe640 1 -- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 msgr2=0x7f8330120410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.835+0000 7f832f7fe640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 0x7f8330120410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f832000b470 tx=0x7f832000b930 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8320017070 con 0x7f83300a60f0 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: dump: 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:18.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:18.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8320003d50 con 0x7f83300a60f0 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 5 monclient: authenticate success, global_id 24666 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 10 monclient: _renew_subs 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8320006540 con 0x7f83300a60f0 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8330121e30 con 0x7f83300a60f0 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f83277fe640 10 monclient: dump: 2024-08-19T11:13:18.854 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:18.855 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f832d7fa640 4 set_mon_vals no callback set 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 10 monclient: _renew_subs 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.836+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8330122990 con 0x7f83300a60f0 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f8335341640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f83200060d0 con 0x7f83300a60f0 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f8335341640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f8335341640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8330122b60 con 0x7f83300a60f0 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f83277fe640 1 --2- 172.21.15.71:0/2925961821 >> v2:172.21.15.135:6800/726754104 conn(0x7f831003ea80 0x7f8310040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f8320050c90 con 0x7f83300a60f0 2024-08-19T11:13:18.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f832effd640 1 --2- 172.21.15.71:0/2925961821 >> v2:172.21.15.135:6800/726754104 conn(0x7f831003ea80 0x7f8310040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:18.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.837+0000 7f832effd640 10 monclient: get_auth_request con 0x7f831003ea80 auth_method 0 2024-08-19T11:13:18.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.840+0000 7f832effd640 1 --2- 172.21.15.71:0/2925961821 >> v2:172.21.15.135:6800/726754104 conn(0x7f831003ea80 0x7f8310040f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8328006fd0 tx=0x7f8328008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:18.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.841+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f8330122b60 con 0x7f83300a60f0 2024-08-19T11:13:18.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.841+0000 7f83277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:18.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:18.841+0000 7f83277fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f8335341640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f8335341640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f8335341640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f83300a17d0 con 0x7f83300a60f0 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f83277fe640 1 -- 172.21.15.71:0/2925961821 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f8320057080 con 0x7f83300a60f0 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f83277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:19.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.084+0000 7f83277fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:19.087 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":62,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:19.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 >> v2:172.21.15.135:6800/726754104 conn(0x7f831003ea80 msgr2=0x7f8310040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:19.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 --2- 172.21.15.71:0/2925961821 >> v2:172.21.15.135:6800/726754104 conn(0x7f831003ea80 0x7f8310040f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8328006fd0 tx=0x7f8328008040 comp rx=0 tx=0).stop 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 10 monclient: shutdown 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 msgr2=0x7f8330120410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 0x7f8330120410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f832000b470 tx=0x7f832000b930 comp rx=0 tx=0).stop 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 shutdown_connections 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 --2- 172.21.15.71:0/2925961821 >> v2:172.21.15.135:6800/726754104 conn(0x7f831003ea80 0x7f8310040f40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f83300a60f0 0x7f8330120410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83300a57d0 0x7f8330136d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 --2- 172.21.15.71:0/2925961821 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8330072400 0x7f83301367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 >> 172.21.15.71:0/2925961821 conn(0x7f83300aa3f0 msgr2=0x7f83300a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 shutdown_connections 2024-08-19T11:13:19.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:19.086+0000 7f8335341640 1 -- 172.21.15.71:0/2925961821 wait complete. 2024-08-19T11:13:22.100 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:22.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.207+0000 7f7754fde640 10 monclient: get_monmap_and_config 2024-08-19T11:13:22.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.207+0000 7f7754fde640 10 monclient: build_initial_monmap 2024-08-19T11:13:22.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.207+0000 7f7754fde640 10 monclient: monmap: 2024-08-19T11:13:22.209 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:22.209 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:22.209 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:22.208783+0000 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:22.208783+0000 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:22.210 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:22.211 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:22.211 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.207+0000 7f7754fde640 1 Processor -- start 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.207+0000 7f7754fde640 1 -- start start 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.207+0000 7f7754fde640 10 monclient: init 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient: _add_conns ranks=[6,2,10,4,7,8,3,1,0,5,9] 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 0x7f77500a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): picked mon.noname-d con 0x7f77500a57d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 0x7f77500a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): picked mon.noname-b con 0x7f7750072400 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f77500a60f0 0x7f7750137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): picked mon.noname-f con 0x7f77500a60f0 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7750072880 con 0x7f77500a60f0 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f77500741c0 con 0x7f7750072400 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f77500a6550 con 0x7f77500a57d0 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f7754fde640 10 monclient(hunting): authenticate will time out at 860.250656s 2024-08-19T11:13:22.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 0x7f77500a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 0x7f77500a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 0x7f77500a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:54210/0 (socket says 172.21.15.71:54210) 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 1 -- 172.21.15.71:0/2861198664 learned_addr learned my addr 172.21.15.71:0/2861198664 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): get_auth_request con 0x7f7750072400 auth_method 0 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): get_auth_request con 0x7f77500a57d0 auth_method 0 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:22.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774ed9d640 1 --2- 172.21.15.71:0/2861198664 >> v2:172.21.15.135:3300/0 conn(0x7f77500a60f0 0x7f7750137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774ed9d640 10 monclient(hunting): get_auth_request con 0x7f77500a60f0 auth_method 0 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.208+0000 7f774ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 10 monclient(hunting): handle_auth_done global_id 24675 payload 274 2024-08-19T11:13:22.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 1 -- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 msgr2=0x7f77500a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 1 --2- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 0x7f77500a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 1 -- 172.21.15.71:0/2861198664 >> v2:172.21.15.135:3300/0 conn(0x7f77500a60f0 msgr2=0x7f7750137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 1 --2- 172.21.15.71:0/2861198664 >> v2:172.21.15.135:3300/0 conn(0x7f77500a60f0 0x7f7750137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 1 monclient: found mon.noname-d 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774e59c640 1 -- 172.21.15.71:0/2861198664 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77500a72a0 con 0x7f77500a57d0 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.209+0000 7f774dd9b640 1 --2- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 0x7f77500a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.211+0000 7f774e59c640 1 -- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 msgr2=0x7f77500a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.211+0000 7f774e59c640 1 --2- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 0x7f77500a17d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f774002a490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1e1045ff04861933 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:22.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 1 -- 172.21.15.71:0/2861198664 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7740007bc0 con 0x7f77500a57d0 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: dump: 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:22.220 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: _finish_auth 0 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 1 -- 172.21.15.71:0/2861198664 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7740007d80 con 0x7f77500a57d0 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 5 monclient: authenticate success, global_id 24675 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:22.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 1 -- 172.21.15.71:0/2861198664 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7740031870 con 0x7f77500a57d0 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 4 set_mon_vals no callback set 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f774d59a640 10 monclient: dump: 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:22.222 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 10 monclient: shutdown 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 -- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 msgr2=0x7f77500a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 --2- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 0x7f77500a17d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7740009d90 tx=0x7f774002a490 comp rx=0 tx=0).stop 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 -- 172.21.15.71:0/2861198664 shutdown_connections 2024-08-19T11:13:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 --2- 172.21.15.71:0/2861198664 >> v2:172.21.15.135:3300/0 conn(0x7f77500a60f0 0x7f7750137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 --2- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7750072400 0x7f77500a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 --2- 172.21.15.71:0/2861198664 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77500a57d0 0x7f77500a17d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 -- 172.21.15.71:0/2861198664 >> 172.21.15.71:0/2861198664 conn(0x7f77500aa3f0 msgr2=0x7f77500a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 -- 172.21.15.71:0/2861198664 shutdown_connections 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.212+0000 7f7754fde640 1 -- 172.21.15.71:0/2861198664 wait complete. 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.213+0000 7f7754fde640 10 monclient: build_initial_monmap 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.213+0000 7f7754fde640 10 monclient: monmap: 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:22.226 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.213+0000 7f7754fde640 1 Processor -- start 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 -- start start 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient: init 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient: _add_conns ranks=[6,0,2,7,3,1,5,8,4] 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 0x7f77501228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): picked mon.noname-d con 0x7f7750072400 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77500a57d0 0x7f7750136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): picked mon.noname-a con 0x7f77500a57d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): picked mon.noname-b con 0x7f77500a60f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7750137e50 con 0x7f77500a57d0 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7750137cd0 con 0x7f77500a60f0 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7750137fd0 con 0x7f7750072400 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f7754fde640 10 monclient(hunting): authenticate will time out at 860.256604s 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 0x7f77501228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77500a57d0 0x7f7750136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77500a57d0 0x7f7750136710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58502/0 (socket says 172.21.15.71:58502) 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 0x7f77501228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:52102/0 (socket says 172.21.15.71:52102) 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:54222/0 (socket says 172.21.15.71:54222) 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 1 -- 172.21.15.71:0/2236902266 learned_addr learned my addr 172.21.15.71:0/2236902266 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): get_auth_request con 0x7f77500a57d0 auth_method 0 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): get_auth_request con 0x7f77500a60f0 auth_method 0 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): get_auth_request con 0x7f7750072400 auth_method 0 2024-08-19T11:13:22.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.214+0000 7f774dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 10 monclient(hunting): handle_auth_done global_id 5402 payload 824 2024-08-19T11:13:22.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 1 -- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 msgr2=0x7f77501228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 0x7f77501228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 1 -- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77500a57d0 msgr2=0x7f7750136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77500a57d0 0x7f7750136710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 1 monclient: found mon.noname-b 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774ed9d640 1 -- 172.21.15.71:0/2236902266 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77501240d0 con 0x7f77500a60f0 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.215+0000 7f774e59c640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 0x7f77501228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f774ed9d640 1 -- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 msgr2=0x7f7750136c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f774ed9d640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f774800e820 tx=0x7f774800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7748017070 con 0x7f77500a60f0 2024-08-19T11:13:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f774ed9d640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f774800e820 tx=0x7f774800ece0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f77480138e0 mon_map magic: 0 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 10 monclient: dump: 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:22.235 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 10 monclient: _finish_auth 0 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 5 monclient: authenticate success, global_id 5402 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774800cdb0 con 0x7f77500a60f0 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f773effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:22.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 10 monclient: _renew_subs 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7750120db0 con 0x7f77500a60f0 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f774cd99640 4 set_mon_vals no callback set 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 10 monclient: _renew_subs 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.217+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7750123830 con 0x7f77500a60f0 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77480138e0 con 0x7f77500a60f0 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f773effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f773effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f773effd640 10 monclient: dump: 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:22.237 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:22.238 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f7754fde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f774801a070 con 0x7f77500a60f0 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f7754fde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f7754fde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77500a17d0 con 0x7f77500a60f0 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.218+0000 7f773effd640 1 --2- 172.21.15.71:0/2236902266 >> v2:172.21.15.135:6800/726754104 conn(0x7f773003ead0 0x7f7730040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.219+0000 7f774e59c640 1 --2- 172.21.15.71:0/2236902266 >> v2:172.21.15.135:6800/726754104 conn(0x7f773003ead0 0x7f7730040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.219+0000 7f774e59c640 10 monclient: get_auth_request con 0x7f773003ead0 auth_method 0 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.221+0000 7f774e59c640 1 --2- 172.21.15.71:0/2236902266 >> v2:172.21.15.135:6800/726754104 conn(0x7f773003ead0 0x7f7730040f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7740034000 tx=0x7f774002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:22.223+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f774800f040 con 0x7f77500a60f0 2024-08-19T11:13:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.046+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f774801ac80 con 0x7f77500a60f0 2024-08-19T11:13:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.046+0000 7f773effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:23.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.046+0000 7f773effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.291+0000 7f7754fde640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.291+0000 7f7754fde640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.291+0000 7f7754fde640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.291+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f775006fd90 con 0x7f77500a60f0 2024-08-19T11:13:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.292+0000 7f773effd640 1 -- 172.21.15.71:0/2236902266 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f7748050e10 con 0x7f77500a60f0 2024-08-19T11:13:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.292+0000 7f773effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.292+0000 7f773effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:23.296 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":62,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 >> v2:172.21.15.135:6800/726754104 conn(0x7f773003ead0 msgr2=0x7f7730040f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 --2- 172.21.15.71:0/2236902266 >> v2:172.21.15.135:6800/726754104 conn(0x7f773003ead0 0x7f7730040f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7740034000 tx=0x7f774002f000 comp rx=0 tx=0).stop 2024-08-19T11:13:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 10 monclient: shutdown 2024-08-19T11:13:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 msgr2=0x7f7750136c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f774800e820 tx=0x7f774800ece0 comp rx=0 tx=0).stop 2024-08-19T11:13:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 shutdown_connections 2024-08-19T11:13:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 --2- 172.21.15.71:0/2236902266 >> v2:172.21.15.135:6800/726754104 conn(0x7f773003ead0 0x7f7730040f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77500a60f0 0x7f7750136c50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77500a57d0 0x7f7750136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 --2- 172.21.15.71:0/2236902266 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7750072400 0x7f77501228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 >> 172.21.15.71:0/2236902266 conn(0x7f77500aa3f0 msgr2=0x7f77501bfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 shutdown_connections 2024-08-19T11:13:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:23.294+0000 7f7754fde640 1 -- 172.21.15.71:0/2236902266 wait complete. 2024-08-19T11:13:26.308 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:26.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.415+0000 7f63333f2640 10 monclient: get_monmap_and_config 2024-08-19T11:13:26.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.415+0000 7f63333f2640 10 monclient: build_initial_monmap 2024-08-19T11:13:26.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.415+0000 7f63333f2640 10 monclient: monmap: 2024-08-19T11:13:26.417 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:26.417172+0000 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:26.417172+0000 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:26.418 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:26.419 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:26.419 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:26.419 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:26.419 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:26.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 Processor -- start 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 -- start start 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient: init 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient: _add_conns ranks=[3,0,4,10,5,9,7,8,6,1,2] 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 0x7f632c0a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): picked mon.noname-g con 0x7f632c0a57d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f632c072400 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 0x7f632c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): picked mon.noname-c con 0x7f632c0a62c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c0741c0 con 0x7f632c072400 2024-08-19T11:13:26.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f632c072880 con 0x7f632c0a57d0 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f632c0a72a0 con 0x7f632c0a62c0 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f63333f2640 10 monclient(hunting): authenticate will time out at 864.458889s 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f633198f640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 msgr2=0x7f632c13ea50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.416+0000 7f633198f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 0x7f632c13ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.417+0000 7f633118e640 1 -- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 msgr2=0x7f632c0a17d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.417+0000 7f633098d640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f632c072400 0x7f632c0a5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38120/0 (socket says 172.21.15.71:38120) 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.417+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 learned_addr learned my addr 172.21.15.71:0/3077991435 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.417+0000 7f633118e640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 0x7f632c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:26.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.419+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 >> v1:172.21.15.71:6789/0 conn(0x7f632c072400 legacy=0x7f632c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:26.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.618+0000 7f633198f640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 msgr2=0x7f632c13ea50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:26.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.618+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 0x7f632c13ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:26.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.618+0000 7f633118e640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 msgr2=0x7f632c0a17d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:26.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:26.618+0000 7f633118e640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 0x7f632c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:13:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.019+0000 7f633118e640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 msgr2=0x7f632c0a17d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.019+0000 7f633118e640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 0x7f632c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.020+0000 7f633198f640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 msgr2=0x7f632c13ea50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:27.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.020+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 0x7f632c13ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:13:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.821+0000 7f633118e640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 msgr2=0x7f632c0a17d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.821+0000 7f633118e640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 0x7f632c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.821+0000 7f633198f640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 msgr2=0x7f632c13ea50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:27.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:27.821+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 0x7f632c13ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:13:29.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 10 monclient(hunting): tick 2024-08-19T11:13:29.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:13:29.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:13:29.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:13:29.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 msgr2=0x7f632c13ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f632c0a62c0 0x7f632c13ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 msgr2=0x7f632c0a17d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f632c0a57d0 0x7f632c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.416+0000 7f6322ffd640 1 -- 172.21.15.71:0/3077991435 >> v1:172.21.15.71:6789/0 conn(0x7f632c072400 legacy=0x7f632c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient: _add_conns ranks=[1,6,7,9,5,10,2,8] 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f63100038c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient(hunting): picked mon.noname-d con 0x7f63100074f0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 0x7f631000c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient(hunting): picked mon.noname-i con 0x7f631000a010 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 1 -- 172.21.15.71:0/3077991435 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c13ffa0 con 0x7f63100038c0 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:29.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 1 -- 172.21.15.71:0/3077991435 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f632c0a72a0 con 0x7f63100074f0 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 1 -- 172.21.15.71:0/3077991435 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f631000dce0 con 0x7f631000a010 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f6322ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 10 monclient(hunting): get_auth_request con 0x7f63100074f0 auth_method 0 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 msgr2=0x7f6310009960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 msgr2=0x7f6310009960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 0x7f631000c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 10 monclient(hunting): get_auth_request con 0x7f631000a010 auth_method 0 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633098d640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 msgr2=0x7f631000c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 msgr2=0x7f631000c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 0x7f631000c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.417+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 0x7f631000c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:29.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.419+0000 7f633118e640 1 -- 172.21.15.71:0/3077991435 >> v1:172.21.15.135:6789/0 conn(0x7f63100038c0 legacy=0x7f6310005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): get_auth_request con 0x7f63100074f0 auth_method 0 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:29.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633198f640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 0x7f631000c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633198f640 10 monclient(hunting): get_auth_request con 0x7f631000a010 auth_method 0 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633198f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633198f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient(hunting): handle_auth_done global_id 24693 payload 274 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 msgr2=0x7f631000c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f631000a010 0x7f631000c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 >> v1:172.21.15.135:6789/0 conn(0x7f63100038c0 legacy=0x7f6310005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 1 monclient: found mon.noname-d 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:29.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:29.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631000df40 con 0x7f63100074f0 2024-08-19T11:13:29.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.618+0000 7f633198f640 1 -- 172.21.15.71:0/3077991435 reap_dead start 2024-08-19T11:13:29.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.621+0000 7f633098d640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 msgr2=0x7f6310009960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:29.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.621+0000 7f633098d640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f632c0aae80 tx=0x7f632802a360 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c73895950ae9d8e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:29.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.621+0000 7f6323fff640 1 -- 172.21.15.71:0/3077991435 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:13:29.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 1 -- 172.21.15.71:0/3077991435 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6328037070 con 0x7f63100074f0 2024-08-19T11:13:29.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: dump: 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:29.626 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: _finish_auth 0 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 1 -- 172.21.15.71:0/3077991435 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63280307b0 con 0x7f63100074f0 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f63333f2640 5 monclient: authenticate success, global_id 24693 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f63333f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:29.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f63333f2640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 1 -- 172.21.15.71:0/3077991435 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6328030dd0 con 0x7f63100074f0 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f63333f2640 4 set_mon_vals no callback set 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.623+0000 7f6323fff640 10 monclient: dump: 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:29.628 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:29.629 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:29.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 10 monclient: shutdown 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 -- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 msgr2=0x7f6310009960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f632c0aae80 tx=0x7f632802a360 comp rx=0 tx=0).stop 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 -- 172.21.15.71:0/3077991435 shutdown_connections 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 --2- 172.21.15.71:0/3077991435 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63100074f0 0x7f6310009960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 -- 172.21.15.71:0/3077991435 >> 172.21.15.71:0/3077991435 conn(0x7f632c0aa3f0 msgr2=0x7f632c0a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 -- 172.21.15.71:0/3077991435 shutdown_connections 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.624+0000 7f63333f2640 1 -- 172.21.15.71:0/3077991435 wait complete. 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.625+0000 7f63333f2640 10 monclient: build_initial_monmap 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.625+0000 7f63333f2640 10 monclient: monmap: 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:29.635 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:29.636 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.625+0000 7f63333f2640 1 Processor -- start 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.625+0000 7f63333f2640 1 -- start start 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.625+0000 7f63333f2640 10 monclient: init 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient: _add_conns ranks=[3,2,1,0,4,5,7,8,6] 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63100074f0 0x7f632c13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): picked mon.noname-g con 0x7f63100074f0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:29.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 0x7f632c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): picked mon.noname-b con 0x7f632c1cc4e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c138b80 0x7f632c139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): picked mon.noname-f con 0x7f632c138b80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0a1b60 con 0x7f632c138b80 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f632c0a19e0 con 0x7f632c1cc4e0 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f632c0a5bb0 con 0x7f63100074f0 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f63333f2640 10 monclient(hunting): authenticate will time out at 867.668282s 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633118e640 1 -- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63100074f0 msgr2=0x7f632c13ef10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:29.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633118e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63100074f0 0x7f632c13ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 0x7f632c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 0x7f632c13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:45964/0 (socket says 172.21.15.71:45964) 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 -- 172.21.15.71:0/3007925492 learned_addr learned my addr 172.21.15.71:0/3007925492 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): get_auth_request con 0x7f632c1cc4e0 auth_method 0 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c138b80 0x7f632c139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): get_auth_request con 0x7f632c138b80 auth_method 0 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:29.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633198f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient(hunting): handle_auth_done global_id 5411 payload 824 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 -- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63100074f0 msgr2=0x7f632c13ef10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63100074f0 0x7f632c13ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 -- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c138b80 msgr2=0x7f632c139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c138b80 0x7f632c139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient: _finish_hunting 0 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 monclient: found mon.noname-b 2024-08-19T11:13:29.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.626+0000 7f633098d640 1 -- 172.21.15.71:0/3007925492 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c1cd190 con 0x7f632c1cc4e0 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f633098d640 1 -- 172.21.15.71:0/3007925492 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 msgr2=0x7f632c13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f633098d640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 0x7f632c13f450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f63280010e0 tx=0x7f63280014d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6328040030 con 0x7f632c1cc4e0 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: dump: 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.641 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:29.642 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: _finish_auth 0 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328004c50 con 0x7f632c1cc4e0 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 5 monclient: authenticate success, global_id 5411 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 10 monclient: _renew_subs 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c13c9d0 con 0x7f632c1cc4e0 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6328037040 con 0x7f632c1cc4e0 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:29.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f6321ffb640 10 monclient: dump: 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:29.644 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63237fe640 4 set_mon_vals no callback set 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 10 monclient: _renew_subs 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.629+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c13f990 con 0x7f632c1cc4e0 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f63333f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f63333f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f63333f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c0a5f40 con 0x7f632c1cc4e0 2024-08-19T11:13:29.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6328043070 con 0x7f632c1cc4e0 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f6321ffb640 1 --2- 172.21.15.71:0/3007925492 >> v2:172.21.15.135:6800/726754104 conn(0x7f6310040070 0x7f6310042530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f6328041070 con 0x7f632c1cc4e0 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f633118e640 1 --2- 172.21.15.71:0/3007925492 >> v2:172.21.15.135:6800/726754104 conn(0x7f6310040070 0x7f6310042530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.631+0000 7f633118e640 10 monclient: get_auth_request con 0x7f6310040070 auth_method 0 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.634+0000 7f633118e640 1 --2- 172.21.15.71:0/3007925492 >> v2:172.21.15.135:6800/726754104 conn(0x7f6310040070 0x7f6310042530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f631c003a00 tx=0x7f631c0090c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.636+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f632804a020 con 0x7f632c1cc4e0 2024-08-19T11:13:29.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.636+0000 7f6321ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:29.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.636+0000 7f6321ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f63333f2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f63333f2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f63333f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f632c13b7b0 con 0x7f632c1cc4e0 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f6321ffb640 1 -- 172.21.15.71:0/3007925492 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7f632803c410 con 0x7f632c1cc4e0 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f6321ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:29.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.889+0000 7f6321ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:29.892 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":66,"quorum":[0,1,2,6,7,8],"quorum_names":["a","f","b","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 >> v2:172.21.15.135:6800/726754104 conn(0x7f6310040070 msgr2=0x7f6310042530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 --2- 172.21.15.71:0/3007925492 >> v2:172.21.15.135:6800/726754104 conn(0x7f6310040070 0x7f6310042530 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f631c003a00 tx=0x7f631c0090c0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 10 monclient: shutdown 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 msgr2=0x7f632c13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 0x7f632c13f450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f63280010e0 tx=0x7f63280014d0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 shutdown_connections 2024-08-19T11:13:29.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 --2- 172.21.15.71:0/3007925492 >> v2:172.21.15.135:6800/726754104 conn(0x7f6310040070 0x7f6310042530 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c138b80 0x7f632c139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f632c1cc4e0 0x7f632c13f450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 --2- 172.21.15.71:0/3007925492 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63100074f0 0x7f632c13ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:29.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 >> 172.21.15.71:0/3007925492 conn(0x7f632c0aa3f0 msgr2=0x7f632c0a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:29.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 shutdown_connections 2024-08-19T11:13:29.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:29.891+0000 7f63333f2640 1 -- 172.21.15.71:0/3007925492 wait complete. 2024-08-19T11:13:29.905 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-08-19T11:13:29.905 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon a 2024-08-19T11:13:29.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.002+0000 7f5f96acc640 10 monclient: get_monmap_and_config 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.002+0000 7f5f96acc640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.002+0000 7f5f96acc640 10 monclient: monmap: 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:30.003898+0000 2024-08-19T11:13:30.004 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:30.003898+0000 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:30.005 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:30.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.002+0000 7f5f96acc640 1 Processor -- start 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 1 -- start start 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient: init 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient: _add_conns ranks=[2,10,0,8,3,6,9,5,1,4,7] 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 0x7f5f900a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): picked mon.noname-b con 0x7f5f900a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5f900a57c0 0x7f5f900a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): picked mon.noname-f con 0x7f5f900a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f90139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f900a6380 con 0x7f5f90139710 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5f900a5020 con 0x7f5f900a57c0 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5f900a77b0 con 0x7f5f900a6950 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f96acc640 10 monclient(hunting): authenticate will time out at 868.045586s 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 0x7f5f900a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f95069640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5f90139710 0x7f5f90139b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:38132/0 (socket says 172.21.15.71:38132) 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 0x7f5f900a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:45972/0 (socket says 172.21.15.71:45972) 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f95069640 1 -- 172.21.15.71:0/134852369 learned_addr learned my addr 172.21.15.71:0/134852369 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): get_auth_request con 0x7f5f900a6950 auth_method 0 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f8ffff640 1 --2- 172.21.15.71:0/134852369 >> v2:172.21.15.135:3300/0 conn(0x7f5f900a57c0 0x7f5f900a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 10 monclient(hunting): handle_auth_done global_id 5420 payload 274 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 1 -- 172.21.15.71:0/134852369 >> v2:172.21.15.135:3300/0 conn(0x7f5f900a57c0 msgr2=0x7f5f900a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 1 --2- 172.21.15.71:0/134852369 >> v2:172.21.15.135:3300/0 conn(0x7f5f900a57c0 0x7f5f900a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.003+0000 7f5f94868640 1 -- 172.21.15.71:0/134852369 >> v1:172.21.15.71:6789/0 conn(0x7f5f90139710 legacy=0x7f5f90139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.004+0000 7f5f94868640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.004+0000 7f5f94868640 1 monclient: found mon.noname-b 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.004+0000 7f5f94868640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.004+0000 7f5f94868640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.004+0000 7f5f94868640 1 -- 172.21.15.71:0/134852369 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f900a3650 con 0x7f5f900a6950 2024-08-19T11:13:30.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f94868640 1 -- 172.21.15.71:0/134852369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 msgr2=0x7f5f900a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f94868640 1 --2- 172.21.15.71:0/134852369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 0x7f5f900a6d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f840097d0 tx=0x7f5f8402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5ac7e5c48a455d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 1 -- 172.21.15.71:0/134852369 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f84037070 con 0x7f5f900a6950 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: dump: 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.013 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f96acc640 5 monclient: authenticate success, global_id 5420 2024-08-19T11:13:30.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 1 -- 172.21.15.71:0/134852369 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8402ae00 con 0x7f5f900a6950 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f96acc640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 1 -- 172.21.15.71:0/134852369 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f84030c20 con 0x7f5f900a6950 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f96acc640 4 set_mon_vals no callback set 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.006+0000 7f5f8f7fe640 10 monclient: dump: 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.015 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 10 monclient: shutdown 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 -- 172.21.15.71:0/134852369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 msgr2=0x7f5f900a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 --2- 172.21.15.71:0/134852369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 0x7f5f900a6d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f840097d0 tx=0x7f5f8402a000 comp rx=0 tx=0).stop 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 -- 172.21.15.71:0/134852369 shutdown_connections 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 --2- 172.21.15.71:0/134852369 >> v2:172.21.15.135:3300/0 conn(0x7f5f900a57c0 0x7f5f900a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 --2- 172.21.15.71:0/134852369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f900a6950 0x7f5f900a6d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 -- 172.21.15.71:0/134852369 >> 172.21.15.71:0/134852369 conn(0x7f5f900abf50 msgr2=0x7f5f900ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 -- 172.21.15.71:0/134852369 shutdown_connections 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.007+0000 7f5f96acc640 1 -- 172.21.15.71:0/134852369 wait complete. 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.008+0000 7f5f96acc640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.008+0000 7f5f96acc640 10 monclient: monmap: 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.017 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.018 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:30.018 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:30.018 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.018 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.018 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.018 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.019 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.019 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.019 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.019 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.008+0000 7f5f96acc640 1 Processor -- start 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.008+0000 7f5f96acc640 1 -- start start 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.008+0000 7f5f96acc640 10 monclient: init 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient: _add_conns ranks=[0,1,8,5,2,7,4,6,3] 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 0x7f5f901382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): picked mon.noname-a con 0x7f5f900a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f900a6950 0x7f5f90138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): picked mon.noname-f con 0x7f5f900a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f90139710 0x7f5f901225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): picked mon.noname-e con 0x7f5f90139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900a84c0 con 0x7f5f900a57c0 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900a7d40 con 0x7f5f900a6950 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f5f900a8700 con 0x7f5f90139710 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f96acc640 10 monclient(hunting): authenticate will time out at 868.051111s 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 0x7f5f901382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f90139710 0x7f5f901225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 0x7f5f901382c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41042/0 (socket says 172.21.15.71:41042) 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 -- 172.21.15.71:0/3063987284 learned_addr learned my addr 172.21.15.71:0/3063987284 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): get_auth_request con 0x7f5f900a57c0 auth_method 0 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): get_auth_request con 0x7f5f90139710 auth_method 0 2024-08-19T11:13:30.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f95069640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f8ffff640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f900a6950 0x7f5f90138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f8ffff640 10 monclient(hunting): get_auth_request con 0x7f5f900a6950 auth_method 0 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient(hunting): handle_auth_done global_id 34272 payload 824 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f90139710 msgr2=0x7f5f901225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f90139710 0x7f5f901225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f900a6950 msgr2=0x7f5f90138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f900a6950 0x7f5f90138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 monclient: found mon.noname-a 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.009+0000 7f5f94868640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f90125e60 con 0x7f5f900a57c0 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f94868640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 msgr2=0x7f5f901382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f94868640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 0x7f5f901382c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f840098f0 tx=0x7f5f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f84037050 con 0x7f5f900a57c0 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:30.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 10 monclient: dump: 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.031 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f96acc640 5 monclient: authenticate success, global_id 34272 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84043070 con 0x7f5f900a57c0 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f84030c20 con 0x7f5f900a57c0 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f96acc640 10 monclient: _renew_subs 2024-08-19T11:13:30.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f96acc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f90126140 con 0x7f5f900a57c0 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.011+0000 7f5f8effd640 4 set_mon_vals no callback set 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8d7fa640 10 monclient: dump: 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.033 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 10 monclient: _renew_subs 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f90125b80 con 0x7f5f900a57c0 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 0x7f5f9002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90076c60 con 0x7f5f901232a0 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5f84030340 con 0x7f5f900a57c0 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8ffff640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 0x7f5f9002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8ffff640 10 monclient: get_auth_request con 0x7f5f901232a0 auth_method 0 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.012+0000 7f5f8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8d7fa640 1 --2- 172.21.15.71:0/3063987284 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f7403eab0 0x7f5f74040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_done global_id 34281 payload 824 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8ffff640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f900a6d30 con 0x7f5f901232a0 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7f5f84071f20 con 0x7f5f900a57c0 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f95069640 1 --2- 172.21.15.71:0/3063987284 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f7403eab0 0x7f5f74040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.013+0000 7f5f95069640 10 monclient: get_auth_request con 0x7f5f7403eab0 auth_method 0 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8ffff640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 msgr2=0x7f5f9002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8ffff640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 0x7f5f9002d1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e7a0 tx=0x7f5f7c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f7c00abf0 con 0x7f5f901232a0 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 10 monclient: dump: 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.037 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f7c01a070 con 0x7f5f901232a0 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 msgr2=0x7f5f9002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 0x7f5f9002d1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e7a0 tx=0x7f5f7c00ec60 comp rx=0 tx=0).stop 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 msgr2=0x7f5f9002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.015+0000 7f5f8d7fa640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f901232a0 0x7f5f9002d1c0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e7a0 tx=0x7f5f7c00ec60 comp rx=0 tx=0).stop 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.016+0000 7f5f95069640 1 --2- 172.21.15.71:0/3063987284 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f7403eab0 0x7f5f74040f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f880055a0 tx=0x7f5f88005530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f96acc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f96acc640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 0x7f5f9002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f96acc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9009e100 con 0x7f5f90123680 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f8ffff640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 0x7f5f9002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f8ffff640 10 monclient: get_auth_request con 0x7f5f90123680 auth_method 0 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f8ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.021+0000 7f5f8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.022+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.022+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.022+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.022+0000 7f5f8ffff640 10 monclient(hunting): handle_auth_done global_id 34290 payload 824 2024-08-19T11:13:30.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.022+0000 7f5f8ffff640 1 -- 172.21.15.71:0/3063987284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f90139080 con 0x7f5f90123680 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8ffff640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 msgr2=0x7f5f9002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8ffff640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 0x7f5f9002d700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e7a0 tx=0x7f5f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f7c025070 con 0x7f5f90123680 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 10 monclient: dump: 2024-08-19T11:13:30.041 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.042 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9569 (secure 0 0 0) 0x7f5f7c00a780 con 0x7f5f90123680 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 msgr2=0x7f5f9002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 0x7f5f9002d700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e7a0 tx=0x7f5f7c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 msgr2=0x7f5f9002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.024+0000 7f5f8d7fa640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f90123680 0x7f5f9002d700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 66, 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45541, 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:30.044 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.045 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.046 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:30.047 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.048 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:30.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:30.052 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.056 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.060 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:30.070 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f7403eab0 msgr2=0x7f5f74040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 --2- 172.21.15.71:0/3063987284 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f7403eab0 0x7f5f74040f70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f880055a0 tx=0x7f5f88005530 comp rx=0 tx=0).stop 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 10 monclient: shutdown 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 msgr2=0x7f5f901382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 --2- 172.21.15.71:0/3063987284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900a57c0 0x7f5f901382c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f840098f0 tx=0x7f5f840046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f95069640 1 -- 172.21.15.71:0/3063987284 reap_dead start 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f95069640 1 -- 172.21.15.71:0/3063987284 reap_dead start 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 shutdown_connections 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 >> 172.21.15.71:0/3063987284 conn(0x7f5f900abf50 msgr2=0x7f5f900aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 shutdown_connections 2024-08-19T11:13:30.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.025+0000 7f5f96acc640 1 -- 172.21.15.71:0/3063987284 wait complete. 2024-08-19T11:13:30.073 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:13:30.073 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2024-08-19T11:13:30.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:13:30.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.170+0000 7f0bbbf28640 10 monclient: get_monmap_and_config 2024-08-19T11:13:30.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.170+0000 7f0bbbf28640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.170+0000 7f0bbbf28640 10 monclient: monmap: 2024-08-19T11:13:30.172 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:30.172143+0000 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:30.172143+0000 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:30.174 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 Processor -- start 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 -- start start 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient: init 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient: _add_conns ranks=[6,8,9,2,5,3,10,1,4,7,0] 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a6950 0x7f0bb40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): picked mon.noname-d con 0x7f0bb40a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0bb40a57c0 0x7f0bb40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): picked mon.noname-e con 0x7f0bb40a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0bb4139710 0x7f0bb4139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): picked mon.noname-a con 0x7f0bb4139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb40a5020 con 0x7f0bb4139710 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f0bb40a77b0 con 0x7f0bb40a6950 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0bb40a7d40 con 0x7f0bb40a57c0 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bbbf28640 10 monclient(hunting): authenticate will time out at 868.213791s 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0bb4139710 0x7f0bb4139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb94c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0bb40a57c0 0x7f0bb40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0bb4139710 0x7f0bb4139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41064/0 (socket says 172.21.15.71:41064) 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb9cc4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a6950 0x7f0bb40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 1 -- 172.21.15.71:0/3988325679 learned_addr learned my addr 172.21.15.71:0/3988325679 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb94c3640 10 monclient(hunting): get_auth_request con 0x7f0bb40a57c0 auth_method 0 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb94c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb94c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb94c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 10 monclient(hunting): get_auth_request con 0x7f0bb4139710 auth_method 0 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bba4c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.171+0000 7f0bb9cc4640 10 monclient(hunting): get_auth_request con 0x7f0bb40a6950 auth_method 0 2024-08-19T11:13:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_done global_id 34299 payload 274 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 1 -- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0bb40a57c0 msgr2=0x7f0bb40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0bb40a57c0 0x7f0bb40a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 1 -- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a6950 msgr2=0x7f0bb40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a6950 0x7f0bb40a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 1 monclient: found mon.noname-a 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bba4c5640 1 -- 172.21.15.71:0/3988325679 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb40a6380 con 0x7f0bb4139710 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb94c3640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0bb40a57c0 0x7f0bb40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.172+0000 7f0bb9cc4640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a6950 0x7f0bb40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:30.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bba4c5640 1 -- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 msgr2=0x7f0bb4139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bba4c5640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 0x7f0bb4139b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009e80 tx=0x7f0bac02a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c6bd37804763a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 1 -- 172.21.15.71:0/3988325679 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bac036070 con 0x7f0bb4139710 2024-08-19T11:13:30.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:30.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: dump: 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.188 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 1 -- 172.21.15.71:0/3988325679 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bac007a70 con 0x7f0bb4139710 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 5 monclient: authenticate success, global_id 34299 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:30.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 1 -- 172.21.15.71:0/3988325679 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bac007ca0 con 0x7f0bb4139710 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 4 set_mon_vals no callback set 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bb8cc2640 10 monclient: dump: 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.190 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.191 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.191 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.191 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.191 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.191 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 10 monclient: shutdown 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 -- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 msgr2=0x7f0bb4139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 0x7f0bb4139b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009e80 tx=0x7f0bac02a580 comp rx=0 tx=0).stop 2024-08-19T11:13:30.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 -- 172.21.15.71:0/3988325679 shutdown_connections 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 0x7f0bb4139b30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0bb40a57c0 0x7f0bb40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/3988325679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a6950 0x7f0bb40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 -- 172.21.15.71:0/3988325679 >> 172.21.15.71:0/3988325679 conn(0x7f0bb40abf50 msgr2=0x7f0bb40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 -- 172.21.15.71:0/3988325679 shutdown_connections 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.175+0000 7f0bbbf28640 1 -- 172.21.15.71:0/3988325679 wait complete. 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.176+0000 7f0bbbf28640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.176+0000 7f0bbbf28640 10 monclient: monmap: 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:30.193 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.194 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.176+0000 7f0bbbf28640 1 Processor -- start 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.176+0000 7f0bbbf28640 1 -- start start 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.176+0000 7f0bbbf28640 10 monclient: init 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient: _add_conns ranks=[6,7,0,4,3,5,2,8,1] 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): picked mon.noname-d con 0x7f0bb40a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:30.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0bb40a6950 0x7f0bb41388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): picked mon.noname-i con 0x7f0bb40a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 0x7f0bb4138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): picked mon.noname-a con 0x7f0bb4139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb40a84c0 con 0x7f0bb4139710 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f0bb40a3650 con 0x7f0bb40a57c0 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0bb40a8700 con 0x7f0bb40a6950 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bbbf28640 10 monclient(hunting): authenticate will time out at 868.219230s 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47672/0 (socket says 172.21.15.71:47672) 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 -- 172.21.15.71:0/1357759004 learned_addr learned my addr 172.21.15.71:0/1357759004 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): get_auth_request con 0x7f0bb40a57c0 auth_method 0 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 0x7f0bb4138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): get_auth_request con 0x7f0bb4139710 auth_method 0 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bba4c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient(hunting): handle_auth_done global_id 24711 payload 824 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0bb40a6950 msgr2=0x7f0bb41388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0bb40a6950 0x7f0bb41388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 msgr2=0x7f0bb4138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bb4139710 0x7f0bb4138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 monclient: found mon.noname-d 2024-08-19T11:13:30.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.177+0000 7f0bb9cc4640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb413a1c0 con 0x7f0bb40a57c0 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0bb9cc4640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 msgr2=0x7f0bb41ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0bb9cc4640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000ebe0 tx=0x7f0bb000c520 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bb0017070 con 0x7f0bb40a57c0 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 10 monclient: dump: 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.199 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0bbbf28640 5 monclient: authenticate success, global_id 24711 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb000ce40 con 0x7f0bb40a57c0 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0bbbf28640 10 monclient: _renew_subs 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0bbbf28640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb4124f60 con 0x7f0bb40a57c0 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.179+0000 7f0baa7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0bb0013d50 con 0x7f0bb40a57c0 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0baa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0baa7fc640 10 monclient: dump: 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.201 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.202 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bab7fe640 4 set_mon_vals no callback set 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 10 monclient: _renew_subs 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb41262b0 con 0x7f0bb40a57c0 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 0x7f0bb402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb40a1cd0 con 0x7f0bb4122d60 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb9cc4640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000ebe0 tx=0x7f0bb000c520 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f0bb000f040 osd_map(87..87 src has 1..87) 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 0x7f0bb402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0bb001a070 con 0x7f0bb40a57c0 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient: get_auth_request con 0x7f0bb4122d60 auth_method 0 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.180+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.181+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_done global_id 5429 payload 824 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.181+0000 7f0bb94c3640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bb40a6d30 con 0x7f0bb4122d60 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.181+0000 7f0baa7fc640 1 --2- 172.21.15.71:0/1357759004 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b9803ea80 0x7f0b98040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.181+0000 7f0bba4c5640 1 --2- 172.21.15.71:0/1357759004 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b9803ea80 0x7f0b98040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.181+0000 7f0bba4c5640 10 monclient: get_auth_request con 0x7f0b9803ea80 auth_method 0 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0bb94c3640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 msgr2=0x7f0bb402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0bb94c3640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 0x7f0bb402d1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bb41245c0 tx=0x7f0ba400ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ba4017070 con 0x7f0bb4122d60 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 10 monclient: dump: 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.205 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0ba400cac0 con 0x7f0bb4122d60 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:30.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 msgr2=0x7f0bb402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 0x7f0bb402d1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bb41245c0 tx=0x7f0ba400ec00 comp rx=0 tx=0).stop 2024-08-19T11:13:30.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 msgr2=0x7f0bb402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0baa7fc640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4122d60 0x7f0bb402d1c0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bb41245c0 tx=0x7f0ba400ec00 comp rx=0 tx=0).stop 2024-08-19T11:13:30.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.183+0000 7f0bba4c5640 1 --2- 172.21.15.71:0/1357759004 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b9803ea80 0x7f0b98040f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0bac033000 tx=0x7f0bac009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bbbf28640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 0x7f0bb402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bbbf28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb4076c60 con 0x7f0bb4123140 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 0x7f0bb402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient: get_auth_request con 0x7f0bb4123140 auth_method 0 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.189+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.190+0000 7f0bb94c3640 10 monclient(hunting): handle_auth_done global_id 5438 payload 824 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.190+0000 7f0bb94c3640 1 -- 172.21.15.71:0/1357759004 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0bb4126090 con 0x7f0bb4123140 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0bb94c3640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 msgr2=0x7f0bb402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0bb94c3640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 0x7f0bb402d700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4019000 tx=0x7f0ba40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ba4017070 con 0x7f0bb4123140 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 10 monclient: dump: 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.210 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.211 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9234 (secure 0 0 0) 0x7f0ba4006690 con 0x7f0bb4123140 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 msgr2=0x7f0bb402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 0x7f0bb402d700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4019000 tx=0x7f0ba40046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 msgr2=0x7f0bb402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.192+0000 7f0baa7fc640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0bb4123140 0x7f0bb402d700 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4019000 tx=0x7f0ba40046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 66, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 207072, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.223 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:30.237 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b9803ea80 msgr2=0x7f0b98040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/1357759004 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b9803ea80 0x7f0b98040f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0bac033000 tx=0x7f0bac009000 comp rx=0 tx=0).stop 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 10 monclient: shutdown 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 msgr2=0x7f0bb41ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000ebe0 tx=0x7f0bb000c520 comp rx=0 tx=0).stop 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bba4c5640 1 -- 172.21.15.71:0/1357759004 reap_dead start 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0baa7fc640 1 -- 172.21.15.71:0/1357759004 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (unknown 0 0 0) 0x7f0bb000f040 con 0x7f0bb40a57c0 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 shutdown_connections 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 --2- 172.21.15.71:0/1357759004 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0bb40a57c0 0x7f0bb41ce080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 >> 172.21.15.71:0/1357759004 conn(0x7f0bb40abf50 msgr2=0x7f0bb40aa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 shutdown_connections 2024-08-19T11:13:30.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.193+0000 7f0bbbf28640 1 -- 172.21.15.71:0/1357759004 wait complete. 2024-08-19T11:13:30.240 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:13:30.240 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2024-08-19T11:13:30.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:13:30.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.337+0000 7fb5a7d8a640 10 monclient: get_monmap_and_config 2024-08-19T11:13:30.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.337+0000 7fb5a7d8a640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.337+0000 7fb5a7d8a640 10 monclient: monmap: 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:30.338847+0000 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:30.338847+0000 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.337+0000 7fb5a7d8a640 1 Processor -- start 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 1 -- start start 2024-08-19T11:13:30.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient: init 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient: _add_conns ranks=[5,6,1,10,0,3,7,9,8,4,2] 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5a00a6950 0x7fb5a00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): picked mon.noname-h con 0x7fb5a00a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 0x7fb5a00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): picked mon.noname-d con 0x7fb5a00a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb5a0139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:30.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a00a6380 con 0x7fb5a0139710 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb5a00a5020 con 0x7fb5a00a6950 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb5a00a77b0 con 0x7fb5a00a57c0 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a7d8a640 10 monclient(hunting): authenticate will time out at 868.380638s 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 0x7fb5a00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5b26640 1 -- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5a00a6950 msgr2=0x7fb5a00a6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3302/0 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 0x7fb5a00a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47686/0 (socket says 172.21.15.71:47686) 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 1 -- 172.21.15.71:0/1829261108 learned_addr learned my addr 172.21.15.71:0/1829261108 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): get_auth_request con 0x7fb5a00a57c0 auth_method 0 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5b26640 1 --2- 172.21.15.71:0/1829261108 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5a00a6950 0x7fb5a00a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a4b24640 1 -- 172.21.15.71:0/1829261108 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.338+0000 7fb5a5325640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 10 monclient(hunting): handle_auth_done global_id 24720 payload 274 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 1 -- 172.21.15.71:0/1829261108 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5a00a6950 msgr2=0x7fb5a00a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 1 --2- 172.21.15.71:0/1829261108 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5a00a6950 0x7fb5a00a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 1 -- 172.21.15.71:0/1829261108 >> v1:172.21.15.135:6789/0 conn(0x7fb5a0139710 legacy=0x7fb5a0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 1 monclient: found mon.noname-d 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.339+0000 7fb5a5325640 1 -- 172.21.15.71:0/1829261108 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a00a3650 con 0x7fb5a00a57c0 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.341+0000 7fb5a5325640 1 -- 172.21.15.71:0/1829261108 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 msgr2=0x7fb5a00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.341+0000 7fb5a5325640 1 --2- 172.21.15.71:0/1829261108 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 0x7fb5a00a7270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0098d0 tx=0x7fb59c02a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=f00fdc0d82344cc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.341+0000 7fb5a4b24640 1 -- 172.21.15.71:0/1829261108 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb59c037070 con 0x7fb5a00a57c0 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.341+0000 7fb5a4b24640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.341+0000 7fb5a4b24640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.341+0000 7fb5a4b24640 10 monclient: dump: 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.348 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.349 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 1 -- 172.21.15.71:0/1829261108 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59c0307b0 con 0x7fb5a00a57c0 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 5 monclient: authenticate success, global_id 24720 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 1 -- 172.21.15.71:0/1829261108 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb59c030e50 con 0x7fb5a00a57c0 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 4 set_mon_vals no callback set 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a4b24640 10 monclient: dump: 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.351 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 10 monclient: shutdown 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/1829261108 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 msgr2=0x7fb5a00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/1829261108 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 0x7fb5a00a7270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0098d0 tx=0x7fb59c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/1829261108 shutdown_connections 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/1829261108 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a00a57c0 0x7fb5a00a7270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/1829261108 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5a00a6950 0x7fb5a00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/1829261108 >> 172.21.15.71:0/1829261108 conn(0x7fb5a00abf50 msgr2=0x7fb5a00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/1829261108 shutdown_connections 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.342+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/1829261108 wait complete. 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.343+0000 7fb5a7d8a640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.343+0000 7fb5a7d8a640 10 monclient: monmap: 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.353 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.343+0000 7fb5a7d8a640 1 Processor -- start 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.343+0000 7fb5a7d8a640 1 -- start start 2024-08-19T11:13:30.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.343+0000 7fb5a7d8a640 10 monclient: init 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient: _add_conns ranks=[7,0,6,2,8,4,1,3,5] 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5a00a57c0 0x7fb5a01281d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): picked mon.noname-i con 0x7fb5a00a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 0x7fb5a0125cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): picked mon.noname-a con 0x7fb5a00a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0139710 0x7fb5a0126230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): picked mon.noname-d con 0x7fb5a0139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00a84c0 con 0x7fb5a00a6950 2024-08-19T11:13:30.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb5a00a7d40 con 0x7fb5a0139710 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fb5a00a8700 con 0x7fb5a00a57c0 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a7d8a640 10 monclient(hunting): authenticate will time out at 868.386153s 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0139710 0x7fb5a0126230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 0x7fb5a0125cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 0x7fb5a0125cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41078/0 (socket says 172.21.15.71:41078) 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 -- 172.21.15.71:0/2862875428 learned_addr learned my addr 172.21.15.71:0/2862875428 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0139710 0x7fb5a0126230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47696/0 (socket says 172.21.15.71:47696) 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): get_auth_request con 0x7fb5a00a6950 auth_method 0 2024-08-19T11:13:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): get_auth_request con 0x7fb5a0139710 auth_method 0 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5b26640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5a00a57c0 0x7fb5a01281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5b26640 10 monclient(hunting): get_auth_request con 0x7fb5a00a57c0 auth_method 0 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5b26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5b26640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5b26640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient(hunting): handle_auth_done global_id 34317 payload 824 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5a00a57c0 msgr2=0x7fb5a01281d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5a00a57c0 0x7fb5a01281d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0139710 msgr2=0x7fb5a0126230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0139710 0x7fb5a0126230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 monclient: found mon.noname-a 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a5325640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a01393b0 con 0x7fb5a00a6950 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.344+0000 7fb5a6327640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0139710 0x7fb5a0126230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5a5325640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 msgr2=0x7fb5a0125cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5a5325640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 0x7fb5a0125cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb59c000c00 tx=0x7fb59c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb59c041020 con 0x7fb5a00a6950 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.364 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59c003610 con 0x7fb5a00a6950 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.346+0000 7fb5a7d8a640 5 monclient: authenticate success, global_id 34317 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 10 monclient: _renew_subs 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a0129410 con 0x7fb5a00a6950 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5927fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb59c037040 con 0x7fb5a00a6950 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.366 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.367 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb593fff640 4 set_mon_vals no callback set 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 10 monclient: _renew_subs 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a0128b60 con 0x7fb5a00a6950 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 0x7fb5a01225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb5a006a590 con 0x7fb5a0126770 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb59c044020 con 0x7fb5a00a6950 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.347+0000 7fb5a5b26640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 0x7fb5a01225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient: get_auth_request con 0x7fb5a0126770 auth_method 0 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5927fc640 1 --2- 172.21.15.71:0/2862875428 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58403ea80 0x7fb584040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_done global_id 24738 payload 824 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a5b26640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5a0126b50 con 0x7fb5a0126770 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7fb59c071b10 con 0x7fb5a00a6950 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a6327640 1 --2- 172.21.15.71:0/2862875428 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58403ea80 0x7fb584040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.348+0000 7fb5a6327640 10 monclient: get_auth_request con 0x7fb58403ea80 auth_method 0 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5a5b26640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 msgr2=0x7fb5a01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5a5b26640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 0x7fb5a01225a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d700 tx=0x7fb59400dbc0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb594003bc0 con 0x7fb5a0126770 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.370 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb594003bc0 con 0x7fb5a0126770 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 msgr2=0x7fb5a01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 0x7fb5a01225a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d700 tx=0x7fb59400dbc0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 msgr2=0x7fb5a01225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5927fc640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0126770 0x7fb5a01225a0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d700 tx=0x7fb59400dbc0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.350+0000 7fb5a6327640 1 --2- 172.21.15.71:0/2862875428 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58403ea80 0x7fb584040f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0127c90 tx=0x7fb59800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.356+0000 7fb5a7d8a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.356+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 0x7fb5a0122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.356+0000 7fb5a7d8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.356+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb5a0076c60 con 0x7fb5a0122ae0 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 0x7fb5a0122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient: get_auth_request con 0x7fb5a0122ae0 auth_method 0 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 10 monclient(hunting): handle_auth_done global_id 24747 payload 824 2024-08-19T11:13:30.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.357+0000 7fb5a5b26640 1 -- 172.21.15.71:0/2862875428 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5a00a6d30 con 0x7fb5a0122ae0 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5a5b26640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 msgr2=0x7fb5a0122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5a5b26640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 0x7fb5a0122ef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d700 tx=0x7fb5940059d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb59400be50 con 0x7fb5a0122ae0 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 10 monclient: dump: 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.374 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9401 (secure 0 0 0) 0x7fb594003e20 con 0x7fb5a0122ae0 2024-08-19T11:13:30.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 msgr2=0x7fb5a0122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 0x7fb5a0122ef0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d700 tx=0x7fb5940059d0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 msgr2=0x7fb5a0122ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.359+0000 7fb5927fc640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5a0122ae0 0x7fb5a0122ef0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d700 tx=0x7fb5940059d0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 66, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 117973, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.377 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.378 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:30.380 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.381 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.382 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.383 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.387 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:30.388 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.391 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:30.392 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.393 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.397 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.398 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.399 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:30.401 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:30.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58403ea80 msgr2=0x7fb584040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/2862875428 >> v2:172.21.15.135:6800/726754104 conn(0x7fb58403ea80 0x7fb584040f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0127c90 tx=0x7fb59800d040 comp rx=0 tx=0).stop 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 10 monclient: shutdown 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 msgr2=0x7fb5a0125cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 --2- 172.21.15.71:0/2862875428 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5a00a6950 0x7fb5a0125cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb59c000c00 tx=0x7fb59c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a6327640 1 -- 172.21.15.71:0/2862875428 reap_dead start 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a6327640 1 -- 172.21.15.71:0/2862875428 reap_dead start 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 shutdown_connections 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 >> 172.21.15.71:0/2862875428 conn(0x7fb5a00abf50 msgr2=0x7fb5a009ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 shutdown_connections 2024-08-19T11:13:30.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.360+0000 7fb5a7d8a640 1 -- 172.21.15.71:0/2862875428 wait complete. 2024-08-19T11:13:30.404 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:13:30.404 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2024-08-19T11:13:30.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.500+0000 7fd9e8dcf640 10 monclient: get_monmap_and_config 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.500+0000 7fd9e8dcf640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.500+0000 7fd9e8dcf640 10 monclient: monmap: 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:30.501771+0000 2024-08-19T11:13:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:30.501771+0000 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:30.504 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.500+0000 7fd9e8dcf640 1 Processor -- start 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.500+0000 7fd9e8dcf640 1 -- start start 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.500+0000 7fd9e8dcf640 10 monclient: init 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient: _add_conns ranks=[5,10,1,0,2,6,8,9,4,3,7] 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4132970 0x7fd9e40a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): picked mon.noname-h con 0x7fd9e4132970 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd9e4132d50 0x7fd9e4135a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): picked mon.noname-f con 0x7fd9e4132d50 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd9e4133130 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e4132560 con 0x7fd9e4133130 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e40a4520 con 0x7fd9e4132d50 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd9e40a13b0 con 0x7fd9e4132970 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e8dcf640 10 monclient(hunting): authenticate will time out at 868.543524s 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e259c640 1 -- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4132970 msgr2=0x7fd9e40a22c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3302/0 2024-08-19T11:13:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e259c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4132970 0x7fd9e40a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd9e4132d50 0x7fd9e4135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd9e4132d50 0x7fd9e4135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:42294/0 (socket says 172.21.15.71:42294) 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/459466565 learned_addr learned my addr 172.21.15.71:0/459466565 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 10 monclient(hunting): get_auth_request con 0x7fd9e4132d50 auth_method 0 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e2d9d640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd9e4133130 0x7fd9e4135fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:52258/0 (socket says 172.21.15.71:52258) 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.501+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_done global_id 5122 payload 274 2024-08-19T11:13:30.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4132970 msgr2=0x7fd9e40a22c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 1 --2- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4132970 0x7fd9e40a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/459466565 >> v1:172.21.15.135:6789/0 conn(0x7fd9e4133130 legacy=0x7fd9e4135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 1 monclient: found mon.noname-f 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:13:30.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.502+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/459466565 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e40a2800 con 0x7fd9e4132d50 2024-08-19T11:13:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 msgr2=0x7fd9e4135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e1d9b640 1 --2- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e4135a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800bb10 tx=0x7fd9d802c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce25b4b6e26c813 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 1 -- 172.21.15.71:0/459466565 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d8038070 con 0x7fd9e4132d50 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: dump: 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.516 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 1 -- 172.21.15.71:0/459466565 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d8031c70 con 0x7fd9e4132d50 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 1 -- 172.21.15.71:0/459466565 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d8032810 con 0x7fd9e4132d50 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 5 monclient: authenticate success, global_id 5122 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 4 set_mon_vals no callback set 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:30.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e159a640 10 monclient: dump: 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.519 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 10 monclient: shutdown 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 msgr2=0x7fd9e4135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.505+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e4135a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800bb10 tx=0x7fd9d802c770 comp rx=0 tx=0).stop 2024-08-19T11:13:30.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/459466565 shutdown_connections 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e4135a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/459466565 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4132970 0x7fd9e40a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/459466565 >> 172.21.15.71:0/459466565 conn(0x7fd9e40a4e70 msgr2=0x7fd9e40a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/459466565 shutdown_connections 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/459466565 wait complete. 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.506+0000 7fd9e8dcf640 10 monclient: monmap: 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:30.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 Processor -- start 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 -- start start 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient: init 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient: _add_conns ranks=[3,1,5,7,4,6,2,8,0] 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e4132970 0x7fd9e4074750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): picked mon.noname-g con 0x7fd9e4132970 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e41cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): picked mon.noname-f con 0x7fd9e4132d50 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4133130 0x7fd9e409e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): picked mon.noname-h con 0x7fd9e4133130 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e40a4020 con 0x7fd9e4132d50 2024-08-19T11:13:30.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e40a5c60 con 0x7fd9e4132970 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd9e40a41a0 con 0x7fd9e4133130 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e8dcf640 10 monclient(hunting): authenticate will time out at 868.549571s 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e2d9d640 1 -- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4133130 msgr2=0x7fd9e409e720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3302/0 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e259c640 1 -- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e4132970 msgr2=0x7fd9e4074750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e2d9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4133130 0x7fd9e409e720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e259c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e4132970 0x7fd9e4074750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e41cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e41cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:42306/0 (socket says 172.21.15.71:42306) 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/801998244 learned_addr learned my addr 172.21.15.71:0/801998244 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 10 monclient(hunting): get_auth_request con 0x7fd9e4132d50 auth_method 0 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.507+0000 7fd9e1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 10 monclient(hunting): handle_auth_done global_id 5131 payload 824 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4133130 msgr2=0x7fd9e409e720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd9e4133130 0x7fd9e409e720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e4132970 msgr2=0x7fd9e4074750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9e4132970 0x7fd9e4074750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 1 monclient: found mon.noname-f 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.508+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e40a68c0 con 0x7fd9e4132d50 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.510+0000 7fd9e1d9b640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 msgr2=0x7fd9e41cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.510+0000 7fd9e1d9b640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e41cad40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800ba60 tx=0x7fd9d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.510+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d8038040 con 0x7fd9e4132d50 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: dump: 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.527 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d8003c90 con 0x7fd9e4132d50 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 5 monclient: authenticate success, global_id 5131 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 10 monclient: _renew_subs 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e4090120 con 0x7fd9e4132d50 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d8003e40 con 0x7fd9e4132d50 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d3fff640 4 set_mon_vals no callback set 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9d2ffd640 10 monclient: dump: 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 10 monclient: _renew_subs 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.511+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e408f880 con 0x7fd9e4132d50 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e8dcf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 0x7fd9e408df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd9e4076c60 con 0x7fd9e409ec60 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 0x7fd9e408df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient: get_auth_request con 0x7fd9e409ec60 auth_method 0 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd9d8003820 con 0x7fd9e4132d50 2024-08-19T11:13:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 10 monclient(hunting): handle_auth_done global_id 5156 payload 824 2024-08-19T11:13:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e259c640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e41cbc80 con 0x7fd9e409ec60 2024-08-19T11:13:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9d2ffd640 1 --2- 172.21.15.71:0/801998244 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9c403e9b0 0x7fd9c4040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7fd9d8071f90 con 0x7fd9e4132d50 2024-08-19T11:13:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e2d9d640 1 --2- 172.21.15.71:0/801998244 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9c403e9b0 0x7fd9c4040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.512+0000 7fd9e2d9d640 10 monclient: get_auth_request con 0x7fd9c403e9b0 auth_method 0 2024-08-19T11:13:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.514+0000 7fd9e259c640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 msgr2=0x7fd9e408df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.514+0000 7fd9e259c640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 0x7fd9e408df80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400bcc0 tx=0x7fd9d4009f30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.514+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d40057d0 con 0x7fd9e409ec60 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.514+0000 7fd9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.514+0000 7fd9d2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.514+0000 7fd9d2ffd640 10 monclient: dump: 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd9d4005360 con 0x7fd9e409ec60 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 msgr2=0x7fd9e408df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 0x7fd9e408df80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400bcc0 tx=0x7fd9d4009f30 comp rx=0 tx=0).stop 2024-08-19T11:13:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 msgr2=0x7fd9e408df80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9d2ffd640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e409ec60 0x7fd9e408df80 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400bcc0 tx=0x7fd9d4009f30 comp rx=0 tx=0).stop 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.515+0000 7fd9e2d9d640 1 --2- 172.21.15.71:0/801998244 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9c403e9b0 0x7fd9c4040e70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc004820 tx=0x7fd9dc0079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e8dcf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 0x7fd9e408e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e8dcf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd9e40a22c0 con 0x7fd9e408fa50 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 0x7fd9e408e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient: get_auth_request con 0x7fd9e408fa50 auth_method 0 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 10 monclient(hunting): handle_auth_done global_id 5165 payload 824 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.521+0000 7fd9e259c640 1 -- 172.21.15.71:0/801998244 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9e406e510 con 0x7fd9e408fa50 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.523+0000 7fd9e259c640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 msgr2=0x7fd9e408e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.523+0000 7fd9e259c640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 0x7fd9e408e4c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4014000 tx=0x7fd9d4005dc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.523+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd9d4019040 con 0x7fd9e408fa50 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.523+0000 7fd9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.523+0000 7fd9d2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.523+0000 7fd9d2ffd640 10 monclient: dump: 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.538 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9401 (secure 0 0 0) 0x7fd9d401a820 con 0x7fd9e408fa50 2024-08-19T11:13:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 msgr2=0x7fd9e408e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 0x7fd9e408e4c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4014000 tx=0x7fd9d4005dc0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 msgr2=0x7fd9e408e4c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9d2ffd640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd9e408fa50 0x7fd9e408e4c0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4014000 tx=0x7fd9d4005dc0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:30.540 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 66, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 207394, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:30.541 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.542 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:30.544 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.545 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.547 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:30.550 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:30.551 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.554 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:30.560 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.561 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:30.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.564 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:30.564 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:30.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9c403e9b0 msgr2=0x7fd9c4040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/801998244 >> v2:172.21.15.135:6800/726754104 conn(0x7fd9c403e9b0 0x7fd9c4040e70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc004820 tx=0x7fd9dc0079e0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 10 monclient: shutdown 2024-08-19T11:13:30.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 msgr2=0x7fd9e41cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e41cad40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800ba60 tx=0x7fd9d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e2d9d640 1 -- 172.21.15.71:0/801998244 reap_dead start 2024-08-19T11:13:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 shutdown_connections 2024-08-19T11:13:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 --2- 172.21.15.71:0/801998244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e4132d50 0x7fd9e41cad40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 >> 172.21.15.71:0/801998244 conn(0x7fd9e40a4e70 msgr2=0x7fd9e4133650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 shutdown_connections 2024-08-19T11:13:30.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.524+0000 7fd9e8dcf640 1 -- 172.21.15.71:0/801998244 wait complete. 2024-08-19T11:13:30.566 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:13:30.566 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2024-08-19T11:13:30.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.663+0000 7ff03b353640 10 monclient: get_monmap_and_config 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.663+0000 7ff03b353640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.663+0000 7ff03b353640 10 monclient: monmap: 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:30.665382+0000 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:30.665382+0000 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.666 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.664+0000 7ff03b353640 1 Processor -- start 2024-08-19T11:13:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.664+0000 7ff03b353640 1 -- start start 2024-08-19T11:13:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.664+0000 7ff03b353640 10 monclient: init 2024-08-19T11:13:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient: _add_conns ranks=[10,1,3,5,0,8,2,9,4,6,7] 2024-08-19T11:13:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0340a6950 0x7ff0340a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): picked mon.noname-f con 0x7ff0340a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff0340a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0340a7270 0x7ff034139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): picked mon.noname-g con 0x7ff0340a7270 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0340a6380 con 0x7ff0340a57c0 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff0340a5020 con 0x7ff0340a6950 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff0340a7d40 con 0x7ff0340a7270 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff03b353640 10 monclient(hunting): authenticate will time out at 868.707201s 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0398f0640 1 -- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0340a7270 msgr2=0x7ff034139e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3301/0 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0398f0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0340a7270 0x7ff034139e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0340a6950 0x7ff0340a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0340a6950 0x7ff0340a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:42314/0 (socket says 172.21.15.71:42314) 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 -- 172.21.15.71:0/1841816954 learned_addr learned my addr 172.21.15.71:0/1841816954 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): get_auth_request con 0x7ff0340a6950 auth_method 0 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient(hunting): handle_auth_done global_id 5140 payload 274 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 -- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0340a7270 msgr2=0x7ff034139e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 --2- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0340a7270 0x7ff034139e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 -- 172.21.15.71:0/1841816954 >> v1:172.21.15.135:6789/0 conn(0x7ff0340a57c0 legacy=0x7ff034139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 monclient: found mon.noname-f 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.665+0000 7ff0390ef640 1 -- 172.21.15.71:0/1841816954 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0340a3650 con 0x7ff0340a6950 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff0390ef640 1 -- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a6950 msgr2=0x7ff0340a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff0390ef640 1 --2- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a6950 0x7ff0340a6d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009e50 tx=0x7ff02c02a570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=448b35120c66da1c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 1 -- 172.21.15.71:0/1841816954 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff02c036070 con 0x7ff0340a6950 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 10 monclient: dump: 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff03b353640 5 monclient: authenticate success, global_id 5140 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff02bfff640 1 -- 172.21.15.71:0/1841816954 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02c007a70 con 0x7ff0340a6950 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.668+0000 7ff03b353640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff02bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff02bfff640 1 -- 172.21.15.71:0/1841816954 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff02c007ca0 con 0x7ff0340a6950 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff02bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 4 set_mon_vals no callback set 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff02bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff02bfff640 10 monclient: dump: 2024-08-19T11:13:30.678 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.679 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 10 monclient: shutdown 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 -- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a6950 msgr2=0x7ff0340a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 --2- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a6950 0x7ff0340a6d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009e50 tx=0x7ff02c02a570 comp rx=0 tx=0).stop 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 -- 172.21.15.71:0/1841816954 shutdown_connections 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 --2- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0340a7270 0x7ff034139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 --2- 172.21.15.71:0/1841816954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a6950 0x7ff0340a6d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 -- 172.21.15.71:0/1841816954 >> 172.21.15.71:0/1841816954 conn(0x7ff0340abf50 msgr2=0x7ff0340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 -- 172.21.15.71:0/1841816954 shutdown_connections 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.669+0000 7ff03b353640 1 -- 172.21.15.71:0/1841816954 wait complete. 2024-08-19T11:13:30.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.670+0000 7ff03b353640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.670+0000 7ff03b353640 10 monclient: monmap: 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.681 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.670+0000 7ff03b353640 1 Processor -- start 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.670+0000 7ff03b353640 1 -- start start 2024-08-19T11:13:30.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.670+0000 7ff03b353640 10 monclient: init 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient: _add_conns ranks=[8,4,1,6,0,3,7,5,2] 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 0x7ff0341ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): picked mon.noname-e con 0x7ff0340a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff0340a6950 0x7ff0341cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): picked mon.noname-c con 0x7ff0340a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a7270 0x7ff0341cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): picked mon.noname-f con 0x7ff0340a7270 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340a76c0 con 0x7ff0340a7270 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff0340a84c0 con 0x7ff0340a6950 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff0340a8700 con 0x7ff0340a57c0 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff03b353640 10 monclient(hunting): authenticate will time out at 868.713126s 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0388ee640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff0340a6950 msgr2=0x7ff0341cee80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0388ee640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff0340a6950 0x7ff0341cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 0x7ff0341ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 0x7ff0341ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:42262/0 (socket says 172.21.15.71:42262) 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 -- 172.21.15.71:0/3044729721 learned_addr learned my addr 172.21.15.71:0/3044729721 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): get_auth_request con 0x7ff0340a57c0 auth_method 0 2024-08-19T11:13:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0398f0640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a7270 0x7ff0341cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient(hunting): handle_auth_done global_id 5174 payload 824 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff0340a6950 msgr2=0x7ff0341cee80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff0340a6950 0x7ff0341cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a7270 msgr2=0x7ff0341cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0340a7270 0x7ff0341cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 monclient: found mon.noname-e 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.671+0000 7ff0390ef640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03412a980 con 0x7ff0340a57c0 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff0390ef640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 msgr2=0x7ff0341ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff0390ef640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 0x7ff0341ce940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0093e0 tx=0x7ff02c004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff02c036050 con 0x7ff0340a57c0 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: dump: 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.691 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.692 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02c037040 con 0x7ff0340a57c0 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff03b353640 5 monclient: authenticate success, global_id 5174 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff02c03b400 con 0x7ff0340a57c0 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff03b353640 10 monclient: _renew_subs 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff03b353640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03412ac60 con 0x7ff0340a57c0 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff02b7fe640 4 set_mon_vals no callback set 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.673+0000 7ff029ffb640 10 monclient: dump: 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.694 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 10 monclient: _renew_subs 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0340a26a0 con 0x7ff0340a57c0 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 0x7ff034127440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.674+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff03406a590 con 0x7ff034127060 2024-08-19T11:13:30.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff02c044030 con 0x7ff0340a57c0 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 0x7ff034127440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient: get_auth_request con 0x7ff034127060 auth_method 0 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff029ffb640 1 --2- 172.21.15.71:0/3044729721 >> v2:172.21.15.135:6800/726754104 conn(0x7ff01803ea80 0x7ff018040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(87..87 src has 1..87) ==== 3506+0+0 (secure 0 0 0) 0x7ff02c042020 con 0x7ff0340a57c0 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 10 monclient(hunting): handle_auth_done global_id 5149 payload 824 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0388ee640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0340a6d30 con 0x7ff034127060 2024-08-19T11:13:30.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0398f0640 1 --2- 172.21.15.71:0/3044729721 >> v2:172.21.15.135:6800/726754104 conn(0x7ff01803ea80 0x7ff018040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.675+0000 7ff0398f0640 10 monclient: get_auth_request con 0x7ff01803ea80 auth_method 0 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.677+0000 7ff0388ee640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 msgr2=0x7ff034127440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.677+0000 7ff0388ee640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 0x7ff034127440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff034128f70 tx=0x7ff02400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff024017070 con 0x7ff034127060 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 10 monclient: dump: 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.697 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff0398f0640 1 --2- 172.21.15.71:0/3044729721 >> v2:172.21.15.135:6800/726754104 conn(0x7ff01803ea80 0x7ff018040f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff03413a730 tx=0x7ff030008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff0240074f0 con 0x7ff034127060 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 msgr2=0x7ff034127440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 0x7ff034127440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff034128f70 tx=0x7ff02400c7a0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 msgr2=0x7ff034127440 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.678+0000 7ff029ffb640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127060 0x7ff034127440 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.684+0000 7ff03b353640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.684+0000 7ff03b353640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 0x7ff0341225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.684+0000 7ff03b353640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.684+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340a95e0 con 0x7ff034127980 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.684+0000 7ff0388ee640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 0x7ff0341225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient: get_auth_request con 0x7ff034127980 auth_method 0 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 10 monclient(hunting): handle_auth_done global_id 5158 payload 824 2024-08-19T11:13:30.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.685+0000 7ff0388ee640 1 -- 172.21.15.71:0/3044729721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0340008d0 con 0x7ff034127980 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.687+0000 7ff0388ee640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 msgr2=0x7ff0341225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.687+0000 7ff0388ee640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 0x7ff0341225a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff034128f70 tx=0x7ff024003700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.687+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff024017030 con 0x7ff034127980 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.687+0000 7ff029ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.687+0000 7ff029ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.687+0000 7ff029ffb640 10 monclient: dump: 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9401 (secure 0 0 0) 0x7ff0240192d0 con 0x7ff034127980 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 msgr2=0x7ff0341225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 0x7ff0341225a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff034128f70 tx=0x7ff024003700 comp rx=0 tx=0).stop 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 msgr2=0x7ff0341225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff029ffb640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff034127980 0x7ff0341225a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 66, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 207528, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:30.727 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 >> v2:172.21.15.135:6800/726754104 conn(0x7ff01803ea80 msgr2=0x7ff018040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 --2- 172.21.15.71:0/3044729721 >> v2:172.21.15.135:6800/726754104 conn(0x7ff01803ea80 0x7ff018040f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff03413a730 tx=0x7ff030008040 comp rx=0 tx=0).stop 2024-08-19T11:13:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 10 monclient: shutdown 2024-08-19T11:13:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 msgr2=0x7ff0341ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 --2- 172.21.15.71:0/3044729721 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff0340a57c0 0x7ff0341ce940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0093e0 tx=0x7ff02c004a40 comp rx=0 tx=0).stop 2024-08-19T11:13:30.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff0398f0640 1 -- 172.21.15.71:0/3044729721 reap_dead start 2024-08-19T11:13:30.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff0398f0640 1 -- 172.21.15.71:0/3044729721 reap_dead start 2024-08-19T11:13:30.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 shutdown_connections 2024-08-19T11:13:30.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 >> 172.21.15.71:0/3044729721 conn(0x7ff0340abf50 msgr2=0x7ff03409dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 shutdown_connections 2024-08-19T11:13:30.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.688+0000 7ff03b353640 1 -- 172.21.15.71:0/3044729721 wait complete. 2024-08-19T11:13:30.729 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:13:30.729 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2024-08-19T11:13:30.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.826+0000 7f0ec446e640 10 monclient: get_monmap_and_config 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.826+0000 7f0ec446e640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.826+0000 7f0ec446e640 10 monclient: monmap: 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:30.827880+0000 2024-08-19T11:13:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:30.827880+0000 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:30.829 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.826+0000 7f0ec446e640 1 Processor -- start 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.826+0000 7f0ec446e640 1 -- start start 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.826+0000 7f0ec446e640 10 monclient: init 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient: _add_conns ranks=[7,8,4,1,5,0,2,3,10,9,6] 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc0a3c30 0x7f0ebc0a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): picked mon.noname-i con 0x7f0ebc0a3c30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:30.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 0x7f0ebc139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): picked mon.noname-e con 0x7f0ebc0a4550 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ebc139eb0 0x7f0ebc13a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): picked mon.noname-c con 0x7f0ebc139eb0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0ebc0a5000 con 0x7f0ebc139eb0 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0ebc0a13b0 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0ebc0a0b10 con 0x7f0ebc0a4550 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec446e640 10 monclient(hunting): authenticate will time out at 868.869548s 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec2a0b640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ebc139eb0 msgr2=0x7f0ebc13a310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec2a0b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ebc139eb0 0x7f0ebc13a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:30.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 0x7f0ebc139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 0x7f0ebc139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:42264/0 (socket says 172.21.15.71:42264) 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 -- 172.21.15.71:0/2144825504 learned_addr learned my addr 172.21.15.71:0/2144825504 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): get_auth_request con 0x7f0ebc0a4550 auth_method 0 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec220a640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc0a3c30 0x7f0ebc0a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec220a640 10 monclient(hunting): get_auth_request con 0x7f0ebc0a3c30 auth_method 0 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec220a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec220a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_done global_id 5183 payload 274 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 -- 172.21.15.71:0/2144825504 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc0a3c30 msgr2=0x7f0ebc0a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc0a3c30 0x7f0ebc0a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 -- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ebc139eb0 msgr2=0x7f0ebc13a310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ebc139eb0 0x7f0ebc13a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 monclient: found mon.noname-e 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.827+0000 7f0ec1a09640 1 -- 172.21.15.71:0/2144825504 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc0a0df0 con 0x7f0ebc0a4550 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1a09640 1 -- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 msgr2=0x7f0ebc139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 0x7f0ebc139970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00098d0 tx=0x7f0eb002a0d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=19c67b94849d1284 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 1 -- 172.21.15.71:0/2144825504 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0eb0037070 con 0x7f0ebc0a4550 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: dump: 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec446e640 5 monclient: authenticate success, global_id 5183 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec446e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:30.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 1 -- 172.21.15.71:0/2144825504 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb002adf0 con 0x7f0ebc0a4550 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec446e640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec446e640 4 set_mon_vals no callback set 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 1 -- 172.21.15.71:0/2144825504 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0eb0030c20 con 0x7f0ebc0a4550 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.830+0000 7f0ec1208640 10 monclient: dump: 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.842 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.843 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 10 monclient: shutdown 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 -- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 msgr2=0x7f0ebc139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 0x7f0ebc139970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00098d0 tx=0x7f0eb002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 -- 172.21.15.71:0/2144825504 shutdown_connections 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ebc139eb0 0x7f0ebc13a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a4550 0x7f0ebc139970 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 --2- 172.21.15.71:0/2144825504 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc0a3c30 0x7f0ebc0a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 -- 172.21.15.71:0/2144825504 >> 172.21.15.71:0/2144825504 conn(0x7f0ebc0a91d0 msgr2=0x7f0ebc0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 -- 172.21.15.71:0/2144825504 shutdown_connections 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.831+0000 7f0ec446e640 1 -- 172.21.15.71:0/2144825504 wait complete. 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient: build_initial_monmap 2024-08-19T11:13:30.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient: monmap: 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:30.845 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 Processor -- start 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 -- start start 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient: init 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient: _add_conns ranks=[8,0,2,1,7,4,6,5,3] 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 0x7f0ebc1395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): picked mon.noname-e con 0x7f0ebc0a3c30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc0a4550 0x7f0ebc125e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): picked mon.noname-a con 0x7f0ebc0a4550 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ebc139eb0 0x7f0ebc1263a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): picked mon.noname-b con 0x7f0ebc139eb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc0a5570 con 0x7f0ebc0a4550 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc06cbd0 con 0x7f0ebc139eb0 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0ebc0a4930 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec446e640 10 monclient(hunting): authenticate will time out at 868.874883s 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 0x7f0ebc1395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 0x7f0ebc1395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:42266/0 (socket says 172.21.15.71:42266) 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 1 -- 172.21.15.71:0/3678225615 learned_addr learned my addr 172.21.15.71:0/3678225615 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 10 monclient(hunting): get_auth_request con 0x7f0ebc0a3c30 auth_method 0 2024-08-19T11:13:30.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.832+0000 7f0ec220a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ebc139eb0 0x7f0ebc1263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc0a4550 0x7f0ebc125e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): get_auth_request con 0x7f0ebc139eb0 auth_method 0 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): get_auth_request con 0x7f0ebc0a4550 auth_method 0 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 10 monclient(hunting): handle_auth_done global_id 5192 payload 824 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ebc139eb0 msgr2=0x7f0ebc1263a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ebc139eb0 0x7f0ebc1263a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc0a4550 msgr2=0x7f0ebc125e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ebc0a4550 0x7f0ebc125e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 10 monclient: _finish_hunting 0 2024-08-19T11:13:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 1 monclient: found mon.noname-e 2024-08-19T11:13:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec220a640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc127950 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.833+0000 7f0ec2a0b640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ebc139eb0 0x7f0ebc1263a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:30.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec220a640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 msgr2=0x7f0ebc1395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec220a640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 0x7f0ebc1395f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0eac007ef0 tx=0x7f0eac00e4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0eac013a00 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: dump: 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.855 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: _finish_auth 0 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 5 monclient: authenticate success, global_id 5192 2024-08-19T11:13:30.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac019070 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 10 monclient: _renew_subs 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc13a660 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0eac013be0 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ebaffd640 10 monclient: dump: 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.857 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec0a07640 4 set_mon_vals no callback set 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 10 monclient: _renew_subs 2024-08-19T11:13:30.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.835+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc128e40 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.836+0000 7f0ec446e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.836+0000 7f0ec446e640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 0x7f0ebc071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.836+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.836+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0ebc076c60 con 0x7f0ebc1268e0 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.836+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0eac013590 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.836+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 0x7f0ebc071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient: get_auth_request con 0x7f0ebc1268e0 auth_method 0 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ebaffd640 1 --2- 172.21.15.71:0/3678225615 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ea803ea80 0x7f0ea8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(88..88 src has 1..88) ==== 3898+0+0 (secure 0 0 0) 0x7f0eac052510 con 0x7f0ebc0a3c30 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_done global_id 5092 payload 824 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec2a0b640 1 --2- 172.21.15.71:0/3678225615 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ea803ea80 0x7f0ea8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec1a09640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ebc0a5210 con 0x7f0ebc1268e0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.837+0000 7f0ec2a0b640 10 monclient: get_auth_request con 0x7f0ea803ea80 auth_method 0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.839+0000 7f0ec1a09640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 msgr2=0x7f0ebc071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.839+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 0x7f0ebc071680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0034000 tx=0x7f0eb00046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.839+0000 7f0ec2a0b640 1 --2- 172.21.15.71:0/3678225615 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ea803ea80 0x7f0ea8040f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4006d70 tx=0x7f0eb4006cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.839+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0eb0042070 con 0x7f0ebc1268e0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.839+0000 7f0ebaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 10 monclient: dump: 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.861 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0eb0003900 con 0x7f0ebc1268e0 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 msgr2=0x7f0ebc071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 0x7f0ebc071680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0034000 tx=0x7f0eb00046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 msgr2=0x7f0ebc071680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.840+0000 7f0ebaffd640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc1268e0 0x7f0ebc071680 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec446e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec446e640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 0x7f0ebc071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:30.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec446e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0ebc06ed40 con 0x7f0ebc126cc0 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 0x7f0ebc071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient: get_auth_request con 0x7f0ebc126cc0 auth_method 0 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:30.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 10 monclient(hunting): handle_auth_done global_id 5101 payload 824 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.846+0000 7f0ec1a09640 1 -- 172.21.15.71:0/3678225615 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ebc129c10 con 0x7f0ebc126cc0 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ec1a09640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 msgr2=0x7f0ebc071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ec1a09640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 0x7f0ebc071bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097c0 tx=0x7f0eb0009240 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0eb0037040 con 0x7f0ebc126cc0 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 10 monclient: dump: 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:30.864 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9234 (secure 0 0 0) 0x7f0eb003e460 con 0x7f0ebc126cc0 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 msgr2=0x7f0ebc071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 0x7f0ebc071bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097c0 tx=0x7f0eb0009240 comp rx=0 tx=0).stop 2024-08-19T11:13:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 msgr2=0x7f0ebc071bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.849+0000 7f0ebaffd640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0ebc126cc0 0x7f0ebc071bc0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097c0 tx=0x7f0eb0009240 comp rx=0 tx=0).stop 2024-08-19T11:13:30.866 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:30.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 66, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 207704, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:30.867 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.868 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:30.870 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:30.871 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:30.875 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:30.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:30.877 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.880 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:30.880 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:30.881 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:30.882 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:30.888 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:30.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:30.890 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:30.891 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:30.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ea803ea80 msgr2=0x7f0ea8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 --2- 172.21.15.71:0/3678225615 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ea803ea80 0x7f0ea8040f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4006d70 tx=0x7f0eb4006cc0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 10 monclient: shutdown 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 msgr2=0x7f0ebc1395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 --2- 172.21.15.71:0/3678225615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0ebc0a3c30 0x7f0ebc1395f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0eac007ef0 tx=0x7f0eac00e4b0 comp rx=0 tx=0).stop 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec2a0b640 1 -- 172.21.15.71:0/3678225615 reap_dead start 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec2a0b640 1 -- 172.21.15.71:0/3678225615 reap_dead start 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 shutdown_connections 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 >> 172.21.15.71:0/3678225615 conn(0x7f0ebc0a91d0 msgr2=0x7f0ebc073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 shutdown_connections 2024-08-19T11:13:30.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:30.850+0000 7f0ec446e640 1 -- 172.21.15.71:0/3678225615 wait complete. 2024-08-19T11:13:30.894 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:13:30.894 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:13:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: starting. 2024-08-19T11:13:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25048 2024-08-19T11:13:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: created object 0... 2024-08-19T11:13:31.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: created object 25... 2024-08-19T11:13:31.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: created object 49... 2024-08-19T11:13:31.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: finishing. 2024-08-19T11:13:31.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25083]: shutting down. 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25085]: starting. 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25085]: listing objects. 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25085]: listed object 0... 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25085]: listed object 25... 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25085]: saw 50 objects 2024-08-19T11:13:31.877 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25085]: shutting down. 2024-08-19T11:13:32.954 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:32.954 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25084]: starting. 2024-08-19T11:13:32.954 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25084]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25048 2024-08-19T11:13:32.954 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25084]: shutting down. 2024-08-19T11:13:32.955 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:32.955 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:32.956 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:13:32.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: starting. 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25151 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: created object 0... 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: created object 25... 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: created object 49... 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: finishing. 2024-08-19T11:13:35.064 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25152]: shutting down. 2024-08-19T11:13:35.960 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25153]: starting. 2024-08-19T11:13:35.960 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25153]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25151 2024-08-19T11:13:35.961 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25153]: shutting down. 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: starting. 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25151 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: created object 0... 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: created object 25... 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: created object 49... 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: finishing. 2024-08-19T11:13:38.101 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25186]: shutting down. 2024-08-19T11:13:38.139 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:38.139 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25188]: starting. 2024-08-19T11:13:38.139 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25188]: listing objects. 2024-08-19T11:13:38.139 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25188]: listed object 0... 2024-08-19T11:13:38.139 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25188]: listed object 25... 2024-08-19T11:13:38.139 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25188]: saw 50 objects 2024-08-19T11:13:38.140 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25188]: shutting down. 2024-08-19T11:13:39.006 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:39.006 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25187]: starting. 2024-08-19T11:13:39.006 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25187]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25151 2024-08-19T11:13:39.006 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25187]: shutting down. 2024-08-19T11:13:39.007 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:39.007 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:39.007 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:13:39.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:13:40.609 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: starting. 2024-08-19T11:13:40.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25254 2024-08-19T11:13:40.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: created object 0... 2024-08-19T11:13:40.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: created object 25... 2024-08-19T11:13:40.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: created object 49... 2024-08-19T11:13:40.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: finishing. 2024-08-19T11:13:40.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25255]: shutting down. 2024-08-19T11:13:41.514 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25256]: starting. 2024-08-19T11:13:41.514 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25256]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25254 2024-08-19T11:13:41.514 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25256]: shutting down. 2024-08-19T11:13:43.649 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: starting. 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25254 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: created object 0... 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: created object 25... 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: created object 49... 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: finishing. 2024-08-19T11:13:43.650 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25289]: shutting down. 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25291]: starting. 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25291]: listing objects. 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25291]: listed object 0... 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25291]: listed object 25... 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25291]: saw 50 objects 2024-08-19T11:13:43.689 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25291]: shutting down. 2024-08-19T11:13:44.545 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:44.546 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25290]: starting. 2024-08-19T11:13:44.546 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25290]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25254 2024-08-19T11:13:44.546 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25290]: shutting down. 2024-08-19T11:13:44.547 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:44.547 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:44.547 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:13:44.550 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:13:46.672 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: starting. 2024-08-19T11:13:46.672 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25357 2024-08-19T11:13:46.672 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: created object 0... 2024-08-19T11:13:46.673 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: created object 25... 2024-08-19T11:13:46.673 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: created object 49... 2024-08-19T11:13:46.673 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: finishing. 2024-08-19T11:13:46.673 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25358]: shutting down. 2024-08-19T11:13:47.575 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25359]: starting. 2024-08-19T11:13:47.575 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25359]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25357 2024-08-19T11:13:47.576 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25359]: shutting down. 2024-08-19T11:13:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: starting. 2024-08-19T11:13:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25357 2024-08-19T11:13:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: created object 0... 2024-08-19T11:13:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: created object 25... 2024-08-19T11:13:49.832 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: created object 49... 2024-08-19T11:13:49.832 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: finishing. 2024-08-19T11:13:49.832 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25392]: shutting down. 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25394]: starting. 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25394]: listing objects. 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25394]: listed object 0... 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25394]: listed object 25... 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25394]: saw 50 objects 2024-08-19T11:13:49.870 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25394]: shutting down. 2024-08-19T11:13:50.750 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:50.750 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25393]: starting. 2024-08-19T11:13:50.750 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25393]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25357 2024-08-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25393]: shutting down. 2024-08-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:13:50.755 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:13:50.894 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-08-19T11:13:50.895 INFO:tasks.ceph.mon.h:Restarting daemon 2024-08-19T11:13:50.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-08-19T11:13:50.898 INFO:tasks.ceph.mon.h:Started 2024-08-19T11:13:50.898 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-08-19T11:13:50.898 INFO:tasks.ceph.mon.g:Restarting daemon 2024-08-19T11:13:50.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-08-19T11:13:50.900 INFO:tasks.ceph.mon.g:Started 2024-08-19T11:13:50.900 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-19T11:13:50.900 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-19T11:13:50.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-19T11:13:50.903 INFO:tasks.ceph.mon.c:Started 2024-08-19T11:13:50.903 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:13:50.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.007+0000 7f58afbd9640 10 monclient: get_monmap_and_config 2024-08-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.007+0000 7f58afbd9640 10 monclient: build_initial_monmap 2024-08-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.007+0000 7f58afbd9640 10 monclient: monmap: 2024-08-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:51.007862+0000 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:51.007862+0000 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.007+0000 7f58afbd9640 1 Processor -- start 2024-08-19T11:13:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 -- start start 2024-08-19T11:13:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient: init 2024-08-19T11:13:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient: _add_conns ranks=[3,6,10,7,9,4,2,1,5,0,8] 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 0x7f58a80a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): picked mon.noname-g con 0x7f58a80a57d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 0x7f58a80a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): picked mon.noname-d con 0x7f58a8072400 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f58a80a60f0 0x7f58a8137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): picked mon.noname-f con 0x7f58a80a60f0 addr v2:172.21.15.135:3300/0 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f58a8072880 con 0x7f58a80a60f0 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f58a80741c0 con 0x7f58a80a57d0 2024-08-19T11:13:51.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f58a80a6550 con 0x7f58a8072400 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58afbd9640 10 monclient(hunting): authenticate will time out at 889.049534s 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 0x7f58a80a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 0x7f58a80a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:37208/0 (socket says 172.21.15.71:37208) 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 -- 172.21.15.71:0/4031912101 learned_addr learned my addr 172.21.15.71:0/4031912101 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): get_auth_request con 0x7f58a8072400 auth_method 0 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 1 --2- 172.21.15.71:0/4031912101 >> v2:172.21.15.135:3300/0 conn(0x7f58a80a60f0 0x7f58a8137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): get_auth_request con 0x7f58a80a60f0 auth_method 0 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 0x7f58a80a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 10 monclient(hunting): get_auth_request con 0x7f58a80a57d0 auth_method 0 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:51.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ae176640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient(hunting): handle_auth_done global_id 24837 payload 274 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 1 -- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 msgr2=0x7f58a80a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 1 -- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 msgr2=0x7f58a80a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 0x7f58a80a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 -- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 msgr2=0x7f58a80a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad975640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 0x7f58a80a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 0x7f58a80a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 -- 172.21.15.71:0/4031912101 >> v2:172.21.15.135:3300/0 conn(0x7f58a80a60f0 msgr2=0x7f58a8137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 --2- 172.21.15.71:0/4031912101 >> v2:172.21.15.135:3300/0 conn(0x7f58a80a60f0 0x7f58a8137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient: _finish_hunting 0 2024-08-19T11:13:51.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 monclient: found mon.noname-d 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.008+0000 7f58ad174640 1 -- 172.21.15.71:0/4031912101 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a80a72a0 con 0x7f58a8072400 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ad174640 1 -- 172.21.15.71:0/4031912101 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 msgr2=0x7f58a80a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ad174640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 0x7f58a80a5bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5898009870 tx=0x7f589802a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=47de4a45864458e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 1 -- 172.21.15.71:0/4031912101 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5898037070 con 0x7f58a8072400 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: dump: 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.026 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:51.027 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: _finish_auth 0 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: _check_auth_tickets 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 1 -- 172.21.15.71:0/4031912101 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589802ae00 con 0x7f58a8072400 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58afbd9640 5 monclient: authenticate success, global_id 24837 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58afbd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 1 -- 172.21.15.71:0/4031912101 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5898030c20 con 0x7f58a8072400 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58ac973640 10 monclient: dump: 2024-08-19T11:13:51.028 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:51.029 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58afbd9640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.011+0000 7f58afbd9640 4 set_mon_vals no callback set 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 10 monclient: shutdown 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 -- 172.21.15.71:0/4031912101 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 msgr2=0x7f58a80a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 0x7f58a80a5bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5898009870 tx=0x7f589802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 -- 172.21.15.71:0/4031912101 shutdown_connections 2024-08-19T11:13:51.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 --2- 172.21.15.71:0/4031912101 >> v2:172.21.15.135:3300/0 conn(0x7f58a80a60f0 0x7f58a8137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f58a8072400 0x7f58a80a5bb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 --2- 172.21.15.71:0/4031912101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f58a80a57d0 0x7f58a80a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 -- 172.21.15.71:0/4031912101 >> 172.21.15.71:0/4031912101 conn(0x7f58a80aa3f0 msgr2=0x7f58a80a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 -- 172.21.15.71:0/4031912101 shutdown_connections 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.012+0000 7f58afbd9640 1 -- 172.21.15.71:0/4031912101 wait complete. 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient: build_initial_monmap 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient: monmap: 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:51.031 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:51.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 Processor -- start 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 -- start start 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient: init 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient: _add_conns ranks=[2,7,1,4,5,8,6,0,3] 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 0x7f58a81cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): picked mon.noname-b con 0x7f58a8072400 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f58a80a57d0 0x7f58a8136740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): picked mon.noname-i con 0x7f58a80a57d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58a80a60f0 0x7f58a8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): picked mon.noname-f con 0x7f58a80a60f0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:51.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f58a8137e50 con 0x7f58a80a60f0 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f58a8137cd0 con 0x7f58a8072400 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f58a8137fd0 con 0x7f58a80a57d0 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.013+0000 7f58afbd9640 10 monclient(hunting): authenticate will time out at 889.054939s 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 0x7f58a81cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 0x7f58a81cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:45682/0 (socket says 172.21.15.71:45682) 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 -- 172.21.15.71:0/1823044177 learned_addr learned my addr 172.21.15.71:0/1823044177 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): get_auth_request con 0x7f58a8072400 auth_method 0 2024-08-19T11:13:51.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f58a80a57d0 0x7f58a8136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): get_auth_request con 0x7f58a80a57d0 auth_method 0 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58a80a60f0 0x7f58a8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): get_auth_request con 0x7f58a80a60f0 auth_method 0 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:51.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad174640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ae176640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient(hunting): handle_auth_done global_id 5546 payload 824 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 -- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f58a80a57d0 msgr2=0x7f58a8136740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f58a80a57d0 0x7f58a8136740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 -- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58a80a60f0 msgr2=0x7f58a8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58a80a60f0 0x7f58a8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient: _finish_hunting 0 2024-08-19T11:13:51.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 monclient: found mon.noname-b 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.014+0000 7f58ad975640 1 -- 172.21.15.71:0/1823044177 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a8121da0 con 0x7f58a8072400 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58ad975640 1 -- 172.21.15.71:0/1823044177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 msgr2=0x7f58a81cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58ad975640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 0x7f58a81cc0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58a400d7d0 tx=0x7f58a400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f58a400bd40 con 0x7f58a8072400 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: dump: 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.037 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:51.038 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4019070 con 0x7f58a8072400 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 5 monclient: authenticate success, global_id 5546 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f58a40148a0 con 0x7f58a8072400 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589e7fc640 10 monclient: dump: 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:51.040 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f589ffff640 4 set_mon_vals no callback set 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 10 monclient: _renew_subs 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:51.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a80a3910 con 0x7f58a8072400 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 10 monclient: _renew_subs 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.016+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a8124100 con 0x7f58a8072400 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.017+0000 7f58afbd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.017+0000 7f58afbd9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.017+0000 7f58afbd9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.017+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a80a17d0 con 0x7f58a8072400 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.017+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f58a4014430 con 0x7f58a8072400 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.018+0000 7f589e7fc640 1 --2- 172.21.15.71:0/1823044177 >> v2:172.21.15.135:6800/726754104 conn(0x7f588c03e9b0 0x7f588c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.018+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(108..108 src has 1..108) ==== 3506+0+0 (secure 0 0 0) 0x7f58a400f040 con 0x7f58a8072400 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.018+0000 7f58ad174640 1 --2- 172.21.15.71:0/1823044177 >> v2:172.21.15.135:6800/726754104 conn(0x7f588c03e9b0 0x7f588c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.018+0000 7f58ad174640 10 monclient: get_auth_request con 0x7f588c03e9b0 auth_method 0 2024-08-19T11:13:51.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.020+0000 7f58ad174640 1 --2- 172.21.15.71:0/1823044177 >> v2:172.21.15.135:6800/726754104 conn(0x7f588c03e9b0 0x7f588c040e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5898034000 tx=0x7f589802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:51.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.022+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f58a400bab0 con 0x7f58a8072400 2024-08-19T11:13:51.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.022+0000 7f589e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:51.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.022+0000 7f589e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:51.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.270+0000 7f58afbd9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:51.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.270+0000 7f58afbd9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:51.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.270+0000 7f58afbd9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:13:51.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:51.270+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58a81cc610 con 0x7f58a8072400 2024-08-19T11:13:54.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:54.013+0000 7f589d7fa640 10 monclient: tick 2024-08-19T11:13:54.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:54.013+0000 7f589d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:54.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:54.013+0000 7f589d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:54.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:54.014+0000 7f589d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:55.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:55.014+0000 7f589d7fa640 10 monclient: tick 2024-08-19T11:13:55.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:55.014+0000 7f589d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:55.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:55.014+0000 7f589d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:56.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.014+0000 7f589d7fa640 10 monclient: tick 2024-08-19T11:13:56.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.014+0000 7f589d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:56.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.014+0000 7f589d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":70,"quorum":[0,1,2,6,7,8],"quorum_names":["a","f","b","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.214+0000 7f589e7fc640 1 -- 172.21.15.71:0/1823044177 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7f58a401da20 con 0x7f58a8072400 2024-08-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.214+0000 7f589e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.214+0000 7f589e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.218+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 >> v2:172.21.15.135:6800/726754104 conn(0x7f588c03e9b0 msgr2=0x7f588c040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.218+0000 7f58afbd9640 1 --2- 172.21.15.71:0/1823044177 >> v2:172.21.15.135:6800/726754104 conn(0x7f588c03e9b0 0x7f588c040e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5898034000 tx=0x7f589802e000 comp rx=0 tx=0).stop 2024-08-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.218+0000 7f58afbd9640 10 monclient: shutdown 2024-08-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.218+0000 7f58afbd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.218+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 msgr2=0x7f58a81cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.218+0000 7f58afbd9640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 0x7f58a81cc0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f58a400d7d0 tx=0x7f58a400dc90 comp rx=0 tx=0).stop 2024-08-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 shutdown_connections 2024-08-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 --2- 172.21.15.71:0/1823044177 >> v2:172.21.15.135:6800/726754104 conn(0x7f588c03e9b0 0x7f588c040e70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58a80a60f0 0x7f58a8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f58a80a57d0 0x7f58a8136740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:56.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 --2- 172.21.15.71:0/1823044177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58a8072400 0x7f58a81cc0d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:56.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 >> 172.21.15.71:0/1823044177 conn(0x7f58a80aa3f0 msgr2=0x7f58a81bfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:56.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 shutdown_connections 2024-08-19T11:13:56.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:56.219+0000 7f58afbd9640 1 -- 172.21.15.71:0/1823044177 wait complete. 2024-08-19T11:13:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: starting. 2024-08-19T11:13:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25460 2024-08-19T11:13:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: created object 0... 2024-08-19T11:13:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: created object 25... 2024-08-19T11:13:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: created object 49... 2024-08-19T11:13:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: finishing. 2024-08-19T11:13:58.010 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25461]: shutting down. 2024-08-19T11:13:59.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:13:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.343+0000 7f32894d3640 10 monclient: get_monmap_and_config 2024-08-19T11:13:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.343+0000 7f32894d3640 10 monclient: build_initial_monmap 2024-08-19T11:13:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.343+0000 7f32894d3640 10 monclient: monmap: 2024-08-19T11:13:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:59.344433+0000 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:59.344433+0000 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:59.348 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:59.348 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 1 Processor -- start 2024-08-19T11:13:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 1 -- start start 2024-08-19T11:13:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 10 monclient: init 2024-08-19T11:13:59.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 10 monclient: _add_conns ranks=[9,2,1,3,7,4,6,8,0,10,5] 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f32840a6a30 0x7f32840a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 10 monclient(hunting): picked mon.noname-a con 0x7f32840a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.344+0000 7f32894d3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 0x7f32840a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 10 monclient(hunting): picked mon.noname-b con 0x7f32840a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3284139860 addr v1:172.21.15.135:6789/0 2024-08-19T11:13:59.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840a4f90 con 0x7f3284139860 2024-08-19T11:13:59.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f32840a6380 con 0x7f32840a6a30 2024-08-19T11:13:59.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f32840a49d0 con 0x7f32840a6e10 2024-08-19T11:13:59.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32894d3640 10 monclient(hunting): authenticate will time out at 897.386084s 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f32840a6a30 0x7f32840a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 0x7f32840a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f32840a6a30 0x7f32840a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52934/0 (socket says 172.21.15.71:52934) 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 0x7f32840a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43312/0 (socket says 172.21.15.71:43312) 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 -- 172.21.15.71:0/3621763050 learned_addr learned my addr 172.21.15.71:0/3621763050 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:59.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): get_auth_request con 0x7f32840a6a30 auth_method 0 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): get_auth_request con 0x7f32840a6e10 auth_method 0 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient(hunting): handle_auth_done global_id 34425 payload 274 2024-08-19T11:13:59.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 -- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 msgr2=0x7f32840a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:59.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 --2- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 0x7f32840a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 -- 172.21.15.71:0/3621763050 >> v1:172.21.15.135:6789/0 conn(0x7f3284139860 legacy=0x7f3284139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:59.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 monclient: found mon.noname-a 2024-08-19T11:13:59.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:13:59.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f3282ffd640 1 -- 172.21.15.71:0/3621763050 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32840a46f0 con 0x7f32840a6a30 2024-08-19T11:13:59.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.345+0000 7f32827fc640 1 --2- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 0x7f32840a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:59.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3282ffd640 1 -- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32840a6a30 msgr2=0x7f32840a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3282ffd640 1 --2- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32840a6a30 0x7f32840a57f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3274009870 tx=0x7f327402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75598177392153a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 1 -- 172.21.15.71:0/3621763050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3274037070 con 0x7f32840a6a30 2024-08-19T11:13:59.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:13:59.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: dump: 2024-08-19T11:13:59.370 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.370 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.371 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.372 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 1 -- 172.21.15.71:0/3621763050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327402ae00 con 0x7f32840a6a30 2024-08-19T11:13:59.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:59.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f32894d3640 5 monclient: authenticate success, global_id 34425 2024-08-19T11:13:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 1 -- 172.21.15.71:0/3621763050 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3274030c20 con 0x7f32840a6a30 2024-08-19T11:13:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f3281ffb640 10 monclient: dump: 2024-08-19T11:13:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.374 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.375 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f32894d3640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.348+0000 7f32894d3640 4 set_mon_vals no callback set 2024-08-19T11:13:59.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 10 monclient: shutdown 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 -- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32840a6a30 msgr2=0x7f32840a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 --2- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32840a6a30 0x7f32840a57f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3274009870 tx=0x7f327402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 -- 172.21.15.71:0/3621763050 shutdown_connections 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 --2- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f32840a6e10 0x7f32840a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 --2- 172.21.15.71:0/3621763050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f32840a6a30 0x7f32840a57f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 -- 172.21.15.71:0/3621763050 >> 172.21.15.71:0/3621763050 conn(0x7f32840ac030 msgr2=0x7f32840ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 -- 172.21.15.71:0/3621763050 shutdown_connections 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 1 -- 172.21.15.71:0/3621763050 wait complete. 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 10 monclient: build_initial_monmap 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.349+0000 7f32894d3640 10 monclient: monmap: 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:59.377 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:59.378 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 Processor -- start 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 -- start start 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient: init 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient: _add_conns ranks=[5,8,1,3,6,0,2,4,7] 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32840a6a30 0x7f32841ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): picked mon.noname-h con 0x7f32840a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 0x7f3284138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): picked mon.noname-e con 0x7f32840a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3284139860 0x7f3284138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): picked mon.noname-f con 0x7f3284139860 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32840a7730 con 0x7f3284139860 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f328413a400 con 0x7f32840a6a30 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3284126460 con 0x7f32840a6e10 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32894d3640 10 monclient(hunting): authenticate will time out at 897.391914s 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.350+0000 7f32827fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 0x7f3284138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 0x7f3284138a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38232/0 (socket says 172.21.15.71:38232) 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 -- 172.21.15.71:0/239810353 learned_addr learned my addr 172.21.15.71:0/239810353 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): get_auth_request con 0x7f32840a6e10 auth_method 0 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f3282ffd640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32840a6a30 0x7f32841ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32837fe640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3284139860 0x7f3284138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f3282ffd640 10 monclient(hunting): get_auth_request con 0x7f32840a6a30 auth_method 0 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f3282ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f3282ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f3282ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32837fe640 10 monclient(hunting): get_auth_request con 0x7f3284139860 auth_method 0 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient(hunting): handle_auth_done global_id 5309 payload 824 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 -- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32840a6a30 msgr2=0x7f32841ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32840a6a30 0x7f32841ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 -- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3284139860 msgr2=0x7f3284138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3284139860 0x7f3284138fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 monclient: found mon.noname-e 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.351+0000 7f32827fc640 1 -- 172.21.15.71:0/239810353 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32840a2150 con 0x7f32840a6e10 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32827fc640 1 -- 172.21.15.71:0/239810353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 msgr2=0x7f3284138a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32827fc640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 0x7f3284138a80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f327800ebe0 tx=0x7f327800c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3278017070 con 0x7f32840a6e10 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: dump: 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.383 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 5 monclient: authenticate success, global_id 5309 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327800ce40 con 0x7f32840a6e10 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 10 monclient: _renew_subs 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3284124c60 con 0x7f32840a6e10 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3278013d50 con 0x7f32840a6e10 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f326b7fe640 10 monclient: dump: 2024-08-19T11:13:59.385 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32817fa640 4 set_mon_vals no callback set 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 10 monclient: _renew_subs 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.353+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f3284124100 con 0x7f32840a6e10 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.354+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f327801a070 con 0x7f32840a6e10 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.354+0000 7f32894d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.354+0000 7f32894d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.354+0000 7f32894d3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.354+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32840a57f0 con 0x7f32840a6e10 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.354+0000 7f326b7fe640 1 --2- 172.21.15.71:0/239810353 >> v2:172.21.15.135:6800/726754104 conn(0x7f327003ea80 0x7f3270040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.355+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (secure 0 0 0) 0x7f327800f040 con 0x7f32840a6e10 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.355+0000 7f3282ffd640 1 --2- 172.21.15.71:0/239810353 >> v2:172.21.15.135:6800/726754104 conn(0x7f327003ea80 0x7f3270040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.355+0000 7f3282ffd640 10 monclient: get_auth_request con 0x7f327003ea80 auth_method 0 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.357+0000 7f3282ffd640 1 --2- 172.21.15.71:0/239810353 >> v2:172.21.15.135:6800/726754104 conn(0x7f327003ea80 0x7f3270040f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3274009870 tx=0x7f327402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.359+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f3278021070 con 0x7f32840a6e10 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.359+0000 7f326b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.359+0000 7f326b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:59.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.599+0000 7f32894d3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:13:59.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.599+0000 7f32894d3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:59.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.599+0000 7f32894d3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.599+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f328406ca70 con 0x7f32840a6e10 2024-08-19T11:13:59.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.600+0000 7f326b7fe640 1 -- 172.21.15.71:0/239810353 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f3278050b10 con 0x7f32840a6e10 2024-08-19T11:13:59.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.600+0000 7f326b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:13:59.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.600+0000 7f326b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:59.603 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":74,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 >> v2:172.21.15.135:6800/726754104 conn(0x7f327003ea80 msgr2=0x7f3270040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 --2- 172.21.15.71:0/239810353 >> v2:172.21.15.135:6800/726754104 conn(0x7f327003ea80 0x7f3270040f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3274009870 tx=0x7f327402e000 comp rx=0 tx=0).stop 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 10 monclient: shutdown 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 msgr2=0x7f3284138a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 0x7f3284138a80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f327800ebe0 tx=0x7f327800c520 comp rx=0 tx=0).stop 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 shutdown_connections 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 --2- 172.21.15.71:0/239810353 >> v2:172.21.15.135:6800/726754104 conn(0x7f327003ea80 0x7f3270040f40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32840a6e10 0x7f3284138a80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3284139860 0x7f3284138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 --2- 172.21.15.71:0/239810353 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32840a6a30 0x7f32841ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 >> 172.21.15.71:0/239810353 conn(0x7f32840ac030 msgr2=0x7f32840aa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:59.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 shutdown_connections 2024-08-19T11:13:59.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.602+0000 7f32894d3640 1 -- 172.21.15.71:0/239810353 wait complete. 2024-08-19T11:13:59.614 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:13:59.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:13:59.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:13:59.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.712+0000 7fa8ffede640 10 monclient: get_monmap_and_config 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.712+0000 7fa8ffede640 10 monclient: build_initial_monmap 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.712+0000 7fa8ffede640 10 monclient: monmap: 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:59.713030+0000 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:59.713030+0000 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:59.714 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.712+0000 7fa8ffede640 1 Processor -- start 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 1 -- start start 2024-08-19T11:13:59.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient: init 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient: _add_conns ranks=[4,0,5,7,9,10,6,3,2,1,8] 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 0x7fa8f80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f80a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8f80a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8f8139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): picked mon.noname-h con 0x7fa8f80a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f80a6380 con 0x7fa8f80a57c0 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa8f80a5020 con 0x7fa8f80a6950 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa8f80a7d40 con 0x7fa8f80a7270 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8ffede640 10 monclient(hunting): authenticate will time out at 897.754683s 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 0x7fa8f80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fd479640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa8f80a57c0 0x7fa8f8139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46234/0 (socket says 172.21.15.71:46234) 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fd479640 1 -- 172.21.15.71:0/727991549 learned_addr learned my addr 172.21.15.71:0/727991549 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 10 monclient(hunting): get_auth_request con 0x7fa8f80a6950 auth_method 0 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 msgr2=0x7fa8f80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 msgr2=0x7fa8f80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 0x7fa8f80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.713+0000 7fa8fdc7a640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 0x7fa8f80a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8f8139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 10 monclient(hunting): get_auth_request con 0x7fa8f80a7270 auth_method 0 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 msgr2=0x7fa8f8139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 msgr2=0x7fa8f8139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:13:59.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8f8139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.714+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8f8139e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.715+0000 7fa8fd479640 1 -- 172.21.15.71:0/727991549 >> v1:172.21.15.71:6789/0 conn(0x7fa8f80a57c0 legacy=0x7fa8f8139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287532939 0 0) 0x7fa8f80a6380 con 0x7fa8f80a57c0 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): _negotiate 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): my global_id is 34434 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8e4003520 con 0x7fa8f80a57c0 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3240367894 0 0) 0x7fa8e4003520 con 0x7fa8f80a57c0 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 msgr2=0x7fa8f8139e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8f8139e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 msgr2=0x7fa8f80a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f80a6950 0x7fa8f80a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80a3650 con 0x7fa8f80a57c0 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7fa8e8001cd0 con 0x7fa8f80a57c0 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8ffede640 5 monclient: authenticate success, global_id 34434 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8ffede640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:13:59.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: dump: 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 >> v1:172.21.15.71:6789/0 conn(0x7fa8f80a57c0 legacy=0x7fa8f8139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient: _add_conns ranks=[7,1,5,0,2,8,4,6,3] 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8e4004260 0x7fa8e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): picked mon.i con 0x7fa8e4004260 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e4004eb0 0x7fa8e40099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): picked mon.f con 0x7fa8e4004eb0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8e400bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): picked mon.h con 0x7fa8f80a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80a5020 con 0x7fa8e4004eb0 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa8f80a7d40 con 0x7fa8f80a7270 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa8e400c4a0 con 0x7fa8e4004260 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fcc78640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8ffede640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8e400bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e4004eb0 0x7fa8e40099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8e4004260 0x7fa8e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): get_auth_request con 0x7fa8f80a7270 auth_method 0 2024-08-19T11:13:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): get_auth_request con 0x7fa8e4004eb0 auth_method 0 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): get_auth_request con 0x7fa8e4004260 auth_method 0 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fe47b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.716+0000 7fa8fd479640 10 monclient(hunting): handle_auth_done global_id 34434 payload 293 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8e4004260 msgr2=0x7fa8e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8e4004260 0x7fa8e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 msgr2=0x7fa8e400bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8e400bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 1 monclient: found mon.f 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 1 -- 172.21.15.71:0/727991549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e4003520 con 0x7fa8e4004eb0 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fd479640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.717+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa8f80a7270 0x7fa8e400bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.719+0000 7fa8fd479640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e4004eb0 msgr2=0x7fa8e40099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.719+0000 7fa8fd479640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e4004eb0 0x7fa8e40099b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8001eb0 tx=0x7fa8e4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9315e84cba73331 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8e8008d20 con 0x7fa8e4004eb0 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:59.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: dump: 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.733 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e8005d40 con 0x7fa8e4004eb0 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 1 -- 172.21.15.71:0/727991549 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8e8008540 con 0x7fa8e4004eb0 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 4 set_mon_vals no callback set 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fcc78640 10 monclient: dump: 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.734 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.735 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 10 monclient: shutdown 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 1 -- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e4004eb0 msgr2=0x7fa8e40099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 1 --2- 172.21.15.71:0/727991549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8e4004eb0 0x7fa8e40099b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8001eb0 tx=0x7fa8e4005830 comp rx=0 tx=0).stop 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8fe47b640 1 -- 172.21.15.71:0/727991549 reap_dead start 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 1 -- 172.21.15.71:0/727991549 shutdown_connections 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.720+0000 7fa8ffede640 1 -- 172.21.15.71:0/727991549 >> 172.21.15.71:0/727991549 conn(0x7fa8f80abf50 msgr2=0x7fa8f80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 1 -- 172.21.15.71:0/727991549 shutdown_connections 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 1 -- 172.21.15.71:0/727991549 wait complete. 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 10 monclient: build_initial_monmap 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 10 monclient: monmap: 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:59.736 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:59.737 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 1 Processor -- start 2024-08-19T11:13:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 1 -- start start 2024-08-19T11:13:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.721+0000 7fa8ffede640 10 monclient: init 2024-08-19T11:13:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient: _add_conns ranks=[6,3,4,7,5,0,2,8,1] 2024-08-19T11:13:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 0x7fa8f81ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): picked mon.noname-d con 0x7fa8e4004eb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 0x7fa8f8139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): picked mon.noname-g con 0x7fa8f8125e70 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 0x7fa8f8123960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f813a1f0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f80a8700 con 0x7fa8f8125e70 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa8f80a84c0 con 0x7fa8f813a1f0 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa8f80a7690 con 0x7fa8e4004eb0 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8ffede640 10 monclient(hunting): authenticate will time out at 897.763396s 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 0x7fa8f8123960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 0x7fa8f81ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 0x7fa8f81ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:46048/0 (socket says 172.21.15.71:46048) 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/2918283846 learned_addr learned my addr 172.21.15.71:0/2918283846 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): get_auth_request con 0x7fa8e4004eb0 auth_method 0 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 0x7fa8f8123960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:43012/0 (socket says 172.21.15.71:43012) 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 10 monclient(hunting): get_auth_request con 0x7fa8f813a1f0 auth_method 0 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 0x7fa8f8139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 msgr2=0x7fa8f8123960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 msgr2=0x7fa8f8123960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 0x7fa8f8123960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 10 monclient(hunting): get_auth_request con 0x7fa8f8125e70 auth_method 0 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 0x7fa8f8123960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 msgr2=0x7fa8f8139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 msgr2=0x7fa8f8139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 0x7fa8f8139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 0x7fa8f8139cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:13:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient(hunting): handle_auth_done global_id 24846 payload 824 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 msgr2=0x7fa8f8123960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa8f813a1f0 0x7fa8f8123960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 msgr2=0x7fa8f8139cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8f8125e70 0x7fa8f8139cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 monclient: found mon.noname-d 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.722+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80a93c0 con 0x7fa8e4004eb0 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8fdc7a640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 msgr2=0x7fa8f81ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8fdc7a640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 0x7fa8f81ce1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4006c00 tx=0x7fa8f4010de0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8f401a020 con 0x7fa8e4004eb0 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: dump: 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.758 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f400ec90 con 0x7fa8e4004eb0 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 5 monclient: authenticate success, global_id 24846 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 10 monclient: _renew_subs 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8f400ee40 con 0x7fa8e4004eb0 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f8125310 con 0x7fa8e4004eb0 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ee7fc640 10 monclient: dump: 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.760 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.761 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.762 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.762 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.762 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.762 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.762 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.762 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ef7fe640 4 set_mon_vals no callback set 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 10 monclient: _renew_subs 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.725+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f8127670 con 0x7fa8e4004eb0 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ffede640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ffede640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 0x7fa8f81242c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f8076c60 con 0x7fa8f8123ea0 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 0x7fa8f81242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa8f401d020 con 0x7fa8e4004eb0 2024-08-19T11:13:59.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient: get_auth_request con 0x7fa8f8123ea0 auth_method 0 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 10 monclient(hunting): handle_auth_done global_id 34443 payload 824 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fd479640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8f81ce6e0 con 0x7fa8f8123ea0 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ee7fc640 1 --2- 172.21.15.71:0/2918283846 >> v2:172.21.15.135:6800/726754104 conn(0x7fa8dc03ea80 0x7fa8dc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (secure 0 0 0) 0x7fa8f400f040 con 0x7fa8e4004eb0 2024-08-19T11:13:59.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/2918283846 >> v2:172.21.15.135:6800/726754104 conn(0x7fa8dc03ea80 0x7fa8dc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.726+0000 7fa8fe47b640 10 monclient: get_auth_request con 0x7fa8dc03ea80 auth_method 0 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.728+0000 7fa8fd479640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 msgr2=0x7fa8f81242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.728+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 0x7fa8f81242c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8001ca0 tx=0x7fa8f80a5420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.728+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8e8008d00 con 0x7fa8f8123ea0 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.728+0000 7fa8ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.728+0000 7fa8ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.728+0000 7fa8ee7fc640 10 monclient: dump: 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.765 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.766 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa8e8008d00 con 0x7fa8f8123ea0 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 msgr2=0x7fa8f81242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 0x7fa8f81242c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8001ca0 tx=0x7fa8f80a5420 comp rx=0 tx=0).stop 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 msgr2=0x7fa8f81242c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8ee7fc640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f8123ea0 0x7fa8f81242c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.729+0000 7fa8fe47b640 1 --2- 172.21.15.71:0/2918283846 >> v2:172.21.15.135:6800/726754104 conn(0x7fa8dc03ea80 0x7fa8dc040f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80a2e70 tx=0x7fa8f0009770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8ffede640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:59.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8ffede640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 0x7fa8f809e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8ffede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f8124800 con 0x7fa8f809e540 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 0x7fa8f809e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient: get_auth_request con 0x7fa8f809e540 auth_method 0 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 10 monclient(hunting): handle_auth_done global_id 34452 payload 824 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.735+0000 7fa8fd479640 1 -- 172.21.15.71:0/2918283846 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8f80a6d30 con 0x7fa8f809e540 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.737+0000 7fa8fd479640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 msgr2=0x7fa8f809e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.737+0000 7fa8fd479640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 0x7fa8f809e9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806a300 tx=0x7fa8e800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.737+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa8e8008720 con 0x7fa8f809e540 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.737+0000 7fa8ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.737+0000 7fa8ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.737+0000 7fa8ee7fc640 10 monclient: dump: 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.769 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.770 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7fa8e8008720 con 0x7fa8f809e540 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 msgr2=0x7fa8f809e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 0x7fa8f809e9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806a300 tx=0x7fa8e800a000 comp rx=0 tx=0).stop 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 msgr2=0x7fa8f809e9d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:59.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ee7fc640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f809e540 0x7fa8f809e9d0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806a300 tx=0x7fa8e800a000 comp rx=0 tx=0).stop 2024-08-19T11:13:59.772 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:59.772 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:59.772 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:59.772 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:13:59.772 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:13:59.772 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 75253, 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:59.773 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:59.774 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:59.774 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:59.774 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:59.774 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.774 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:59.775 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:59.776 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:59.777 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:59.778 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:59.779 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.780 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:59.781 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.782 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:59.783 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.784 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:59.785 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:13:59.790 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.791 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:13:59.792 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.796 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:59.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:13:59.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.801 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:13:59.801 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:13:59.802 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25462]: starting. 2024-08-19T11:13:59.802 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25462]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25460 2024-08-19T11:13:59.802 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25462]: shutting down. 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 >> v2:172.21.15.135:6800/726754104 conn(0x7fa8dc03ea80 msgr2=0x7fa8dc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 --2- 172.21.15.71:0/2918283846 >> v2:172.21.15.135:6800/726754104 conn(0x7fa8dc03ea80 0x7fa8dc040f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80a2e70 tx=0x7fa8f0009770 comp rx=0 tx=0).stop 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 10 monclient: shutdown 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 msgr2=0x7fa8f81ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 0x7fa8f81ce1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4006c00 tx=0x7fa8f4010de0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8fe47b640 1 -- 172.21.15.71:0/2918283846 reap_dead start 2024-08-19T11:13:59.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 shutdown_connections 2024-08-19T11:13:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 --2- 172.21.15.71:0/2918283846 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa8e4004eb0 0x7fa8f81ce1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 >> 172.21.15.71:0/2918283846 conn(0x7fa8f80abf50 msgr2=0x7fa8f81c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 shutdown_connections 2024-08-19T11:13:59.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.738+0000 7fa8ffede640 1 -- 172.21.15.71:0/2918283846 wait complete. 2024-08-19T11:13:59.804 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:13:59.804 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:13:59.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:13:59.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.942+0000 7f70ab111640 10 monclient: get_monmap_and_config 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.942+0000 7f70ab111640 10 monclient: build_initial_monmap 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.942+0000 7f70ab111640 10 monclient: monmap: 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:13:59.943071+0000 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:13:59.943071+0000 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:13:59.944 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 Processor -- start 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 -- start start 2024-08-19T11:13:59.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient: init 2024-08-19T11:13:59.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient: _add_conns ranks=[8,6,0,1,10,4,3,9,5,7,2] 2024-08-19T11:13:59.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 0x7f70a40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): picked mon.noname-e con 0x7f70a40a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:59.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70a40a57c0 0x7f70a40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): picked mon.noname-d con 0x7f70a40a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f70a4139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a40a6380 con 0x7f70a4139710 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f70a40a5020 con 0x7f70a40a57c0 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f70a40a77b0 con 0x7f70a40a6950 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70ab111640 10 monclient(hunting): authenticate will time out at 897.984768s 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a8ead640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 0x7f70a40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70a40a57c0 0x7f70a40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a96ae640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f70a4139710 0x7f70a4139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46236/0 (socket says 172.21.15.71:46236) 2024-08-19T11:13:59.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a96ae640 1 -- 172.21.15.71:0/1974555815 learned_addr learned my addr 172.21.15.71:0/1974555815 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a8ead640 10 monclient(hunting): get_auth_request con 0x7f70a40a6950 auth_method 0 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a8ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a8ead640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a8ead640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a3fff640 10 monclient(hunting): get_auth_request con 0x7f70a40a57c0 auth_method 0 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.943+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 10 monclient(hunting): handle_auth_done global_id 5336 payload 274 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 1 -- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70a40a57c0 msgr2=0x7f70a40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 1 --2- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70a40a57c0 0x7f70a40a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 1 -- 172.21.15.71:0/1974555815 >> v1:172.21.15.71:6789/0 conn(0x7f70a4139710 legacy=0x7f70a4139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 1 monclient: found mon.noname-e 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a8ead640 1 -- 172.21.15.71:0/1974555815 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a40a3650 con 0x7f70a40a6950 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.944+0000 7f70a3fff640 1 --2- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70a40a57c0 0x7f70a40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.946+0000 7f70a8ead640 1 -- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 msgr2=0x7f70a40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.946+0000 7f70a8ead640 1 --2- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 0x7f70a40a6d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7098009800 tx=0x7f7098029fd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7430f16121ac2877 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 1 -- 172.21.15.71:0/1974555815 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7098037070 con 0x7f70a40a6950 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: dump: 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.961 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 1 -- 172.21.15.71:0/1974555815 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709802acf0 con 0x7f70a40a6950 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 5 monclient: authenticate success, global_id 5336 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 10 monclient: get_monmap_and_config success 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 1 -- 172.21.15.71:0/1974555815 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7098030c20 con 0x7f70a40a6950 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 4 set_mon_vals no callback set 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70a37fe640 10 monclient: dump: 2024-08-19T11:13:59.963 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.964 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.964 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.964 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.964 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.964 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.965 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 10 monclient: shutdown 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 -- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 msgr2=0x7f70a40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 --2- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 0x7f70a40a6d30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7098009800 tx=0x7f7098029fd0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 -- 172.21.15.71:0/1974555815 shutdown_connections 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 --2- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70a40a57c0 0x7f70a40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 --2- 172.21.15.71:0/1974555815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a40a6950 0x7f70a40a6d30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 -- 172.21.15.71:0/1974555815 >> 172.21.15.71:0/1974555815 conn(0x7f70a40abf50 msgr2=0x7f70a40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 -- 172.21.15.71:0/1974555815 shutdown_connections 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.947+0000 7f70ab111640 1 -- 172.21.15.71:0/1974555815 wait complete. 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.948+0000 7f70ab111640 10 monclient: build_initial_monmap 2024-08-19T11:13:59.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.948+0000 7f70ab111640 10 monclient: monmap: 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:13:59.967 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.948+0000 7f70ab111640 1 Processor -- start 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.948+0000 7f70ab111640 1 -- start start 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.948+0000 7f70ab111640 10 monclient: init 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient: _reopen_session rank -1 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient: _add_conns ranks=[5,1,8,4,0,2,7,3,6] 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f70a40a57c0 0x7f70a4124ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): picked mon.noname-h con 0x7f70a40a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70a40a6950 0x7f70a4125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): picked mon.noname-f con 0x7f70a40a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:13:59.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 0x7f70a4125760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): picked mon.noname-e con 0x7f70a4139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70a40a84c0 con 0x7f70a40a6950 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f70a40a7d40 con 0x7f70a40a57c0 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f70a40a8700 con 0x7f70a4139710 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): _renew_subs 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70ab111640 10 monclient(hunting): authenticate will time out at 897.990389s 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 0x7f70a4125760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 0x7f70a4125760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38248/0 (socket says 172.21.15.71:38248) 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 learned_addr learned my addr 172.21.15.71:0/491984649 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): get_auth_request con 0x7f70a4139710 auth_method 0 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a8ead640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f70a40a57c0 0x7f70a4124ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a3fff640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70a40a6950 0x7f70a4125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient(hunting): handle_auth_done global_id 5345 payload 824 2024-08-19T11:13:59.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f70a40a57c0 msgr2=0x7f70a4124ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f70a40a57c0 0x7f70a4124ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70a40a6950 msgr2=0x7f70a4125220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70a40a6950 0x7f70a4125220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient: _finish_hunting 0 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 monclient: found mon.noname-e 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a4128b00 con 0x7f70a4139710 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a3fff640 10 monclient: get_auth_request con 0x7f70a40a6950 auth_method 0 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a8ead640 10 monclient: get_auth_request con 0x7f70a40a57c0 auth_method 0 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a3fff640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70a40a6950 0x7f70a4125220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.949+0000 7f70a8ead640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f70a40a57c0 0x7f70a4124ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:13:59.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.951+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 msgr2=0x7f70a4125760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.951+0000 7f70a96ae640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 0x7f70a4125760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f709c00b9d0 tx=0x7f709c00be90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f709c019070 con 0x7f70a4139710 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: dump: 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.973 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: _finish_auth 0 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: _check_auth_tickets 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:13:59.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709c00cbe0 con 0x7f70a4139710 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 5 monclient: authenticate success, global_id 5345 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 10 monclient: _renew_subs 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a40a1f00 con 0x7f70a4139710 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f709c00cd90 con 0x7f70a4139710 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a17fa640 10 monclient: dump: 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.975 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 10 monclient: _renew_subs 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:13:59.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a4127c90 con 0x7f70a4139710 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70a2ffd640 4 set_mon_vals no callback set 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.952+0000 7f70ab111640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 0x7f70a4063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f70a40a3f10 con 0x7f70a402e340 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 0x7f70a4063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient: get_auth_request con 0x7f70a402e340 auth_method 0 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a96ae640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 0x7f70a4125760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f709c00b9d0 tx=0x7f709c00be90 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f709c051880 osd_map(111..111 src has 1..111) 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f709c0133a0 con 0x7f70a4139710 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 10 monclient(hunting): handle_auth_done global_id 5600 payload 824 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a8ead640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70a402e720 con 0x7f70a402e340 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a17fa640 1 --2- 172.21.15.71:0/491984649 >> v2:172.21.15.135:6800/726754104 conn(0x7f708803ea80 0x7f7088040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a3fff640 1 --2- 172.21.15.71:0/491984649 >> v2:172.21.15.135:6800/726754104 conn(0x7f708803ea80 0x7f7088040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.953+0000 7f70a3fff640 10 monclient: get_auth_request con 0x7f708803ea80 auth_method 0 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a8ead640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 msgr2=0x7f70a4063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a8ead640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 0x7f70a4063a80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7098034000 tx=0x7f70980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7098042020 con 0x7f70a402e340 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:59.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 10 monclient: dump: 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.979 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7098003820 con 0x7f70a402e340 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 msgr2=0x7f70a4063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.955+0000 7f70a17fa640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 0x7f70a4063a80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7098034000 tx=0x7f70980046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.956+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 msgr2=0x7f70a4063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.956+0000 7f70a17fa640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a402e340 0x7f70a4063a80 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7098034000 tx=0x7f70980046c0 comp rx=0 tx=0).stop 2024-08-19T11:13:59.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.956+0000 7f70a3fff640 1 --2- 172.21.15.71:0/491984649 >> v2:172.21.15.135:6800/726754104 conn(0x7f708803ea80 0x7f7088040f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f70a4126e10 tx=0x7f7090008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70ab111640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:13:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70ab111640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 0x7f70a41d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:13:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70ab111640 10 monclient(hunting): start opening mon connection 2024-08-19T11:13:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f70a4076c60 con 0x7f70a4063fc0 2024-08-19T11:13:59.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 0x7f70a41d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient: get_auth_request con 0x7f70a4063fc0 auth_method 0 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 10 monclient(hunting): handle_auth_done global_id 5609 payload 824 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.962+0000 7f70a8ead640 1 -- 172.21.15.71:0/491984649 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f70a40a6d30 con 0x7f70a4063fc0 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.964+0000 7f70a8ead640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 msgr2=0x7f70a41d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.964+0000 7f70a8ead640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 0x7f70a41d8990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f70a4077730 tx=0x7f7098008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.964+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7098042040 con 0x7f70a4063fc0 2024-08-19T11:13:59.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.964+0000 7f70a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.964+0000 7f70a17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.964+0000 7f70a17fa640 10 monclient: dump: 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:13:59.984 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f7098049280 con 0x7f70a4063fc0 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 msgr2=0x7f70a41d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 0x7f70a41d8990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f70a4077730 tx=0x7f7098008030 comp rx=0 tx=0).stop 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 msgr2=0x7f70a41d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:13:59.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70a4063fc0 0x7f70a41d8990 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f70a4077730 tx=0x7f7098008030 comp rx=0 tx=0).stop 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 236843, 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:13:59.986 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:59.987 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:59.988 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:13:59.989 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:13:59.990 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:13:59.991 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:13:59.993 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.996 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:13:59.997 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:13:59.998 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:13:59.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:00.001 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.003 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:00.006 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:00.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:00.008 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:00.009 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:00.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 >> v2:172.21.15.135:6800/726754104 conn(0x7f708803ea80 msgr2=0x7f7088040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:00.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 --2- 172.21.15.71:0/491984649 >> v2:172.21.15.135:6800/726754104 conn(0x7f708803ea80 0x7f7088040f40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f70a4126e10 tx=0x7f7090008040 comp rx=0 tx=0).stop 2024-08-19T11:14:00.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 10 monclient: shutdown 2024-08-19T11:14:00.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 msgr2=0x7f70a4125760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 --2- 172.21.15.71:0/491984649 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f70a4139710 0x7f70a4125760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f709c00b9d0 tx=0x7f709c00be90 comp rx=0 tx=0).stop 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 reap_dead start 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a96ae640 1 -- 172.21.15.71:0/491984649 reap_dead start 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70a17fa640 1 -- 172.21.15.71:0/491984649 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(111..111 src has 1..111) ==== 3506+0+0 (unknown 0 0 0) 0x7f709c051880 con 0x7f70a4139710 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 shutdown_connections 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 >> 172.21.15.71:0/491984649 conn(0x7f70a40abf50 msgr2=0x7f70a4138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 shutdown_connections 2024-08-19T11:14:00.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:13:59.965+0000 7f70ab111640 1 -- 172.21.15.71:0/491984649 wait complete. 2024-08-19T11:14:00.011 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:00.012 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:14:00.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:14:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.109+0000 7fcc3dd41640 10 monclient: get_monmap_and_config 2024-08-19T11:14:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.109+0000 7fcc3dd41640 10 monclient: build_initial_monmap 2024-08-19T11:14:00.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.109+0000 7fcc3dd41640 10 monclient: monmap: 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:00.109901+0000 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:00.109901+0000 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:00.113 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 Processor -- start 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 -- start start 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient: init 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient: _add_conns ranks=[0,10,9,5,3,4,7,2,6,1,8] 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcc380a4640 addr v1:172.21.15.71:6789/0 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc3806d500 0x7fcc3813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): picked mon.noname-f con 0x7fcc3806d500 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc380a5130 0x7fcc38141190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): picked mon.noname-a con 0x7fcc380a5130 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc380a1400 con 0x7fcc380a4640 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcc380a31a0 con 0x7fcc380a5130 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcc3809fab0 con 0x7fcc3806d500 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc3dd41640 10 monclient(hunting): authenticate will time out at 898.151576s 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc380a5130 0x7fcc38141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc377fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcc380a4640 0x7fcc380a4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46240/0 (socket says 172.21.15.71:46240) 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): get_auth_request con 0x7fcc380a5130 auth_method 0 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc377fe640 1 -- 172.21.15.71:0/2755573022 learned_addr learned my addr 172.21.15.71:0/2755573022 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:00.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc36ffd640 1 --2- 172.21.15.71:0/2755573022 >> v2:172.21.15.135:3300/0 conn(0x7fcc3806d500 0x7fcc3813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient(hunting): handle_auth_done global_id 34470 payload 274 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 1 -- 172.21.15.71:0/2755573022 >> v2:172.21.15.135:3300/0 conn(0x7fcc3806d500 msgr2=0x7fcc3813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 1 --2- 172.21.15.71:0/2755573022 >> v2:172.21.15.135:3300/0 conn(0x7fcc3806d500 0x7fcc3813ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 1 -- 172.21.15.71:0/2755573022 >> v1:172.21.15.71:6789/0 conn(0x7fcc380a4640 legacy=0x7fcc380a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 1 monclient: found mon.noname-a 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:00.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:00.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.110+0000 7fcc37fff640 1 -- 172.21.15.71:0/2755573022 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3806d040 con 0x7fcc380a5130 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.113+0000 7fcc37fff640 1 -- 172.21.15.71:0/2755573022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 msgr2=0x7fcc38141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.113+0000 7fcc37fff640 1 --2- 172.21.15.71:0/2755573022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38141190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc3806ea70 tx=0x7fcc3002a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39db91de951dc476 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 1 -- 172.21.15.71:0/2755573022 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc30007ca0 con 0x7fcc380a5130 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: dump: 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.124 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:00.125 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: _finish_auth 0 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: _check_auth_tickets 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 1 -- 172.21.15.71:0/2755573022 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc30031400 con 0x7fcc380a5130 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 5 monclient: authenticate success, global_id 34470 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:00.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 1 -- 172.21.15.71:0/2755573022 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc30007e60 con 0x7fcc380a5130 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 4 set_mon_vals no callback set 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc367fc640 10 monclient: dump: 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:00.127 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 10 monclient: shutdown 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2755573022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 msgr2=0x7fcc38141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2755573022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38141190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc3806ea70 tx=0x7fcc3002a4b0 comp rx=0 tx=0).stop 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2755573022 shutdown_connections 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2755573022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38141190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:00.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2755573022 >> v2:172.21.15.135:3300/0 conn(0x7fcc3806d500 0x7fcc3813ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2755573022 >> 172.21.15.71:0/2755573022 conn(0x7fcc3806dfe0 msgr2=0x7fcc380a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2755573022 shutdown_connections 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.114+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2755573022 wait complete. 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.115+0000 7fcc3dd41640 10 monclient: build_initial_monmap 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.115+0000 7fcc3dd41640 10 monclient: monmap: 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:00.129 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.115+0000 7fcc3dd41640 1 Processor -- start 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.115+0000 7fcc3dd41640 1 -- start start 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.115+0000 7fcc3dd41640 10 monclient: init 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient: _add_conns ranks=[3,1,0,2,6,5,8,4,7] 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 0x7fcc38126410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): picked mon.noname-g con 0x7fcc3806d500 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc380a4640 0x7fcc38126950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): picked mon.noname-f con 0x7fcc380a4640 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38126e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): picked mon.noname-a con 0x7fcc380a5130 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc380a6170 con 0x7fcc380a5130 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc381416d0 con 0x7fcc380a4640 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3809f0c0 con 0x7fcc3806d500 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc3dd41640 10 monclient(hunting): authenticate will time out at 898.157235s 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38126e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38126e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52980/0 (socket says 172.21.15.71:52980) 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 -- 172.21.15.71:0/2309422834 learned_addr learned my addr 172.21.15.71:0/2309422834 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): get_auth_request con 0x7fcc380a5130 auth_method 0 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 0x7fcc38126410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 10 monclient(hunting): get_auth_request con 0x7fcc3806d500 auth_method 0 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc380a4640 0x7fcc38126950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:00.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): get_auth_request con 0x7fcc380a4640 auth_method 0 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 msgr2=0x7fcc38126410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 msgr2=0x7fcc38126410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 0x7fcc38126410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 0x7fcc38126410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc36ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient(hunting): handle_auth_done global_id 34479 payload 824 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 msgr2=0x7fcc38126410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc3806d500 0x7fcc38126410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc380a4640 msgr2=0x7fcc38126950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:00.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc380a4640 0x7fcc38126950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 monclient: found mon.noname-a 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.116+0000 7fcc37fff640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc380a2330 con 0x7fcc380a5130 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.118+0000 7fcc37fff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 msgr2=0x7fcc38126e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.118+0000 7fcc37fff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38126e90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc3002a9d0 tx=0x7fcc30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.118+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc30007e30 con 0x7fcc380a5130 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: dump: 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:00.134 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:00.135 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: _finish_auth 0 2024-08-19T11:14:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:14:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 5 monclient: authenticate success, global_id 34479 2024-08-19T11:14:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc300046c0 con 0x7fcc380a5130 2024-08-19T11:14:00.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 10 monclient: _renew_subs 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc38129f10 con 0x7fcc380a5130 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc30031a20 con 0x7fcc380a5130 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc2ffff640 10 monclient: dump: 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:00.137 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc35ffb640 4 set_mon_vals no callback set 2024-08-19T11:14:00.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 10 monclient: _renew_subs 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3812a1f0 con 0x7fcc380a5130 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.119+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcc3806d2c0 con 0x7fcc381ce5e0 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 10 monclient: get_auth_request con 0x7fcc381ce5e0 auth_method 0 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcc30031c00 con 0x7fcc380a5130 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:14:00.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc2ffff640 1 --2- 172.21.15.71:0/2309422834 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc1803ea80 0x7fcc18040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 3506+0+0 (secure 0 0 0) 0x7fcc30072af0 con 0x7fcc380a5130 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc36ffd640 1 --2- 172.21.15.71:0/2309422834 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc1803ea80 0x7fcc18040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.120+0000 7fcc36ffd640 10 monclient: get_auth_request con 0x7fcc1803ea80 auth_method 0 2024-08-19T11:14:00.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.123+0000 7fcc36ffd640 1 --2- 172.21.15.71:0/2309422834 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc1803ea80 0x7fcc18040f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000aac0 tx=0x7fcc20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 10 monclient: get_auth_request con 0x7fcc381ce5e0 auth_method 0 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:14:00.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:00.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.321+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 10 monclient: get_auth_request con 0x7fcc381ce5e0 auth_method 0 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:00.722+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:14:01.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient: get_auth_request con 0x7fcc381ce5e0 auth_method 0 2024-08-19T11:14:01.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 10 monclient(hunting): handle_auth_done global_id 44104 payload 824 2024-08-19T11:14:01.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.524+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc380a4a20 con 0x7fcc381ce5e0 2024-08-19T11:14:01.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.526+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.526+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc28007c90 tx=0x7fcc28011cc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc28018070 con 0x7fcc381ce5e0 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 10 monclient: dump: 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.530 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.531 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcc2800fa60 con 0x7fcc381ce5e0 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc28007c90 tx=0x7fcc28011cc0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 msgr2=0x7fcc381ce9c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:01.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.529+0000 7fcc2ffff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381ce5e0 0x7fcc381ce9c0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc28007c90 tx=0x7fcc28011cc0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc3dd41640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:01.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 0x7fcc38123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc3dd41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcc3806cc70 con 0x7fcc381cef00 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 0x7fcc38123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient: get_auth_request con 0x7fcc381cef00 auth_method 0 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.536+0000 7fcc377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.537+0000 7fcc377fe640 10 monclient(hunting): handle_auth_done global_id 44113 payload 824 2024-08-19T11:14:01.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.537+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc38127ec0 con 0x7fcc381cef00 2024-08-19T11:14:01.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.539+0000 7fcc377fe640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 msgr2=0x7fcc38123690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.539+0000 7fcc377fe640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 0x7fcc38123690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2801a000 tx=0x7fcc28007c20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.539+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc28018050 con 0x7fcc381cef00 2024-08-19T11:14:01.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.539+0000 7fcc2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.539+0000 7fcc2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.539+0000 7fcc2ffff640 10 monclient: dump: 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.541 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7fcc28014430 con 0x7fcc381cef00 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:01.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 msgr2=0x7fcc38123690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 0x7fcc38123690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2801a000 tx=0x7fcc28007c20 comp rx=0 tx=0).stop 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 msgr2=0x7fcc38123690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc2ffff640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcc381cef00 0x7fcc38123690 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc2801a000 tx=0x7fcc28007c20 comp rx=0 tx=0).stop 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:01.543 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 10552, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:01.544 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.545 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.546 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:01.547 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.548 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.549 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.554 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.556 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:01.556 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:01.558 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:01.559 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.560 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.562 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.566 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:01.568 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.570 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:01.570 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:01.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc1803ea80 msgr2=0x7fcc18040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2309422834 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc1803ea80 0x7fcc18040f40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000aac0 tx=0x7fcc20008040 comp rx=0 tx=0).stop 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 10 monclient: shutdown 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 msgr2=0x7fcc38126e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38126e90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc3002a9d0 tx=0x7fcc30004a40 comp rx=0 tx=0).stop 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc37fff640 1 -- 172.21.15.71:0/2309422834 reap_dead start 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 shutdown_connections 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 --2- 172.21.15.71:0/2309422834 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc380a5130 0x7fcc38126e90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 >> 172.21.15.71:0/2309422834 conn(0x7fcc3806dfe0 msgr2=0x7fcc38070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 shutdown_connections 2024-08-19T11:14:01.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.540+0000 7fcc3dd41640 1 -- 172.21.15.71:0/2309422834 wait complete. 2024-08-19T11:14:01.573 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:01.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:14:01.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:14:01.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.679+0000 7fe09167e640 10 monclient: get_monmap_and_config 2024-08-19T11:14:01.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.679+0000 7fe09167e640 10 monclient: build_initial_monmap 2024-08-19T11:14:01.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.679+0000 7fe09167e640 10 monclient: monmap: 2024-08-19T11:14:01.681 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:01.681 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:01.680553+0000 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:01.680553+0000 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:01.682 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:01.683 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.680+0000 7fe09167e640 1 Processor -- start 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.680+0000 7fe09167e640 1 -- start start 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.680+0000 7fe09167e640 10 monclient: init 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient: _add_conns ranks=[5,4,1,10,7,8,0,9,6,3,2] 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe08c0a6950 0x7fe08c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): picked mon.noname-h con 0x7fe08c0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 0x7fe08c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): picked mon.noname-c con 0x7fe08c0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe08c139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:14:01.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0a6380 con 0x7fe08c139710 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe08c0a5020 con 0x7fe08c0a57c0 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe08c0a77b0 con 0x7fe08c0a6950 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe09167e640 10 monclient(hunting): authenticate will time out at 899.722209s 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 0x7fe08c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 0x7fe08c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:43072/0 (socket says 172.21.15.71:43072) 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 -- 172.21.15.71:0/1290529273 learned_addr learned my addr 172.21.15.71:0/1290529273 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): get_auth_request con 0x7fe08c0a57c0 auth_method 0 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08affd640 1 --2- 172.21.15.71:0/1290529273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe08c0a6950 0x7fe08c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08affd640 10 monclient(hunting): get_auth_request con 0x7fe08c0a6950 auth_method 0 2024-08-19T11:14:01.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_done global_id 44122 payload 274 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 -- 172.21.15.71:0/1290529273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe08c0a6950 msgr2=0x7fe08c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/1290529273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe08c0a6950 0x7fe08c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 -- 172.21.15.71:0/1290529273 >> v1:172.21.15.135:6789/0 conn(0x7fe08c139710 legacy=0x7fe08c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:14:01.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 monclient: found mon.noname-c 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.681+0000 7fe08a7fc640 1 -- 172.21.15.71:0/1290529273 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0a3650 con 0x7fe08c0a57c0 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe08a7fc640 1 -- 172.21.15.71:0/1290529273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 msgr2=0x7fe08c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/1290529273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 0x7fe08c0a7270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe080009e80 tx=0x7fe08002a530 comp rx=0 tx=0).ready entity=mon.4 client_cookie=935fecb42fdceabe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 1 -- 172.21.15.71:0/1290529273 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe080036070 con 0x7fe08c0a57c0 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: dump: 2024-08-19T11:14:01.699 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.700 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 1 -- 172.21.15.71:0/1290529273 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe080007a70 con 0x7fe08c0a57c0 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe09167e640 5 monclient: authenticate success, global_id 44122 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe09167e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:01.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe09167e640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 1 -- 172.21.15.71:0/1290529273 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe080007c20 con 0x7fe08c0a57c0 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe09167e640 4 set_mon_vals no callback set 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.684+0000 7fe089ffb640 10 monclient: dump: 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.702 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 10 monclient: shutdown 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 -- 172.21.15.71:0/1290529273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 msgr2=0x7fe08c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 --2- 172.21.15.71:0/1290529273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 0x7fe08c0a7270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe080009e80 tx=0x7fe08002a530 comp rx=0 tx=0).stop 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 -- 172.21.15.71:0/1290529273 shutdown_connections 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 --2- 172.21.15.71:0/1290529273 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe08c0a57c0 0x7fe08c0a7270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 --2- 172.21.15.71:0/1290529273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe08c0a6950 0x7fe08c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 -- 172.21.15.71:0/1290529273 >> 172.21.15.71:0/1290529273 conn(0x7fe08c0abf50 msgr2=0x7fe08c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 -- 172.21.15.71:0/1290529273 shutdown_connections 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 1 -- 172.21.15.71:0/1290529273 wait complete. 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 10 monclient: build_initial_monmap 2024-08-19T11:14:01.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.685+0000 7fe09167e640 10 monclient: monmap: 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:01.705 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 Processor -- start 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 -- start start 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient: init 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient: _add_conns ranks=[6,2,1,7,8,5,4,3,0] 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c0a57c0 0x7fe08c138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): picked mon.noname-d con 0x7fe08c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:01.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe08c0a6950 0x7fe08c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): picked mon.noname-b con 0x7fe08c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe08c139710 0x7fe08c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): picked mon.noname-f con 0x7fe08c139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c0a84c0 con 0x7fe08c139710 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c0a7d40 con 0x7fe08c0a6950 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe08c0a8700 con 0x7fe08c0a57c0 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe09167e640 10 monclient(hunting): authenticate will time out at 899.727746s 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c0a57c0 0x7fe08c138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe08c0a6950 0x7fe08c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe08c0a6950 0x7fe08c138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43334/0 (socket says 172.21.15.71:43334) 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 1 -- 172.21.15.71:0/798180320 learned_addr learned my addr 172.21.15.71:0/798180320 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): get_auth_request con 0x7fe08c0a57c0 auth_method 0 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 10 monclient(hunting): get_auth_request con 0x7fe08c0a6950 auth_method 0 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.686+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08b7fe640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe08c139710 0x7fe08c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08b7fe640 10 monclient(hunting): get_auth_request con 0x7fe08c139710 auth_method 0 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 10 monclient(hunting): handle_auth_done global_id 24882 payload 824 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe08c0a6950 msgr2=0x7fe08c138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe08c0a6950 0x7fe08c138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe08c139710 msgr2=0x7fe08c1225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe08c139710 0x7fe08c1225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 10 monclient: _finish_hunting 0 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 1 monclient: found mon.noname-d 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08affd640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c123f80 con 0x7fe08c0a57c0 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe08c0a6950 0x7fe08c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:01.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.687+0000 7fe08b7fe640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe08c139710 0x7fe08c1225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe08affd640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c0a57c0 msgr2=0x7fe08c138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe08affd640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c0a57c0 0x7fe08c138920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00d5f0 tx=0x7fe07c00dab0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe07c012c70 con 0x7fe08c0a57c0 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: dump: 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.711 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 5 monclient: authenticate success, global_id 24882 2024-08-19T11:14:01.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c019070 con 0x7fe08c0a57c0 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe07c0148a0 con 0x7fe08c0a57c0 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 10 monclient: _renew_subs 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c13a2d0 con 0x7fe08c0a57c0 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0897fa640 4 set_mon_vals no callback set 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe0737fe640 10 monclient: dump: 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.713 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 10 monclient: _renew_subs 2024-08-19T11:14:01.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.689+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08c1262e0 con 0x7fe08c0a57c0 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe09167e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe09167e640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 0x7fe08c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe08c076c60 con 0x7fe08c1ce5a0 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 0x7fe08c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient: get_auth_request con 0x7fe08c1ce5a0 auth_method 0 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe07c014430 con 0x7fe08c0a57c0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_done global_id 24891 payload 824 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe08a7fc640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe08c125c80 con 0x7fe08c1ce5a0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe0737fe640 1 --2- 172.21.15.71:0/798180320 >> v2:172.21.15.135:6800/726754104 conn(0x7fe07803ea80 0x7fe078040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.690+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(112..112 src has 1..112) ==== 3898+0+0 (secure 0 0 0) 0x7fe07c00f040 con 0x7fe08c0a57c0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.691+0000 7fe08b7fe640 1 --2- 172.21.15.71:0/798180320 >> v2:172.21.15.135:6800/726754104 conn(0x7fe07803ea80 0x7fe078040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.691+0000 7fe08b7fe640 10 monclient: get_auth_request con 0x7fe07803ea80 auth_method 0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe08a7fc640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 msgr2=0x7fe08c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 0x7fe08c02d1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe080034040 tx=0x7fe080004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe080040030 con 0x7fe08c1ce5a0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 10 monclient: dump: 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.717 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe080037040 con 0x7fe08c1ce5a0 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:01.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:01.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 msgr2=0x7fe08c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 0x7fe08c02d1c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe080034040 tx=0x7fe080004a40 comp rx=0 tx=0).stop 2024-08-19T11:14:01.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 msgr2=0x7fe08c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:01.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe0737fe640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c1ce5a0 0x7fe08c02d1c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.693+0000 7fe08b7fe640 1 --2- 172.21.15.71:0/798180320 >> v2:172.21.15.135:6800/726754104 conn(0x7fe07803ea80 0x7fe078040f40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe084006fd0 tx=0x7fe084008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe09167e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe09167e640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 0x7fe08c02db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe09167e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe08c0a20a0 con 0x7fe08c02d700 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 0x7fe08c02db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient: get_auth_request con 0x7fe08c02d700 auth_method 0 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 10 monclient(hunting): handle_auth_done global_id 24900 payload 824 2024-08-19T11:14:01.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.699+0000 7fe08a7fc640 1 -- 172.21.15.71:0/798180320 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe08c0a23a0 con 0x7fe08c02d700 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe08a7fc640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 msgr2=0x7fe08c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe08a7fc640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 0x7fe08c02db10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0800093e0 tx=0x7fe08002f000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe080040050 con 0x7fe08c02d700 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 10 monclient: dump: 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.723 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.724 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fe080045830 con 0x7fe08c02d700 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 msgr2=0x7fe08c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 0x7fe08c02db10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0800093e0 tx=0x7fe08002f000 comp rx=0 tx=0).stop 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 msgr2=0x7fe08c02db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe0737fe640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c02d700 0x7fe08c02db10 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0800093e0 tx=0x7fe08002f000 comp rx=0 tx=0).stop 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 149316, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:14:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:01.755 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:01.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 >> v2:172.21.15.135:6800/726754104 conn(0x7fe07803ea80 msgr2=0x7fe078040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe09167e640 1 --2- 172.21.15.71:0/798180320 >> v2:172.21.15.135:6800/726754104 conn(0x7fe07803ea80 0x7fe078040f40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe084006fd0 tx=0x7fe084008040 comp rx=0 tx=0).stop 2024-08-19T11:14:01.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe09167e640 10 monclient: shutdown 2024-08-19T11:14:01.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe09167e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:01.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c0a57c0 msgr2=0x7fe08c138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe09167e640 1 --2- 172.21.15.71:0/798180320 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe08c0a57c0 0x7fe08c138920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00d5f0 tx=0x7fe07c00dab0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.702+0000 7fe08b7fe640 1 -- 172.21.15.71:0/798180320 reap_dead start 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.703+0000 7fe08b7fe640 1 -- 172.21.15.71:0/798180320 reap_dead start 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.703+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 shutdown_connections 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.703+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 >> 172.21.15.71:0/798180320 conn(0x7fe08c0abf50 msgr2=0x7fe08c0aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.703+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 shutdown_connections 2024-08-19T11:14:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.703+0000 7fe09167e640 1 -- 172.21.15.71:0/798180320 wait complete. 2024-08-19T11:14:01.759 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:01.760 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:14:01.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.858+0000 7f3b8575a640 10 monclient: get_monmap_and_config 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.858+0000 7f3b8575a640 10 monclient: build_initial_monmap 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.859+0000 7f3b8575a640 10 monclient: monmap: 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:01.859645+0000 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:01.859645+0000 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:01.860 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:01.861 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.859+0000 7f3b8575a640 1 Processor -- start 2024-08-19T11:14:01.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.859+0000 7f3b8575a640 1 -- start start 2024-08-19T11:14:01.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.859+0000 7f3b8575a640 10 monclient: init 2024-08-19T11:14:01.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:01.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient: _add_conns ranks=[8,4,2,5,1,10,9,3,6,0,7] 2024-08-19T11:14:01.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 0x7f3b800a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): picked mon.noname-e con 0x7f3b800a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): picked mon.noname-c con 0x7f3b800a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b80139710 0x7f3b80139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): picked mon.noname-b con 0x7f3b80139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b800a5020 con 0x7f3b80139710 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3b800a77b0 con 0x7f3b800a57c0 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3b800a7d40 con 0x7f3b800a6950 2024-08-19T11:14:01.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b8575a640 10 monclient(hunting): authenticate will time out at 899.901230s 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 0x7f3b800a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b80139710 0x7f3b80139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 0x7f3b800a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38260/0 (socket says 172.21.15.71:38260) 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:43074/0 (socket says 172.21.15.71:43074) 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 -- 172.21.15.71:0/1365562474 learned_addr learned my addr 172.21.15.71:0/1365562474 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): get_auth_request con 0x7f3b80139710 auth_method 0 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): get_auth_request con 0x7f3b800a6950 auth_method 0 2024-08-19T11:14:01.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 10 monclient(hunting): get_auth_request con 0x7f3b800a57c0 auth_method 0 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 1 -- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 msgr2=0x7f3b800a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 1 -- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 msgr2=0x7f3b800a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7e7fc640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:01.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient(hunting): handle_auth_done global_id 5354 payload 274 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 -- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 msgr2=0x7f3b800a7270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 -- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b80139710 msgr2=0x7f3b80139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b80139710 0x7f3b80139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient: _finish_hunting 0 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 monclient: found mon.noname-e 2024-08-19T11:14:01.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7effd640 1 -- 172.21.15.71:0/1365562474 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b800a6380 con 0x7f3b800a6950 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.860+0000 7f3b7f7fe640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b80139710 0x7f3b80139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7effd640 1 -- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 msgr2=0x7f3b800a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 0x7f3b800a6d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098a0 tx=0x7f3b7002a080 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c39471d6ff2d4641 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 1 -- 172.21.15.71:0/1365562474 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b70037070 con 0x7f3b800a6950 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: dump: 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.874 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 1 -- 172.21.15.71:0/1365562474 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7002ade0 con 0x7f3b800a6950 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b8575a640 5 monclient: authenticate success, global_id 5354 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b8575a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 1 -- 172.21.15.71:0/1365562474 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b70030c20 con 0x7f3b800a6950 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b8575a640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b8575a640 4 set_mon_vals no callback set 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.863+0000 7f3b7dffb640 10 monclient: dump: 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.876 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.877 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 10 monclient: shutdown 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 -- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 msgr2=0x7f3b800a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 0x7f3b800a6d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098a0 tx=0x7f3b7002a080 comp rx=0 tx=0).stop 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 -- 172.21.15.71:0/1365562474 shutdown_connections 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b80139710 0x7f3b80139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b800a57c0 0x7f3b800a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1365562474 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b800a6950 0x7f3b800a6d30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 -- 172.21.15.71:0/1365562474 >> 172.21.15.71:0/1365562474 conn(0x7f3b800abf50 msgr2=0x7f3b800ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 -- 172.21.15.71:0/1365562474 shutdown_connections 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 1 -- 172.21.15.71:0/1365562474 wait complete. 2024-08-19T11:14:01.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 10 monclient: build_initial_monmap 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.864+0000 7f3b8575a640 10 monclient: monmap: 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:01.879 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 Processor -- start 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 -- start start 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient: init 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient: _add_conns ranks=[1,6,0,7,3,8,4,5,2] 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b800a57c0 0x7f3b801271c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): picked mon.noname-f con 0x7f3b800a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b800a6950 0x7f3b80124ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): picked mon.noname-d con 0x7f3b800a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 0x7f3b80125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): picked mon.noname-a con 0x7f3b80139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:01.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3b800a84c0 con 0x7f3b80139710 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b800a3650 con 0x7f3b800a57c0 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b800a8700 con 0x7f3b800a6950 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b8575a640 10 monclient(hunting): authenticate will time out at 899.906871s 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b7e7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b800a6950 0x7f3b80124ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b7f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 0x7f3b80125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b7e7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b800a6950 0x7f3b80124ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:46090/0 (socket says 172.21.15.71:46090) 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): get_auth_request con 0x7f3b80139710 auth_method 0 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.865+0000 7f3b7e7fc640 1 -- 172.21.15.71:0/1214922076 learned_addr learned my addr 172.21.15.71:0/1214922076 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): get_auth_request con 0x7f3b800a6950 auth_method 0 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b800a57c0 0x7f3b801271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient(hunting): handle_auth_done global_id 34488 payload 824 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b800a6950 msgr2=0x7f3b80124ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b800a6950 0x7f3b80124ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b800a57c0 msgr2=0x7f3b801271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b800a57c0 0x7f3b801271c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 1 monclient: found mon.noname-a 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7f7fe640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b800a1e90 con 0x7f3b80139710 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7effd640 10 monclient: get_auth_request con 0x7f3b800a57c0 auth_method 0 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b800a57c0 0x7f3b801271c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:14:01.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.866+0000 7f3b7e7fc640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b800a6950 0x7f3b80124ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b7f7fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 msgr2=0x7f3b80125220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b7f7fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 0x7f3b80125220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800ef90 tx=0x7f3b7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b78018020 con 0x7f3b80139710 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: dump: 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.890 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b780148f0 con 0x7f3b80139710 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 5 monclient: authenticate success, global_id 34488 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 10 monclient: _renew_subs 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8013a2c0 con 0x7f3b80139710 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b780133e0 con 0x7f3b80139710 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b677fe640 10 monclient: dump: 2024-08-19T11:14:01.892 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.893 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 10 monclient: _renew_subs 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b7d7fa640 4 set_mon_vals no callback set 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.868+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b80126660 con 0x7f3b80139710 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b8575a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 0x7f3b8009fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3b80076c60 con 0x7f3b80125760 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 0x7f3b8009fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3b78005d10 con 0x7f3b80139710 2024-08-19T11:14:01.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient: get_auth_request con 0x7f3b80125760 auth_method 0 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 10 monclient(hunting): handle_auth_done global_id 5363 payload 824 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b677fe640 1 --2- 172.21.15.71:0/1214922076 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b6c03ea80 0x7f3b6c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b7effd640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b80125b40 con 0x7f3b80125760 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.869+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 3898+0+0 (secure 0 0 0) 0x7f3b780527b0 con 0x7f3b80139710 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.870+0000 7f3b7e7fc640 1 --2- 172.21.15.71:0/1214922076 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b6c03ea80 0x7f3b6c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.870+0000 7f3b7e7fc640 10 monclient: get_auth_request con 0x7f3b6c03ea80 auth_method 0 2024-08-19T11:14:01.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b7effd640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 msgr2=0x7f3b8009fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 0x7f3b8009fa10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b70034000 tx=0x7f3b700046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b70041070 con 0x7f3b80125760 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 10 monclient: dump: 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.896 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3b7002ade0 con 0x7f3b80125760 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 msgr2=0x7f3b8009fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 0x7f3b8009fa10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b70034000 tx=0x7f3b700046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 msgr2=0x7f3b8009fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b677fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b80125760 0x7f3b8009fa10 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b70034000 tx=0x7f3b700046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.872+0000 7f3b7e7fc640 1 --2- 172.21.15.71:0/1214922076 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b6c03ea80 0x7f3b6c040f40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3b80126cd0 tx=0x7f3b74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b8575a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 0x7f3b800a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b8575a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3b800a6d30 con 0x7f3b8009ff50 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 0x7f3b800a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient: get_auth_request con 0x7f3b8009ff50 auth_method 0 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:01.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 10 monclient(hunting): handle_auth_done global_id 5372 payload 824 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.878+0000 7f3b7effd640 1 -- 172.21.15.71:0/1214922076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b801287a0 con 0x7f3b8009ff50 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b7effd640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 msgr2=0x7f3b800a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b7effd640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 0x7f3b800a0330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098a0 tx=0x7f3b7003a000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b70037040 con 0x7f3b8009ff50 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 10 monclient: dump: 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:01.899 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:01.900 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f3b7003ccf0 con 0x7f3b8009ff50 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 msgr2=0x7f3b800a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 0x7f3b800a0330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098a0 tx=0x7f3b7003a000 comp rx=0 tx=0).stop 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 msgr2=0x7f3b800a0330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b677fe640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b8009ff50 0x7f3b800a0330 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098a0 tx=0x7f3b7003a000 comp rx=0 tx=0).stop 2024-08-19T11:14:01.901 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 238751, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:01.902 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.903 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.904 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:01.905 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:01.906 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:01.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.908 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:01.909 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.911 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.912 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:01.913 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:01.925 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:01.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b6c03ea80 msgr2=0x7f3b6c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1214922076 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b6c03ea80 0x7f3b6c040f40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3b80126cd0 tx=0x7f3b74008040 comp rx=0 tx=0).stop 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b8575a640 10 monclient: shutdown 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b8575a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 msgr2=0x7f3b80125220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b7f7fe640 1 -- 172.21.15.71:0/1214922076 reap_dead start 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.881+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 0x7f3b80125220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800ef90 tx=0x7f3b7800c490 comp rx=0 tx=0).stop 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.882+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 shutdown_connections 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.882+0000 7f3b8575a640 1 --2- 172.21.15.71:0/1214922076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b80139710 0x7f3b80125220 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.882+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 >> 172.21.15.71:0/1214922076 conn(0x7f3b800abf50 msgr2=0x7f3b80138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.882+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 shutdown_connections 2024-08-19T11:14:01.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:01.882+0000 7f3b8575a640 1 -- 172.21.15.71:0/1214922076 wait complete. 2024-08-19T11:14:01.928 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:01.928 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:14:01.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:14:02.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.026+0000 7f4317ede640 10 monclient: get_monmap_and_config 2024-08-19T11:14:02.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.026+0000 7f4317ede640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.026+0000 7f4317ede640 10 monclient: monmap: 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:02.027308+0000 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:02.027308+0000 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.028 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.029 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.029 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.029 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.029 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:02.029 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:02.029 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 Processor -- start 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 -- start start 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient: init 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient: _add_conns ranks=[3,2,6,5,8,9,4,1,7,0,10] 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43100a6950 0x7f43100a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): picked mon.noname-g con 0x7f43100a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:02.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 0x7f43100a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): picked mon.noname-b con 0x7f43100a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 0x7f4310139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): picked mon.noname-d con 0x7f4310139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f43100a5020 con 0x7f43100a57c0 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f43100a77b0 con 0x7f43100a6950 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f43100a7d40 con 0x7f4310139710 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.027+0000 7f4317ede640 10 monclient(hunting): authenticate will time out at 900.068985s 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 0x7f4310139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 0x7f43100a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 0x7f43100a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43352/0 (socket says 172.21.15.71:43352) 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 0x7f4310139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:46094/0 (socket says 172.21.15.71:46094) 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 1 -- 172.21.15.71:0/1735433743 learned_addr learned my addr 172.21.15.71:0/1735433743 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): get_auth_request con 0x7f43100a57c0 auth_method 0 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): get_auth_request con 0x7f4310139710 auth_method 0 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43100a6950 0x7f43100a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): get_auth_request con 0x7f43100a6950 auth_method 0 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient(hunting): handle_auth_done global_id 24918 payload 274 2024-08-19T11:14:02.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 -- 172.21.15.71:0/1735433743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43100a6950 msgr2=0x7f43100a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43100a6950 0x7f43100a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 -- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 msgr2=0x7f43100a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 0x7f43100a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 monclient: found mon.noname-d 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f431647b640 1 -- 172.21.15.71:0/1735433743 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43100a6380 con 0x7f4310139710 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.028+0000 7f4315479640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 0x7f43100a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f431647b640 1 -- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 msgr2=0x7f4310139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f431647b640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 0x7f4310139b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4308009dc0 tx=0x7f430802a480 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b689c2dd428c74f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 1 -- 172.21.15.71:0/1735433743 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4308007bc0 con 0x7f4310139710 2024-08-19T11:14:02.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: dump: 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.038 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 1 -- 172.21.15.71:0/1735433743 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308007d80 con 0x7f4310139710 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 5 monclient: authenticate success, global_id 24918 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 1 -- 172.21.15.71:0/1735433743 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4308031870 con 0x7f4310139710 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 4 set_mon_vals no callback set 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4314c78640 10 monclient: dump: 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.040 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 10 monclient: shutdown 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 -- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 msgr2=0x7f4310139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 0x7f4310139b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4308009dc0 tx=0x7f430802a480 comp rx=0 tx=0).stop 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 -- 172.21.15.71:0/1735433743 shutdown_connections 2024-08-19T11:14:02.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4310139710 0x7f4310139b10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f43100a57c0 0x7f43100a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 --2- 172.21.15.71:0/1735433743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43100a6950 0x7f43100a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.031+0000 7f4317ede640 1 -- 172.21.15.71:0/1735433743 >> 172.21.15.71:0/1735433743 conn(0x7f43100abf50 msgr2=0x7f43100ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.032+0000 7f4317ede640 1 -- 172.21.15.71:0/1735433743 shutdown_connections 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.032+0000 7f4317ede640 1 -- 172.21.15.71:0/1735433743 wait complete. 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.032+0000 7f4317ede640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.032+0000 7f4317ede640 10 monclient: monmap: 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.042 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.043 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.032+0000 7f4317ede640 1 Processor -- start 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 -- start start 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient: init 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient: _add_conns ranks=[8,6,4,0,7,5,1,2,3] 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f43100a57c0 0x7f43101ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): picked mon.noname-e con 0x7f43100a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 0x7f4310138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): picked mon.noname-d con 0x7f43100a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4310139710 0x7f4310139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): picked mon.noname-c con 0x7f4310139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f43100a84c0 con 0x7f4310139710 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f43100a3650 con 0x7f43100a6950 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f43100a8700 con 0x7f43100a57c0 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4317ede640 10 monclient(hunting): authenticate will time out at 900.074521s 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f43100a57c0 0x7f43101ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 0x7f4310138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f43100a57c0 0x7f43101ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38280/0 (socket says 172.21.15.71:38280) 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 1 -- 172.21.15.71:0/1561649228 learned_addr learned my addr 172.21.15.71:0/1561649228 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): get_auth_request con 0x7f43100a6950 auth_method 0 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): get_auth_request con 0x7f43100a57c0 auth_method 0 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4310139710 0x7f4310139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): get_auth_request con 0x7f4310139710 auth_method 0 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f431647b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient(hunting): handle_auth_done global_id 24927 payload 824 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f43100a57c0 msgr2=0x7f43101ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f43100a57c0 0x7f43101ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4310139710 msgr2=0x7f4310139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4310139710 0x7f4310139020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 monclient: found mon.noname-d 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315479640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101261c0 con 0x7f43100a6950 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.033+0000 7f4315c7a640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f43100a57c0 0x7f43101ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4315479640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 msgr2=0x7f4310138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4315479640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 0x7f4310138ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f430000e900 tx=0x7f430000edc0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f43000044a0 con 0x7f43100a6950 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: dump: 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.054 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430000cc10 con 0x7f43100a6950 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 5 monclient: authenticate success, global_id 24927 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 10 monclient: _renew_subs 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4310125ee0 con 0x7f43100a6950 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f430000cdc0 con 0x7f43100a6950 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f43067fc640 10 monclient: dump: 2024-08-19T11:14:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.057 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4307fff640 4 set_mon_vals no callback set 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 10 monclient: _renew_subs 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.036+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4310122830 con 0x7f43100a6950 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4317ede640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4317ede640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 0x7f431002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f431006a590 con 0x7f43101232b0 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4300004030 con 0x7f43100a6950 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 0x7f431002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient: get_auth_request con 0x7f43101232b0 auth_method 0 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f43067fc640 1 --2- 172.21.15.71:0/1561649228 >> v2:172.21.15.135:6800/726754104 conn(0x7f42f403ea80 0x7f42f4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (secure 0 0 0) 0x7f430000f040 con 0x7f43100a6950 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 10 monclient(hunting): handle_auth_done global_id 5320 payload 824 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f431647b640 1 --2- 172.21.15.71:0/1561649228 >> v2:172.21.15.135:6800/726754104 conn(0x7f42f403ea80 0x7f42f4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f4315c7a640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f431013a150 con 0x7f43101232b0 2024-08-19T11:14:02.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.037+0000 7f431647b640 10 monclient: get_auth_request con 0x7f42f403ea80 auth_method 0 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f4315c7a640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 msgr2=0x7f431002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f4315c7a640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 0x7f431002d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f430c011d10 tx=0x7f430c00f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f430c00fe70 con 0x7f43101232b0 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 10 monclient: dump: 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.060 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f431647b640 1 --2- 172.21.15.71:0/1561649228 >> v2:172.21.15.135:6800/726754104 conn(0x7f42f403ea80 0x7f42f4040f40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4310074f90 tx=0x7f430802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f430c00fe70 con 0x7f43101232b0 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:02.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 msgr2=0x7f431002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 0x7f431002d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f430c011d10 tx=0x7f430c00f610 comp rx=0 tx=0).stop 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 msgr2=0x7f431002d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.040+0000 7f43067fc640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43101232b0 0x7f431002d1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.046+0000 7f4317ede640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.046+0000 7f4317ede640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 0x7f431002db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.046+0000 7f4317ede640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.046+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43101259d0 con 0x7f431002d700 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.046+0000 7f4315c7a640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 0x7f431002db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient: get_auth_request con 0x7f431002d700 auth_method 0 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 10 monclient(hunting): handle_auth_done global_id 5329 payload 824 2024-08-19T11:14:02.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.047+0000 7f4315c7a640 1 -- 172.21.15.71:0/1561649228 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43100a2250 con 0x7f431002d700 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.049+0000 7f4315c7a640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 msgr2=0x7f431002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.049+0000 7f4315c7a640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 0x7f431002db10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f430c01b000 tx=0x7f430c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.049+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f430c028400 con 0x7f431002d700 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.049+0000 7f43067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.049+0000 7f43067fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.049+0000 7f43067fc640 10 monclient: dump: 2024-08-19T11:14:02.064 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.065 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f430c003a30 con 0x7f431002d700 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 msgr2=0x7f431002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 0x7f431002db10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f430c01b000 tx=0x7f430c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 msgr2=0x7f431002db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f43067fc640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f431002d700 0x7f431002db10 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f430c01b000 tx=0x7f430c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.066 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 238890, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:02.067 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.068 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.069 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:02.070 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.071 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.072 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.075 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:02.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.077 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.079 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:02.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:02.085 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.086 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:02.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:02.090 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 >> v2:172.21.15.135:6800/726754104 conn(0x7f42f403ea80 msgr2=0x7f42f4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 --2- 172.21.15.71:0/1561649228 >> v2:172.21.15.135:6800/726754104 conn(0x7f42f403ea80 0x7f42f4040f40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4310074f90 tx=0x7f430802f000 comp rx=0 tx=0).stop 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 10 monclient: shutdown 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 msgr2=0x7f4310138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 0x7f4310138ae0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f430000e900 tx=0x7f430000edc0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f431647b640 1 -- 172.21.15.71:0/1561649228 reap_dead start 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 shutdown_connections 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 --2- 172.21.15.71:0/1561649228 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f43100a6950 0x7f4310138ae0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 >> 172.21.15.71:0/1561649228 conn(0x7f43100abf50 msgr2=0x7f43100aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 shutdown_connections 2024-08-19T11:14:02.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.050+0000 7f4317ede640 1 -- 172.21.15.71:0/1561649228 wait complete. 2024-08-19T11:14:02.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:02.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:14:02.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:14:02.177 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:02.177 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: starting. 2024-08-19T11:14:02.177 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25460 2024-08-19T11:14:02.178 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: created object 0... 2024-08-19T11:14:02.178 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: created object 25... 2024-08-19T11:14:02.178 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: created object 49... 2024-08-19T11:14:02.178 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: finishing. 2024-08-19T11:14:02.178 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25613]: shutting down. 2024-08-19T11:14:02.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.195+0000 7f5b8e3bc640 10 monclient: get_monmap_and_config 2024-08-19T11:14:02.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.195+0000 7f5b8e3bc640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.195+0000 7f5b8e3bc640 10 monclient: monmap: 2024-08-19T11:14:02.196 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.196 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:02.196073+0000 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:02.196073+0000 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.197 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.198 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.198 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:02.198 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:02.198 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 Processor -- start 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 -- start start 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient: init 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient: _add_conns ranks=[9,10,5,8,4,3,2,0,6,1,7] 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b880a3cd0 0x7f5b880a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): picked mon.noname-a con 0x7f5b880a3cd0 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b880a40b0 0x7f5b880a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): picked mon.noname-f con 0x7f5b880a40b0 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b88139a50 0x7f5b88139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): picked mon.noname-h con 0x7f5b88139a50 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5b880a1410 con 0x7f5b880a3cd0 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5b880a0ae0 con 0x7f5b880a40b0 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5b880a0dc0 con 0x7f5b88139a50 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b8e3bc640 10 monclient(hunting): authenticate will time out at 900.237804s 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b880a3cd0 0x7f5b880a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b880a3cd0 0x7f5b880a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53006/0 (socket says 172.21.15.71:53006) 2024-08-19T11:14:02.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 1 -- 172.21.15.71:0/2112121014 learned_addr learned my addr 172.21.15.71:0/2112121014 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): get_auth_request con 0x7f5b880a3cd0 auth_method 0 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.196+0000 7f5b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b877fe640 1 --2- 172.21.15.71:0/2112121014 >> v2:172.21.15.135:3300/0 conn(0x7f5b880a40b0 0x7f5b880a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b8c959640 1 --2- 172.21.15.71:0/2112121014 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b88139a50 0x7f5b88139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b8c959640 10 monclient(hunting): get_auth_request con 0x7f5b88139a50 auth_method 0 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b8c959640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b8c959640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b8c959640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b877fe640 10 monclient(hunting): get_auth_request con 0x7f5b880a40b0 auth_method 0 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 10 monclient(hunting): handle_auth_done global_id 34497 payload 274 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 1 -- 172.21.15.71:0/2112121014 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b88139a50 msgr2=0x7f5b88139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 1 --2- 172.21.15.71:0/2112121014 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b88139a50 0x7f5b88139ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 1 -- 172.21.15.71:0/2112121014 >> v2:172.21.15.135:3300/0 conn(0x7f5b880a40b0 msgr2=0x7f5b880a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 1 --2- 172.21.15.71:0/2112121014 >> v2:172.21.15.135:3300/0 conn(0x7f5b880a40b0 0x7f5b880a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 1 monclient: found mon.noname-a 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.197+0000 7f5b87fff640 1 -- 172.21.15.71:0/2112121014 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b880a10a0 con 0x7f5b880a3cd0 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.199+0000 7f5b87fff640 1 -- 172.21.15.71:0/2112121014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b880a3cd0 msgr2=0x7f5b880a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.199+0000 7f5b87fff640 1 --2- 172.21.15.71:0/2112121014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b880a3cd0 0x7f5b880a1880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5b880a4d40 tx=0x7f5b7802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928594fab5dba1bf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 1 -- 172.21.15.71:0/2112121014 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b78037070 con 0x7f5b880a3cd0 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: dump: 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 1 -- 172.21.15.71:0/2112121014 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7802ae10 con 0x7f5b880a3cd0 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 5 monclient: authenticate success, global_id 34497 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 1 -- 172.21.15.71:0/2112121014 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b78030c20 con 0x7f5b880a3cd0 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 4 set_mon_vals no callback set 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b86ffd640 10 monclient: dump: 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.216 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 10 monclient: shutdown 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/2112121014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b880a3cd0 msgr2=0x7f5b880a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/2112121014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b880a3cd0 0x7f5b880a1880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5b880a4d40 tx=0x7f5b7802a0b0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/2112121014 shutdown_connections 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/2112121014 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b88139a50 0x7f5b88139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/2112121014 >> v2:172.21.15.135:3300/0 conn(0x7f5b880a40b0 0x7f5b880a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/2112121014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b880a3cd0 0x7f5b880a1880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/2112121014 >> 172.21.15.71:0/2112121014 conn(0x7f5b880a91d0 msgr2=0x7f5b880a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/2112121014 shutdown_connections 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.200+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/2112121014 wait complete. 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.201+0000 7f5b8e3bc640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.201+0000 7f5b8e3bc640 10 monclient: monmap: 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.219 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.201+0000 7f5b8e3bc640 1 Processor -- start 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.201+0000 7f5b8e3bc640 1 -- start start 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.201+0000 7f5b8e3bc640 10 monclient: init 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient: _add_conns ranks=[2,5,7,0,8,3,6,1,4] 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 0x7f5b88073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): picked mon.noname-b con 0x7f5b880a3cd0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b880a40b0 0x7f5b88138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): picked mon.noname-h con 0x7f5b880a40b0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b88139a50 0x7f5b88139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): picked mon.noname-i con 0x7f5b88139a50 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5b880a1dc0 con 0x7f5b880a3cd0 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5b880a4a10 con 0x7f5b880a40b0 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f5b880a1f40 con 0x7f5b88139a50 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8e3bc640 10 monclient(hunting): authenticate will time out at 900.243420s 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 0x7f5b88073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 0x7f5b88073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43364/0 (socket says 172.21.15.71:43364) 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 -- 172.21.15.71:0/4266430988 learned_addr learned my addr 172.21.15.71:0/4266430988 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): get_auth_request con 0x7f5b880a3cd0 auth_method 0 2024-08-19T11:14:02.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b880a40b0 0x7f5b88138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b88139a50 0x7f5b88139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): get_auth_request con 0x7f5b880a40b0 auth_method 0 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): get_auth_request con 0x7f5b88139a50 auth_method 0 2024-08-19T11:14:02.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b8c959640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient(hunting): handle_auth_done global_id 5645 payload 824 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b88139a50 msgr2=0x7f5b88139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b88139a50 0x7f5b88139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b880a40b0 msgr2=0x7f5b88138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b880a40b0 0x7f5b88138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 monclient: found mon.noname-b 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.202+0000 7f5b87fff640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b881ce8a0 con 0x7f5b880a3cd0 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.204+0000 7f5b87fff640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 msgr2=0x7f5b88073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.204+0000 7f5b87fff640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 0x7f5b88073160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b780097c0 tx=0x7f5b780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b78041020 con 0x7f5b880a3cd0 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: dump: 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.224 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.225 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b78003c50 con 0x7f5b880a3cd0 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 5 monclient: authenticate success, global_id 5645 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b78037040 con 0x7f5b880a3cd0 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 10 monclient: _renew_subs 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8813a270 con 0x7f5b880a3cd0 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b84ff9640 10 monclient: dump: 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.227 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b867fc640 4 set_mon_vals no callback set 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 10 monclient: _renew_subs 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.205+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b88126060 con 0x7f5b880a3cd0 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b8e3bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 0x7f5b881cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5b88076c60 con 0x7f5b881caee0 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5b78044020 con 0x7f5b880a3cd0 2024-08-19T11:14:02.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b84ff9640 1 --2- 172.21.15.71:0/4266430988 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b7403ea80 0x7f5b74040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 0x7f5b881cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient: get_auth_request con 0x7f5b881caee0 auth_method 0 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (secure 0 0 0) 0x7f5b78071fb0 con 0x7f5b880a3cd0 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b8c959640 1 --2- 172.21.15.71:0/4266430988 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b7403ea80 0x7f5b74040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b8c959640 10 monclient: get_auth_request con 0x7f5b7403ea80 auth_method 0 2024-08-19T11:14:02.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 10 monclient(hunting): handle_auth_done global_id 44112 payload 824 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.206+0000 7f5b877fe640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b88126580 con 0x7f5b881caee0 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.208+0000 7f5b877fe640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 msgr2=0x7f5b881cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.208+0000 7f5b877fe640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 0x7f5b881cb2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c006fd0 tx=0x7f5b7c010c10 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b8c959640 1 --2- 172.21.15.71:0/4266430988 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b7403ea80 0x7f5b74040f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b88124e90 tx=0x7f5b80009780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b7c018020 con 0x7f5b881caee0 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 10 monclient: dump: 2024-08-19T11:14:02.230 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5b7c004450 con 0x7f5b881caee0 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 msgr2=0x7f5b881cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 0x7f5b881cb2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c006fd0 tx=0x7f5b7c010c10 comp rx=0 tx=0).stop 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 msgr2=0x7f5b881cb2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.209+0000 7f5b84ff9640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881caee0 0x7f5b881cb2c0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c006fd0 tx=0x7f5b7c010c10 comp rx=0 tx=0).stop 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25615]: starting. 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25615]: listing objects. 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25615]: listed object 0... 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25615]: listed object 25... 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25615]: saw 50 objects 2024-08-19T11:14:02.233 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25615]: shutting down. 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b8e3bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 0x7f5b8809ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b8e3bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5b880a04b0 con 0x7f5b881cb800 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 0x7f5b8809ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient: get_auth_request con 0x7f5b881cb800 auth_method 0 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.215+0000 7f5b877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.216+0000 7f5b877fe640 10 monclient(hunting): handle_auth_done global_id 44121 payload 824 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.216+0000 7f5b877fe640 1 -- 172.21.15.71:0/4266430988 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b880a1880 con 0x7f5b881cb800 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b877fe640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 msgr2=0x7f5b8809ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b877fe640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 0x7f5b8809ccc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c019000 tx=0x7f5b7c0046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b7c018040 con 0x7f5b881cb800 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:02.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 10 monclient: dump: 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.237 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f5b7c020e50 con 0x7f5b881cb800 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 msgr2=0x7f5b8809ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 0x7f5b8809ccc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c019000 tx=0x7f5b7c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 msgr2=0x7f5b8809ccc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.218+0000 7f5b84ff9640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b881cb800 0x7f5b8809ccc0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c019000 tx=0x7f5b7c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 11241, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:02.262 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:02.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b7403ea80 msgr2=0x7f5b74040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/4266430988 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b7403ea80 0x7f5b74040f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b88124e90 tx=0x7f5b80009780 comp rx=0 tx=0).stop 2024-08-19T11:14:02.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 10 monclient: shutdown 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 msgr2=0x7f5b88073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 --2- 172.21.15.71:0/4266430988 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5b880a3cd0 0x7f5b88073160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b780097c0 tx=0x7f5b780046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8c959640 1 -- 172.21.15.71:0/4266430988 reap_dead start 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8c959640 1 -- 172.21.15.71:0/4266430988 reap_dead start 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 shutdown_connections 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 >> 172.21.15.71:0/4266430988 conn(0x7f5b880a91d0 msgr2=0x7f5b880a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 shutdown_connections 2024-08-19T11:14:02.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.219+0000 7f5b8e3bc640 1 -- 172.21.15.71:0/4266430988 wait complete. 2024-08-19T11:14:02.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:02.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:14:02.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:14:02.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.362+0000 7fcc704b1640 10 monclient: get_monmap_and_config 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.362+0000 7fcc704b1640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.362+0000 7fcc704b1640 10 monclient: monmap: 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:02.363476+0000 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:02.363476+0000 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.364 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:02.365 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.363+0000 7fcc704b1640 1 Processor -- start 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.363+0000 7fcc704b1640 1 -- start start 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.363+0000 7fcc704b1640 10 monclient: init 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient: _add_conns ranks=[8,10,9,6,0,4,7,5,1,3,2] 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 0x7fcc680a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): picked mon.noname-e con 0x7fcc680a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcc680a57c0 0x7fcc680a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): picked mon.noname-f con 0x7fcc680a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 0x7fcc68139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): picked mon.noname-a con 0x7fcc68139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcc680a5020 con 0x7fcc68139710 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcc680a77b0 con 0x7fcc680a57c0 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcc680a7d40 con 0x7fcc680a6950 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc704b1640 10 monclient(hunting): authenticate will time out at 900.405236s 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 0x7fcc68139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 0x7fcc680a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 0x7fcc680a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38288/0 (socket says 172.21.15.71:38288) 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 0x7fcc68139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53010/0 (socket says 172.21.15.71:53010) 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 -- 172.21.15.71:0/1411330951 learned_addr learned my addr 172.21.15.71:0/1411330951 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): get_auth_request con 0x7fcc680a6950 auth_method 0 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): get_auth_request con 0x7fcc68139710 auth_method 0 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.135:3300/0 conn(0x7fcc680a57c0 0x7fcc680a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6da4c640 10 monclient(hunting): get_auth_request con 0x7fcc680a57c0 auth_method 0 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6da4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6da4c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6da4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_done global_id 5390 payload 274 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 -- 172.21.15.71:0/1411330951 >> v2:172.21.15.135:3300/0 conn(0x7fcc680a57c0 msgr2=0x7fcc680a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.135:3300/0 conn(0x7fcc680a57c0 0x7fcc680a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 -- 172.21.15.71:0/1411330951 >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 msgr2=0x7fcc68139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 0x7fcc68139b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 monclient: found mon.noname-e 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:02.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6e24d640 1 -- 172.21.15.71:0/1411330951 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc680a6380 con 0x7fcc680a6950 2024-08-19T11:14:02.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6ea4e640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 0x7fcc68139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:02.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.364+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.135:3300/0 conn(0x7fcc680a57c0 0x7fcc680a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6e24d640 1 -- 172.21.15.71:0/1411330951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 msgr2=0x7fcc680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6e24d640 1 --2- 172.21.15.71:0/1411330951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 0x7fcc680a6d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcc680a5730 tx=0x7fcc6402a0b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=3115ada2481f0e1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 1 -- 172.21.15.71:0/1411330951 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc64037070 con 0x7fcc680a6950 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: dump: 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.379 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc704b1640 5 monclient: authenticate success, global_id 5390 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 1 -- 172.21.15.71:0/1411330951 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6402ae10 con 0x7fcc680a6950 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc704b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc704b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 1 -- 172.21.15.71:0/1411330951 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc64030c20 con 0x7fcc680a6950 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc704b1640 4 set_mon_vals no callback set 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.367+0000 7fcc6d24b640 10 monclient: dump: 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.381 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.382 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 10 monclient: shutdown 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 -- 172.21.15.71:0/1411330951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 msgr2=0x7fcc680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 --2- 172.21.15.71:0/1411330951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 0x7fcc680a6d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcc680a5730 tx=0x7fcc6402a0b0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 -- 172.21.15.71:0/1411330951 shutdown_connections 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.71:3300/0 conn(0x7fcc68139710 0x7fcc68139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 --2- 172.21.15.71:0/1411330951 >> v2:172.21.15.135:3300/0 conn(0x7fcc680a57c0 0x7fcc680a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 --2- 172.21.15.71:0/1411330951 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcc680a6950 0x7fcc680a6d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 -- 172.21.15.71:0/1411330951 >> 172.21.15.71:0/1411330951 conn(0x7fcc680abf50 msgr2=0x7fcc680ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 -- 172.21.15.71:0/1411330951 shutdown_connections 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 1 -- 172.21.15.71:0/1411330951 wait complete. 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.368+0000 7fcc704b1640 10 monclient: monmap: 2024-08-19T11:14:02.383 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.384 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 Processor -- start 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 -- start start 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient: init 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient: _add_conns ranks=[1,3,7,8,6,2,0,5,4] 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 0x7fcc68138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): picked mon.noname-f con 0x7fcc680a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc680a6950 0x7fcc68138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): picked mon.noname-g con 0x7fcc680a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:02.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc68139710 0x7fcc68122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): picked mon.noname-i con 0x7fcc68139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680a84c0 con 0x7fcc680a57c0 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcc680a3650 con 0x7fcc680a6950 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcc680a8700 con 0x7fcc68139710 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.369+0000 7fcc704b1640 10 monclient(hunting): authenticate will time out at 900.410811s 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc680a6950 0x7fcc68138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc68139710 0x7fcc68122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 0x7fcc68138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc680a6950 0x7fcc68138f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:51592/0 (socket says 172.21.15.71:51592) 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc68139710 0x7fcc68122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:41792/0 (socket says 172.21.15.71:41792) 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 1 -- 172.21.15.71:0/4247980267 learned_addr learned my addr 172.21.15.71:0/4247980267 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): get_auth_request con 0x7fcc680a57c0 auth_method 0 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): get_auth_request con 0x7fcc680a6950 auth_method 0 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): get_auth_request con 0x7fcc68139710 auth_method 0 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6ea4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient(hunting): handle_auth_done global_id 5356 payload 824 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc68139710 msgr2=0x7fcc68122840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcc68139710 0x7fcc68122840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc680a6950 msgr2=0x7fcc68138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc680a6950 0x7fcc68138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 monclient: found mon.noname-f 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6e24d640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6813a180 con 0x7fcc680a57c0 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.370+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcc680a6950 0x7fcc68138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.372+0000 7fcc6e24d640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 msgr2=0x7fcc68138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.372+0000 7fcc6e24d640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 0x7fcc68138a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc64031000 tx=0x7fcc640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.372+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc64041020 con 0x7fcc680a57c0 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.372+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: dump: 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.390 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 5 monclient: authenticate success, global_id 5356 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc64003bd0 con 0x7fcc680a57c0 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 10 monclient: _renew_subs 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc64037040 con 0x7fcc680a57c0 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:14:02.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc68125e30 con 0x7fcc680a57c0 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc6ca4a640 4 set_mon_vals no callback set 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc5effd640 10 monclient: dump: 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.392 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 10 monclient: _renew_subs 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc680a1d00 con 0x7fcc680a57c0 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 0x7fcc6802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.373+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcc6806a590 con 0x7fcc681ce380 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 0x7fcc6802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient: get_auth_request con 0x7fcc681ce380 auth_method 0 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcc64044020 con 0x7fcc680a57c0 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc5effd640 1 --2- 172.21.15.71:0/4247980267 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc4c03ea80 0x7fcc4c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_done global_id 44132 payload 824 2024-08-19T11:14:02.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (secure 0 0 0) 0x7fcc64071bc0 con 0x7fcc680a57c0 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6da4c640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc68124090 con 0x7fcc681ce380 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6ea4e640 1 --2- 172.21.15.71:0/4247980267 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc4c03ea80 0x7fcc4c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.374+0000 7fcc6ea4e640 10 monclient: get_auth_request con 0x7fcc4c03ea80 auth_method 0 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.376+0000 7fcc6da4c640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 msgr2=0x7fcc6802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.376+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 0x7fcc6802d1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc68124700 tx=0x7fcc58011f10 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.376+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc5800f040 con 0x7fcc681ce380 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.376+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.376+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.376+0000 7fcc5effd640 10 monclient: dump: 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.395 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc6ea4e640 1 --2- 172.21.15.71:0/4247980267 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc4c03ea80 0x7fcc4c040f40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009c10 tx=0x7fcc6000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcc58004030 con 0x7fcc681ce380 2024-08-19T11:14:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 msgr2=0x7fcc6802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 0x7fcc6802d1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc68124700 tx=0x7fcc58011f10 comp rx=0 tx=0).stop 2024-08-19T11:14:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 msgr2=0x7fcc6802d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.377+0000 7fcc5effd640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc681ce380 0x7fcc6802d1c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc704b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc704b1640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 0x7fcc6802db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc704b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcc68076c60 con 0x7fcc6802d700 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 0x7fcc6802db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient: get_auth_request con 0x7fcc6802d700 auth_method 0 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 10 monclient(hunting): handle_auth_done global_id 44141 payload 824 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.383+0000 7fcc6da4c640 1 -- 172.21.15.71:0/4247980267 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc680a6d30 con 0x7fcc6802d700 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc6da4c640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 msgr2=0x7fcc6802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc6da4c640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 0x7fcc6802db10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc68124700 tx=0x7fcc58004730 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcc58015cf0 con 0x7fcc6802d700 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 10 monclient: dump: 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.400 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.401 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7fcc58015880 con 0x7fcc6802d700 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 msgr2=0x7fcc6802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 0x7fcc6802db10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc68124700 tx=0x7fcc58004730 comp rx=0 tx=0).stop 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 msgr2=0x7fcc6802db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc5effd640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcc6802d700 0x7fcc6802db10 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc68124700 tx=0x7fcc58004730 comp rx=0 tx=0).stop 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:02.402 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 11408, 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:02.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.407 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:02.408 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.409 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:02.410 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.411 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:02.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:02.415 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:02.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:02.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.422 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:02.424 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.427 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:02.429 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:02.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc4c03ea80 msgr2=0x7fcc4c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc704b1640 1 --2- 172.21.15.71:0/4247980267 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc4c03ea80 0x7fcc4c040f40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009c10 tx=0x7fcc6000b040 comp rx=0 tx=0).stop 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc704b1640 10 monclient: shutdown 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc704b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 msgr2=0x7fcc68138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc704b1640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 0x7fcc68138a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc64031000 tx=0x7fcc640046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.386+0000 7fcc6ea4e640 1 -- 172.21.15.71:0/4247980267 reap_dead start 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.387+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 shutdown_connections 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.387+0000 7fcc704b1640 1 --2- 172.21.15.71:0/4247980267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc680a57c0 0x7fcc68138a30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.387+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 >> 172.21.15.71:0/4247980267 conn(0x7fcc680abf50 msgr2=0x7fcc680aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.387+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 shutdown_connections 2024-08-19T11:14:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.387+0000 7fcc704b1640 1 -- 172.21.15.71:0/4247980267 wait complete. 2024-08-19T11:14:02.432 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:02.432 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:14:02.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:14:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.529+0000 7fe5588f6640 10 monclient: get_monmap_and_config 2024-08-19T11:14:02.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.529+0000 7fe5588f6640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.529+0000 7fe5588f6640 10 monclient: monmap: 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:02.530305+0000 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:02.530305+0000 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.531 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:02.532 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 Processor -- start 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 -- start start 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient: init 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient: _add_conns ranks=[9,4,10,6,7,3,2,0,5,1,8] 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe5540a6950 0x7fe5540a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): picked mon.noname-a con 0x7fe5540a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5540a57c0 0x7fe5540a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): picked mon.noname-c con 0x7fe5540a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe554139710 0x7fe554139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): picked mon.noname-f con 0x7fe554139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe5540a5020 con 0x7fe5540a6950 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe5540a77b0 con 0x7fe554139710 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe5540a7d40 con 0x7fe5540a57c0 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe5588f6640 10 monclient(hunting): authenticate will time out at 900.571817s 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe5540a6950 0x7fe5540a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe5540a6950 0x7fe5540a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53016/0 (socket says 172.21.15.71:53016) 2024-08-19T11:14:02.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 1 -- 172.21.15.71:0/3867955879 learned_addr learned my addr 172.21.15.71:0/3867955879 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 10 monclient(hunting): get_auth_request con 0x7fe5540a6950 auth_method 0 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe55259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.530+0000 7fe549d9b640 1 --2- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5540a57c0 0x7fe5540a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): get_auth_request con 0x7fe5540a57c0 auth_method 0 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 10 monclient(hunting): handle_auth_done global_id 34515 payload 274 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 1 -- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5540a57c0 msgr2=0x7fe5540a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 1 --2- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5540a57c0 0x7fe5540a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 1 -- 172.21.15.71:0/3867955879 >> v2:172.21.15.135:3300/0 conn(0x7fe554139710 msgr2=0x7fe554139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe552d9d640 1 --2- 172.21.15.71:0/3867955879 >> v2:172.21.15.135:3300/0 conn(0x7fe554139710 0x7fe554139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 1 --2- 172.21.15.71:0/3867955879 >> v2:172.21.15.135:3300/0 conn(0x7fe554139710 0x7fe554139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 1 monclient: found mon.noname-a 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.531+0000 7fe55259c640 1 -- 172.21.15.71:0/3867955879 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5540a6380 con 0x7fe5540a6950 2024-08-19T11:14:02.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.533+0000 7fe55259c640 1 -- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5540a6950 msgr2=0x7fe5540a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.533+0000 7fe55259c640 1 --2- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5540a6950 0x7fe5540a6d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe55406c930 tx=0x7fe54402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3456e43c17e96654 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 1 -- 172.21.15.71:0/3867955879 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe544037070 con 0x7fe5540a6950 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: dump: 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.543 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 1 -- 172.21.15.71:0/3867955879 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54402ae20 con 0x7fe5540a6950 2024-08-19T11:14:02.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 5 monclient: authenticate success, global_id 34515 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 1 -- 172.21.15.71:0/3867955879 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe544030c20 con 0x7fe5540a6950 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 4 set_mon_vals no callback set 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe551d9b640 10 monclient: dump: 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.545 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 10 monclient: shutdown 2024-08-19T11:14:02.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 -- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5540a6950 msgr2=0x7fe5540a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 --2- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5540a6950 0x7fe5540a6d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe55406c930 tx=0x7fe54402a100 comp rx=0 tx=0).stop 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 -- 172.21.15.71:0/3867955879 shutdown_connections 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 --2- 172.21.15.71:0/3867955879 >> v2:172.21.15.135:3300/0 conn(0x7fe554139710 0x7fe554139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 --2- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe5540a57c0 0x7fe5540a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 --2- 172.21.15.71:0/3867955879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5540a6950 0x7fe5540a6d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 -- 172.21.15.71:0/3867955879 >> 172.21.15.71:0/3867955879 conn(0x7fe5540abf50 msgr2=0x7fe5540ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 -- 172.21.15.71:0/3867955879 shutdown_connections 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.534+0000 7fe5588f6640 1 -- 172.21.15.71:0/3867955879 wait complete. 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.535+0000 7fe5588f6640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.535+0000 7fe5588f6640 10 monclient: monmap: 2024-08-19T11:14:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.535+0000 7fe5588f6640 1 Processor -- start 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 -- start start 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient: init 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient: _add_conns ranks=[8,5,1,6,7,3,4,2,0] 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 0x7fe5541ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): picked mon.noname-e con 0x7fe5540a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5540a6950 0x7fe554138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): picked mon.noname-h con 0x7fe5540a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 0x7fe5541390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): picked mon.noname-f con 0x7fe554139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5540a84c0 con 0x7fe554139710 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe5540a3650 con 0x7fe5540a6950 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe5540a8700 con 0x7fe5540a57c0 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe5588f6640 10 monclient(hunting): authenticate will time out at 900.577484s 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 0x7fe5541ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 0x7fe5541ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38296/0 (socket says 172.21.15.71:38296) 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 -- 172.21.15.71:0/4125642487 learned_addr learned my addr 172.21.15.71:0/4125642487 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): get_auth_request con 0x7fe5540a57c0 auth_method 0 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5540a6950 0x7fe554138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): get_auth_request con 0x7fe5540a6950 auth_method 0 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 0x7fe5541390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 10 monclient(hunting): get_auth_request con 0x7fe554139710 auth_method 0 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 msgr2=0x7fe5541390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 msgr2=0x7fe5541390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 0x7fe5541390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe552d9d640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 0x7fe5541390f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient(hunting): handle_auth_done global_id 5399 payload 824 2024-08-19T11:14:02.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5540a6950 msgr2=0x7fe554138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe5540a6950 0x7fe554138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 msgr2=0x7fe5541390f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe554139710 0x7fe5541390f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 monclient: found mon.noname-e 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:02.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.536+0000 7fe55259c640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554125cd0 con 0x7fe5540a57c0 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe55259c640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 msgr2=0x7fe5541ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe55259c640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 0x7fe5541ce470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe54402a6f0 tx=0x7fe5440046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe544037040 con 0x7fe5540a57c0 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: dump: 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.558 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.559 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 5 monclient: authenticate success, global_id 5399 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe544042070 con 0x7fe5540a57c0 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 10 monclient: _renew_subs 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5540a1e00 con 0x7fe5540a57c0 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe544030c20 con 0x7fe5540a57c0 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:02.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe55159a640 4 set_mon_vals no callback set 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe54b7fe640 10 monclient: dump: 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.561 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 10 monclient: _renew_subs 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.539+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5541254e0 con 0x7fe5540a57c0 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe5588f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe5588f6640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 0x7fe554123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe554076c60 con 0x7fe554124d70 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe544003c50 con 0x7fe5540a57c0 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 0x7fe554123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient: get_auth_request con 0x7fe554124d70 auth_method 0 2024-08-19T11:14:02.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe54b7fe640 1 --2- 172.21.15.71:0/4125642487 >> v2:172.21.15.135:6800/726754104 conn(0x7fe53403ea80 0x7fe534040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 10 monclient(hunting): handle_auth_done global_id 5227 payload 824 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe549d9b640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe55406db10 con 0x7fe554124d70 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (secure 0 0 0) 0x7fe544071f10 con 0x7fe5540a57c0 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe552d9d640 1 --2- 172.21.15.71:0/4125642487 >> v2:172.21.15.135:6800/726754104 conn(0x7fe53403ea80 0x7fe534040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.540+0000 7fe552d9d640 10 monclient: get_auth_request con 0x7fe53403ea80 auth_method 0 2024-08-19T11:14:02.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.542+0000 7fe549d9b640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 msgr2=0x7fe554123170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.542+0000 7fe549d9b640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 0x7fe554123170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe554124880 tx=0x7fe53c011d40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.542+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe53c019070 con 0x7fe554124d70 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.542+0000 7fe54b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.542+0000 7fe54b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.542+0000 7fe54b7fe640 10 monclient: dump: 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.564 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe552d9d640 1 --2- 172.21.15.71:0/4125642487 >> v2:172.21.15.135:6800/726754104 conn(0x7fe53403ea80 0x7fe534040f40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5541cf530 tx=0x7fe54c0073d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe53c00f890 con 0x7fe554124d70 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 msgr2=0x7fe554123170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 0x7fe554123170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe554124880 tx=0x7fe53c011d40 comp rx=0 tx=0).stop 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 msgr2=0x7fe554123170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.543+0000 7fe54b7fe640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe554124d70 0x7fe554123170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe5588f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe5588f6640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 0x7fe55402d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe5588f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe5540a2870 con 0x7fe55402d1c0 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 0x7fe55402d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient: get_auth_request con 0x7fe55402d1c0 auth_method 0 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 10 monclient(hunting): handle_auth_done global_id 5236 payload 824 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.549+0000 7fe549d9b640 1 -- 172.21.15.71:0/4125642487 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe5540a6d30 con 0x7fe55402d1c0 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.551+0000 7fe549d9b640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 msgr2=0x7fe55402d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.551+0000 7fe549d9b640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 0x7fe55402d5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe554124880 tx=0x7fe53c0046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe53c019040 con 0x7fe55402d1c0 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 10 monclient: dump: 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.567 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fe53c01e660 con 0x7fe55402d1c0 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:02.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 msgr2=0x7fe55402d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 0x7fe55402d5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe554124880 tx=0x7fe53c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 msgr2=0x7fe55402d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe54b7fe640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe55402d1c0 0x7fe55402d5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 239405, 2024-08-19T11:14:02.569 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:14:02.570 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.571 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.572 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:02.573 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:02.574 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.576 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:02.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.578 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:02.580 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.583 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:02.584 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:02.587 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.588 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:02.590 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:02.591 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:02.592 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 >> v2:172.21.15.135:6800/726754104 conn(0x7fe53403ea80 msgr2=0x7fe534040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 --2- 172.21.15.71:0/4125642487 >> v2:172.21.15.135:6800/726754104 conn(0x7fe53403ea80 0x7fe534040f40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5541cf530 tx=0x7fe54c0073d0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 10 monclient: shutdown 2024-08-19T11:14:02.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 msgr2=0x7fe5541ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 0x7fe5541ce470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe54402a6f0 tx=0x7fe5440046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe552d9d640 1 -- 172.21.15.71:0/4125642487 reap_dead start 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 shutdown_connections 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 --2- 172.21.15.71:0/4125642487 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe5540a57c0 0x7fe5541ce470 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 >> 172.21.15.71:0/4125642487 conn(0x7fe5540abf50 msgr2=0x7fe5540aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 shutdown_connections 2024-08-19T11:14:02.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.552+0000 7fe5588f6640 1 -- 172.21.15.71:0/4125642487 wait complete. 2024-08-19T11:14:02.594 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:02.595 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:14:02.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:14:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.692+0000 7f06cd856640 10 monclient: get_monmap_and_config 2024-08-19T11:14:02.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.692+0000 7f06cd856640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.692+0000 7f06cd856640 10 monclient: monmap: 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:02.692913+0000 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:02.692913+0000 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:02.697 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.692+0000 7f06cd856640 1 Processor -- start 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.692+0000 7f06cd856640 1 -- start start 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.692+0000 7f06cd856640 10 monclient: init 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient: _add_conns ranks=[5,4,8,2,10,3,7,1,9,0,6] 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f06c80a6a30 0x7f06c80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): picked mon.noname-h con 0x7f06c80a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 0x7f06c80a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): picked mon.noname-c con 0x7f06c80a6e10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 0x7f06c8139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): picked mon.noname-e con 0x7f06c8139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f06c80a4f90 con 0x7f06c80a6e10 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f06c80a6380 con 0x7f06c80a6a30 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f06c80a49d0 con 0x7f06c8139860 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06cd856640 10 monclient(hunting): authenticate will time out at 900.734457s 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 0x7f06c80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 0x7f06c8139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 0x7f06c80a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:43100/0 (socket says 172.21.15.71:43100) 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 0x7f06c8139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38310/0 (socket says 172.21.15.71:38310) 2024-08-19T11:14:02.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 1 -- 172.21.15.71:0/3852666364 learned_addr learned my addr 172.21.15.71:0/3852666364 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): get_auth_request con 0x7f06c80a6e10 auth_method 0 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): get_auth_request con 0x7f06c8139860 auth_method 0 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f06c80a6a30 0x7f06c80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): get_auth_request con 0x7f06c80a6a30 auth_method 0 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient(hunting): handle_auth_done global_id 5408 payload 274 2024-08-19T11:14:02.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 -- 172.21.15.71:0/3852666364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f06c80a6a30 msgr2=0x7f06c80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f06c80a6a30 0x7f06c80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 -- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 msgr2=0x7f06c80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 0x7f06c80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 monclient: found mon.noname-e 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c77fe640 1 -- 172.21.15.71:0/3852666364 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c80a46f0 con 0x7f06c8139860 2024-08-19T11:14:02.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.693+0000 7f06c67fc640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 0x7f06c80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c77fe640 1 -- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 msgr2=0x7f06c8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c77fe640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 0x7f06c8139c60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009dc0 tx=0x7f06c002a480 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b0ea73a19cf3d3d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 1 -- 172.21.15.71:0/3852666364 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06c0007bc0 con 0x7f06c8139860 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: dump: 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.709 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.710 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 1 -- 172.21.15.71:0/3852666364 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c0007d80 con 0x7f06c8139860 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06cd856640 5 monclient: authenticate success, global_id 5408 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06cd856640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 1 -- 172.21.15.71:0/3852666364 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06c0031870 con 0x7f06c8139860 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06cd856640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06cd856640 4 set_mon_vals no callback set 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.696+0000 7f06c5ffb640 10 monclient: dump: 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.712 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 10 monclient: shutdown 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 -- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 msgr2=0x7f06c8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 0x7f06c8139c60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009dc0 tx=0x7f06c002a480 comp rx=0 tx=0).stop 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 -- 172.21.15.71:0/3852666364 shutdown_connections 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f06c8139860 0x7f06c8139c60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f06c80a6e10 0x7f06c80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 --2- 172.21.15.71:0/3852666364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f06c80a6a30 0x7f06c80a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 -- 172.21.15.71:0/3852666364 >> 172.21.15.71:0/3852666364 conn(0x7f06c80ac030 msgr2=0x7f06c80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 -- 172.21.15.71:0/3852666364 shutdown_connections 2024-08-19T11:14:02.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.697+0000 7f06cd856640 1 -- 172.21.15.71:0/3852666364 wait complete. 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.698+0000 7f06cd856640 10 monclient: build_initial_monmap 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.698+0000 7f06cd856640 10 monclient: monmap: 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:02.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.698+0000 7f06cd856640 1 Processor -- start 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.698+0000 7f06cd856640 1 -- start start 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.698+0000 7f06cd856640 10 monclient: init 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient: _add_conns ranks=[7,0,2,8,5,1,3,6,4] 2024-08-19T11:14:02.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f06c80a6a30 0x7f06c8138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): picked mon.noname-i con 0x7f06c80a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 0x7f06c8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): picked mon.noname-a con 0x7f06c80a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06c8139860 0x7f06c8122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): picked mon.noname-b con 0x7f06c8139860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80a7730 con 0x7f06c80a6e10 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f06c813a1a0 con 0x7f06c8139860 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f06c81cefe0 con 0x7f06c80a6a30 2024-08-19T11:14:02.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06cd856640 10 monclient(hunting): authenticate will time out at 900.740139s 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 0x7f06c8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 0x7f06c8138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53030/0 (socket says 172.21.15.71:53030) 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 -- 172.21.15.71:0/3347126321 learned_addr learned my addr 172.21.15.71:0/3347126321 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): get_auth_request con 0x7f06c80a6e10 auth_method 0 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06c8139860 0x7f06c8122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): get_auth_request con 0x7f06c8139860 auth_method 0 2024-08-19T11:14:02.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c6ffd640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f06c80a6a30 0x7f06c8138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient(hunting): handle_auth_done global_id 34524 payload 824 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 -- 172.21.15.71:0/3347126321 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f06c80a6a30 msgr2=0x7f06c8138940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f06c80a6a30 0x7f06c8138940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 -- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06c8139860 msgr2=0x7f06c8122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06c8139860 0x7f06c8122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient: _finish_hunting 0 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 monclient: found mon.noname-a 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c67fc640 1 -- 172.21.15.71:0/3347126321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c8126320 con 0x7f06c80a6e10 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c6ffd640 10 monclient: get_auth_request con 0x7f06c80a6a30 auth_method 0 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.699+0000 7f06c6ffd640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f06c80a6a30 0x7f06c8138940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06c67fc640 1 -- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 msgr2=0x7f06c8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06c67fc640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 0x7f06c8138e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00ea00 tx=0x7f06bc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06bc017070 con 0x7f06c80a6e10 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:02.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: dump: 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.720 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: _finish_auth 0 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: _check_auth_tickets 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06cd856640 5 monclient: authenticate success, global_id 34524 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc00cc70 con 0x7f06c80a6e10 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06cd856640 10 monclient: _renew_subs 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06cd856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c80a2210 con 0x7f06c80a6e10 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:02.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f06bc00ce20 con 0x7f06c80a6e10 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06affff640 10 monclient: dump: 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:02.722 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.701+0000 7f06c57fa640 4 set_mon_vals no callback set 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 10 monclient: _renew_subs 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c8126040 con 0x7f06c80a6e10 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f06bc01a070 con 0x7f06c80a6e10 2024-08-19T11:14:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.702+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c813a500 con 0x7f06c80a6e10 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.703+0000 7f06affff640 1 --2- 172.21.15.71:0/3347126321 >> v2:172.21.15.135:6800/726754104 conn(0x7f06b403ea80 0x7f06b4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.703+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (secure 0 0 0) 0x7f06bc00f040 con 0x7f06c80a6e10 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.703+0000 7f06c6ffd640 1 --2- 172.21.15.71:0/3347126321 >> v2:172.21.15.135:6800/726754104 conn(0x7f06b403ea80 0x7f06b4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.703+0000 7f06c6ffd640 10 monclient: get_auth_request con 0x7f06b403ea80 auth_method 0 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.705+0000 7f06c6ffd640 1 --2- 172.21.15.71:0/3347126321 >> v2:172.21.15.135:6800/726754104 conn(0x7f06b403ea80 0x7f06b4040f40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009ac0 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.707+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f06bc021070 con 0x7f06c80a6e10 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.707+0000 7f06affff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:02.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.707+0000 7f06affff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:02.899 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:02.900 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25614]: starting. 2024-08-19T11:14:02.900 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25614]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25460 2024-08-19T11:14:02.900 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25614]: shutting down. 2024-08-19T11:14:02.901 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:02.901 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:02.901 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:14:02.903 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:14:02.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.960+0000 7f06cd856640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:14:02.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.960+0000 7f06cd856640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:14:02.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.960+0000 7f06cd856640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:02.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.960+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f06c806ca70 con 0x7f06c80a6e10 2024-08-19T11:14:02.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f06affff640 1 -- 172.21.15.71:0/3347126321 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f06bc050a80 con 0x7f06c80a6e10 2024-08-19T11:14:02.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f06affff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:14:02.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f06affff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:02.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=10,config=2,health=11,kv=12,logm=65} crc {auth=270123157,config=2586702516,health=3296874668,kv=1733167337,logm=2492999288}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=1,health=12,kv=12,logm=63} crc {auth=2496437099,config=1747058506,health=1346729461,kv=3646823213,logm=4057269131}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=489632047,config=2586702516,health=3422089198,kv=1111774046,logm=3992176946}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=3306953234,config=2586702516,health=1346729461,kv=2298616631,logm=2066953918}) 2024-08-19T11:14:02.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=10,config=2,health=11,kv=12,logm=65} crc {auth=4038458020,config=2586702516,health=3296874668,kv=3646823213,logm=1299515031}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=3306953234,config=2586702516,health=1346729461,kv=1515141452,logm=4099266714}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=10,config=2,health=11,kv=12,logm=65} crc {auth=2284321557,config=2586702516,health=2730158282,kv=3646823213,logm=335847505}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=3646823213,logm=4110558332}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.961+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=53259676,config=2586702516,health=1346729461,kv=1361786024,logm=3273021104}) 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1261576074}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272698349}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1366436401}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=48328593}) 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.968 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.969 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1922155329}) 2024-08-19T11:14:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 >> v2:172.21.15.135:6800/726754104 conn(0x7f06b403ea80 msgr2=0x7f06b4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.969 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.969 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 --2- 172.21.15.71:0/3347126321 >> v2:172.21.15.135:6800/726754104 conn(0x7f06b403ea80 0x7f06b4040f40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009ac0 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2024-08-19T11:14:02.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 10 monclient: shutdown 2024-08-19T11:14:02.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:02.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 msgr2=0x7f06c8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:02.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 0x7f06c8138e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00ea00 tx=0x7f06bc00eec0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.970 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3935935370}) 2024-08-19T11:14:02.970 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.970 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.971 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2544628103}) 2024-08-19T11:14:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 shutdown_connections 2024-08-19T11:14:02.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 --2- 172.21.15.71:0/3347126321 >> v2:172.21.15.135:6800/726754104 conn(0x7f06b403ea80 0x7f06b4040f40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.971 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f06c8139860 0x7f06c8122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c80a6e10 0x7f06c8138e80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 --2- 172.21.15.71:0/3347126321 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f06c80a6a30 0x7f06c8138940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 >> 172.21.15.71:0/3347126321 conn(0x7f06c80ac030 msgr2=0x7f06c81c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:02.972 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3834608299}) 2024-08-19T11:14:02.972 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.963+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3949039095}) 2024-08-19T11:14:02.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.964+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 shutdown_connections 2024-08-19T11:14:02.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:02.964+0000 7f06cd856640 1 -- 172.21.15.71:0/3347126321 wait complete. 2024-08-19T11:14:02.974 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3135285825}) 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1150688237}) 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1441231066}) 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.975 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3994183748}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2072788000}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3702984105}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=41381958}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064886586}) 2024-08-19T11:14:02.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:02.965+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1842037234}) 2024-08-19T11:14:02.977 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:14:03.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2315287595}) 2024-08-19T11:14:03.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4250516155}) 2024-08-19T11:14:03.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1145066557}) 2024-08-19T11:14:03.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3728681538}) 2024-08-19T11:14:03.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=695731776}) 2024-08-19T11:14:03.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.495+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=860323870}) 2024-08-19T11:14:03.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3601750161}) 2024-08-19T11:14:03.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1361951057}) 2024-08-19T11:14:03.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.496+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1050973832}) 2024-08-19T11:14:03.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3894566675}) 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2230955374}) 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2588221279}) 2024-08-19T11:14:03.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1354798259}) 2024-08-19T11:14:03.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2678360276}) 2024-08-19T11:14:03.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1198188536}) 2024-08-19T11:14:03.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=981977977}) 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4167238346}) 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.497+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2275162760}) 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1339442238}) 2024-08-19T11:14:03.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3120404774}) 2024-08-19T11:14:03.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=862145223}) 2024-08-19T11:14:03.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1830710251}) 2024-08-19T11:14:03.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2702743061}) 2024-08-19T11:14:03.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2551682285}) 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3374600095}) 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.498+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.499+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=470616394}) 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.499+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1568924744}) 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1816186577}) 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4135616952}) 2024-08-19T11:14:03.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2284603461}) 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1507579287}) 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1148005157}) 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3725424110}) 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1734710938}) 2024-08-19T11:14:03.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3691759018}) 2024-08-19T11:14:03.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.500+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3902614815}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=696849480}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2816604026}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1144058711}) 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=227400478}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1328451543}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=449380350}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=590175574}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3529072793}) 2024-08-19T11:14:03.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.851+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=824487826}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1919646277}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3204621872}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1707292332}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1017321401}) 2024-08-19T11:14:03.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3280109058}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=889876728}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3026632688}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400879783}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.853+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2214752044}) 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.854+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1878249020}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=532231747}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=373700752}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1512431745}) 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4013546429}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4152833032}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2618792547}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441910781}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.855+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3461161676}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2960650534}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1548659263}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3811287908}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1689670437}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3624141500}) 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1935193072}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539178437}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4191025515}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.856+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1979644279}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1352657998}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2991308522}) 2024-08-19T11:14:03.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2653777307}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3895092812}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=854430744}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.857+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2729504854}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3813826965}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023996596}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.858+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1619279204}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3330889703}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2171952566}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3698842427}) 2024-08-19T11:14:03.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=251330024}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3732679797}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=686965811}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1100285017}) 2024-08-19T11:14:03.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337828574}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.859+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3397669955}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1859187602}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3618834063}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.860+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=454555009}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3263888918}) 2024-08-19T11:14:03.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1837579105}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=321498497}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1192205222}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3913404950}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.861+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2600747105}) 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2811372332}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3184172158}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2319768752}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3373209862}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=699371843}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.862+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2913703817}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.863+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.863+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.863+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=183184094}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.863+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.863+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386395879}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.863+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2548812598}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=667252545}) 2024-08-19T11:14:03.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=82567596}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1429209036}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1409086709}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3123491051}) 2024-08-19T11:14:03.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2514101530}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2637916998}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680570355}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.864+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=825333641}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=52,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=14,monmap=3,osd_metadata=3} crc {logm=2369325842,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=4172938767,mon_config_key=1794882263,monmap=1080203526,osd_metadata=2729632640}) 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=48,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=18,mon_config_key=16,monmap=3,osd_metadata=3} crc {logm=2989900386,mdsmap=4204236774,mgr=1057647138,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=346900923,mon_config_key=3399514852,monmap=1080203526,osd_metadata=2729632640}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=50,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=18,mon_config_key=17,monmap=3,osd_metadata=1} crc {logm=812110971,mdsmap=4204236774,mgr=2898961144,mgr_metadata=880626121,mgrstat=346900923,mon_config_key=2720761110,monmap=1080203526,osd_metadata=1748737375}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=52,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=17,mon_config_key=17,monmap=2,osd_metadata=1} crc {logm=2390805999,mdsmap=4081106307,mgr=3044166884,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2897872042,mon_config_key=2720761110,monmap=2667667542,osd_metadata=1748737375}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=3,osd_metadata=1} crc {logm=2033722448,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1019998125,mon_config_key=2720761110,monmap=1080203526,osd_metadata=1748737375}) 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=51,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=18,mon_config_key=17,monmap=1} crc {logm=2390953070,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=346900923,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=15,mon_config_key=15,monmap=2,osd_metadata=3} crc {logm=959543095,mdsmap=4204236774,mgr=30385681,mgr_command_descs=3626727127,mgr_metadata=880626121,mgrstat=3926723118,mon_config_key=1248917128,monmap=2667667542,osd_metadata=2729632640}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=16,mon_config_key=17,monmap=1} crc {logm=1571526993,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1625339224,mon_config_key=2720761110,monmap=1802609469}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.866+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=52,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=17,mon_config_key=15,monmap=2,osd_metadata=3} crc {logm=2857358886,mdsmap=4204236774,mgr=3875194627,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=122921557,mon_config_key=1749790675,monmap=2667667542,osd_metadata=2729632640}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=90} crc {monmap=3140514009,osd_metadata=1597162317,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=2166376729}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=89} crc {monmap=55734535,osd_metadata=2544538045,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=3238077066}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=90} crc {monmap=3140514009,osd_metadata=624310928,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=2060302312}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=89} crc {monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=2631303948}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=89} crc {monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=302871473}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=89} crc {monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=3509185073}) 2024-08-19T11:14:03.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=90} crc {monmap=3140514009,osd_metadata=186790487,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=2235538833}) 2024-08-19T11:14:03.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=2,osd_metadata=5,osd_snap=2,osdmap=91} crc {monmap=3140514009,osd_metadata=306360182,osd_snap=421676469,osdmap=1905864707}) 2024-08-19T11:14:03.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.868+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=89} crc {monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2264818009,osd_snap=421676469,osdmap=1176963553}) 2024-08-19T11:14:03.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=89} crc {osdmap=4045226760}) 2024-08-19T11:14:03.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=92} crc {osdmap=1979230845}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=3174583627}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=91} crc {osdmap=2124460076}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=90} crc {osdmap=3306299837}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=90} crc {osdmap=912833918}) 2024-08-19T11:14:03.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=92} crc {osdmap=900030788}) 2024-08-19T11:14:03.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:14:03.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=86} crc {osdmap=4015418306}) 2024-08-19T11:14:03.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:14:03.873+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=88} crc {osdmap=1490817477}) 2024-08-19T11:14:03.979 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:14:03.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.074+0000 7f4c99fd9640 10 monclient: get_monmap_and_config 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.074+0000 7f4c99fd9640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.075+0000 7f4c99fd9640 10 monclient: monmap: 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:04.075645+0000 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:04.075645+0000 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:04.076 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:04.077 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.075+0000 7f4c99fd9640 1 Processor -- start 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.075+0000 7f4c99fd9640 1 -- start start 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.075+0000 7f4c99fd9640 10 monclient: init 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient: _add_conns ranks=[9,3,5,0,2,8,6,7,10,4,1] 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c940a6a30 0x7f4c940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): picked mon.noname-a con 0x7f4c940a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c940a6e10 0x7f4c940a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): picked mon.noname-g con 0x7f4c940a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94139c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): picked mon.noname-h con 0x7f4c941397f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4c940a3650 con 0x7f4c940a6a30 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4c940a5d50 con 0x7f4c940a6e10 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4c940a4cb0 con 0x7f4c941397f0 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c99fd9640 10 monclient(hunting): authenticate will time out at 902.117317s 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c940a6a30 0x7f4c940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c940a6a30 0x7f4c940a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53042/0 (socket says 172.21.15.71:53042) 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 -- 172.21.15.71:0/3352577284 learned_addr learned my addr 172.21.15.71:0/3352577284 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): get_auth_request con 0x7f4c940a6a30 auth_method 0 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c93fff640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c92ffd640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c940a6e10 0x7f4c940a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c93fff640 10 monclient(hunting): get_auth_request con 0x7f4c941397f0 auth_method 0 2024-08-19T11:14:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c92ffd640 10 monclient(hunting): get_auth_request con 0x7f4c940a6e10 auth_method 0 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c92ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient(hunting): handle_auth_done global_id 34551 payload 274 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 -- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 msgr2=0x7f4c94139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 -- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c940a6e10 msgr2=0x7f4c940a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c940a6e10 0x7f4c940a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 monclient: found mon.noname-a 2024-08-19T11:14:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.076+0000 7f4c937fe640 1 -- 172.21.15.71:0/3352577284 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c940a4f90 con 0x7f4c940a6a30 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c937fe640 1 -- 172.21.15.71:0/3352577284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c940a6a30 msgr2=0x7f4c940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c937fe640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c940a6a30 0x7f4c940a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009e80 tx=0x7f4c8402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d614b3687c49fc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 1 -- 172.21.15.71:0/3352577284 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c84036070 con 0x7f4c940a6a30 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: dump: 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c99fd9640 5 monclient: authenticate success, global_id 34551 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c99fd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 1 -- 172.21.15.71:0/3352577284 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c84007a70 con 0x7f4c940a6a30 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c99fd9640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c99fd9640 4 set_mon_vals no callback set 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 1 -- 172.21.15.71:0/3352577284 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c84007ca0 con 0x7f4c940a6a30 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.079+0000 7f4c927fc640 10 monclient: dump: 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 10 monclient: shutdown 2024-08-19T11:14:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 -- 172.21.15.71:0/3352577284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c940a6a30 msgr2=0x7f4c940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c940a6a30 0x7f4c940a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009e80 tx=0x7f4c8402a570 comp rx=0 tx=0).stop 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 -- 172.21.15.71:0/3352577284 shutdown_connections 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c940a6e10 0x7f4c940a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/3352577284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c940a6a30 0x7f4c940a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 -- 172.21.15.71:0/3352577284 >> 172.21.15.71:0/3352577284 conn(0x7f4c940ac030 msgr2=0x7f4c940ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 -- 172.21.15.71:0/3352577284 shutdown_connections 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 1 -- 172.21.15.71:0/3352577284 wait complete. 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.080+0000 7f4c99fd9640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.081+0000 7f4c99fd9640 10 monclient: monmap: 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.092 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.081+0000 7f4c99fd9640 1 Processor -- start 2024-08-19T11:14:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.081+0000 7f4c99fd9640 1 -- start start 2024-08-19T11:14:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.081+0000 7f4c99fd9640 10 monclient: init 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient: _add_conns ranks=[6,4,5,7,8,0,3,1,2] 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 0x7f4c941ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): picked mon.noname-d con 0x7f4c940a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c940a6e10 0x7f4c94138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): picked mon.noname-c con 0x7f4c940a6e10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): picked mon.noname-h con 0x7f4c941397f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4c940a87d0 con 0x7f4c940a6e10 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4c940a8590 con 0x7f4c941397f0 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4c940a7730 con 0x7f4c940a6a30 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c99fd9640 10 monclient(hunting): authenticate will time out at 902.123110s 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 0x7f4c941ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 0x7f4c941ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:46114/0 (socket says 172.21.15.71:46114) 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c940a6e10 0x7f4c94138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 -- 172.21.15.71:0/702092902 learned_addr learned my addr 172.21.15.71:0/702092902 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): get_auth_request con 0x7f4c940a6a30 auth_method 0 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): get_auth_request con 0x7f4c940a6e10 auth_method 0 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): get_auth_request con 0x7f4c941397f0 auth_method 0 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c92ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient(hunting): handle_auth_done global_id 24936 payload 824 2024-08-19T11:14:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 -- 172.21.15.71:0/702092902 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 msgr2=0x7f4c94138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 -- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c940a6e10 msgr2=0x7f4c94138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c940a6e10 0x7f4c94138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 monclient: found mon.noname-d 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.082+0000 7f4c937fe640 1 -- 172.21.15.71:0/702092902 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c94126420 con 0x7f4c940a6a30 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c937fe640 1 -- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 msgr2=0x7f4c941ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c937fe640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 0x7f4c941ce1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c84034040 tx=0x7f4c84004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c84036050 con 0x7f4c940a6a30 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: dump: 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 5 monclient: authenticate success, global_id 24936 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c84042070 con 0x7f4c940a6a30 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 10 monclient: _renew_subs 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c940a3ef0 con 0x7f4c940a6a30 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c84003db0 con 0x7f4c940a6a30 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c7bfff640 10 monclient: dump: 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.103 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c91ffb640 4 set_mon_vals no callback set 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 10 monclient: _renew_subs 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.084+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c940a2010 con 0x7f4c940a6a30 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.085+0000 7f4c99fd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.085+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4c84004040 con 0x7f4c940a6a30 2024-08-19T11:14:04.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.085+0000 7f4c99fd9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.085+0000 7f4c99fd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.085+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c940a5810 con 0x7f4c940a6a30 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.086+0000 7f4c7bfff640 1 --2- 172.21.15.71:0/702092902 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c8003ea80 0x7f4c80040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.086+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(114..114 src has 1..114) ==== 3506+0+0 (secure 0 0 0) 0x7f4c84072980 con 0x7f4c940a6a30 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.086+0000 7f4c92ffd640 1 --2- 172.21.15.71:0/702092902 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c8003ea80 0x7f4c80040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.086+0000 7f4c92ffd640 10 monclient: get_auth_request con 0x7f4c8003ea80 auth_method 0 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.088+0000 7f4c92ffd640 1 --2- 172.21.15.71:0/702092902 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c8003ea80 0x7f4c80040f40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4c94124730 tx=0x7f4c88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.090+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f4c84031400 con 0x7f4c940a6a30 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.090+0000 7f4c7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.090+0000 7f4c7bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.331+0000 7f4c99fd9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.331+0000 7f4c99fd9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.331+0000 7f4c99fd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.331+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4c941240c0 con 0x7f4c940a6a30 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.332+0000 7f4c7bfff640 1 -- 172.21.15.71:0/702092902 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f4c84071870 con 0x7f4c940a6a30 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.332+0000 7f4c7bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:14:04.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.332+0000 7f4c7bfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:04.334 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":74,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:14:04.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c8003ea80 msgr2=0x7f4c80040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/702092902 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c8003ea80 0x7f4c80040f40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4c94124730 tx=0x7f4c88008040 comp rx=0 tx=0).stop 2024-08-19T11:14:04.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 10 monclient: shutdown 2024-08-19T11:14:04.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 msgr2=0x7f4c941ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 0x7f4c941ce1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c84034040 tx=0x7f4c84004a40 comp rx=0 tx=0).stop 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 shutdown_connections 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/702092902 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c8003ea80 0x7f4c80040f40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c940a6e10 0x7f4c94138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4c941397f0 0x7f4c94138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 --2- 172.21.15.71:0/702092902 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4c940a6a30 0x7f4c941ce1d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 >> 172.21.15.71:0/702092902 conn(0x7f4c940ac030 msgr2=0x7f4c940aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 shutdown_connections 2024-08-19T11:14:04.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.334+0000 7f4c99fd9640 1 -- 172.21.15.71:0/702092902 wait complete. 2024-08-19T11:14:04.345 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:14:04.346 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:14:04.346 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:14:04.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:14:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.443+0000 7effd2308640 10 monclient: get_monmap_and_config 2024-08-19T11:14:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.443+0000 7effd2308640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.443+0000 7effd2308640 10 monclient: monmap: 2024-08-19T11:14:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.444 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:04.443821+0000 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:04.443821+0000 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:04.445 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:04.446 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.443+0000 7effd2308640 1 Processor -- start 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.443+0000 7effd2308640 1 -- start start 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.443+0000 7effd2308640 10 monclient: init 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient: _add_conns ranks=[10,2,6,4,9,1,3,7,5,8,0] 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7effcc0a6950 0x7effcc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): picked mon.noname-f con 0x7effcc0a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 0x7effcc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): picked mon.noname-b con 0x7effcc0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 0x7effcc139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): picked mon.noname-d con 0x7effcc139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:04.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7effcc0a5020 con 0x7effcc0a6950 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7effcc0a77b0 con 0x7effcc0a57c0 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7effcc0a7d40 con 0x7effcc139710 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd2308640 10 monclient(hunting): authenticate will time out at 902.485477s 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 0x7effcc139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 0x7effcc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 0x7effcc139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:46122/0 (socket says 172.21.15.71:46122) 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 0x7effcc0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43380/0 (socket says 172.21.15.71:43380) 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 -- 172.21.15.71:0/3726301491 learned_addr learned my addr 172.21.15.71:0/3726301491 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): get_auth_request con 0x7effcc139710 auth_method 0 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): get_auth_request con 0x7effcc0a57c0 auth_method 0 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcbfff640 1 --2- 172.21.15.71:0/3726301491 >> v2:172.21.15.135:3300/0 conn(0x7effcc0a6950 0x7effcc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient(hunting): handle_auth_done global_id 24945 payload 274 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 -- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 msgr2=0x7effcc0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 --2- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 0x7effcc0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 -- 172.21.15.71:0/3726301491 >> v2:172.21.15.135:3300/0 conn(0x7effcc0a6950 msgr2=0x7effcc0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 --2- 172.21.15.71:0/3726301491 >> v2:172.21.15.135:3300/0 conn(0x7effcc0a6950 0x7effcc0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 monclient: found mon.noname-d 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effd08a5640 1 -- 172.21.15.71:0/3726301491 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc0a6380 con 0x7effcc139710 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcbfff640 10 monclient: get_auth_request con 0x7effcc0a6950 auth_method 0 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcb7fe640 1 --2- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 0x7effcc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.444+0000 7effcbfff640 1 --2- 172.21.15.71:0/3726301491 >> v2:172.21.15.135:3300/0 conn(0x7effcc0a6950 0x7effcc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:14:04.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effd08a5640 1 -- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 msgr2=0x7effcc139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effd08a5640 1 --2- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 0x7effcc139b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effc4009e80 tx=0x7effc402a580 comp rx=0 tx=0).ready entity=mon.6 client_cookie=daf9dd6fa88dc37b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 1 -- 172.21.15.71:0/3726301491 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7effc4036070 con 0x7effcc139710 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: dump: 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.464 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effd2308640 5 monclient: authenticate success, global_id 24945 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 1 -- 172.21.15.71:0/3726301491 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc4007a70 con 0x7effcc139710 2024-08-19T11:14:04.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effd2308640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effd2308640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 1 -- 172.21.15.71:0/3726301491 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7effc4007c60 con 0x7effcc139710 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effd2308640 4 set_mon_vals no callback set 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.447+0000 7effcaffd640 10 monclient: dump: 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.466 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 10 monclient: shutdown 2024-08-19T11:14:04.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 -- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 msgr2=0x7effcc139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 --2- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 0x7effcc139b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effc4009e80 tx=0x7effc402a580 comp rx=0 tx=0).stop 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 -- 172.21.15.71:0/3726301491 shutdown_connections 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 --2- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7effcc139710 0x7effcc139b30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 --2- 172.21.15.71:0/3726301491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc0a57c0 0x7effcc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 --2- 172.21.15.71:0/3726301491 >> v2:172.21.15.135:3300/0 conn(0x7effcc0a6950 0x7effcc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 -- 172.21.15.71:0/3726301491 >> 172.21.15.71:0/3726301491 conn(0x7effcc0abf50 msgr2=0x7effcc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 -- 172.21.15.71:0/3726301491 shutdown_connections 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.448+0000 7effd2308640 1 -- 172.21.15.71:0/3726301491 wait complete. 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 10 monclient: monmap: 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.468 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.469 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 1 Processor -- start 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 1 -- start start 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 10 monclient: init 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.449+0000 7effd2308640 10 monclient: _add_conns ranks=[3,7,2,5,8,1,4,6,0] 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effcc0a57c0 0x7effcc1ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): picked mon.noname-g con 0x7effcc0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7effcc0a6950 0x7effcc138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): picked mon.noname-i con 0x7effcc0a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 0x7effcc138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): picked mon.noname-b con 0x7effcc139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7effcc0a84c0 con 0x7effcc139710 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7effcc0a3650 con 0x7effcc0a57c0 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7effcc0a8700 con 0x7effcc0a6950 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd2308640 10 monclient(hunting): authenticate will time out at 902.491071s 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 0x7effcc138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 0x7effcc138fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43382/0 (socket says 172.21.15.71:43382) 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 -- 172.21.15.71:0/849429612 learned_addr learned my addr 172.21.15.71:0/849429612 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): get_auth_request con 0x7effcc139710 auth_method 0 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effcc0a57c0 0x7effcc1ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): get_auth_request con 0x7effcc0a57c0 auth_method 0 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7effcc0a6950 0x7effcc138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): get_auth_request con 0x7effcc0a6950 auth_method 0 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effcb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient(hunting): handle_auth_done global_id 5690 payload 824 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7effcc0a6950 msgr2=0x7effcc138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7effcc0a6950 0x7effcc138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effcc0a57c0 msgr2=0x7effcc1ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7effcc0a57c0 0x7effcc1ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 monclient: found mon.noname-b 2024-08-19T11:14:04.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.450+0000 7effd08a5640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc124100 con 0x7effcc139710 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd08a5640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 msgr2=0x7effcc138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd08a5640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 0x7effcc138fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effc4009fa0 tx=0x7effc4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7effc4040020 con 0x7effcc139710 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: dump: 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.474 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc4003ba0 con 0x7effcc139710 2024-08-19T11:14:04.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 5 monclient: authenticate success, global_id 5690 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 10 monclient: _renew_subs 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc0a2240 con 0x7effcc139710 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7effc4036040 con 0x7effcc139710 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effc8ff9640 10 monclient: dump: 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.476 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 10 monclient: _renew_subs 2024-08-19T11:14:04.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effca7fc640 4 set_mon_vals no callback set 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.452+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc1ce8d0 con 0x7effcc139710 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effd2308640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effd2308640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 0x7effcc122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effcc076c60 con 0x7effcc1227d0 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 0x7effcc122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 10 monclient: get_auth_request con 0x7effcc1227d0 auth_method 0 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.453+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7effc4043020 con 0x7effcc139710 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effcbfff640 10 monclient(hunting): handle_auth_done global_id 34560 payload 824 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effcbfff640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effcc0a1cf0 con 0x7effcc1227d0 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effc8ff9640 1 --2- 172.21.15.71:0/849429612 >> v2:172.21.15.135:6800/726754104 conn(0x7effac03ea80 0x7effac040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(114..114 src has 1..114) ==== 3506+0+0 (secure 0 0 0) 0x7effc4072350 con 0x7effcc139710 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effcb7fe640 1 --2- 172.21.15.71:0/849429612 >> v2:172.21.15.135:6800/726754104 conn(0x7effac03ea80 0x7effac040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.454+0000 7effcb7fe640 10 monclient: get_auth_request con 0x7effac03ea80 auth_method 0 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effcbfff640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 msgr2=0x7effcc122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effcbfff640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 0x7effcc122bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7effb400f810 tx=0x7effb400fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7effb400dc30 con 0x7effcc1227d0 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 10 monclient: dump: 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.480 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7effb400dc30 con 0x7effcc1227d0 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 msgr2=0x7effcc122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 0x7effcc122bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7effb400f810 tx=0x7effb400fcd0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 msgr2=0x7effcc122bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.456+0000 7effc8ff9640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1227d0 0x7effcc122bb0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7effb400f810 tx=0x7effb400fcd0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.457+0000 7effcb7fe640 1 --2- 172.21.15.71:0/849429612 >> v2:172.21.15.135:6800/726754104 conn(0x7effac03ea80 0x7effac040f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7effbc009560 tx=0x7effbc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.462+0000 7effd2308640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.462+0000 7effd2308640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 0x7effcc09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.462+0000 7effd2308640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.462+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effcc13a100 con 0x7effcc1230f0 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 0x7effcc09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient: get_auth_request con 0x7effcc1230f0 auth_method 0 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 10 monclient(hunting): handle_auth_done global_id 34569 payload 824 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.463+0000 7effcbfff640 1 -- 172.21.15.71:0/849429612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7effcc0a6d30 con 0x7effcc1230f0 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effcbfff640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 msgr2=0x7effcc09c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effcbfff640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 0x7effcc09c9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7effb400f810 tx=0x7effb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7effb400dea0 con 0x7effcc1230f0 2024-08-19T11:14:04.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 10 monclient: dump: 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.485 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7effb4006550 con 0x7effcc1230f0 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 msgr2=0x7effcc09c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 0x7effcc09c9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7effb400f810 tx=0x7effb40046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 msgr2=0x7effcc09c9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.465+0000 7effc8ff9640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1230f0 0x7effcc09c9f0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7effb400f810 tx=0x7effb40046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 79981, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 8, 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.489 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:04.490 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:04.491 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.492 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:04.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:04.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.499 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.501 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:04.504 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.508 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.511 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:04.511 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 >> v2:172.21.15.135:6800/726754104 conn(0x7effac03ea80 msgr2=0x7effac040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 --2- 172.21.15.71:0/849429612 >> v2:172.21.15.135:6800/726754104 conn(0x7effac03ea80 0x7effac040f40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7effbc009560 tx=0x7effbc009190 comp rx=0 tx=0).stop 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 10 monclient: shutdown 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 msgr2=0x7effcc138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd08a5640 1 -- 172.21.15.71:0/849429612 reap_dead start 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 0x7effcc138fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7effc4009fa0 tx=0x7effc4004a40 comp rx=0 tx=0).stop 2024-08-19T11:14:04.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 shutdown_connections 2024-08-19T11:14:04.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 --2- 172.21.15.71:0/849429612 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7effcc139710 0x7effcc138fe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 >> 172.21.15.71:0/849429612 conn(0x7effcc0abf50 msgr2=0x7effcc0ab810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 shutdown_connections 2024-08-19T11:14:04.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.466+0000 7effd2308640 1 -- 172.21.15.71:0/849429612 wait complete. 2024-08-19T11:14:04.513 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:04.513 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:14:04.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:14:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.610+0000 7efcfaecc640 10 monclient: get_monmap_and_config 2024-08-19T11:14:04.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.610+0000 7efcfaecc640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.610+0000 7efcfaecc640 10 monclient: monmap: 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:04.611278+0000 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:04.611278+0000 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:04.613 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:04.613 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 Processor -- start 2024-08-19T11:14:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 -- start start 2024-08-19T11:14:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient: init 2024-08-19T11:14:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient: _add_conns ranks=[8,2,5,1,7,9,4,10,3,6,0] 2024-08-19T11:14:04.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): picked mon.noname-e con 0x7efcf40a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 0x7efcf40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): picked mon.noname-b con 0x7efcf40a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efcf4139710 0x7efcf4139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): picked mon.noname-h con 0x7efcf4139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcf40a5020 con 0x7efcf40a57c0 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7efcf40a77b0 con 0x7efcf4139710 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7efcf40a7d40 con 0x7efcf40a6950 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.611+0000 7efcfaecc640 10 monclient(hunting): authenticate will time out at 902.652893s 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 0x7efcf40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf40a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38322/0 (socket says 172.21.15.71:38322) 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 1 -- 172.21.15.71:0/707150878 learned_addr learned my addr 172.21.15.71:0/707150878 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): get_auth_request con 0x7efcf40a6950 auth_method 0 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): get_auth_request con 0x7efcf40a57c0 auth_method 0 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf9469640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efcf4139710 0x7efcf4139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf9469640 10 monclient(hunting): get_auth_request con 0x7efcf4139710 auth_method 0 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf9469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf9469640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf9469640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient(hunting): handle_auth_done global_id 5699 payload 274 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 -- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 msgr2=0x7efcf40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf40a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 -- 172.21.15.71:0/707150878 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efcf4139710 msgr2=0x7efcf4139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efcf4139710 0x7efcf4139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 monclient: found mon.noname-b 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf3fff640 1 -- 172.21.15.71:0/707150878 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf40a6380 con 0x7efcf40a57c0 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.612+0000 7efcf8c68640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf3fff640 1 -- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 msgr2=0x7efcf40a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf3fff640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 0x7efcf40a7270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efce0009800 tx=0x7efce0029fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177c02afbf39309e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 1 -- 172.21.15.71:0/707150878 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efce0037070 con 0x7efcf40a57c0 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: dump: 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.621 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.622 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 5 monclient: authenticate success, global_id 5699 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 1 -- 172.21.15.71:0/707150878 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce002ad00 con 0x7efcf40a57c0 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 1 -- 172.21.15.71:0/707150878 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efce0030c20 con 0x7efcf40a57c0 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 4 set_mon_vals no callback set 2024-08-19T11:14:04.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcf37fe640 10 monclient: dump: 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.624 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 10 monclient: shutdown 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 -- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 msgr2=0x7efcf40a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 0x7efcf40a7270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efce0009800 tx=0x7efce0029fe0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 -- 172.21.15.71:0/707150878 shutdown_connections 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efcf4139710 0x7efcf4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf40a57c0 0x7efcf40a7270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 --2- 172.21.15.71:0/707150878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 -- 172.21.15.71:0/707150878 >> 172.21.15.71:0/707150878 conn(0x7efcf40abf50 msgr2=0x7efcf40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 -- 172.21.15.71:0/707150878 shutdown_connections 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.615+0000 7efcfaecc640 1 -- 172.21.15.71:0/707150878 wait complete. 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.616+0000 7efcfaecc640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.616+0000 7efcfaecc640 10 monclient: monmap: 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:04.626 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.616+0000 7efcfaecc640 1 Processor -- start 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.616+0000 7efcfaecc640 1 -- start start 2024-08-19T11:14:04.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.616+0000 7efcfaecc640 10 monclient: init 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient: _add_conns ranks=[7,8,2,4,1,3,6,0,5] 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efcf40a57c0 0x7efcf41ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): picked mon.noname-i con 0x7efcf40a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf4138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): picked mon.noname-e con 0x7efcf40a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4139710 0x7efcf4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): picked mon.noname-b con 0x7efcf4139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcf40a84c0 con 0x7efcf4139710 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7efcf40a3650 con 0x7efcf40a57c0 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7efcf40a8700 con 0x7efcf40a6950 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcfaecc640 10 monclient(hunting): authenticate will time out at 902.658435s 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf4138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4139710 0x7efcf4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf4138a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38332/0 (socket says 172.21.15.71:38332) 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 -- 172.21.15.71:0/978473905 learned_addr learned my addr 172.21.15.71:0/978473905 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): get_auth_request con 0x7efcf4139710 auth_method 0 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): get_auth_request con 0x7efcf40a6950 auth_method 0 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efcf40a57c0 0x7efcf41ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): get_auth_request con 0x7efcf40a57c0 auth_method 0 2024-08-19T11:14:04.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient(hunting): handle_auth_done global_id 5444 payload 824 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efcf40a57c0 msgr2=0x7efcf41ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efcf40a57c0 0x7efcf41ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4139710 msgr2=0x7efcf4138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4139710 0x7efcf4138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 monclient: found mon.noname-e 2024-08-19T11:14:04.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf3fff640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf41240f0 con 0x7efcf40a6950 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.617+0000 7efcf9469640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4139710 0x7efcf4138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf3fff640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 msgr2=0x7efcf4138a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf3fff640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf4138a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efce0000c00 tx=0x7efce00046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efce0037040 con 0x7efcf40a6950 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: dump: 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.638 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.639 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce0042070 con 0x7efcf40a6950 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 5 monclient: authenticate success, global_id 5444 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 10 monclient: _renew_subs 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf40a1e90 con 0x7efcf40a6950 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efce003dd20 con 0x7efcf40a6950 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf17fa640 10 monclient: dump: 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.641 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcf2ffd640 4 set_mon_vals no callback set 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 10 monclient: _renew_subs 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.620+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf4126450 con 0x7efcf40a6950 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcfaecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcfaecc640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 0x7efcf402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcf4076c60 con 0x7efcf4123000 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf3fff640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf4138a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efce0000c00 tx=0x7efce00046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7efce0003bd0 mgrmap(e 5) 2024-08-19T11:14:04.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7efce0003bd0 con 0x7efcf40a6950 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 0x7efcf402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient: get_auth_request con 0x7efcf4123000 auth_method 0 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf17fa640 1 --2- 172.21.15.71:0/978473905 >> v2:172.21.15.135:6800/726754104 conn(0x7efcd803ea80 0x7efcd8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 10 monclient(hunting): handle_auth_done global_id 5717 payload 824 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf8c68640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efcf40a6d30 con 0x7efcf4123000 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf9469640 1 --2- 172.21.15.71:0/978473905 >> v2:172.21.15.135:6800/726754104 conn(0x7efcd803ea80 0x7efcd8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.621+0000 7efcf9469640 10 monclient: get_auth_request con 0x7efcd803ea80 auth_method 0 2024-08-19T11:14:04.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf8c68640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 msgr2=0x7efcf402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf8c68640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 0x7efcf402d1c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efce80118f0 tx=0x7efce8011db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efce800fd90 con 0x7efcf4123000 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf17fa640 10 monclient: dump: 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.644 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.623+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efce800fd90 con 0x7efcf4123000 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf17fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 msgr2=0x7efcf402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf17fa640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 0x7efcf402d1c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efce80118f0 tx=0x7efce8011db0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 msgr2=0x7efcf402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf17fa640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf4123000 0x7efcf402d1c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.624+0000 7efcf9469640 1 --2- 172.21.15.71:0/978473905 >> v2:172.21.15.135:6800/726754104 conn(0x7efcd803ea80 0x7efcd8040f40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efcf4074f90 tx=0x7efcec009780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcfaecc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcfaecc640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 0x7efcf402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcfaecc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcf409e100 con 0x7efcf41233e0 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 0x7efcf402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient: get_auth_request con 0x7efcf41233e0 auth_method 0 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 10 monclient(hunting): handle_auth_done global_id 5726 payload 824 2024-08-19T11:14:04.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.630+0000 7efcf8c68640 1 -- 172.21.15.71:0/978473905 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efcf41ce840 con 0x7efcf41233e0 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.632+0000 7efcf8c68640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 msgr2=0x7efcf402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.632+0000 7efcf8c68640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 0x7efcf402d700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efce80118f0 tx=0x7efce8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.632+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efce8004490 con 0x7efcf41233e0 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.632+0000 7efcf17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.632+0000 7efcf17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.632+0000 7efcf17fa640 10 monclient: dump: 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.648 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7efce802a440 con 0x7efcf41233e0 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:04.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 msgr2=0x7efcf402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 0x7efcf402d700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efce80118f0 tx=0x7efce8004730 comp rx=0 tx=0).stop 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 msgr2=0x7efcf402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcf41233e0 0x7efcf402d700 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efce80118f0 tx=0x7efce8004730 comp rx=0 tx=0).stop 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:04.650 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 241511, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 8, 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:04.651 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.652 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.653 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.654 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:04.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:04.657 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:04.658 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:04.661 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.663 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.665 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:04.667 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.672 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.673 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:04.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.675 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:04.675 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 >> v2:172.21.15.135:6800/726754104 conn(0x7efcd803ea80 msgr2=0x7efcd8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 --2- 172.21.15.71:0/978473905 >> v2:172.21.15.135:6800/726754104 conn(0x7efcd803ea80 0x7efcd8040f40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efcf4074f90 tx=0x7efcec009780 comp rx=0 tx=0).stop 2024-08-19T11:14:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 10 monclient: shutdown 2024-08-19T11:14:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 msgr2=0x7efcf4138a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 --2- 172.21.15.71:0/978473905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efcf40a6950 0x7efcf4138a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efce0000c00 tx=0x7efce00046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf9469640 1 -- 172.21.15.71:0/978473905 reap_dead start 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf17fa640 1 -- 172.21.15.71:0/978473905 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(114..114 src has 1..114) ==== 3506+0+0 (unknown 0 0 0) 0x7efce0071ff0 con 0x7efcf40a6950 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcf9469640 1 -- 172.21.15.71:0/978473905 reap_dead start 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 shutdown_connections 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 >> 172.21.15.71:0/978473905 conn(0x7efcf40abf50 msgr2=0x7efcf40aabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 shutdown_connections 2024-08-19T11:14:04.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.633+0000 7efcfaecc640 1 -- 172.21.15.71:0/978473905 wait complete. 2024-08-19T11:14:04.677 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:04.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:14:04.678 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.777+0000 7f649c379640 10 monclient: get_monmap_and_config 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.777+0000 7f649c379640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.777+0000 7f649c379640 10 monclient: monmap: 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:04.777697+0000 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:04.777697+0000 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:04.779 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.777+0000 7f649c379640 1 Processor -- start 2024-08-19T11:14:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.777+0000 7f649c379640 1 -- start start 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.777+0000 7f649c379640 10 monclient: init 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient: _add_conns ranks=[1,7,5,0,4,8,10,6,3,2,9] 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f64940a3c30 addr v1:172.21.15.135:6789/0 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f64940a4720 0x7f649413ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): picked mon.noname-i con 0x7f64940a4720 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f64941414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): picked mon.noname-h con 0x7f649413f0f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64940a13b0 con 0x7f64940a3c30 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f64940a5000 con 0x7f649413f0f0 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f64940a0b10 con 0x7f64940a4720 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649c379640 10 monclient(hunting): authenticate will time out at 902.819436s 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a115640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f64940a3c30 0x7f64940a4010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:58826/0 (socket says 172.21.15.71:58826) 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a115640 1 -- 172.21.15.71:0/677671780 learned_addr learned my addr 172.21.15.71:0/677671780 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f64941414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): get_auth_request con 0x7f649413f0f0 auth_method 0 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f64940a4720 0x7f649413ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): get_auth_request con 0x7f64940a4720 auth_method 0 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f649a916640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.778+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 10 monclient(hunting): handle_auth_done global_id 44204 payload 274 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 1 -- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f64940a4720 msgr2=0x7f649413ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f64940a4720 0x7f649413ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 1 -- 172.21.15.71:0/677671780 >> v1:172.21.15.135:6789/0 conn(0x7f64940a3c30 legacy=0x7f64940a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 1 monclient: found mon.noname-h 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f649a916640 1 -- 172.21.15.71:0/677671780 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64940a0df0 con 0x7f649413f0f0 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.779+0000 7f6499914640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f64940a4720 0x7f649413ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.781+0000 7f649a916640 1 -- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 msgr2=0x7f64941414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.781+0000 7f649a916640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f64941414e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f648c009dc0 tx=0x7f648c02a480 comp rx=0 tx=0).ready entity=mon.5 client_cookie=8b6c2a96a711ad8f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 1 -- 172.21.15.71:0/677671780 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f648c007bc0 con 0x7f649413f0f0 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: dump: 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.787 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.788 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 1 -- 172.21.15.71:0/677671780 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c007d80 con 0x7f649413f0f0 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 5 monclient: authenticate success, global_id 44204 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 1 -- 172.21.15.71:0/677671780 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f648c031870 con 0x7f649413f0f0 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 4 set_mon_vals no callback set 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f6499113640 10 monclient: dump: 2024-08-19T11:14:04.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 10 monclient: shutdown 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 -- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 msgr2=0x7f64941414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f64941414e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f648c009dc0 tx=0x7f648c02a480 comp rx=0 tx=0).stop 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 -- 172.21.15.71:0/677671780 shutdown_connections 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f64941414e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 --2- 172.21.15.71:0/677671780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f64940a4720 0x7f649413ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 -- 172.21.15.71:0/677671780 >> 172.21.15.71:0/677671780 conn(0x7f64940a91d0 msgr2=0x7f64940a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 -- 172.21.15.71:0/677671780 shutdown_connections 2024-08-19T11:14:04.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.782+0000 7f649c379640 1 -- 172.21.15.71:0/677671780 wait complete. 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.783+0000 7f649c379640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.783+0000 7f649c379640 10 monclient: monmap: 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:04.797 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.783+0000 7f649c379640 1 Processor -- start 2024-08-19T11:14:04.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.783+0000 7f649c379640 1 -- start start 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.783+0000 7f649c379640 10 monclient: init 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient: _add_conns ranks=[8,2,5,6,7,4,1,0,3] 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 0x7f6494126ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): picked mon.noname-e con 0x7f64940a3c30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64940a4720 0x7f649413de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): picked mon.noname-b con 0x7f64940a4720 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f649413e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): picked mon.noname-h con 0x7f649413f0f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f64940a5570 con 0x7f64940a4720 2024-08-19T11:14:04.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f649406cbd0 con 0x7f649413f0f0 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f64940a5210 con 0x7f64940a3c30 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649c379640 10 monclient(hunting): authenticate will time out at 902.825214s 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 0x7f6494126ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64940a4720 0x7f649413de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 0x7f6494126ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38826/0 (socket says 172.21.15.71:38826) 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): get_auth_request con 0x7f64940a4720 auth_method 0 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 -- 172.21.15.71:0/4109803432 learned_addr learned my addr 172.21.15.71:0/4109803432 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): get_auth_request con 0x7f64940a3c30 auth_method 0 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f649413e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): get_auth_request con 0x7f649413f0f0 auth_method 0 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a916640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient(hunting): handle_auth_done global_id 5453 payload 824 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 msgr2=0x7f649413e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f649413f0f0 0x7f649413e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64940a4720 msgr2=0x7f649413de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64940a4720 0x7f649413de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 monclient: found mon.noname-e 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f649a115640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64941284a0 con 0x7f64940a3c30 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.784+0000 7f6499914640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64940a4720 0x7f649413de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.786+0000 7f649a115640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 msgr2=0x7f6494126ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.786+0000 7f649a115640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 0x7f6494126ea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f649000c460 tx=0x7f649000c920 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.786+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6490005cf0 con 0x7f64940a3c30 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.786+0000 7f648affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: dump: 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.803 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64900074e0 con 0x7f64940a3c30 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 5 monclient: authenticate success, global_id 5453 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 10 monclient: _renew_subs 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6490007690 con 0x7f64940a3c30 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64940a96d0 con 0x7f64940a3c30 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f6498912640 4 set_mon_vals no callback set 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:04.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 10 monclient: dump: 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.806 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 10 monclient: _renew_subs 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6494129f60 con 0x7f64940a3c30 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 0x7f64941ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6494076c60 con 0x7f64941ce3f0 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6490007070 con 0x7f64940a3c30 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f6499914640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 0x7f64941ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f6499914640 10 monclient: get_auth_request con 0x7f64941ce3f0 auth_method 0 2024-08-19T11:14:04.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f6499914640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f6499914640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.787+0000 7f6499914640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f648affd640 1 --2- 172.21.15.71:0/4109803432 >> v2:172.21.15.135:6800/726754104 conn(0x7f647803eab0 0x7f6478040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f6499914640 10 monclient(hunting): handle_auth_done global_id 44167 payload 824 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f6499914640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f649412a3d0 con 0x7f64941ce3f0 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(114..114 src has 1..114) ==== 3506+0+0 (secure 0 0 0) 0x7f64900516f0 con 0x7f64940a3c30 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f649a916640 1 --2- 172.21.15.71:0/4109803432 >> v2:172.21.15.135:6800/726754104 conn(0x7f647803eab0 0x7f6478040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.788+0000 7f649a916640 10 monclient: get_auth_request con 0x7f647803eab0 auth_method 0 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f6499914640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 msgr2=0x7f64941ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f6499914640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 0x7f64941ce7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f649406cf50 tx=0x7f648400f610 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6484014ac0 con 0x7f64941ce3f0 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 10 monclient: dump: 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.809 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6484014650 con 0x7f64941ce3f0 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 msgr2=0x7f64941ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 0x7f64941ce7d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f649406cf50 tx=0x7f648400f610 comp rx=0 tx=0).stop 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 msgr2=0x7f64941ce7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.790+0000 7f648affd640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ce3f0 0x7f64941ce7d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.791+0000 7f649a916640 1 --2- 172.21.15.71:0/4109803432 >> v2:172.21.15.135:6800/726754104 conn(0x7f647803eab0 0x7f6478040f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.796+0000 7f649c379640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:04.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.796+0000 7f649c379640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 0x7f6494071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.796+0000 7f649c379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.796+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6494068e50 con 0x7f64941ced10 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 0x7f6494071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient: get_auth_request con 0x7f64941ced10 auth_method 0 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 10 monclient(hunting): handle_auth_done global_id 44176 payload 824 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.797+0000 7f6499914640 1 -- 172.21.15.71:0/4109803432 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f64940a4010 con 0x7f64941ced10 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f6499914640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 msgr2=0x7f6494071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f6499914640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 0x7f6494071110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f649406cf50 tx=0x7f64840046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f648401d870 con 0x7f64941ced10 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 10 monclient: dump: 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.814 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f648402b3d0 con 0x7f64941ced10 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 msgr2=0x7f6494071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 0x7f6494071110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f649406cf50 tx=0x7f64840046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 msgr2=0x7f6494071110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.799+0000 7f648affd640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f64941ced10 0x7f6494071110 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f649406cf50 tx=0x7f64840046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 13812, 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:04.816 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 8, 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:04.817 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:04.818 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:04.820 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.821 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:04.823 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.827 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.832 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.834 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:04.836 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.838 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:04.839 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 >> v2:172.21.15.135:6800/726754104 conn(0x7f647803eab0 msgr2=0x7f6478040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 --2- 172.21.15.71:0/4109803432 >> v2:172.21.15.135:6800/726754104 conn(0x7f647803eab0 0x7f6478040f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f648c034000 tx=0x7f648c02f000 comp rx=0 tx=0).stop 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 10 monclient: shutdown 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 msgr2=0x7f6494126ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 --2- 172.21.15.71:0/4109803432 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f64940a3c30 0x7f6494126ea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f649000c460 tx=0x7f649000c920 comp rx=0 tx=0).stop 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649a916640 1 -- 172.21.15.71:0/4109803432 reap_dead start 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649a916640 1 -- 172.21.15.71:0/4109803432 reap_dead start 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 shutdown_connections 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 >> 172.21.15.71:0/4109803432 conn(0x7f64940a91d0 msgr2=0x7f64940a6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 shutdown_connections 2024-08-19T11:14:04.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.800+0000 7f649c379640 1 -- 172.21.15.71:0/4109803432 wait complete. 2024-08-19T11:14:04.842 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:04.842 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:14:04.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:14:04.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.954+0000 7fbd92c38640 10 monclient: get_monmap_and_config 2024-08-19T11:14:04.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.954+0000 7fbd92c38640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.954+0000 7fbd92c38640 10 monclient: monmap: 2024-08-19T11:14:04.955 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.955 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:04.955292+0000 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:04.955292+0000 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.956 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.957 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:04.957 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:04.957 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 Processor -- start 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 -- start start 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient: init 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient: _add_conns ranks=[0,2,9,1,3,5,7,10,8,4,6] 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbd8c0a3d80 addr v1:172.21.15.71:6789/0 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 0x7fbd8c13c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): picked mon.noname-b con 0x7fbd8c0a0460 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbd8c0a4870 0x7fbd8c13eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): picked mon.noname-a con 0x7fbd8c0a4870 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c0a0040 con 0x7fbd8c0a3d80 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c0a5bd0 con 0x7fbd8c0a4870 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c09c080 con 0x7fbd8c0a0460 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.955+0000 7fbd92c38640 10 monclient(hunting): authenticate will time out at 902.996960s 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 0x7fbd8c13c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd909d4640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbd8c0a3d80 0x7fbd8c0a4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56636/0 (socket says 172.21.15.71:56636) 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd909d4640 1 -- 172.21.15.71:0/135887309 learned_addr learned my addr 172.21.15.71:0/135887309 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): get_auth_request con 0x7fbd8c0a0460 auth_method 0 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 1 --2- 172.21.15.71:0/135887309 >> v2:172.21.15.71:3300/0 conn(0x7fbd8c0a4870 0x7fbd8c13eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): get_auth_request con 0x7fbd8c0a4870 auth_method 0 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd911d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_done global_id 5744 payload 274 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 1 -- 172.21.15.71:0/135887309 >> v2:172.21.15.71:3300/0 conn(0x7fbd8c0a4870 msgr2=0x7fbd8c13eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 1 --2- 172.21.15.71:0/135887309 >> v2:172.21.15.71:3300/0 conn(0x7fbd8c0a4870 0x7fbd8c13eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 1 -- 172.21.15.71:0/135887309 >> v1:172.21.15.71:6789/0 conn(0x7fbd8c0a3d80 legacy=0x7fbd8c0a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 1 monclient: found mon.noname-b 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:04.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.956+0000 7fbd8bfff640 1 -- 172.21.15.71:0/135887309 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c069660 con 0x7fbd8c0a0460 2024-08-19T11:14:04.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.959+0000 7fbd8bfff640 1 -- 172.21.15.71:0/135887309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 msgr2=0x7fbd8c13c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.959+0000 7fbd8bfff640 1 --2- 172.21.15.71:0/135887309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 0x7fbd8c13c990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd780097a0 tx=0x7fbd78029fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e420b468b0749 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 1 -- 172.21.15.71:0/135887309 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd78037070 con 0x7fbd8c0a0460 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: dump: 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.967 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 1 -- 172.21.15.71:0/135887309 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7802ad10 con 0x7fbd8c0a0460 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd92c38640 5 monclient: authenticate success, global_id 5744 2024-08-19T11:14:04.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd92c38640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd92c38640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd92c38640 4 set_mon_vals no callback set 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 1 -- 172.21.15.71:0/135887309 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd78030c20 con 0x7fbd8c0a0460 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.961+0000 7fbd8b7fe640 10 monclient: dump: 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.969 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.970 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 10 monclient: shutdown 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 -- 172.21.15.71:0/135887309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 msgr2=0x7fbd8c13c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 --2- 172.21.15.71:0/135887309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 0x7fbd8c13c990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd780097a0 tx=0x7fbd78029fb0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 -- 172.21.15.71:0/135887309 shutdown_connections 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 --2- 172.21.15.71:0/135887309 >> v2:172.21.15.71:3300/0 conn(0x7fbd8c0a4870 0x7fbd8c13eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 --2- 172.21.15.71:0/135887309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a0460 0x7fbd8c13c990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 -- 172.21.15.71:0/135887309 >> 172.21.15.71:0/135887309 conn(0x7fbd8c0a4e70 msgr2=0x7fbd8c0a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 -- 172.21.15.71:0/135887309 shutdown_connections 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 1 -- 172.21.15.71:0/135887309 wait complete. 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 10 monclient: build_initial_monmap 2024-08-19T11:14:04.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.962+0000 7fbd92c38640 10 monclient: monmap: 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:04.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 Processor -- start 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 -- start start 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient: init 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient: _add_conns ranks=[5,2,6,7,0,1,8,3,4] 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd8c0a0460 0x7fbd8c1ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): picked mon.noname-h con 0x7fbd8c0a0460 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a3d80 0x7fbd8c1346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): picked mon.noname-b con 0x7fbd8c0a3d80 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 0x7fbd8c134c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): picked mon.noname-d con 0x7fbd8c0a4870 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:04.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c09ea40 con 0x7fbd8c0a3d80 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbd8c0693b0 con 0x7fbd8c0a0460 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbd8c09ebc0 con 0x7fbd8c0a4870 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd92c38640 10 monclient(hunting): authenticate will time out at 903.004863s 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd911d5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 0x7fbd8c134c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd8bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a3d80 0x7fbd8c1346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd911d5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 0x7fbd8c134c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:56862/0 (socket says 172.21.15.71:56862) 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd8bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a3d80 0x7fbd8c1346d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:53078/0 (socket says 172.21.15.71:53078) 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.963+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 learned_addr learned my addr 172.21.15.71:0/2884302074 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:04.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): get_auth_request con 0x7fbd8c0a4870 auth_method 0 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): get_auth_request con 0x7fbd8c0a3d80 auth_method 0 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd909d4640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd8c0a0460 0x7fbd8c1ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd909d4640 10 monclient(hunting): get_auth_request con 0x7fbd8c0a0460 auth_method 0 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd909d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd909d4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd909d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient(hunting): handle_auth_done global_id 24954 payload 824 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd8c0a0460 msgr2=0x7fbd8c1ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd8c0a0460 0x7fbd8c1ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a3d80 msgr2=0x7fbd8c1346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a3d80 0x7fbd8c1346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient: _finish_hunting 0 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 1 monclient: found mon.noname-d 2024-08-19T11:14:04.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c08df80 con 0x7fbd8c0a4870 2024-08-19T11:14:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd8bfff640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd8c0a3d80 0x7fbd8c1346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:04.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.964+0000 7fbd909d4640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd8c0a0460 0x7fbd8c1ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:14:04.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 msgr2=0x7fbd8c134c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd911d5640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 0x7fbd8c134c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400efc0 tx=0x7fbd8400c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd84018020 con 0x7fbd8c0a4870 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: dump: 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.982 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: _finish_auth 0 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: _check_auth_tickets 2024-08-19T11:14:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd840148f0 con 0x7fbd8c0a4870 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 5 monclient: authenticate success, global_id 24954 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 10 monclient: _renew_subs 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd840133e0 con 0x7fbd8c0a4870 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c08eae0 con 0x7fbd8c0a4870 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd897fa640 10 monclient: dump: 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.984 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.985 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd8affd640 4 set_mon_vals no callback set 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 10 monclient: _renew_subs 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.966+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c074650 con 0x7fbd8c0a4870 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd92c38640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd92c38640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 0x7fbd8c08e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbd8c076c60 con 0x7fbd8c1cf400 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 0x7fbd8c08e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient: get_auth_request con 0x7fbd8c1cf400 auth_method 0 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd911d5640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 0x7fbd8c134c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400efc0 tx=0x7fbd8400c490 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fbd84005d10 mgrmap(e 5) 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbd84005d10 con 0x7fbd8c0a4870 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 10 monclient(hunting): handle_auth_done global_id 24963 payload 824 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.967+0000 7fbd909d4640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd8c0a3780 con 0x7fbd8c1cf400 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.968+0000 7fbd897fa640 1 --2- 172.21.15.71:0/2884302074 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd7003eab0 0x7fbd70040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.968+0000 7fbd8bfff640 1 --2- 172.21.15.71:0/2884302074 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd7003eab0 0x7fbd70040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.968+0000 7fbd8bfff640 10 monclient: get_auth_request con 0x7fbd7003eab0 auth_method 0 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd909d4640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 msgr2=0x7fbd8c08e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd909d4640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 0x7fbd8c08e3e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000e520 tx=0x7fbd8000e9e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd80005cf0 con 0x7fbd8c1cf400 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 10 monclient: dump: 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbd80018070 con 0x7fbd8c1cf400 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 msgr2=0x7fbd8c08e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 0x7fbd8c08e3e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000e520 tx=0x7fbd8000e9e0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 msgr2=0x7fbd8c08e3e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd897fa640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c1cf400 0x7fbd8c08e3e0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000e520 tx=0x7fbd8000e9e0 comp rx=0 tx=0).stop 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.970+0000 7fbd8bfff640 1 --2- 172.21.15.71:0/2884302074 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd7003eab0 0x7fbd70040f70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbd78031000 tx=0x7fbd7802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd92c38640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd92c38640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 0x7fbd8c135560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd92c38640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbd8c08e920 con 0x7fbd8c135150 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 0x7fbd8c135560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient: get_auth_request con 0x7fbd8c135150 auth_method 0 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 10 monclient(hunting): handle_auth_done global_id 24972 payload 824 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.976+0000 7fbd909d4640 1 -- 172.21.15.71:0/2884302074 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd8c0a27e0 con 0x7fbd8c135150 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd909d4640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 msgr2=0x7fbd8c135560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd909d4640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 0x7fbd8c135560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd80017000 tx=0x7fbd80004940 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd80007750 con 0x7fbd8c135150 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 10 monclient: dump: 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.991 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:04.992 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fbd800072e0 con 0x7fbd8c135150 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 msgr2=0x7fbd8c135560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 0x7fbd8c135560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd80017000 tx=0x7fbd80004940 comp rx=0 tx=0).stop 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 msgr2=0x7fbd8c135560 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c135150 0x7fbd8c135560 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd80017000 tx=0x7fbd80004940 comp rx=0 tx=0).stop 2024-08-19T11:14:04.993 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 152593, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 8, 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:05.017 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd7003eab0 msgr2=0x7fbd70040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd92c38640 1 --2- 172.21.15.71:0/2884302074 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd7003eab0 0x7fbd70040f70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbd78031000 tx=0x7fbd7802e000 comp rx=0 tx=0).stop 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd92c38640 10 monclient: shutdown 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd92c38640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 msgr2=0x7fbd8c134c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd92c38640 1 --2- 172.21.15.71:0/2884302074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd8c0a4870 0x7fbd8c134c10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400efc0 tx=0x7fbd8400c490 comp rx=0 tx=0).stop 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 reap_dead start 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd911d5640 1 -- 172.21.15.71:0/2884302074 reap_dead start 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.979+0000 7fbd897fa640 1 -- 172.21.15.71:0/2884302074 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(115..115 src has 1..115) ==== 3898+0+0 (unknown 0 0 0) 0x7fbd84052650 con 0x7fbd8c0a4870 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.980+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 shutdown_connections 2024-08-19T11:14:05.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.980+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 >> 172.21.15.71:0/2884302074 conn(0x7fbd8c0a4e70 msgr2=0x7fbd8c0732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.980+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 shutdown_connections 2024-08-19T11:14:05.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:04.980+0000 7fbd92c38640 1 -- 172.21.15.71:0/2884302074 wait complete. 2024-08-19T11:14:05.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:05.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:14:05.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:14:05.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.118+0000 7f4e74f8a640 10 monclient: get_monmap_and_config 2024-08-19T11:14:05.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.118+0000 7f4e74f8a640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.118+0000 7f4e74f8a640 10 monclient: monmap: 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:05.119387+0000 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:05.119387+0000 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.120 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:05.121 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.119+0000 7f4e74f8a640 1 Processor -- start 2024-08-19T11:14:05.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.119+0000 7f4e74f8a640 1 -- start start 2024-08-19T11:14:05.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.119+0000 7f4e74f8a640 10 monclient: init 2024-08-19T11:14:05.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.119+0000 7f4e74f8a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.119+0000 7f4e74f8a640 10 monclient: _add_conns ranks=[0,3,9,10,5,4,2,6,8,1,7] 2024-08-19T11:14:05.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.119+0000 7f4e74f8a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4e700a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a57c0 0x7f4e7013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 10 monclient(hunting): picked mon.noname-g con 0x7f4e700a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e700a7440 0x7f4e701410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 10 monclient(hunting): picked mon.noname-a con 0x7f4e700a7440 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e700a6380 con 0x7f4e700a6950 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4e700a5020 con 0x7f4e700a7440 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700a7d40 con 0x7f4e700a57c0 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e74f8a640 10 monclient(hunting): authenticate will time out at 903.161047s 2024-08-19T11:14:05.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e700a7440 0x7f4e701410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6e59c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4e700a6950 0x7f4e700a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56650/0 (socket says 172.21.15.71:56650) 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6e59c640 1 -- 172.21.15.71:0/3179808165 learned_addr learned my addr 172.21.15.71:0/3179808165 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): get_auth_request con 0x7f4e700a7440 auth_method 0 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6dd9b640 1 --2- 172.21.15.71:0/3179808165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a57c0 0x7f4e7013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6dd9b640 10 monclient(hunting): get_auth_request con 0x7f4e700a57c0 auth_method 0 2024-08-19T11:14:05.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_done global_id 34587 payload 274 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 1 -- 172.21.15.71:0/3179808165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a57c0 msgr2=0x7f4e7013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 1 --2- 172.21.15.71:0/3179808165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a57c0 0x7f4e7013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 1 -- 172.21.15.71:0/3179808165 >> v1:172.21.15.71:6789/0 conn(0x7f4e700a6950 legacy=0x7f4e700a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 1 monclient: found mon.noname-a 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:05.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.120+0000 7f4e6ed9d640 1 -- 172.21.15.71:0/3179808165 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700a3650 con 0x7f4e700a7440 2024-08-19T11:14:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6ed9d640 1 -- 172.21.15.71:0/3179808165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e700a7440 msgr2=0x7f4e701410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6ed9d640 1 --2- 172.21.15.71:0/3179808165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e700a7440 0x7f4e701410b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009dc0 tx=0x7f4e6802a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a6041c4e1a8927 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 1 -- 172.21.15.71:0/3179808165 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e68007bc0 con 0x7f4e700a7440 2024-08-19T11:14:05.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: dump: 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 1 -- 172.21.15.71:0/3179808165 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e68007d80 con 0x7f4e700a7440 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 5 monclient: authenticate success, global_id 34587 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 1 -- 172.21.15.71:0/3179808165 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e68031870 con 0x7f4e700a7440 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 4 set_mon_vals no callback set 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e6d59a640 10 monclient: dump: 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 10 monclient: shutdown 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3179808165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e700a7440 msgr2=0x7f4e701410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3179808165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e700a7440 0x7f4e701410b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009dc0 tx=0x7f4e6802a4d0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3179808165 shutdown_connections 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3179808165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e700a7440 0x7f4e701410b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3179808165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a57c0 0x7f4e7013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.123+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3179808165 >> 172.21.15.71:0/3179808165 conn(0x7f4e700abf50 msgr2=0x7f4e700ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.124+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3179808165 shutdown_connections 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.124+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3179808165 wait complete. 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.124+0000 7f4e74f8a640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.124+0000 7f4e74f8a640 10 monclient: monmap: 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:05.138 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 Processor -- start 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 -- start start 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient: init 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient: _add_conns ranks=[4,3,2,7,0,6,8,1,5] 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 0x7f4e70126210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): picked mon.noname-c con 0x7f4e700a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a6950 0x7f4e70126750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): picked mon.noname-g con 0x7f4e700a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e700a7440 0x7f4e70126c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): picked mon.noname-b con 0x7f4e700a7440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700a8700 con 0x7f4e700a7440 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700a84c0 con 0x7f4e700a6950 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4e701415f0 con 0x7f4e700a57c0 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e74f8a640 10 monclient(hunting): authenticate will time out at 903.166587s 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 0x7f4e70126210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 0x7f4e70126210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:36426/0 (socket says 172.21.15.71:36426) 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e700a7440 0x7f4e70126c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 -- 172.21.15.71:0/3697030187 learned_addr learned my addr 172.21.15.71:0/3697030187 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): get_auth_request con 0x7f4e700a57c0 auth_method 0 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): get_auth_request con 0x7f4e700a7440 auth_method 0 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6dd9b640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a6950 0x7f4e70126750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6dd9b640 10 monclient(hunting): get_auth_request con 0x7f4e700a6950 auth_method 0 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 10 monclient(hunting): handle_auth_done global_id 44185 payload 824 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a6950 msgr2=0x7f4e70126750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e700a6950 0x7f4e70126750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e700a7440 msgr2=0x7f4e70126c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.125+0000 7f4e6e59c640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e700a7440 0x7f4e70126c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.126+0000 7f4e6e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.126+0000 7f4e6e59c640 1 monclient: found mon.noname-c 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.126+0000 7f4e6e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.126+0000 7f4e6e59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.126+0000 7f4e6e59c640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e701291a0 con 0x7f4e700a57c0 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.126+0000 7f4e6ed9d640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e700a7440 0x7f4e70126c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e6e59c640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 msgr2=0x7f4e70126210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e6e59c640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 0x7f4e70126210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c490 tx=0x7f4e6000c950 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e60005cf0 con 0x7f4e700a57c0 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: dump: 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.144 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e600074e0 con 0x7f4e700a57c0 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 5 monclient: authenticate success, global_id 44185 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 10 monclient: _renew_subs 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e70129770 con 0x7f4e700a57c0 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e60007690 con 0x7f4e700a57c0 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e5effd640 10 monclient: dump: 2024-08-19T11:14:05.146 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.147 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e6cd99640 4 set_mon_vals no callback set 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 10 monclient: _renew_subs 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.128+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7012a010 con 0x7f4e700a57c0 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e74f8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 0x7f4e70122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4e70076c60 con 0x7f4e701225a0 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 0x7f4e70122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4e60007070 con 0x7f4e700a57c0 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient: get_auth_request con 0x7f4e701225a0 auth_method 0 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e5effd640 1 --2- 172.21.15.71:0/3697030187 >> v2:172.21.15.135:6800/726754104 conn(0x7f4e5003ea80 0x7f4e50040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_done global_id 5462 payload 824 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6dd9b640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e700a92d0 con 0x7f4e701225a0 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(115..115 src has 1..115) ==== 3898+0+0 (secure 0 0 0) 0x7f4e600518c0 con 0x7f4e700a57c0 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6ed9d640 1 --2- 172.21.15.71:0/3697030187 >> v2:172.21.15.135:6800/726754104 conn(0x7f4e5003ea80 0x7f4e50040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.129+0000 7f4e6ed9d640 10 monclient: get_auth_request con 0x7f4e5003ea80 auth_method 0 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.131+0000 7f4e6dd9b640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 msgr2=0x7f4e70122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.131+0000 7f4e6dd9b640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 0x7f4e70122980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e70128320 tx=0x7f4e6400f930 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.131+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e64019030 con 0x7f4e701225a0 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.131+0000 7f4e5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.131+0000 7f4e5effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.131+0000 7f4e5effd640 10 monclient: dump: 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.150 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4e64014880 con 0x7f4e701225a0 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 msgr2=0x7f4e70122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 0x7f4e70122980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e70128320 tx=0x7f4e6400f930 comp rx=0 tx=0).stop 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 msgr2=0x7f4e70122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e5effd640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e701225a0 0x7f4e70122980 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e70128320 tx=0x7f4e6400f930 comp rx=0 tx=0).stop 2024-08-19T11:14:05.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.132+0000 7f4e6ed9d640 1 --2- 172.21.15.71:0/3697030187 >> v2:172.21.15.135:6800/726754104 conn(0x7f4e5003ea80 0x7f4e50040f40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009dc0 tx=0x7f4e6802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e74f8a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:05.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 0x7f4e701d8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e74f8a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4e700a4d40 con 0x7f4e70122ec0 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 0x7f4e701d8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient: get_auth_request con 0x7f4e70122ec0 auth_method 0 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 10 monclient(hunting): handle_auth_done global_id 5471 payload 824 2024-08-19T11:14:05.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.138+0000 7f4e6dd9b640 1 -- 172.21.15.71:0/3697030187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e700a6d30 con 0x7f4e70122ec0 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.140+0000 7f4e6dd9b640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 msgr2=0x7f4e701d8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.140+0000 7f4e6dd9b640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 0x7f4e701d8550 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e70128320 tx=0x7f4e640046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.140+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4e64004260 con 0x7f4e70122ec0 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.140+0000 7f4e5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.140+0000 7f4e5effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.140+0000 7f4e5effd640 10 monclient: dump: 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.155 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f4e64004260 con 0x7f4e70122ec0 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 msgr2=0x7f4e701d8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 0x7f4e701d8550 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e70128320 tx=0x7f4e640046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 msgr2=0x7f4e701d8550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e5effd640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4e70122ec0 0x7f4e701d8550 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e70128320 tx=0x7f4e640046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 242010, 2024-08-19T11:14:05.157 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 8, 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.158 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:05.159 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:05.159 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.159 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.159 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.159 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.161 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.162 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.163 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.165 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.165 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.165 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.165 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.165 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:05.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.171 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:05.172 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.175 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.177 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.178 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.180 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.185 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.186 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:05.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.186 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.186 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.187 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.187 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:05.187 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:05.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 >> v2:172.21.15.135:6800/726754104 conn(0x7f4e5003ea80 msgr2=0x7f4e50040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3697030187 >> v2:172.21.15.135:6800/726754104 conn(0x7f4e5003ea80 0x7f4e50040f40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009dc0 tx=0x7f4e6802f000 comp rx=0 tx=0).stop 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 10 monclient: shutdown 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 msgr2=0x7f4e70126210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 --2- 172.21.15.71:0/3697030187 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4e700a57c0 0x7f4e70126210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c490 tx=0x7f4e6000c950 comp rx=0 tx=0).stop 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e6ed9d640 1 -- 172.21.15.71:0/3697030187 reap_dead start 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e6ed9d640 1 -- 172.21.15.71:0/3697030187 reap_dead start 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 shutdown_connections 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 >> 172.21.15.71:0/3697030187 conn(0x7f4e700abf50 msgr2=0x7f4e7009f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 shutdown_connections 2024-08-19T11:14:05.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.141+0000 7f4e74f8a640 1 -- 172.21.15.71:0/3697030187 wait complete. 2024-08-19T11:14:05.190 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:05.190 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:14:05.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.288+0000 7fb01a53a640 10 monclient: get_monmap_and_config 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.288+0000 7fb01a53a640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.288+0000 7fb01a53a640 10 monclient: monmap: 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:05.288955+0000 2024-08-19T11:14:05.289 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:05.288955+0000 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:05.290 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:05.291 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 Processor -- start 2024-08-19T11:14:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 -- start start 2024-08-19T11:14:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient: init 2024-08-19T11:14:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient: _add_conns ranks=[10,3,5,8,4,7,1,0,2,6,9] 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb0140a6950 0x7fb0140a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): picked mon.noname-f con 0x7fb0140a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 0x7fb0140a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): picked mon.noname-g con 0x7fb0140a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): picked mon.noname-h con 0x7fb014139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb0140a5020 con 0x7fb0140a6950 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb0140a77b0 con 0x7fb0140a57c0 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb0140a7d40 con 0x7fb014139710 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb01a53a640 10 monclient(hunting): authenticate will time out at 903.330681s 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 0x7fb0140a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb018ad7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb013fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb0140a6950 0x7fb0140a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 0x7fb0140a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:58794/0 (socket says 172.21.15.71:58794) 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb018ad7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:53766/0 (socket says 172.21.15.71:53766) 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 1 -- 172.21.15.71:0/2259196046 learned_addr learned my addr 172.21.15.71:0/2259196046 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 10 monclient(hunting): get_auth_request con 0x7fb0140a57c0 auth_method 0 2024-08-19T11:14:05.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb0137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb013fff640 10 monclient(hunting): get_auth_request con 0x7fb0140a6950 auth_method 0 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb013fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb013fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb013fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb018ad7640 10 monclient(hunting): get_auth_request con 0x7fb014139710 auth_method 0 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb018ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb018ad7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.289+0000 7fb018ad7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb0137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb0137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb0137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 10 monclient(hunting): handle_auth_done global_id 44231 payload 274 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 1 -- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 msgr2=0x7fb0140a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 1 --2- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 0x7fb0140a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 1 -- 172.21.15.71:0/2259196046 >> v2:172.21.15.135:3300/0 conn(0x7fb0140a6950 msgr2=0x7fb0140a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 1 --2- 172.21.15.71:0/2259196046 >> v2:172.21.15.135:3300/0 conn(0x7fb0140a6950 0x7fb0140a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 1 monclient: found mon.noname-h 2024-08-19T11:14:05.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:14:05.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb018ad7640 1 -- 172.21.15.71:0/2259196046 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0140a6380 con 0x7fb014139710 2024-08-19T11:14:05.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb0137fe640 1 --2- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 0x7fb0140a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:05.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.290+0000 7fb013fff640 1 --2- 172.21.15.71:0/2259196046 >> v2:172.21.15.135:3300/0 conn(0x7fb0140a6950 0x7fb0140a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb018ad7640 1 -- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 msgr2=0x7fb014139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb018ad7640 1 --2- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014139b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009dc0 tx=0x7fb00c02a4d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=7517b8affc5f333a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 1 -- 172.21.15.71:0/2259196046 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb00c007bc0 con 0x7fb014139710 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: dump: 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.305 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.306 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 5 monclient: authenticate success, global_id 44231 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 1 -- 172.21.15.71:0/2259196046 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c007d80 con 0x7fb014139710 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 1 -- 172.21.15.71:0/2259196046 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb00c031870 con 0x7fb014139710 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 4 set_mon_vals no callback set 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:05.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb012ffd640 10 monclient: dump: 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 10 monclient: shutdown 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 1 -- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 msgr2=0x7fb014139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.293+0000 7fb01a53a640 1 --2- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014139b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009dc0 tx=0x7fb00c02a4d0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 -- 172.21.15.71:0/2259196046 shutdown_connections 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 --2- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014139b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 --2- 172.21.15.71:0/2259196046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb0140a57c0 0x7fb0140a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 --2- 172.21.15.71:0/2259196046 >> v2:172.21.15.135:3300/0 conn(0x7fb0140a6950 0x7fb0140a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 -- 172.21.15.71:0/2259196046 >> 172.21.15.71:0/2259196046 conn(0x7fb0140abf50 msgr2=0x7fb0140ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 -- 172.21.15.71:0/2259196046 shutdown_connections 2024-08-19T11:14:05.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 1 -- 172.21.15.71:0/2259196046 wait complete. 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.294+0000 7fb01a53a640 10 monclient: monmap: 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.310 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 Processor -- start 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 -- start start 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient: init 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient: _add_conns ranks=[6,4,5,8,3,1,0,2,7] 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb0140a57c0 0x7fb0141ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): picked mon.noname-d con 0x7fb0140a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:05.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 0x7fb014138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): picked mon.noname-c con 0x7fb0140a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): picked mon.noname-h con 0x7fb014139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb0140a84c0 con 0x7fb0140a6950 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb0140a3650 con 0x7fb014139710 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb0140a8700 con 0x7fb0140a57c0 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb01a53a640 10 monclient(hunting): authenticate will time out at 903.336737s 2024-08-19T11:14:05.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb0140a57c0 0x7fb0141ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 0x7fb014138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb0140a57c0 0x7fb0141ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:56892/0 (socket says 172.21.15.71:56892) 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 0x7fb014138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:36434/0 (socket says 172.21.15.71:36434) 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 1 -- 172.21.15.71:0/3567186375 learned_addr learned my addr 172.21.15.71:0/3567186375 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): get_auth_request con 0x7fb0140a57c0 auth_method 0 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): get_auth_request con 0x7fb0140a6950 auth_method 0 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb0137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.295+0000 7fb018ad7640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): get_auth_request con 0x7fb014139710 auth_method 0 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb018ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 10 monclient(hunting): handle_auth_done global_id 44194 payload 824 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb0140a57c0 msgr2=0x7fb0141ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb0140a57c0 0x7fb0141ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 msgr2=0x7fb014138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb014139710 0x7fb014138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 1 monclient: found mon.noname-c 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.296+0000 7fb0137fe640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb014123fc0 con 0x7fb0140a6950 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb0137fe640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 msgr2=0x7fb014138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb0137fe640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 0x7fb014138960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e900 tx=0x7fb00800edc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb0080044a0 con 0x7fb0140a6950 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: dump: 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.316 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00800cc10 con 0x7fb0140a6950 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 5 monclient: authenticate success, global_id 44194 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 10 monclient: _renew_subs 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01413a200 con 0x7fb0140a6950 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb00800cdc0 con 0x7fb0140a6950 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb010ff9640 10 monclient: dump: 2024-08-19T11:14:05.318 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.319 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 10 monclient: _renew_subs 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0140a1cf0 con 0x7fb0140a6950 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.298+0000 7fb0127fc640 4 set_mon_vals no callback set 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb01a53a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb01a53a640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 0x7fb01402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb014076c60 con 0x7fb014122d60 2024-08-19T11:14:05.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb008004030 con 0x7fb0140a6950 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 0x7fb01402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient: get_auth_request con 0x7fb014122d60 auth_method 0 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb010ff9640 1 --2- 172.21.15.71:0/3567186375 >> v2:172.21.15.135:6800/726754104 conn(0x7fb00003ea80 0x7fb000040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(115..115 src has 1..115) ==== 3898+0+0 (secure 0 0 0) 0x7fb00800f040 con 0x7fb0140a6950 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 10 monclient(hunting): handle_auth_done global_id 5392 payload 824 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb013fff640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb014068d30 con 0x7fb014122d60 2024-08-19T11:14:05.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb018ad7640 1 --2- 172.21.15.71:0/3567186375 >> v2:172.21.15.135:6800/726754104 conn(0x7fb00003ea80 0x7fb000040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.299+0000 7fb018ad7640 10 monclient: get_auth_request con 0x7fb00003ea80 auth_method 0 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb013fff640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 msgr2=0x7fb01402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb013fff640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 0x7fb01402d1c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb004011c00 tx=0x7fb004009e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb0040148b0 con 0x7fb014122d60 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 10 monclient: dump: 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.322 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb018ad7640 1 --2- 172.21.15.71:0/3567186375 >> v2:172.21.15.135:6800/726754104 conn(0x7fb00003ea80 0x7fb000040f40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009dc0 tx=0x7fb00c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb004014440 con 0x7fb014122d60 2024-08-19T11:14:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 msgr2=0x7fb01402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 0x7fb01402d1c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb004011c00 tx=0x7fb004009e20 comp rx=0 tx=0).stop 2024-08-19T11:14:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 msgr2=0x7fb01402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.302+0000 7fb010ff9640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014122d60 0x7fb01402d1c0 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb004011c00 tx=0x7fb004009e20 comp rx=0 tx=0).stop 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb01a53a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb01a53a640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 0x7fb01402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb01a53a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0140a6d30 con 0x7fb014123140 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 0x7fb01402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient: get_auth_request con 0x7fb014123140 auth_method 0 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.308+0000 7fb013fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.309+0000 7fb013fff640 10 monclient(hunting): handle_auth_done global_id 5401 payload 824 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.309+0000 7fb013fff640 1 -- 172.21.15.71:0/3567186375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb014125b40 con 0x7fb014123140 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.311+0000 7fb013fff640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 msgr2=0x7fb01402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.311+0000 7fb013fff640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 0x7fb01402d700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb004011c00 tx=0x7fb0040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.311+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb004004490 con 0x7fb014123140 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.311+0000 7fb010ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.311+0000 7fb010ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.311+0000 7fb010ff9640 10 monclient: dump: 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.327 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fb004004020 con 0x7fb014123140 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 msgr2=0x7fb01402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 0x7fb01402d700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb004011c00 tx=0x7fb0040046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 msgr2=0x7fb01402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb010ff9640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb014123140 0x7fb01402d700 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb004011c00 tx=0x7fb0040046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 242151, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 9, 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:05.353 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 >> v2:172.21.15.135:6800/726754104 conn(0x7fb00003ea80 msgr2=0x7fb000040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 --2- 172.21.15.71:0/3567186375 >> v2:172.21.15.135:6800/726754104 conn(0x7fb00003ea80 0x7fb000040f40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009dc0 tx=0x7fb00c02f000 comp rx=0 tx=0).stop 2024-08-19T11:14:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 10 monclient: shutdown 2024-08-19T11:14:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 msgr2=0x7fb014138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 0x7fb014138960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e900 tx=0x7fb00800edc0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb018ad7640 1 -- 172.21.15.71:0/3567186375 reap_dead start 2024-08-19T11:14:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 shutdown_connections 2024-08-19T11:14:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 --2- 172.21.15.71:0/3567186375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb0140a6950 0x7fb014138960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 >> 172.21.15.71:0/3567186375 conn(0x7fb0140abf50 msgr2=0x7fb0140aa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 shutdown_connections 2024-08-19T11:14:05.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.312+0000 7fb01a53a640 1 -- 172.21.15.71:0/3567186375 wait complete. 2024-08-19T11:14:05.355 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:05.355 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:14:05.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.452+0000 7f0d4a5b1640 10 monclient: get_monmap_and_config 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.452+0000 7f0d4a5b1640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.452+0000 7f0d4a5b1640 10 monclient: monmap: 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:05.453525+0000 2024-08-19T11:14:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:05.453525+0000 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.455 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:05.456 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:05.456 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.453+0000 7f0d4a5b1640 1 Processor -- start 2024-08-19T11:14:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.453+0000 7f0d4a5b1640 1 -- start start 2024-08-19T11:14:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.453+0000 7f0d4a5b1640 10 monclient: init 2024-08-19T11:14:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient: _add_conns ranks=[7,5,2,8,6,10,0,4,1,9,3] 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d440a6950 0x7f0d440a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): picked mon.noname-i con 0x7f0d440a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0d440a57c0 0x7f0d440a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): picked mon.noname-h con 0x7f0d440a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 0x7f0d44139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): picked mon.noname-b con 0x7f0d44139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0d440a5020 con 0x7f0d44139710 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0d440a77b0 con 0x7f0d440a57c0 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0d440a7d40 con 0x7f0d440a6950 2024-08-19T11:14:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d4a5b1640 10 monclient(hunting): authenticate will time out at 903.495244s 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 0x7f0d44139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 0x7f0d44139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:53106/0 (socket says 172.21.15.71:53106) 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 -- 172.21.15.71:0/3151852855 learned_addr learned my addr 172.21.15.71:0/3151852855 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): get_auth_request con 0x7f0d44139710 auth_method 0 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0d440a57c0 0x7f0d440a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d440a6950 0x7f0d440a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): get_auth_request con 0x7f0d440a6950 auth_method 0 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): get_auth_request con 0x7f0d440a57c0 auth_method 0 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient(hunting): handle_auth_done global_id 5771 payload 274 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 -- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d440a6950 msgr2=0x7f0d440a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d440a6950 0x7f0d440a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 -- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0d440a57c0 msgr2=0x7f0d440a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0d440a57c0 0x7f0d440a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 monclient: found mon.noname-b 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.454+0000 7f0d48b4e640 1 -- 172.21.15.71:0/3151852855 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d440a6380 con 0x7f0d44139710 2024-08-19T11:14:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d48b4e640 1 -- 172.21.15.71:0/3151852855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 msgr2=0x7f0d44139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 0x7f0d44139b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009eb0 tx=0x7f0d3c02a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acec3be95ef48c90 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 1 -- 172.21.15.71:0/3151852855 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0d3c036070 con 0x7f0d44139710 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: dump: 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d4a5b1640 5 monclient: authenticate success, global_id 5771 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 1 -- 172.21.15.71:0/3151852855 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c007a70 con 0x7f0d44139710 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d4a5b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d4a5b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 1 -- 172.21.15.71:0/3151852855 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0d3c007ca0 con 0x7f0d44139710 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d4a5b1640 4 set_mon_vals no callback set 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.457+0000 7f0d42ffd640 10 monclient: dump: 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 10 monclient: shutdown 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/3151852855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 msgr2=0x7f0d44139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 0x7f0d44139b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009eb0 tx=0x7f0d3c02a560 comp rx=0 tx=0).stop 2024-08-19T11:14:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/3151852855 shutdown_connections 2024-08-19T11:14:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d44139710 0x7f0d44139b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0d440a57c0 0x7f0d440a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/3151852855 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d440a6950 0x7f0d440a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/3151852855 >> 172.21.15.71:0/3151852855 conn(0x7f0d440abf50 msgr2=0x7f0d440ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/3151852855 shutdown_connections 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/3151852855 wait complete. 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.458+0000 7f0d4a5b1640 10 monclient: monmap: 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 Processor -- start 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 -- start start 2024-08-19T11:14:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient: init 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient: _add_conns ranks=[0,4,7,8,3,1,2,5,6] 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440a57c0 0x7f0d441ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): picked mon.noname-a con 0x7f0d440a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): picked mon.noname-c con 0x7f0d440a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d44139710 0x7f0d44125090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): picked mon.noname-i con 0x7f0d44139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d440a84c0 con 0x7f0d440a57c0 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0d440a3650 con 0x7f0d440a6950 2024-08-19T11:14:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0d440a8700 con 0x7f0d44139710 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d4a5b1640 10 monclient(hunting): authenticate will time out at 903.500744s 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440a57c0 0x7f0d441ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440a57c0 0x7f0d441ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47674/0 (socket says 172.21.15.71:47674) 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 1 -- 172.21.15.71:0/2625242709 learned_addr learned my addr 172.21.15.71:0/2625242709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): get_auth_request con 0x7f0d440a57c0 auth_method 0 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:36440/0 (socket says 172.21.15.71:36440) 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): get_auth_request con 0x7f0d440a6950 auth_method 0 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.459+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d44139710 0x7f0d44125090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 10 monclient(hunting): handle_auth_done global_id 44203 payload 824 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d44139710 msgr2=0x7f0d44125090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d44139710 0x7f0d44125090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440a57c0 msgr2=0x7f0d441ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440a57c0 0x7f0d441ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 1 monclient: found mon.noname-c 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d437fe640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441383c0 con 0x7f0d440a6950 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d48b4e640 10 monclient: get_auth_request con 0x7f0d44139710 auth_method 0 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0d44139710 0x7f0d44125090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:14:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.460+0000 7f0d43fff640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d440a57c0 0x7f0d441ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d437fe640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 msgr2=0x7f0d441cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d437fe640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800e850 tx=0x7f0d3800ed10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0d38017070 con 0x7f0d440a6950 2024-08-19T11:14:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: dump: 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d38013470 con 0x7f0d440a6950 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 5 monclient: authenticate success, global_id 44203 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 10 monclient: _renew_subs 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d44126aa0 con 0x7f0d440a6950 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0d38013a90 con 0x7f0d440a6950 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d40ff9640 10 monclient: dump: 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 10 monclient: _renew_subs 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d44128560 con 0x7f0d440a6950 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.462+0000 7f0d427fc640 4 set_mon_vals no callback set 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d4a5b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 0x7f0d441259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4406a590 con 0x7f0d441255d0 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d437fe640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800e850 tx=0x7f0d3800ed10 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f0d3801a070 mgrmap(e 5) 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0d3801a070 con 0x7f0d440a6950 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 0x7f0d441259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient: get_auth_request con 0x7f0d441255d0 auth_method 0 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.463+0000 7f0d40ff9640 1 --2- 172.21.15.71:0/2625242709 >> v2:172.21.15.135:6800/726754104 conn(0x7f0d3003ea80 0x7f0d30040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.464+0000 7f0d43fff640 10 monclient(hunting): handle_auth_done global_id 44184 payload 824 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.464+0000 7f0d43fff640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d440a1f60 con 0x7f0d441255d0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.464+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/2625242709 >> v2:172.21.15.135:6800/726754104 conn(0x7f0d3003ea80 0x7f0d30040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.464+0000 7f0d48b4e640 10 monclient: get_auth_request con 0x7f0d3003ea80 auth_method 0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d43fff640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 msgr2=0x7f0d441259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d43fff640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 0x7f0d441259b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d34011d10 tx=0x7f0d3400f610 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0d3400fe70 con 0x7f0d441255d0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d48b4e640 1 --2- 172.21.15.71:0/2625242709 >> v2:172.21.15.135:6800/726754104 conn(0x7f0d3003ea80 0x7f0d30040f40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c033000 tx=0x7f0d3c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 10 monclient: dump: 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0d3400fe70 con 0x7f0d441255d0 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 msgr2=0x7f0d441259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 0x7f0d441259b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0d34011d10 tx=0x7f0d3400f610 comp rx=0 tx=0).stop 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 msgr2=0x7f0d441259b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.466+0000 7f0d40ff9640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d441255d0 0x7f0d441259b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.472+0000 7f0d4a5b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.472+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 0x7f0d4409fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.472+0000 7f0d4a5b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.472+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0d44076c60 con 0x7f0d44125ef0 2024-08-19T11:14:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 0x7f0d4409fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient: get_auth_request con 0x7f0d44125ef0 auth_method 0 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 10 monclient(hunting): handle_auth_done global_id 44193 payload 824 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.473+0000 7f0d43fff640 1 -- 172.21.15.71:0/2625242709 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0d440a6d30 con 0x7f0d44125ef0 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.475+0000 7f0d43fff640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 msgr2=0x7f0d4409fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.475+0000 7f0d43fff640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 0x7f0d4409fa10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d3401b000 tx=0x7f0d340046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.475+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0d3401d3f0 con 0x7f0d44125ef0 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.475+0000 7f0d40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.475+0000 7f0d40ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.475+0000 7f0d40ff9640 10 monclient: dump: 2024-08-19T11:14:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f0d34003a30 con 0x7f0d44125ef0 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 msgr2=0x7f0d4409fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 0x7f0d4409fa10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d3401b000 tx=0x7f0d340046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 msgr2=0x7f0d4409fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d44125ef0 0x7f0d4409fa10 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d3401b000 tx=0x7f0d340046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:05.496 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 14498, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:05.497 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 9, 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.498 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.499 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.500 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.501 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:05.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.504 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.505 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.507 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.511 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.514 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.518 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.519 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.520 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:05.520 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 >> v2:172.21.15.135:6800/726754104 conn(0x7f0d3003ea80 msgr2=0x7f0d30040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/2625242709 >> v2:172.21.15.135:6800/726754104 conn(0x7f0d3003ea80 0x7f0d30040f40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c033000 tx=0x7f0d3c009000 comp rx=0 tx=0).stop 2024-08-19T11:14:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 10 monclient: shutdown 2024-08-19T11:14:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 msgr2=0x7f0d441cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800e850 tx=0x7f0d3800ed10 comp rx=0 tx=0).stop 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d48b4e640 1 -- 172.21.15.71:0/2625242709 reap_dead start 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d40ff9640 1 -- 172.21.15.71:0/2625242709 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(115..115 src has 1..115) ==== 3898+0+0 (unknown 0 0 0) 0x7f0d3800f040 con 0x7f0d440a6950 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 shutdown_connections 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 --2- 172.21.15.71:0/2625242709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0d440a6950 0x7f0d441cf260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 >> 172.21.15.71:0/2625242709 conn(0x7f0d440abf50 msgr2=0x7f0d44138f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 shutdown_connections 2024-08-19T11:14:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.476+0000 7f0d4a5b1640 1 -- 172.21.15.71:0/2625242709 wait complete. 2024-08-19T11:14:05.523 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:05.523 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:14:05.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:14:05.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.619+0000 7f13d6b98640 10 monclient: get_monmap_and_config 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.619+0000 7f13d6b98640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.619+0000 7f13d6b98640 10 monclient: monmap: 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:05.620246+0000 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:05.620246+0000 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.621 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:05.622 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 Processor -- start 2024-08-19T11:14:05.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 -- start start 2024-08-19T11:14:05.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient: init 2024-08-19T11:14:05.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient: _add_conns ranks=[6,2,5,10,9,1,0,4,7,3,8] 2024-08-19T11:14:05.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 0x7f13d00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): picked mon.noname-d con 0x7f13d00a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 0x7f13d00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): picked mon.noname-b con 0x7f13d00a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0139710 0x7f13d0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): picked mon.noname-h con 0x7f13d0139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f13d00a5020 con 0x7f13d00a57c0 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f13d00a77b0 con 0x7f13d0139710 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f13d00a7d40 con 0x7f13d00a6950 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.620+0000 7f13d6b98640 10 monclient(hunting): authenticate will time out at 903.661963s 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 0x7f13d00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 0x7f13d00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 0x7f13d00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:56904/0 (socket says 172.21.15.71:56904) 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 0x7f13d00a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:53120/0 (socket says 172.21.15.71:53120) 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 -- 172.21.15.71:0/3093158077 learned_addr learned my addr 172.21.15.71:0/3093158077 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): get_auth_request con 0x7f13d00a6950 auth_method 0 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): get_auth_request con 0x7f13d00a57c0 auth_method 0 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d5135640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0139710 0x7f13d0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d5135640 10 monclient(hunting): get_auth_request con 0x7f13d0139710 auth_method 0 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d5135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d5135640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d5135640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient(hunting): handle_auth_done global_id 24990 payload 274 2024-08-19T11:14:05.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 -- 172.21.15.71:0/3093158077 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0139710 msgr2=0x7f13d0139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0139710 0x7f13d0139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 -- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 msgr2=0x7f13d00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 0x7f13d00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 monclient: found mon.noname-d 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13d4934640 1 -- 172.21.15.71:0/3093158077 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d00a6380 con 0x7f13d00a6950 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.621+0000 7f13c7fff640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 0x7f13d00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d4934640 1 -- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 msgr2=0x7f13d00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d4934640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 0x7f13d00a6d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0098a0 tx=0x7f13cc02a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e56346339ba262d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 1 -- 172.21.15.71:0/3093158077 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13cc037070 con 0x7f13d00a6950 2024-08-19T11:14:05.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: dump: 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.633 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 5 monclient: authenticate success, global_id 24990 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 1 -- 172.21.15.71:0/3093158077 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc02ade0 con 0x7f13d00a6950 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 4 set_mon_vals no callback set 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 1 -- 172.21.15.71:0/3093158077 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13cc030c20 con 0x7f13d00a6950 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13c77fe640 10 monclient: dump: 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.635 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 10 monclient: shutdown 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 -- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 msgr2=0x7f13d00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 0x7f13d00a6d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0098a0 tx=0x7f13cc02a080 comp rx=0 tx=0).stop 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 -- 172.21.15.71:0/3093158077 shutdown_connections 2024-08-19T11:14:05.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13d00a57c0 0x7f13d00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0139710 0x7f13d0139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 --2- 172.21.15.71:0/3093158077 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13d00a6950 0x7f13d00a6d30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 -- 172.21.15.71:0/3093158077 >> 172.21.15.71:0/3093158077 conn(0x7f13d00abf50 msgr2=0x7f13d00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 -- 172.21.15.71:0/3093158077 shutdown_connections 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.624+0000 7f13d6b98640 1 -- 172.21.15.71:0/3093158077 wait complete. 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.625+0000 7f13d6b98640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.625+0000 7f13d6b98640 10 monclient: monmap: 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.637 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.625+0000 7f13d6b98640 1 Processor -- start 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.625+0000 7f13d6b98640 1 -- start start 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.625+0000 7f13d6b98640 10 monclient: init 2024-08-19T11:14:05.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient: _add_conns ranks=[4,3,7,8,6,1,0,2,5] 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 0x7f13d01ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): picked mon.noname-c con 0x7f13d00a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13d00a6950 0x7f13d01388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): picked mon.noname-g con 0x7f13d00a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13d0139710 0x7f13d0138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): picked mon.noname-i con 0x7f13d0139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f13d00a84c0 con 0x7f13d00a6950 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f13d00a3650 con 0x7f13d00a57c0 2024-08-19T11:14:05.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f13d00a8700 con 0x7f13d0139710 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d6b98640 10 monclient(hunting): authenticate will time out at 903.667433s 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 0x7f13d01ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 0x7f13d01ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:36456/0 (socket says 172.21.15.71:36456) 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 -- 172.21.15.71:0/2753222740 learned_addr learned my addr 172.21.15.71:0/2753222740 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): get_auth_request con 0x7f13d00a57c0 auth_method 0 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13c7fff640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13d00a6950 0x7f13d01388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d5135640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13d0139710 0x7f13d0138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient(hunting): handle_auth_done global_id 44212 payload 824 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13d0139710 msgr2=0x7f13d0138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13d0139710 0x7f13d0138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13d00a6950 msgr2=0x7f13d01388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13d00a6950 0x7f13d01388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 monclient: found mon.noname-c 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.626+0000 7f13d4934640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d0123f70 con 0x7f13d00a57c0 2024-08-19T11:14:05.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.628+0000 7f13d4934640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 msgr2=0x7f13d01ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.628+0000 7f13d4934640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 0x7f13d01ce0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13cc000c00 tx=0x7f13cc004730 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13cc042070 con 0x7f13d00a57c0 2024-08-19T11:14:05.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:14:05.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: dump: 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.647 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc003c50 con 0x7f13d00a57c0 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 5 monclient: authenticate success, global_id 44212 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 10 monclient: _renew_subs 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d013a2e0 con 0x7f13d00a57c0 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13cc037040 con 0x7f13d00a57c0 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c57fa640 10 monclient: dump: 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.649 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 10 monclient: _renew_subs 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d0125a30 con 0x7f13d00a57c0 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.629+0000 7f13c6ffd640 4 set_mon_vals no callback set 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13d6b98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13d6b98640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 0x7f13d002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f13d0076c60 con 0x7f13d0122d60 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f13cc047460 con 0x7f13d00a57c0 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 0x7f13d002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient: get_auth_request con 0x7f13d0122d60 auth_method 0 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c57fa640 1 --2- 172.21.15.71:0/2753222740 >> v2:172.21.15.135:6800/726754104 conn(0x7f13bc03ea80 0x7f13bc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(115..115 src has 1..115) ==== 3898+0+0 (secure 0 0 0) 0x7f13cc0716a0 con 0x7f13d00a57c0 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13d5135640 1 --2- 172.21.15.71:0/2753222740 >> v2:172.21.15.135:6800/726754104 conn(0x7f13bc03ea80 0x7f13bc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13d5135640 10 monclient: get_auth_request con 0x7f13bc03ea80 auth_method 0 2024-08-19T11:14:05.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 10 monclient(hunting): handle_auth_done global_id 44267 payload 824 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.630+0000 7f13c7fff640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13d00a6d30 con 0x7f13d0122d60 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c7fff640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 msgr2=0x7f13d002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c7fff640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 0x7f13d002d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13d01cf160 tx=0x7f13c0010c20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13d5135640 1 --2- 172.21.15.71:0/2753222740 >> v2:172.21.15.135:6800/726754104 conn(0x7f13bc03ea80 0x7f13bc040f40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f13d0074f90 tx=0x7f13c800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13c000f040 con 0x7f13d0122d60 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 10 monclient: dump: 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.652 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f13c001c400 con 0x7f13d0122d60 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 msgr2=0x7f13d002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 0x7f13d002d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13d01cf160 tx=0x7f13c0010c20 comp rx=0 tx=0).stop 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 msgr2=0x7f13d002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.633+0000 7f13c57fa640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0122d60 0x7f13d002d1c0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13d01cf160 tx=0x7f13c0010c20 comp rx=0 tx=0).stop 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13d6b98640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13d6b98640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 0x7f13d002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13d6b98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f13d00a1d60 con 0x7f13d0123140 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 0x7f13d002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient: get_auth_request con 0x7f13d0123140 auth_method 0 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.639+0000 7f13c7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.640+0000 7f13c7fff640 10 monclient(hunting): handle_auth_done global_id 44276 payload 824 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.640+0000 7f13c7fff640 1 -- 172.21.15.71:0/2753222740 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13d009e100 con 0x7f13d0123140 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c7fff640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 msgr2=0x7f13d002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c7fff640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 0x7f13d002d700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13c0000c00 tx=0x7f13c00046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13c0021570 con 0x7f13d0123140 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 10 monclient: dump: 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.655 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f13c001ca70 con 0x7f13d0123140 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 msgr2=0x7f13d002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 0x7f13d002d700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13c0000c00 tx=0x7f13c00046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 msgr2=0x7f13d002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.642+0000 7f13c57fa640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13d0123140 0x7f13d002d700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:05.657 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 14665, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.658 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 9, 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.659 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.660 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:05.661 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.662 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.666 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.671 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.673 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.679 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:05.680 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:05.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 >> v2:172.21.15.135:6800/726754104 conn(0x7f13bc03ea80 msgr2=0x7f13bc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 --2- 172.21.15.71:0/2753222740 >> v2:172.21.15.135:6800/726754104 conn(0x7f13bc03ea80 0x7f13bc040f40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f13d0074f90 tx=0x7f13c800b040 comp rx=0 tx=0).stop 2024-08-19T11:14:05.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 10 monclient: shutdown 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 msgr2=0x7f13d01ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 --2- 172.21.15.71:0/2753222740 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13d00a57c0 0x7f13d01ce0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13cc000c00 tx=0x7f13cc004730 comp rx=0 tx=0).stop 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d5135640 1 -- 172.21.15.71:0/2753222740 reap_dead start 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d5135640 1 -- 172.21.15.71:0/2753222740 reap_dead start 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 shutdown_connections 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 >> 172.21.15.71:0/2753222740 conn(0x7f13d00abf50 msgr2=0x7f13d00aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 shutdown_connections 2024-08-19T11:14:05.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.643+0000 7f13d6b98640 1 -- 172.21.15.71:0/2753222740 wait complete. 2024-08-19T11:14:05.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:05.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:14:05.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.780+0000 7f7643b28640 10 monclient: get_monmap_and_config 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.780+0000 7f7643b28640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.780+0000 7f7643b28640 10 monclient: monmap: 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:05.780795+0000 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:05.780795+0000 2024-08-19T11:14:05.781 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:05.782 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.780+0000 7f7643b28640 1 Processor -- start 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 -- start start 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient: init 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient: _add_conns ranks=[9,3,7,4,8,2,6,10,0,1,5] 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f763c0a6950 0x7f763c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): picked mon.noname-a con 0x7f763c0a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): picked mon.noname-g con 0x7f763c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c139710 0x7f763c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): picked mon.noname-i con 0x7f763c139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f763c0a5020 con 0x7f763c0a6950 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f763c0a77b0 con 0x7f763c0a57c0 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f763c0a7d40 con 0x7f763c139710 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f7643b28640 10 monclient(hunting): authenticate will time out at 903.822586s 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f763c0a6950 0x7f763c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f763c0a6950 0x7f763c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47688/0 (socket says 172.21.15.71:47688) 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 -- 172.21.15.71:0/3174492744 learned_addr learned my addr 172.21.15.71:0/3174492744 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): get_auth_request con 0x7f763c0a6950 auth_method 0 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76410c3640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76410c3640 10 monclient(hunting): get_auth_request con 0x7f763c0a57c0 auth_method 0 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76410c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76410c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76420c5640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c139710 0x7f763c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76410c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76420c5640 10 monclient(hunting): get_auth_request con 0x7f763c139710 auth_method 0 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76420c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76420c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76420c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient(hunting): handle_auth_done global_id 34605 payload 274 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 -- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c139710 msgr2=0x7f763c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c139710 0x7f763c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 -- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 msgr2=0x7f763c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 monclient: found mon.noname-a 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.781+0000 7f76418c4640 1 -- 172.21.15.71:0/3174492744 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c0a6380 con 0x7f763c0a6950 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76418c4640 1 -- 172.21.15.71:0/3174492744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f763c0a6950 msgr2=0x7f763c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76418c4640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f763c0a6950 0x7f763c0a6d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f76380098a0 tx=0x7f763802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88c613b0e590cba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 1 -- 172.21.15.71:0/3174492744 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7638037070 con 0x7f763c0a6950 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: dump: 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.791 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.792 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 1 -- 172.21.15.71:0/3174492744 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763802adf0 con 0x7f763c0a6950 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f7643b28640 5 monclient: authenticate success, global_id 34605 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f7643b28640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 1 -- 172.21.15.71:0/3174492744 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7638030c20 con 0x7f763c0a6950 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f7643b28640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:05.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f7643b28640 4 set_mon_vals no callback set 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.784+0000 7f76408c2640 10 monclient: dump: 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.794 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 10 monclient: shutdown 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 -- 172.21.15.71:0/3174492744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f763c0a6950 msgr2=0x7f763c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f763c0a6950 0x7f763c0a6d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f76380098a0 tx=0x7f763802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 -- 172.21.15.71:0/3174492744 shutdown_connections 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c139710 0x7f763c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 --2- 172.21.15.71:0/3174492744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f763c0a6950 0x7f763c0a6d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 -- 172.21.15.71:0/3174492744 >> 172.21.15.71:0/3174492744 conn(0x7f763c0abf50 msgr2=0x7f763c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 -- 172.21.15.71:0/3174492744 shutdown_connections 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.785+0000 7f7643b28640 1 -- 172.21.15.71:0/3174492744 wait complete. 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 10 monclient: build_initial_monmap 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 10 monclient: monmap: 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:05.796 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:05.797 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 1 Processor -- start 2024-08-19T11:14:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 1 -- start start 2024-08-19T11:14:05.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 10 monclient: init 2024-08-19T11:14:05.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:05.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.786+0000 7f7643b28640 10 monclient: _add_conns ranks=[3,8,4,0,7,5,6,2,1] 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c1ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): picked mon.noname-g con 0x7f763c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 0x7f763c1388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): picked mon.noname-e con 0x7f763c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f763c139710 0x7f763c138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): picked mon.noname-c con 0x7f763c139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f763c0a84c0 con 0x7f763c0a57c0 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f763c0a3650 con 0x7f763c139710 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f763c0a8700 con 0x7f763c0a6950 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f7643b28640 10 monclient(hunting): authenticate will time out at 903.828074s 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 0x7f763c1388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 0x7f763c1388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:38862/0 (socket says 172.21.15.71:38862) 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 -- 172.21.15.71:0/2318985808 learned_addr learned my addr 172.21.15.71:0/2318985808 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): get_auth_request con 0x7f763c0a6950 auth_method 0 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f763c139710 0x7f763c138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): get_auth_request con 0x7f763c139710 auth_method 0 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c1ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): get_auth_request con 0x7f763c0a57c0 auth_method 0 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient(hunting): handle_auth_done global_id 5480 payload 824 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f763c139710 msgr2=0x7f763c138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f763c139710 0x7f763c138df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 msgr2=0x7f763c1ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f763c0a57c0 0x7f763c1ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient: _finish_hunting 0 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 monclient: found mon.noname-e 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76410c3640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c0a1de0 con 0x7f763c0a6950 2024-08-19T11:14:05.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.787+0000 7f76420c5640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f763c139710 0x7f763c138df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76410c3640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 msgr2=0x7f763c1388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76410c3640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 0x7f763c1388b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f762c00d830 tx=0x7f762c00dcf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f762c00bd40 con 0x7f763c0a6950 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: dump: 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.809 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: _finish_auth 0 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: _check_auth_tickets 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:05.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762c019070 con 0x7f763c0a6950 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 5 monclient: authenticate success, global_id 5480 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 10 monclient: _renew_subs 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c126270 con 0x7f763c0a6950 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f762c0148a0 con 0x7f763c0a6950 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f76327fc640 10 monclient: dump: 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.811 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7633fff640 4 set_mon_vals no callback set 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 10 monclient: _renew_subs 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.789+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c123f10 con 0x7f763c0a6950 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f7643b28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f7643b28640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 0x7f763c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f763c06a590 con 0x7f763c122d60 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f762c014430 con 0x7f763c0a6950 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76418c4640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 0x7f763c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76327fc640 1 --2- 172.21.15.71:0/2318985808 >> v2:172.21.15.135:6800/726754104 conn(0x7f762003ea80 0x7f7620040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76418c4640 10 monclient: get_auth_request con 0x7f763c122d60 auth_method 0 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76418c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76418c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.790+0000 7f76418c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(115..115 src has 1..115) ==== 3898+0+0 (secure 0 0 0) 0x7f762c00f040 con 0x7f763c0a6950 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76420c5640 1 --2- 172.21.15.71:0/2318985808 >> v2:172.21.15.135:6800/726754104 conn(0x7f762003ea80 0x7f7620040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76420c5640 10 monclient: get_auth_request con 0x7f762003ea80 auth_method 0 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76418c4640 10 monclient(hunting): handle_auth_done global_id 5299 payload 824 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.791+0000 7f76418c4640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f763c0a6d30 con 0x7f763c122d60 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76418c4640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 msgr2=0x7f763c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76418c4640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 0x7f763c02d1c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7638034000 tx=0x7f76380046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76420c5640 1 --2- 172.21.15.71:0/2318985808 >> v2:172.21.15.135:6800/726754104 conn(0x7f762003ea80 0x7f7620040f40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76340076a0 tx=0x7f7634009780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7638042070 con 0x7f763c122d60 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76327fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.793+0000 7f76327fc640 10 monclient: dump: 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.815 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7638003900 con 0x7f763c122d60 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 msgr2=0x7f763c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 0x7f763c02d1c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7638034000 tx=0x7f76380046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 msgr2=0x7f763c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.794+0000 7f76327fc640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c122d60 0x7f763c02d1c0 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7638034000 tx=0x7f76380046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f7643b28640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f7643b28640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 0x7f763c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f7643b28640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f763c076c60 con 0x7f763c123140 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 0x7f763c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient: get_auth_request con 0x7f763c123140 auth_method 0 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:05.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 10 monclient(hunting): handle_auth_done global_id 5308 payload 824 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.800+0000 7f76418c4640 1 -- 172.21.15.71:0/2318985808 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f763c09e100 con 0x7f763c123140 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.802+0000 7f76418c4640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 msgr2=0x7f763c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.802+0000 7f76418c4640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 0x7f763c02d700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f76380097c0 tx=0x7f7638009240 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7638037040 con 0x7f763c123140 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 10 monclient: dump: 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:05.818 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f7638052460 con 0x7f763c123140 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:05.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 msgr2=0x7f763c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 0x7f763c02d700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f76380097c0 tx=0x7f7638009240 comp rx=0 tx=0).stop 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 msgr2=0x7f763c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76327fc640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f763c123140 0x7f763c02d700 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f76380097c0 tx=0x7f7638009240 comp rx=0 tx=0).stop 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:05.820 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 74, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 242656, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:14:05.821 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 9, 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.822 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.823 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:05.824 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:05.825 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.827 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:05.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:05.833 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.836 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.838 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.840 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:05.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:05.843 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:05.844 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:05.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 >> v2:172.21.15.135:6800/726754104 conn(0x7f762003ea80 msgr2=0x7f7620040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 --2- 172.21.15.71:0/2318985808 >> v2:172.21.15.135:6800/726754104 conn(0x7f762003ea80 0x7f7620040f40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76340076a0 tx=0x7f7634009780 comp rx=0 tx=0).stop 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 10 monclient: shutdown 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 msgr2=0x7f763c1388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 --2- 172.21.15.71:0/2318985808 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f763c0a6950 0x7f763c1388b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f762c00d830 tx=0x7f762c00dcf0 comp rx=0 tx=0).stop 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76420c5640 1 -- 172.21.15.71:0/2318985808 reap_dead start 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f76420c5640 1 -- 172.21.15.71:0/2318985808 reap_dead start 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 shutdown_connections 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 >> 172.21.15.71:0/2318985808 conn(0x7f763c0abf50 msgr2=0x7f763c0aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 shutdown_connections 2024-08-19T11:14:05.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:05.803+0000 7f7643b28640 1 -- 172.21.15.71:0/2318985808 wait complete. 2024-08-19T11:14:05.847 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:14:05.847 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['i', 'e'] 2024-08-19T11:14:05.847 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['h'] 2024-08-19T11:14:05.847 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-08-19T11:14:05.847 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-08-19T11:14:05.847 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-19T11:14:05.847 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:14:05.861 INFO:tasks.ceph.mon.i:Stopped 2024-08-19T11:14:05.861 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-19T11:14:05.861 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-19T11:14:05.862 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-19T11:14:05.862 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:14:05.872 INFO:tasks.ceph.mon.e:Stopped 2024-08-19T11:14:05.872 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-08-19T11:14:05.873 INFO:tasks.ceph.mon.h:Sent signal 19 2024-08-19T11:14:05.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:14:20.082 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: starting. 2024-08-19T11:14:20.102 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25681 2024-08-19T11:14:20.102 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: created object 0... 2024-08-19T11:14:20.102 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: created object 25... 2024-08-19T11:14:20.102 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: created object 49... 2024-08-19T11:14:20.102 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: finishing. 2024-08-19T11:14:20.102 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25682]: shutting down. 2024-08-19T11:14:20.873 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-08-19T11:14:20.874 INFO:tasks.ceph.mon.h:Sent signal 18 2024-08-19T11:14:20.874 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-08-19T11:14:20.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:14:20.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.981+0000 7fbeec4e5640 10 monclient: get_monmap_and_config 2024-08-19T11:14:20.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.981+0000 7fbeec4e5640 10 monclient: build_initial_monmap 2024-08-19T11:14:20.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.981+0000 7fbeec4e5640 10 monclient: monmap: 2024-08-19T11:14:20.984 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:20.984 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:20.983390+0000 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:20.983390+0000 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:20.985 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.982+0000 7fbeec4e5640 1 Processor -- start 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.982+0000 7fbeec4e5640 1 -- start start 2024-08-19T11:14:20.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.982+0000 7fbeec4e5640 10 monclient: init 2024-08-19T11:14:20.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:20.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient: _add_conns ranks=[6,8,0,5,9,2,3,4,10,7,1] 2024-08-19T11:14:20.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): picked mon.noname-d con 0x7fbee40a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 0x7fbee40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): picked mon.noname-e con 0x7fbee40a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbee4139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee40a4f90 con 0x7fbee4139860 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbee40a6380 con 0x7fbee40a6a30 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbee40a49d0 con 0x7fbee40a6e10 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeec4e5640 10 monclient(hunting): authenticate will time out at 919.025217s 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbee9a80640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 msgr2=0x7fbee40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:20.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbee9a80640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 0x7fbee40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeeaa82640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbee4139860 0x7fbee4139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44030/0 (socket says 172.21.15.71:44030) 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 learned_addr learned my addr 172.21.15.71:0/4755891 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:50934/0 (socket says 172.21.15.71:50934) 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbee40a6a30 auth_method 0 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.983+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:20.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:20.985+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> v1:172.21.15.71:6789/0 conn(0x7fbee4139860 legacy=0x7fbee4139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 msgr2=0x7fbee40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 0x7fbee40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbee40a6a30 auth_method 0 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:21.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:21.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:21.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:21.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.184+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:14:21.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 msgr2=0x7fbee40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:21.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 0x7fbee40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbee40a6a30 auth_method 0 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:21.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:21.585+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:14:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 msgr2=0x7fbee40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:22.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 0x7fbee40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbee40a6a30 auth_method 0 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:22.387+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:14:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): tick 2024-08-19T11:14:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:14:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:14:23.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 msgr2=0x7fbee40a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbee40a6e10 0x7fbee40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 msgr2=0x7fbee40a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbee40a6a30 0x7fbee40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 >> v1:172.21.15.71:6789/0 conn(0x7fbee4139860 legacy=0x7fbee4139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient: _add_conns ranks=[4,9,5,10,1,2,7,3] 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): picked mon.noname-c con 0x7fbed00038c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): picked mon.noname-a con 0x7fbed00062f0 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:23.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): picked mon.noname-h con 0x7fbed0008e30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fbee40a6380 con 0x7fbed00062f0 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbee40a49d0 con 0x7fbed00038c0 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbed000bab0 con 0x7fbed0008e30 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 10 monclient(hunting): get_auth_request con 0x7fbed00062f0 auth_method 0 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:23.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbed00038c0 auth_method 0 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:23.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request con 0x7fbed0008e30 auth_method 0 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:23.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:23.983+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 10 monclient(hunting): get_auth_request con 0x7fbed00062f0 auth_method 0 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbed00038c0 auth_method 0 2024-08-19T11:14:24.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request con 0x7fbed0008e30 auth_method 0 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:24.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:24.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.184+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:14:24.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:24.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:24.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbed00038c0 auth_method 0 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 10 monclient(hunting): get_auth_request con 0x7fbed00062f0 auth_method 0 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request con 0x7fbed0008e30 auth_method 0 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:24.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:24.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:24.585+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:14:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 10 monclient(hunting): get_auth_request con 0x7fbed00062f0 auth_method 0 2024-08-19T11:14:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbed00038c0 auth_method 0 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:14:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request con 0x7fbed0008e30 auth_method 0 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbee9a80640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:14:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:25.387+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:14:26.609 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25683]: starting. 2024-08-19T11:14:26.609 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25683]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25681 2024-08-19T11:14:26.610 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25683]: shutting down. 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): tick 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 msgr2=0x7fbed000b2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbed0008e30 0x7fbed000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 msgr2=0x7fbed0005cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbed00038c0 0x7fbed0005cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.71:3300/0 conn(0x7fbed00062f0 0x7fbed0008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 reap_dead start 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient: _add_conns ranks=[3,1,10,7,2] 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 1 -- 172.21.15.71:0/4755891 reap_dead start 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 0x7fbed00092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): picked mon.noname-g con 0x7fbed0003ce0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbed0009820 addr v1:172.21.15.135:6789/0 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.135:3300/0 conn(0x7fbed000b320 0x7fbed0008780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): picked mon.noname-f con 0x7fbed000b320 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee40a46f0 con 0x7fbed0009820 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbee40a6380 con 0x7fbed000b320 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 1 -- 172.21.15.71:0/4755891 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbee40a49d0 con 0x7fbed0003ce0 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbee3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 0x7fbed00092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.135:3300/0 conn(0x7fbed000b320 0x7fbed0008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): get_auth_request con 0x7fbed0003ce0 auth_method 0 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request con 0x7fbed000b320 auth_method 0 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeeaa82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient(hunting): handle_auth_done global_id 44229 payload 274 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> v2:172.21.15.135:3300/0 conn(0x7fbed000b320 msgr2=0x7fbed0008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.135:3300/0 conn(0x7fbed000b320 0x7fbed0008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> v1:172.21.15.135:6789/0 conn(0x7fbed0009820 legacy=0x7fbed0009c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient: _finish_hunting 0 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 1 monclient: found mon.noname-g 2024-08-19T11:14:26.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:26.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:14:26.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.984+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed000f180 con 0x7fbed0003ce0 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbeea281640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 msgr2=0x7fbed00092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbeea281640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 0x7fbed00092e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009610 tx=0x7fbed402c170 comp rx=0 tx=0).ready entity=mon.3 client_cookie=e7b818532fad40d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 1 -- 172.21.15.71:0/4755891 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbed4032070 con 0x7fbed0003ce0 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 10 monclient: dump: 2024-08-19T11:14:26.995 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:26.996 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 10 monclient: _finish_auth 0 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 10 monclient: _check_auth_tickets 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 1 -- 172.21.15.71:0/4755891 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed4036870 con 0x7fbed0003ce0 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbeec4e5640 5 monclient: authenticate success, global_id 44229 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbeec4e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.987+0000 7fbee927f640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbeec4e5640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbeec4e5640 4 set_mon_vals no callback set 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbee927f640 1 -- 172.21.15.71:0/4755891 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbed40353b0 con 0x7fbed0003ce0 2024-08-19T11:14:26.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbee927f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbee927f640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbee927f640 10 monclient: dump: 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:26.998 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbeec4e5640 10 monclient: shutdown 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbeec4e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbeec4e5640 1 -- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 msgr2=0x7fbed00092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.988+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 0x7fbed00092e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009610 tx=0x7fbed402c170 comp rx=0 tx=0).stop 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 1 -- 172.21.15.71:0/4755891 shutdown_connections 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/4755891 >> v2:172.21.15.135:3300/0 conn(0x7fbed000b320 0x7fbed0008780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/4755891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed0003ce0 0x7fbed00092e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:26.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 1 -- 172.21.15.71:0/4755891 >> 172.21.15.71:0/4755891 conn(0x7fbee40ac030 msgr2=0x7fbee40ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 1 -- 172.21.15.71:0/4755891 shutdown_connections 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 1 -- 172.21.15.71:0/4755891 wait complete. 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.989+0000 7fbeec4e5640 10 monclient: monmap: 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:27.000 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 Processor -- start 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 -- start start 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient: init 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient: _add_conns ranks=[8,0,1,5,7,4,6,2,3] 2024-08-19T11:14:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbed0003ce0 0x7fbee41ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): picked mon.noname-e con 0x7fbed0003ce0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 0x7fbee4138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): picked mon.noname-a con 0x7fbed0009820 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed000b320 0x7fbee4139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): picked mon.noname-f con 0x7fbed000b320 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40a5b80 con 0x7fbed0009820 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40a5a00 con 0x7fbed000b320 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbee40a5d00 con 0x7fbed0003ce0 2024-08-19T11:14:27.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeea281640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbed0003ce0 msgr2=0x7fbee41ce240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.990+0000 7fbeec4e5640 10 monclient(hunting): authenticate will time out at 925.032983s 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeea281640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbed0003ce0 0x7fbee41ce240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 0x7fbee4138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 0x7fbee4138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59330/0 (socket says 172.21.15.71:59330) 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 -- 172.21.15.71:0/86261878 learned_addr learned my addr 172.21.15.71:0/86261878 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): get_auth_request con 0x7fbed0009820 auth_method 0 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed000b320 0x7fbee4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request con 0x7fbed000b320 auth_method 0 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbeeaa82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient(hunting): handle_auth_done global_id 34641 payload 824 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 -- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbed0003ce0 msgr2=0x7fbee41ce240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbed0003ce0 0x7fbee41ce240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 -- 172.21.15.71:0/86261878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed000b320 msgr2=0x7fbee4139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed000b320 0x7fbee4139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 monclient: found mon.noname-a 2024-08-19T11:14:27.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.991+0000 7fbee9a80640 1 -- 172.21.15.71:0/86261878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee413a460 con 0x7fbed0009820 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee9a80640 1 -- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 msgr2=0x7fbee4138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee9a80640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 0x7fbee4138b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbed800ba60 tx=0x7fbed800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbed801b020 con 0x7fbed0009820 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: dump: 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.007 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 5 monclient: authenticate success, global_id 34641 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed8017860 con 0x7fbed0009820 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 10 monclient: _renew_subs 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee4126250 con 0x7fbed0009820 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbed8016350 con 0x7fbed0009820 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee2ffd640 10 monclient: dump: 2024-08-19T11:14:27.009 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.010 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 10 monclient: _renew_subs 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee40a2180 con 0x7fbed0009820 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.994+0000 7fbee8a7e640 4 set_mon_vals no callback set 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.995+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbed801e020 con 0x7fbed0009820 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.995+0000 7fbeec4e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.995+0000 7fbeec4e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.995+0000 7fbeec4e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.995+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee40a71f0 con 0x7fbed0009820 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.996+0000 7fbee2ffd640 1 --2- 172.21.15.71:0/86261878 >> v2:172.21.15.135:6800/726754104 conn(0x7fbed0040f10 0x7fbed00433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.996+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 3506+0+0 (secure 0 0 0) 0x7fbed8014040 con 0x7fbed0009820 2024-08-19T11:14:27.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.996+0000 7fbeea281640 1 --2- 172.21.15.71:0/86261878 >> v2:172.21.15.135:6800/726754104 conn(0x7fbed0040f10 0x7fbed00433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.996+0000 7fbeea281640 10 monclient: get_auth_request con 0x7fbed0040f10 auth_method 0 2024-08-19T11:14:27.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:26.998+0000 7fbeea281640 1 --2- 172.21.15.71:0/86261878 >> v2:172.21.15.135:6800/726754104 conn(0x7fbed0040f10 0x7fbed00433d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbed4034000 tx=0x7fbed4032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.001+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fbed8025030 con 0x7fbed0009820 2024-08-19T11:14:27.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.001+0000 7fbee2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.001+0000 7fbee2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbeec4e5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:14:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbeec4e5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:14:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbeec4e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbee41241b0 con 0x7fbed0009820 2024-08-19T11:14:27.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbee2ffd640 1 -- 172.21.15.71:0/86261878 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3180 (secure 0 0 0) 0x7fbee413a460 con 0x7fbed0009820 2024-08-19T11:14:27.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbee2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:14:27.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.248+0000 7fbee2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:27.251 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":80,"quorum":[0,1,2,3,4,5,6],"quorum_names":["a","f","b","g","c","h","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:14:27.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 >> v2:172.21.15.135:6800/726754104 conn(0x7fbed0040f10 msgr2=0x7fbed00433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/86261878 >> v2:172.21.15.135:6800/726754104 conn(0x7fbed0040f10 0x7fbed00433d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbed4034000 tx=0x7fbed4032000 comp rx=0 tx=0).stop 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 10 monclient: shutdown 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 msgr2=0x7fbee4138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 0x7fbee4138b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbed800ba60 tx=0x7fbed800bf20 comp rx=0 tx=0).stop 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 shutdown_connections 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/86261878 >> v2:172.21.15.135:6800/726754104 conn(0x7fbed0040f10 0x7fbed00433d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed000b320 0x7fbee4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbed0009820 0x7fbee4138b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 --2- 172.21.15.71:0/86261878 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbed0003ce0 0x7fbee41ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 >> 172.21.15.71:0/86261878 conn(0x7fbee40ac030 msgr2=0x7fbee41c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 shutdown_connections 2024-08-19T11:14:27.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.250+0000 7fbeec4e5640 1 -- 172.21.15.71:0/86261878 wait complete. 2024-08-19T11:14:27.263 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-08-19T11:14:27.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-08-19T11:14:27.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:14:27.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.359+0000 7f70407d9640 10 monclient: get_monmap_and_config 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.359+0000 7f70407d9640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.359+0000 7f70407d9640 10 monclient: monmap: 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:27.361522+0000 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:27.361522+0000 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:27.362 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:27.363 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.360+0000 7f70407d9640 1 Processor -- start 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.360+0000 7f70407d9640 1 -- start start 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.360+0000 7f70407d9640 10 monclient: init 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient: _add_conns ranks=[4,1,0,10,2,7,5,8,9,6,3] 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 0x7f70380a3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient(hunting): picked mon.noname-c con 0x7f70380a2e50 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f70380a2310 addr v1:172.21.15.135:6789/0 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f703813ca00 addr v1:172.21.15.71:6789/0 2024-08-19T11:14:27.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703809e580 con 0x7f703813ca00 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f703809c940 con 0x7f70380a2310 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f703809e850 con 0x7f70380a2e50 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f70407d9640 10 monclient(hunting): authenticate will time out at 925.403569s 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 0x7f70380a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703ed76640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f703813ca00 0x7f703813edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50314/0 (socket says 172.21.15.71:50314) 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703ed76640 1 -- 172.21.15.71:0/2872516006 learned_addr learned my addr 172.21.15.71:0/2872516006 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): get_auth_request con 0x7f70380a2e50 auth_method 0 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 10 monclient(hunting): handle_auth_done global_id 44266 payload 274 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.361+0000 7f703e575640 1 -- 172.21.15.71:0/2872516006 >> v1:172.21.15.135:6789/0 conn(0x7f70380a2310 legacy=0x7f70380a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.362+0000 7f703e575640 1 -- 172.21.15.71:0/2872516006 >> v1:172.21.15.71:6789/0 conn(0x7f703813ca00 legacy=0x7f703813edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.362+0000 7f703e575640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.362+0000 7f703e575640 1 monclient: found mon.noname-c 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.362+0000 7f703e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.362+0000 7f703e575640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:14:27.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.362+0000 7f703e575640 1 -- 172.21.15.71:0/2872516006 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70380a20d0 con 0x7f70380a2e50 2024-08-19T11:14:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703e575640 1 -- 172.21.15.71:0/2872516006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 msgr2=0x7f70380a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703e575640 1 --2- 172.21.15.71:0/2872516006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 0x7f70380a3230 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70340097d0 tx=0x7f7034029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=3895190ba6eb1ecf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 1 -- 172.21.15.71:0/2872516006 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7034037070 con 0x7f70380a2e50 2024-08-19T11:14:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: dump: 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.375 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 5 monclient: authenticate success, global_id 44266 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 1 -- 172.21.15.71:0/2872516006 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703402adf0 con 0x7f70380a2e50 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 4 set_mon_vals no callback set 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 1 -- 172.21.15.71:0/2872516006 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7034030c20 con 0x7f70380a2e50 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f703d573640 10 monclient: dump: 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.377 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 10 monclient: shutdown 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 1 -- 172.21.15.71:0/2872516006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 msgr2=0x7f70380a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.365+0000 7f70407d9640 1 --2- 172.21.15.71:0/2872516006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 0x7f70380a3230 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70340097d0 tx=0x7f7034029fb0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 1 -- 172.21.15.71:0/2872516006 shutdown_connections 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 1 --2- 172.21.15.71:0/2872516006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f70380a2e50 0x7f70380a3230 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 1 -- 172.21.15.71:0/2872516006 >> 172.21.15.71:0/2872516006 conn(0x7f70380a8630 msgr2=0x7f70380a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 1 -- 172.21.15.71:0/2872516006 shutdown_connections 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 1 -- 172.21.15.71:0/2872516006 wait complete. 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 10 monclient: monmap: 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:27.379 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.380 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.366+0000 7f70407d9640 1 Processor -- start 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 -- start start 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient: init 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient: _add_conns ranks=[0,6,5,3,8,7,1,4,2] 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 0x7f70381cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): picked mon.noname-a con 0x7f70380a2310 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70380a2e50 0x7f70381cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): picked mon.noname-d con 0x7f70380a2e50 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f703813ca00 0x7f7038073690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): picked mon.noname-h con 0x7f703813ca00 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f70380a42b0 con 0x7f70380a2310 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f703809c660 con 0x7f703813ca00 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f70380a4430 con 0x7f70380a2e50 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f70407d9640 10 monclient(hunting): authenticate will time out at 925.409509s 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 0x7f70381cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 0x7f70381cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59334/0 (socket says 172.21.15.71:59334) 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70380a2e50 0x7f70381cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 -- 172.21.15.71:0/2055580020 learned_addr learned my addr 172.21.15.71:0/2055580020 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): get_auth_request con 0x7f70380a2310 auth_method 0 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): get_auth_request con 0x7f70380a2e50 auth_method 0 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703ed76640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f703813ca00 0x7f7038073690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703ed76640 10 monclient(hunting): get_auth_request con 0x7f703813ca00 auth_method 0 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703ed76640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703ed76640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient(hunting): handle_auth_done global_id 34650 payload 824 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70380a2e50 msgr2=0x7f70381cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f70380a2e50 0x7f70381cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f703813ca00 msgr2=0x7f7038073690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f703813ca00 0x7f7038073690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 monclient: found mon.noname-a 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703e575640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703813c2e0 con 0x7f70380a2310 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.367+0000 7f703ed76640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f703813ca00 0x7f7038073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f703e575640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 msgr2=0x7f70381cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f703e575640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 0x7f70381cf040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7034029ff0 tx=0x7f70340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7034041020 con 0x7f70380a2310 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: dump: 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7034003c10 con 0x7f70380a2310 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 5 monclient: authenticate success, global_id 34650 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 10 monclient: _renew_subs 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7038073190 con 0x7f70380a2310 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7034037040 con 0x7f70380a2310 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f702effd640 10 monclient: dump: 2024-08-19T11:14:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f703cd72640 4 set_mon_vals no callback set 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 10 monclient: _renew_subs 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.370+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7038072eb0 con 0x7f70380a2310 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f70407d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f70407d9640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 0x7f7038073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f70407d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f703806a590 con 0x7f7038073bd0 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7034044020 con 0x7f70380a2310 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 0x7f7038073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient: get_auth_request con 0x7f7038073bd0 auth_method 0 2024-08-19T11:14:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f702effd640 1 --2- 172.21.15.71:0/2055580020 >> v2:172.21.15.135:6800/726754104 conn(0x7f701c03ea80 0x7f701c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 10 monclient(hunting): handle_auth_done global_id 34659 payload 824 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 3506+0+0 (secure 0 0 0) 0x7f7034071f10 con 0x7f70380a2310 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703dd74640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70380a3230 con 0x7f7038073bd0 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703ed76640 1 --2- 172.21.15.71:0/2055580020 >> v2:172.21.15.135:6800/726754104 conn(0x7f701c03ea80 0x7f701c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.371+0000 7f703ed76640 10 monclient: get_auth_request con 0x7f701c03ea80 auth_method 0 2024-08-19T11:14:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.373+0000 7f703dd74640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 msgr2=0x7f7038073fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.373+0000 7f703dd74640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 0x7f7038073fb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f70380a4030 tx=0x7f702800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.373+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7028018030 con 0x7f7038073bd0 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.373+0000 7f702effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.373+0000 7f702effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.373+0000 7f702effd640 10 monclient: dump: 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7028003940 con 0x7f7038073bd0 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 msgr2=0x7f7038073fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 0x7f7038073fb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f70380a4030 tx=0x7f702800fc00 comp rx=0 tx=0).stop 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 msgr2=0x7f7038073fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f702effd640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7038073bd0 0x7f7038073fb0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f70380a4030 tx=0x7f702800fc00 comp rx=0 tx=0).stop 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.374+0000 7f703ed76640 1 --2- 172.21.15.71:0/2055580020 >> v2:172.21.15.135:6800/726754104 conn(0x7f701c03ea80 0x7f701c040f40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7030009f40 tx=0x7f7030009550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f70407d9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f70407d9640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 0x7f7038139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f70407d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7038076c60 con 0x7f70380744f0 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 0x7f7038139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient: get_auth_request con 0x7f70380744f0 auth_method 0 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 10 monclient(hunting): handle_auth_done global_id 34668 payload 824 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.380+0000 7f703dd74640 1 -- 172.21.15.71:0/2055580020 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f70380728f0 con 0x7f70380744f0 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.382+0000 7f703dd74640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 msgr2=0x7f7038139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.382+0000 7f703dd74640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 0x7f7038139c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7028018000 tx=0x7f7028003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.382+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f702800de50 con 0x7f70380744f0 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.382+0000 7f702effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.382+0000 7f702effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.382+0000 7f702effd640 10 monclient: dump: 2024-08-19T11:14:27.397 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.398 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9581 (secure 0 0 0) 0x7f702800de50 con 0x7f70380744f0 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 msgr2=0x7f7038139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 0x7f7038139c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7028018000 tx=0x7f7028003760 comp rx=0 tx=0).stop 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 msgr2=0x7f7038139c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f702effd640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380744f0 0x7f7038139c10 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7028018000 tx=0x7f7028003760 comp rx=0 tx=0).stop 2024-08-19T11:14:27.399 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 102899, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:27.400 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.401 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.402 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:27.403 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.404 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:27.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.410 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.412 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:27.424 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 >> v2:172.21.15.135:6800/726754104 conn(0x7f701c03ea80 msgr2=0x7f701c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 --2- 172.21.15.71:0/2055580020 >> v2:172.21.15.135:6800/726754104 conn(0x7f701c03ea80 0x7f701c040f40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7030009f40 tx=0x7f7030009550 comp rx=0 tx=0).stop 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 10 monclient: shutdown 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 msgr2=0x7f70381cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 --2- 172.21.15.71:0/2055580020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70380a2310 0x7f70381cf040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7034029ff0 tx=0x7f70340046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f703ed76640 1 -- 172.21.15.71:0/2055580020 reap_dead start 2024-08-19T11:14:27.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f703ed76640 1 -- 172.21.15.71:0/2055580020 reap_dead start 2024-08-19T11:14:27.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 shutdown_connections 2024-08-19T11:14:27.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 >> 172.21.15.71:0/2055580020 conn(0x7f70380a8630 msgr2=0x7f70380a4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 shutdown_connections 2024-08-19T11:14:27.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.383+0000 7f70407d9640 1 -- 172.21.15.71:0/2055580020 wait complete. 2024-08-19T11:14:27.426 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:27.426 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-08-19T11:14:27.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:14:27.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.523+0000 7fa06d35a640 10 monclient: get_monmap_and_config 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.523+0000 7fa06d35a640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.523+0000 7fa06d35a640 10 monclient: monmap: 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:27.525459+0000 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:27.525459+0000 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:27.527 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 1 Processor -- start 2024-08-19T11:14:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 1 -- start start 2024-08-19T11:14:27.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 10 monclient: init 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 10 monclient: _add_conns ranks=[8,6,5,9,1,7,3,0,2,4,10] 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0680a6950 0x7fa0680a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.524+0000 7fa06d35a640 10 monclient(hunting): picked mon.noname-e con 0x7fa0680a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 0x7fa0680a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): picked mon.noname-d con 0x7fa0680a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa068139710 0x7fa068139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): picked mon.noname-h con 0x7fa068139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa0680a5020 con 0x7fa068139710 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa0680a77b0 con 0x7fa0680a57c0 2024-08-19T11:14:27.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa0680a7d40 con 0x7fa0680a6950 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa06d35a640 10 monclient(hunting): authenticate will time out at 925.567044s 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa066ffd640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0680a6950 msgr2=0x7fa0680a6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa066ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0680a6950 0x7fa0680a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 0x7fa0680a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 0x7fa0680a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:53796/0 (socket says 172.21.15.71:53796) 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 -- 172.21.15.71:0/3371866518 learned_addr learned my addr 172.21.15.71:0/3371866518 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): get_auth_request con 0x7fa0680a57c0 auth_method 0 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0677fe640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa068139710 0x7fa068139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient(hunting): handle_auth_done global_id 25026 payload 274 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 -- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0680a6950 msgr2=0x7fa0680a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0680a6950 0x7fa0680a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 -- 172.21.15.71:0/3371866518 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa068139710 msgr2=0x7fa068139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa068139710 0x7fa068139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 monclient: found mon.noname-d 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0667fc640 1 -- 172.21.15.71:0/3371866518 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680a6380 con 0x7fa0680a57c0 2024-08-19T11:14:27.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0677fe640 10 monclient: get_auth_request con 0x7fa068139710 auth_method 0 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.525+0000 7fa0677fe640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa068139710 0x7fa068139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa0667fc640 1 -- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 msgr2=0x7fa0680a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa0667fc640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 0x7fa0680a7270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0098d0 tx=0x7fa05c02a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=65a8f23e56cd7071 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 1 -- 172.21.15.71:0/3371866518 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa05c037070 con 0x7fa0680a57c0 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: dump: 2024-08-19T11:14:27.541 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.542 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.543 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.543 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.543 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 1 -- 172.21.15.71:0/3371866518 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c0307b0 con 0x7fa0680a57c0 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 5 monclient: authenticate success, global_id 25026 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 1 -- 172.21.15.71:0/3371866518 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa05c030e50 con 0x7fa0680a57c0 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 4 set_mon_vals no callback set 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa065ffb640 10 monclient: dump: 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.545 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 10 monclient: shutdown 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 -- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 msgr2=0x7fa0680a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 0x7fa0680a7270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0098d0 tx=0x7fa05c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 -- 172.21.15.71:0/3371866518 shutdown_connections 2024-08-19T11:14:27.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa068139710 0x7fa068139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa0680a57c0 0x7fa0680a7270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 --2- 172.21.15.71:0/3371866518 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa0680a6950 0x7fa0680a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 -- 172.21.15.71:0/3371866518 >> 172.21.15.71:0/3371866518 conn(0x7fa0680abf50 msgr2=0x7fa0680ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.528+0000 7fa06d35a640 1 -- 172.21.15.71:0/3371866518 shutdown_connections 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.529+0000 7fa06d35a640 1 -- 172.21.15.71:0/3371866518 wait complete. 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.529+0000 7fa06d35a640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.529+0000 7fa06d35a640 10 monclient: monmap: 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 Processor -- start 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 -- start start 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient: init 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient: _add_conns ranks=[4,2,6,5,0,8,1,3,7] 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa0680a57c0 0x7fa0681cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): picked mon.noname-c con 0x7fa0680a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 0x7fa068125380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): picked mon.noname-b con 0x7fa0680a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa068139710 0x7fa0681258c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): picked mon.noname-d con 0x7fa068139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa0680a84c0 con 0x7fa0680a6950 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa0680a3650 con 0x7fa0680a57c0 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa0680a8700 con 0x7fa068139710 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa06d35a640 10 monclient(hunting): authenticate will time out at 925.572525s 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 0x7fa068125380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa0680a57c0 0x7fa0681cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa068139710 0x7fa0681258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 0x7fa068125380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:57446/0 (socket says 172.21.15.71:57446) 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 -- 172.21.15.71:0/1475734075 learned_addr learned my addr 172.21.15.71:0/1475734075 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa068139710 0x7fa0681258c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:53808/0 (socket says 172.21.15.71:53808) 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): get_auth_request con 0x7fa0680a6950 auth_method 0 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa0680a57c0 0x7fa0681cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:45450/0 (socket says 172.21.15.71:45450) 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): get_auth_request con 0x7fa0680a57c0 auth_method 0 2024-08-19T11:14:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): get_auth_request con 0x7fa068139710 auth_method 0 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient(hunting): handle_auth_done global_id 5807 payload 824 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa068139710 msgr2=0x7fa0681258c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa068139710 0x7fa0681258c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa0680a57c0 msgr2=0x7fa0681cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa0680a57c0 0x7fa0681cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 monclient: found mon.noname-b 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.530+0000 7fa0667fc640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680a1ee0 con 0x7fa0680a6950 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.531+0000 7fa066ffd640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa0680a57c0 0x7fa0681cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:27.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa0667fc640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 msgr2=0x7fa068125380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa0667fc640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 0x7fa068125380 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa05c02a110 tx=0x7fa05c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa05c037040 con 0x7fa0680a6950 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: dump: 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.553 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 5 monclient: authenticate success, global_id 5807 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c003610 con 0x7fa0680a6950 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa05c003c30 con 0x7fa0680a6950 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 10 monclient: _renew_subs 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa068126d30 con 0x7fa0680a6950 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa0657fa640 4 set_mon_vals no callback set 2024-08-19T11:14:27.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa04f7fe640 10 monclient: dump: 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.556 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 10 monclient: _renew_subs 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.533+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa068129090 con 0x7fa0680a6950 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa06d35a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa06d35a640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 0x7fa06802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa068076c60 con 0x7fa0681cf570 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 0x7fa06802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa05c044020 con 0x7fa0680a6950 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient: get_auth_request con 0x7fa0681cf570 auth_method 0 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 10 monclient(hunting): handle_auth_done global_id 5816 payload 824 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa066ffd640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0680a2110 con 0x7fa0681cf570 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa04f7fe640 1 --2- 172.21.15.71:0/1475734075 >> v2:172.21.15.135:6800/726754104 conn(0x7fa05403ea80 0x7fa054040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(117..117 src has 1..117) ==== 3506+0+0 (secure 0 0 0) 0x7fa05c042020 con 0x7fa0680a6950 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa0677fe640 1 --2- 172.21.15.71:0/1475734075 >> v2:172.21.15.135:6800/726754104 conn(0x7fa05403ea80 0x7fa054040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.534+0000 7fa0677fe640 10 monclient: get_auth_request con 0x7fa05403ea80 auth_method 0 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.536+0000 7fa066ffd640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 msgr2=0x7fa06802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.536+0000 7fa066ffd640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 0x7fa06802d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa058003d00 tx=0x7fa0580079c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.536+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa05801a070 con 0x7fa0681cf570 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.536+0000 7fa04f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.536+0000 7fa04f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 10 monclient: dump: 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa05800a9a0 con 0x7fa0681cf570 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 msgr2=0x7fa06802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 0x7fa06802d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa058003d00 tx=0x7fa0580079c0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 msgr2=0x7fa06802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa04f7fe640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0681cf570 0x7fa06802d1c0 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa058003d00 tx=0x7fa0580079c0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.537+0000 7fa0677fe640 1 --2- 172.21.15.71:0/1475734075 >> v2:172.21.15.135:6800/726754104 conn(0x7fa05403ea80 0x7fa054040f40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa060006fd0 tx=0x7fa060014040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa06d35a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa06d35a640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 0x7fa06802db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa06d35a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa06806a510 con 0x7fa06802d700 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 0x7fa06802db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient: get_auth_request con 0x7fa06802d700 auth_method 0 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 10 monclient(hunting): handle_auth_done global_id 5825 payload 824 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.543+0000 7fa066ffd640 1 -- 172.21.15.71:0/1475734075 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa0680a6d30 con 0x7fa06802d700 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.545+0000 7fa066ffd640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 msgr2=0x7fa06802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.545+0000 7fa066ffd640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 0x7fa06802db10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa058017000 tx=0x7fa058005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.545+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa05801a050 con 0x7fa06802d700 2024-08-19T11:14:27.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.545+0000 7fa04f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.545+0000 7fa04f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.545+0000 7fa04f7fe640 10 monclient: dump: 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.565 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9412 (secure 0 0 0) 0x7fa05801b040 con 0x7fa06802d700 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 msgr2=0x7fa06802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 0x7fa06802db10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa058017000 tx=0x7fa058005d50 comp rx=0 tx=0).stop 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 msgr2=0x7fa06802db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa04f7fe640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa06802d700 0x7fa06802db10 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa058017000 tx=0x7fa058005d50 comp rx=0 tx=0).stop 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 264425, 2024-08-19T11:14:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.589 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:27.590 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.592 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.592 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.592 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.592 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.592 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.593 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:27.593 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:27.594 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.595 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.597 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.598 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.599 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:27.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.600 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.600 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:27.600 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:27.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 >> v2:172.21.15.135:6800/726754104 conn(0x7fa05403ea80 msgr2=0x7fa054040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 --2- 172.21.15.71:0/1475734075 >> v2:172.21.15.135:6800/726754104 conn(0x7fa05403ea80 0x7fa054040f40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa060006fd0 tx=0x7fa060014040 comp rx=0 tx=0).stop 2024-08-19T11:14:27.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 10 monclient: shutdown 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 msgr2=0x7fa068125380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 --2- 172.21.15.71:0/1475734075 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa0680a6950 0x7fa068125380 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa05c02a110 tx=0x7fa05c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa0677fe640 1 -- 172.21.15.71:0/1475734075 reap_dead start 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa0677fe640 1 -- 172.21.15.71:0/1475734075 reap_dead start 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 shutdown_connections 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 >> 172.21.15.71:0/1475734075 conn(0x7fa0680abf50 msgr2=0x7fa0680aacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 shutdown_connections 2024-08-19T11:14:27.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.546+0000 7fa06d35a640 1 -- 172.21.15.71:0/1475734075 wait complete. 2024-08-19T11:14:27.603 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:27.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-08-19T11:14:27.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.699+0000 7f42ff4da640 10 monclient: get_monmap_and_config 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.699+0000 7f42ff4da640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.699+0000 7f42ff4da640 10 monclient: monmap: 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:27.701335+0000 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:27.701335+0000 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.702 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 Processor -- start 2024-08-19T11:14:27.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 -- start start 2024-08-19T11:14:27.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient: init 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient: _add_conns ranks=[10,9,2,8,6,4,7,3,5,1,0] 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42f80a6950 0x7f42f80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): picked mon.noname-f con 0x7f42f80a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42f80a57c0 0x7f42f80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): picked mon.noname-a con 0x7f42f80a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:27.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 0x7f42f8139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): picked mon.noname-b con 0x7f42f8139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f42f80a5020 con 0x7f42f80a57c0 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f42f80a77b0 con 0x7f42f80a6950 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f42f80a7d40 con 0x7f42f8139710 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.700+0000 7f42ff4da640 10 monclient(hunting): authenticate will time out at 925.742959s 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42f80a57c0 0x7f42f80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 0x7f42f8139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 0x7f42f8139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:57480/0 (socket says 172.21.15.71:57480) 2024-08-19T11:14:27.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42f80a57c0 0x7f42f80a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59366/0 (socket says 172.21.15.71:59366) 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 1 -- 172.21.15.71:0/965761405 learned_addr learned my addr 172.21.15.71:0/965761405 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): get_auth_request con 0x7f42f8139710 auth_method 0 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): get_auth_request con 0x7f42f80a57c0 auth_method 0 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fd276640 1 --2- 172.21.15.71:0/965761405 >> v2:172.21.15.135:3300/0 conn(0x7f42f80a6950 0x7f42f80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient(hunting): handle_auth_done global_id 34677 payload 274 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 -- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 msgr2=0x7f42f8139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 --2- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 0x7f42f8139b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 -- 172.21.15.71:0/965761405 >> v2:172.21.15.135:3300/0 conn(0x7f42f80a6950 msgr2=0x7f42f80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 --2- 172.21.15.71:0/965761405 >> v2:172.21.15.135:3300/0 conn(0x7f42f80a6950 0x7f42f80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 monclient: found mon.noname-a 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fca75640 1 -- 172.21.15.71:0/965761405 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f80a6380 con 0x7f42f80a57c0 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fd276640 10 monclient: get_auth_request con 0x7f42f80a6950 auth_method 0 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fd276640 1 --2- 172.21.15.71:0/965761405 >> v2:172.21.15.135:3300/0 conn(0x7f42f80a6950 0x7f42f80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.701+0000 7f42fda77640 1 --2- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 0x7f42f8139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42fca75640 1 -- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f80a57c0 msgr2=0x7f42f80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42fca75640 1 --2- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f80a57c0 0x7f42f80a7270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f42f80a2e70 tx=0x7f42e802a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc20e453b65bca72 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 1 -- 172.21.15.71:0/965761405 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42e8037070 con 0x7f42f80a57c0 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: dump: 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.714 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.715 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 5 monclient: authenticate success, global_id 34677 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 1 -- 172.21.15.71:0/965761405 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e802ad30 con 0x7f42f80a57c0 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 1 -- 172.21.15.71:0/965761405 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42e8030c20 con 0x7f42f80a57c0 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 4 set_mon_vals no callback set 2024-08-19T11:14:27.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42effff640 10 monclient: dump: 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.717 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 10 monclient: shutdown 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 -- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f80a57c0 msgr2=0x7f42f80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 --2- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f80a57c0 0x7f42f80a7270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f42f80a2e70 tx=0x7f42e802a010 comp rx=0 tx=0).stop 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 -- 172.21.15.71:0/965761405 shutdown_connections 2024-08-19T11:14:27.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 --2- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f8139710 0x7f42f8139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 --2- 172.21.15.71:0/965761405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f80a57c0 0x7f42f80a7270 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 --2- 172.21.15.71:0/965761405 >> v2:172.21.15.135:3300/0 conn(0x7f42f80a6950 0x7f42f80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.704+0000 7f42ff4da640 1 -- 172.21.15.71:0/965761405 >> 172.21.15.71:0/965761405 conn(0x7f42f80abf50 msgr2=0x7f42f80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.705+0000 7f42ff4da640 1 -- 172.21.15.71:0/965761405 shutdown_connections 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.705+0000 7f42ff4da640 1 -- 172.21.15.71:0/965761405 wait complete. 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.705+0000 7f42ff4da640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.705+0000 7f42ff4da640 10 monclient: monmap: 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:27.719 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.720 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.705+0000 7f42ff4da640 1 Processor -- start 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 -- start start 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient: init 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient: _add_conns ranks=[2,1,0,3,7,6,8,4,5] 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 0x7f42f81ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): picked mon.noname-b con 0x7f42f80a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80a6950 0x7f42f8138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): picked mon.noname-f con 0x7f42f80a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f8139710 0x7f42f8138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): picked mon.noname-a con 0x7f42f8139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42f80a84c0 con 0x7f42f8139710 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42f80a3650 con 0x7f42f80a6950 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f42f80a8700 con 0x7f42f80a57c0 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42ff4da640 10 monclient(hunting): authenticate will time out at 925.748518s 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 0x7f42f81ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 0x7f42f81ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:57490/0 (socket says 172.21.15.71:57490) 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 -- 172.21.15.71:0/690924962 learned_addr learned my addr 172.21.15.71:0/690924962 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): get_auth_request con 0x7f42f80a57c0 auth_method 0 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f8139710 0x7f42f8138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): get_auth_request con 0x7f42f8139710 auth_method 0 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fda77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fca75640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80a6950 0x7f42f8138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fca75640 10 monclient(hunting): get_auth_request con 0x7f42f80a6950 auth_method 0 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fca75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fca75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fca75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient(hunting): handle_auth_done global_id 5843 payload 824 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80a6950 msgr2=0x7f42f8138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42f80a6950 0x7f42f8138a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f8139710 msgr2=0x7f42f8138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42f8139710 0x7f42f8138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 monclient: found mon.noname-b 2024-08-19T11:14:27.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:27.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.706+0000 7f42fd276640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f81240f0 con 0x7f42f80a57c0 2024-08-19T11:14:27.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42fd276640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 msgr2=0x7f42f81ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42fd276640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 0x7f42f81ce1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c7f0 tx=0x7f42f400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42f4015070 con 0x7f42f80a57c0 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: dump: 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.730 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 5 monclient: authenticate success, global_id 5843 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f400ce40 con 0x7f42f80a57c0 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 10 monclient: _renew_subs 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42f4011860 con 0x7f42f80a57c0 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f80a1e70 con 0x7f42f80a57c0 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ef7fe640 4 set_mon_vals no callback set 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42edffb640 10 monclient: dump: 2024-08-19T11:14:27.732 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.733 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 10 monclient: _renew_subs 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.709+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f8126450 con 0x7f42f80a57c0 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f42f4018070 con 0x7f42f80a57c0 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42ff4da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42ff4da640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 0x7f42f802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f42f8076c60 con 0x7f42f8122f90 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42edffb640 1 --2- 172.21.15.71:0/690924962 >> v2:172.21.15.135:6800/726754104 conn(0x7f42dc03ea80 0x7f42dc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 0x7f42f802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient: get_auth_request con 0x7f42f8122f90 auth_method 0 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(117..117 src has 1..117) ==== 3506+0+0 (secure 0 0 0) 0x7f42f4051a90 con 0x7f42f80a57c0 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fda77640 1 --2- 172.21.15.71:0/690924962 >> v2:172.21.15.135:6800/726754104 conn(0x7f42dc03ea80 0x7f42dc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fda77640 10 monclient: get_auth_request con 0x7f42dc03ea80 auth_method 0 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 10 monclient(hunting): handle_auth_done global_id 44284 payload 824 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.710+0000 7f42fca75640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42f80a6d30 con 0x7f42f8122f90 2024-08-19T11:14:27.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.712+0000 7f42fca75640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 msgr2=0x7f42f802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.712+0000 7f42fca75640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 0x7f42f802d1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f8074f90 tx=0x7f42e80046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42fda77640 1 --2- 172.21.15.71:0/690924962 >> v2:172.21.15.135:6800/726754104 conn(0x7f42dc03ea80 0x7f42dc040f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009c90 tx=0x7f42f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42e8042030 con 0x7f42f8122f90 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 10 monclient: dump: 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.736 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f42e8038040 con 0x7f42f8122f90 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 msgr2=0x7f42f802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 0x7f42f802d1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f8074f90 tx=0x7f42e80046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 msgr2=0x7f42f802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.713+0000 7f42edffb640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8122f90 0x7f42f802d1c0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42f8074f90 tx=0x7f42e80046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42ff4da640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42ff4da640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 0x7f42f802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42ff4da640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f42f809e100 con 0x7f42f8123370 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 0x7f42f802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient: get_auth_request con 0x7f42f8123370 auth_method 0 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 10 monclient(hunting): handle_auth_done global_id 44293 payload 824 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.719+0000 7f42fca75640 1 -- 172.21.15.71:0/690924962 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42f81ce730 con 0x7f42f8123370 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.721+0000 7f42fca75640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 msgr2=0x7f42f802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.721+0000 7f42fca75640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 0x7f42f802d700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42e80096f0 tx=0x7f42e8008030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f42e8042070 con 0x7f42f8123370 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:14:27.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 10 monclient: dump: 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.740 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9244 (secure 0 0 0) 0x7f42e803e6b0 con 0x7f42f8123370 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 msgr2=0x7f42f802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 0x7f42f802d700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42e80096f0 tx=0x7f42e8008030 comp rx=0 tx=0).stop 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 msgr2=0x7f42f802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42edffb640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f42f8123370 0x7f42f802d700 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42e80096f0 tx=0x7f42e8008030 comp rx=0 tx=0).stop 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 36736, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.756 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:27.757 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.758 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:27.762 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.764 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:27.765 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 >> v2:172.21.15.135:6800/726754104 conn(0x7f42dc03ea80 msgr2=0x7f42dc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 --2- 172.21.15.71:0/690924962 >> v2:172.21.15.135:6800/726754104 conn(0x7f42dc03ea80 0x7f42dc040f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009c90 tx=0x7f42f000b040 comp rx=0 tx=0).stop 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 10 monclient: shutdown 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 msgr2=0x7f42f81ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 --2- 172.21.15.71:0/690924962 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f42f80a57c0 0x7f42f81ce1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c7f0 tx=0x7f42f400cbf0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42fda77640 1 -- 172.21.15.71:0/690924962 reap_dead start 2024-08-19T11:14:27.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42fda77640 1 -- 172.21.15.71:0/690924962 reap_dead start 2024-08-19T11:14:27.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 shutdown_connections 2024-08-19T11:14:27.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 >> 172.21.15.71:0/690924962 conn(0x7f42f80abf50 msgr2=0x7f42f80aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 shutdown_connections 2024-08-19T11:14:27.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.722+0000 7f42ff4da640 1 -- 172.21.15.71:0/690924962 wait complete. 2024-08-19T11:14:27.768 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:27.768 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-08-19T11:14:27.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.865+0000 7f63dbd72640 10 monclient: get_monmap_and_config 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.865+0000 7f63dbd72640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.865+0000 7f63dbd72640 10 monclient: monmap: 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:27.866814+0000 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:27.866814+0000 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.867 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:27.868 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.865+0000 7f63dbd72640 1 Processor -- start 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 -- start start 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient: init 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient: _add_conns ranks=[7,5,9,6,0,2,4,8,3,10,1] 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a47c0 0x7f63d40a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): picked mon.noname-i con 0x7f63d40a47c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d40a50e0 0x7f63d4139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): picked mon.noname-h con 0x7f63d40a50e0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:27.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63d4139eb0 0x7f63d413a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): picked mon.noname-a con 0x7f63d4139eb0 addr v2:172.21.15.71:3300/0 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f63d40a1540 con 0x7f63d4139eb0 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f63d40a32a0 con 0x7f63d40a50e0 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f63d406cc40 con 0x7f63d40a47c0 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63dbd72640 10 monclient(hunting): authenticate will time out at 925.908538s 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63d4139eb0 0x7f63d413a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63d4139eb0 0x7f63d413a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59386/0 (socket says 172.21.15.71:59386) 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 -- 172.21.15.71:0/720991070 learned_addr learned my addr 172.21.15.71:0/720991070 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): get_auth_request con 0x7f63d4139eb0 auth_method 0 2024-08-19T11:14:27.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d9b0e640 1 -- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a47c0 msgr2=0x7f63d40a4ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:14:27.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d9b0e640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a47c0 0x7f63d40a4ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d930d640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d40a50e0 0x7f63d4139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d930d640 10 monclient(hunting): get_auth_request con 0x7f63d40a50e0 auth_method 0 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d930d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d930d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63d930d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient(hunting): handle_auth_done global_id 34695 payload 274 2024-08-19T11:14:27.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 -- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a47c0 msgr2=0x7f63d40a4ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a47c0 0x7f63d40a4ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 -- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d40a50e0 msgr2=0x7f63d4139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d40a50e0 0x7f63d4139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 monclient: found mon.noname-a 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.866+0000 7f63da30f640 1 -- 172.21.15.71:0/720991070 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d40a6380 con 0x7f63d4139eb0 2024-08-19T11:14:27.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63da30f640 1 -- 172.21.15.71:0/720991070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d4139eb0 msgr2=0x7f63d413a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63da30f640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d4139eb0 0x7f63d413a360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009e50 tx=0x7f63c402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2376db081433e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 1 -- 172.21.15.71:0/720991070 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c4036070 con 0x7f63d4139eb0 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: dump: 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.879 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 1 -- 172.21.15.71:0/720991070 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c4007a70 con 0x7f63d4139eb0 2024-08-19T11:14:27.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 1 -- 172.21.15.71:0/720991070 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c4007c60 con 0x7f63d4139eb0 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63d8b0c640 10 monclient: dump: 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.881 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63dbd72640 5 monclient: authenticate success, global_id 34695 2024-08-19T11:14:27.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63dbd72640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.869+0000 7f63dbd72640 4 set_mon_vals no callback set 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 10 monclient: shutdown 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 -- 172.21.15.71:0/720991070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d4139eb0 msgr2=0x7f63d413a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d4139eb0 0x7f63d413a360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009e50 tx=0x7f63c402a570 comp rx=0 tx=0).stop 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 -- 172.21.15.71:0/720991070 shutdown_connections 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d4139eb0 0x7f63d413a360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d40a50e0 0x7f63d4139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 --2- 172.21.15.71:0/720991070 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a47c0 0x7f63d40a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 -- 172.21.15.71:0/720991070 >> 172.21.15.71:0/720991070 conn(0x7f63d40a9470 msgr2=0x7f63d40a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 -- 172.21.15.71:0/720991070 shutdown_connections 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.870+0000 7f63dbd72640 1 -- 172.21.15.71:0/720991070 wait complete. 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient: build_initial_monmap 2024-08-19T11:14:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient: monmap: 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:27.885 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:27.885 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 Processor -- start 2024-08-19T11:14:27.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 -- start start 2024-08-19T11:14:27.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient: init 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient: _add_conns ranks=[6,7,1,2,5,3,4,8,0] 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 0x7f63d41ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): picked mon.noname-d con 0x7f63d40a47c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a50e0 0x7f63d41cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): picked mon.noname-i con 0x7f63d40a50e0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:27.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d4139eb0 0x7f63d41cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): picked mon.noname-f con 0x7f63d4139eb0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63d40a5500 con 0x7f63d4139eb0 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f63d406cfd0 con 0x7f63d40a47c0 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f63d406d300 con 0x7f63d40a50e0 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.871+0000 7f63dbd72640 10 monclient(hunting): authenticate will time out at 925.913941s 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 0x7f63d41ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 0x7f63d41ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:53824/0 (socket says 172.21.15.71:53824) 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d930d640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a50e0 msgr2=0x7f63d41cecc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:14:27.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 -- 172.21.15.71:0/2933764379 learned_addr learned my addr 172.21.15.71:0/2933764379 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): get_auth_request con 0x7f63d40a47c0 auth_method 0 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d930d640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a50e0 0x7f63d41cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d4139eb0 0x7f63d41cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): get_auth_request con 0x7f63d4139eb0 auth_method 0 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63da30f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient(hunting): handle_auth_done global_id 25044 payload 824 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a50e0 msgr2=0x7f63d41cecc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f63d40a50e0 0x7f63d41cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d4139eb0 msgr2=0x7f63d41cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63d4139eb0 0x7f63d41cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient: _finish_hunting 0 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 monclient: found mon.noname-d 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:27.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.872+0000 7f63d9b0e640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d4128fe0 con 0x7f63d40a47c0 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.874+0000 7f63d9b0e640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 msgr2=0x7f63d41ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.874+0000 7f63d9b0e640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 0x7f63d41ce780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00b550 tx=0x7f63cc00ba10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.874+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63cc013020 con 0x7f63d40a47c0 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: dump: 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.896 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: _finish_auth 0 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc003dd0 con 0x7f63d40a47c0 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 5 monclient: authenticate success, global_id 25044 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 10 monclient: _renew_subs 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d4129e50 con 0x7f63d40a47c0 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63cc00f460 con 0x7f63d40a47c0 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d27fc640 10 monclient: dump: 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.898 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.899 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63d3fff640 4 set_mon_vals no callback set 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 10 monclient: _renew_subs 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.876+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d4127af0 con 0x7f63d40a47c0 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63dbd72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63dbd72640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 0x7f63d4126630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f63d4076c60 con 0x7f63d4126250 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 0x7f63d4126630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient: get_auth_request con 0x7f63d4126250 auth_method 0 2024-08-19T11:14:27.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f63cc016020 con 0x7f63d40a47c0 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 10 monclient(hunting): handle_auth_done global_id 25053 payload 824 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.877+0000 7f63d930d640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63d409fab0 con 0x7f63d4126250 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.878+0000 7f63d27fc640 1 --2- 172.21.15.71:0/2933764379 >> v2:172.21.15.135:6800/726754104 conn(0x7f63c003ea80 0x7f63c0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.878+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(117..117 src has 1..117) ==== 3506+0+0 (secure 0 0 0) 0x7f63cc051720 con 0x7f63d40a47c0 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.878+0000 7f63da30f640 1 --2- 172.21.15.71:0/2933764379 >> v2:172.21.15.135:6800/726754104 conn(0x7f63c003ea80 0x7f63c0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.878+0000 7f63da30f640 10 monclient: get_auth_request con 0x7f63c003ea80 auth_method 0 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d930d640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 msgr2=0x7f63d4126630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d930d640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 0x7f63d4126630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63d4127930 tx=0x7f63c800eba0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c8017030 con 0x7f63d4126250 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 10 monclient: dump: 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.902 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f63c800c710 con 0x7f63d4126250 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 msgr2=0x7f63d4126630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 0x7f63d4126630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63d4127930 tx=0x7f63c800eba0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 msgr2=0x7f63d4126630 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63d27fc640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126250 0x7f63d4126630 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63d4127930 tx=0x7f63c800eba0 comp rx=0 tx=0).stop 2024-08-19T11:14:27.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.880+0000 7f63da30f640 1 --2- 172.21.15.71:0/2933764379 >> v2:172.21.15.135:6800/726754104 conn(0x7f63c003ea80 0x7f63c0040f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009e50 tx=0x7f63c4009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63dbd72640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63dbd72640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 0x7f63d409d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63dbd72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f63d4069ed0 con 0x7f63d4126b70 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 0x7f63d409d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient: get_auth_request con 0x7f63d4126b70 auth_method 0 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 10 monclient(hunting): handle_auth_done global_id 25062 payload 824 2024-08-19T11:14:27.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.886+0000 7f63d930d640 1 -- 172.21.15.71:0/2933764379 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63d412a270 con 0x7f63d4126b70 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d930d640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 msgr2=0x7f63d409d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d930d640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 0x7f63d409d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63c8017000 tx=0x7f63c8004730 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c800f040 con 0x7f63d4126b70 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 10 monclient: dump: 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:27.905 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9412 (secure 0 0 0) 0x7f63c8004260 con 0x7f63d4126b70 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 msgr2=0x7f63d409d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 0x7f63d409d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63c8017000 tx=0x7f63c8004730 comp rx=0 tx=0).stop 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 msgr2=0x7f63d409d3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63d27fc640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d4126b70 0x7f63d409d3f0 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f63c8017000 tx=0x7f63c8004730 comp rx=0 tx=0).stop 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 175503, 2024-08-19T11:14:27.907 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:27.908 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:27.909 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.910 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:27.911 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:27.912 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:27.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.919 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.921 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.926 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.929 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:27.930 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 >> v2:172.21.15.135:6800/726754104 conn(0x7f63c003ea80 msgr2=0x7f63c0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 --2- 172.21.15.71:0/2933764379 >> v2:172.21.15.135:6800/726754104 conn(0x7f63c003ea80 0x7f63c0040f40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009e50 tx=0x7f63c4009000 comp rx=0 tx=0).stop 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 10 monclient: shutdown 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 msgr2=0x7f63d41ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 --2- 172.21.15.71:0/2933764379 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d40a47c0 0x7f63d41ce780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00b550 tx=0x7f63cc00ba10 comp rx=0 tx=0).stop 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63da30f640 1 -- 172.21.15.71:0/2933764379 reap_dead start 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63da30f640 1 -- 172.21.15.71:0/2933764379 reap_dead start 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 shutdown_connections 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 >> 172.21.15.71:0/2933764379 conn(0x7f63d40a9470 msgr2=0x7f63d409c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:27.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 shutdown_connections 2024-08-19T11:14:27.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:27.889+0000 7f63dbd72640 1 -- 172.21.15.71:0/2933764379 wait complete. 2024-08-19T11:14:27.933 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:27.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-08-19T11:14:27.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.030+0000 7f8587fff640 10 monclient: get_monmap_and_config 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.030+0000 7f8587fff640 10 monclient: build_initial_monmap 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.030+0000 7f8587fff640 10 monclient: monmap: 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:28.032275+0000 2024-08-19T11:14:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:28.032275+0000 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 Processor -- start 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 -- start start 2024-08-19T11:14:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient: init 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient: _add_conns ranks=[7,1,6,8,10,4,9,5,0,2,3] 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f85880a66d0 0x7f85880a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): picked mon.noname-i con 0x7f85880a66d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f85880a6ff0 addr v1:172.21.15.135:6789/0 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 0x7f8588139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): picked mon.noname-d con 0x7f85880a73d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85880a84f0 con 0x7f85880a6ff0 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f85880a2ec0 con 0x7f85880a73d0 2024-08-19T11:14:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f85880a5570 con 0x7f85880a66d0 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8587fff640 10 monclient(hunting): authenticate will time out at 926.073758s 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8586ffd640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f85880a66d0 msgr2=0x7f85880a6ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 0x7f8588139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f8586ffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f85880a66d0 0x7f85880a6ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 0x7f8588139ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:53854/0 (socket says 172.21.15.71:53854) 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 1 -- 172.21.15.71:0/3775444532 learned_addr learned my addr 172.21.15.71:0/3775444532 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 10 monclient(hunting): get_auth_request con 0x7f85880a73d0 auth_method 0 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.031+0000 7f85877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 10 monclient(hunting): handle_auth_done global_id 25071 payload 274 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 1 -- 172.21.15.71:0/3775444532 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f85880a66d0 msgr2=0x7f85880a6ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 1 --2- 172.21.15.71:0/3775444532 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f85880a66d0 0x7f85880a6ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 1 -- 172.21.15.71:0/3775444532 >> v1:172.21.15.135:6789/0 conn(0x7f85880a6ff0 legacy=0x7f8588139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 1 monclient: found mon.noname-d 2024-08-19T11:14:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.032+0000 7f85877fe640 1 -- 172.21.15.71:0/3775444532 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85880a4d10 con 0x7f85880a73d0 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.034+0000 7f85877fe640 1 -- 172.21.15.71:0/3775444532 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 msgr2=0x7f8588139ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.034+0000 7f85877fe640 1 --2- 172.21.15.71:0/3775444532 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 0x7f8588139ba0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8580009e80 tx=0x7f858002a5f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ef6ae957ea534328 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 1 -- 172.21.15.71:0/3775444532 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8580036070 con 0x7f85880a73d0 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: dump: 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.045 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 1 -- 172.21.15.71:0/3775444532 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580007a70 con 0x7f85880a73d0 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 5 monclient: authenticate success, global_id 25071 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 1 -- 172.21.15.71:0/3775444532 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8580007c60 con 0x7f85880a73d0 2024-08-19T11:14:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 4 set_mon_vals no callback set 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8585ffb640 10 monclient: dump: 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 10 monclient: shutdown 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 -- 172.21.15.71:0/3775444532 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 msgr2=0x7f8588139ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 --2- 172.21.15.71:0/3775444532 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 0x7f8588139ba0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8580009e80 tx=0x7f858002a5f0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 -- 172.21.15.71:0/3775444532 shutdown_connections 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 --2- 172.21.15.71:0/3775444532 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f85880a73d0 0x7f8588139ba0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 --2- 172.21.15.71:0/3775444532 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f85880a66d0 0x7f85880a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 -- 172.21.15.71:0/3775444532 >> 172.21.15.71:0/3775444532 conn(0x7f85880abcd0 msgr2=0x7f85880ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 -- 172.21.15.71:0/3775444532 shutdown_connections 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.035+0000 7f8587fff640 1 -- 172.21.15.71:0/3775444532 wait complete. 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.036+0000 7f8587fff640 10 monclient: build_initial_monmap 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.036+0000 7f8587fff640 10 monclient: monmap: 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.036+0000 7f8587fff640 1 Processor -- start 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.036+0000 7f8587fff640 1 -- start start 2024-08-19T11:14:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.036+0000 7f8587fff640 10 monclient: init 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient: _add_conns ranks=[8,2,1,7,0,5,4,6,3] 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f85880a66d0 0x7f85881ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): picked mon.noname-e con 0x7f85880a66d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 0x7f85881398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): picked mon.noname-b con 0x7f85880a6ff0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85880a73d0 0x7f8588139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): picked mon.noname-f con 0x7f85880a73d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8586ffd640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f85880a66d0 msgr2=0x7f85881ce110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85880a33d0 con 0x7f85880a73d0 2024-08-19T11:14:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85880644e0 con 0x7f85880a6ff0 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f85880a81e0 con 0x7f85880a66d0 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8586ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f85880a66d0 0x7f85881ce110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f8587fff640 10 monclient(hunting): authenticate will time out at 926.079345s 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 0x7f85881398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 0x7f85881398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:57494/0 (socket says 172.21.15.71:57494) 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 -- 172.21.15.71:0/2022180736 learned_addr learned my addr 172.21.15.71:0/2022180736 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): get_auth_request con 0x7f85880a6ff0 auth_method 0 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85880a73d0 0x7f8588139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): get_auth_request con 0x7f85880a73d0 auth_method 0 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient(hunting): handle_auth_done global_id 5852 payload 824 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f85880a66d0 msgr2=0x7f85881ce110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f85880a66d0 0x7f85881ce110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85880a73d0 msgr2=0x7f8588139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85880a73d0 0x7f8588139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient: _finish_hunting 0 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 monclient: found mon.noname-b 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:14:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.037+0000 7f85867fc640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85881255e0 con 0x7f85880a6ff0 2024-08-19T11:14:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.039+0000 7f85867fc640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 msgr2=0x7f85881398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.039+0000 7f85867fc640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 0x7f85881398a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c430 tx=0x7f857c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f857c011c10 con 0x7f85880a6ff0 2024-08-19T11:14:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:14:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: dump: 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c017070 con 0x7f85880a6ff0 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 5 monclient: authenticate success, global_id 5852 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 10 monclient: _renew_subs 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85880ab660 con 0x7f85880a6ff0 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f857c011dd0 con 0x7f85880a6ff0 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f856f7fe640 10 monclient: dump: 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f85857fa640 4 set_mon_vals no callback set 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 10 monclient: _renew_subs 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8588126ca0 con 0x7f85880a6ff0 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.040+0000 7f8587fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8587fff640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 0x7f8588123840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8588076c60 con 0x7f8588123460 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f857c0117a0 con 0x7f85880a6ff0 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 0x7f8588123840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient: get_auth_request con 0x7f8588123460 auth_method 0 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f856f7fe640 1 --2- 172.21.15.71:0/2022180736 >> v2:172.21.15.135:6800/726754104 conn(0x7f857403eab0 0x7f8574040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(118..118 src has 1..118) ==== 3898+0+0 (secure 0 0 0) 0x7f857c051a20 con 0x7f85880a6ff0 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 10 monclient(hunting): handle_auth_done global_id 5464 payload 824 2024-08-19T11:14:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f8586ffd640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85880a2670 con 0x7f8588123460 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f85877fe640 1 --2- 172.21.15.71:0/2022180736 >> v2:172.21.15.135:6800/726754104 conn(0x7f857403eab0 0x7f8574040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.041+0000 7f85877fe640 10 monclient: get_auth_request con 0x7f857403eab0 auth_method 0 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.043+0000 7f8586ffd640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 msgr2=0x7f8588123840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.043+0000 7f8586ffd640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 0x7f8588123840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f857800b450 tx=0x7f857800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.043+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f85780054e0 con 0x7f8588123460 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 10 monclient: dump: 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f85877fe640 1 --2- 172.21.15.71:0/2022180736 >> v2:172.21.15.135:6800/726754104 conn(0x7f857403eab0 0x7f8574040f70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8580009e80 tx=0x7f8580009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8578015070 con 0x7f8588123460 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 msgr2=0x7f8588123840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 0x7f8588123840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f857800b450 tx=0x7f857800b910 comp rx=0 tx=0).stop 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 msgr2=0x7f8588123840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.044+0000 7f856f7fe640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123460 0x7f8588123840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8587fff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8587fff640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 0x7f858809e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8587fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f858806d260 con 0x7f8588123d80 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 0x7f858809e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient: get_auth_request con 0x7f8588123d80 auth_method 0 2024-08-19T11:14:28.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 10 monclient(hunting): handle_auth_done global_id 5473 payload 824 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.050+0000 7f8586ffd640 1 -- 172.21.15.71:0/2022180736 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85880a6ab0 con 0x7f8588123d80 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8586ffd640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 msgr2=0x7f858809e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8586ffd640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 0x7f858809e7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f857800b450 tx=0x7f85780059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8578010870 con 0x7f8588123d80 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 10 monclient: dump: 2024-08-19T11:14:28.068 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.069 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9412 (secure 0 0 0) 0x7f8578010400 con 0x7f8588123d80 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 msgr2=0x7f858809e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 0x7f858809e7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f857800b450 tx=0x7f85780059d0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 msgr2=0x7f858809e7a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:28.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f856f7fe640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8588123d80 0x7f858809e7a0 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f857800b450 tx=0x7f85780059d0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 264893, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:28.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.095 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:28.095 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 >> v2:172.21.15.135:6800/726754104 conn(0x7f857403eab0 msgr2=0x7f8574040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 --2- 172.21.15.71:0/2022180736 >> v2:172.21.15.135:6800/726754104 conn(0x7f857403eab0 0x7f8574040f70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8580009e80 tx=0x7f8580009000 comp rx=0 tx=0).stop 2024-08-19T11:14:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 10 monclient: shutdown 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 msgr2=0x7f85881398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 --2- 172.21.15.71:0/2022180736 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85880a6ff0 0x7f85881398a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c430 tx=0x7f857c00c8f0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f85877fe640 1 -- 172.21.15.71:0/2022180736 reap_dead start 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f85877fe640 1 -- 172.21.15.71:0/2022180736 reap_dead start 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 shutdown_connections 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 >> 172.21.15.71:0/2022180736 conn(0x7f85880abcd0 msgr2=0x7f85881c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 shutdown_connections 2024-08-19T11:14:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.053+0000 7f8587fff640 1 -- 172.21.15.71:0/2022180736 wait complete. 2024-08-19T11:14:28.097 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:28.098 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-08-19T11:14:28.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:14:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.194+0000 7f9994ce5640 10 monclient: get_monmap_and_config 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.194+0000 7f9994ce5640 10 monclient: build_initial_monmap 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.194+0000 7f9994ce5640 10 monclient: monmap: 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:28.196460+0000 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:28.196460+0000 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:28.198 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.195+0000 7f9994ce5640 1 Processor -- start 2024-08-19T11:14:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.195+0000 7f9994ce5640 1 -- start start 2024-08-19T11:14:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.195+0000 7f9994ce5640 10 monclient: init 2024-08-19T11:14:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient: _add_conns ranks=[5,0,1,8,3,6,2,4,7,10,9] 2024-08-19T11:14:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 0x7f99900a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient(hunting): picked mon.noname-h con 0x7f99900a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f99900a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f99900a7270 addr v1:172.21.15.135:6789/0 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99900a6380 con 0x7f99900a57c0 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999013a530 con 0x7f99900a7270 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f99900a5020 con 0x7f99900a6950 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f9994ce5640 10 monclient(hunting): authenticate will time out at 926.238123s 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998dd9b640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f99900a57c0 0x7f9990139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50316/0 (socket says 172.21.15.71:50316) 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998dd9b640 1 -- 172.21.15.71:0/3428991279 learned_addr learned my addr 172.21.15.71:0/3428991279 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 1 --2- 172.21.15.71:0/3428991279 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 0x7f99900a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): get_auth_request con 0x7f99900a6950 auth_method 0 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient(hunting): handle_auth_done global_id 44321 payload 274 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 1 -- 172.21.15.71:0/3428991279 >> v1:172.21.15.135:6789/0 conn(0x7f99900a7270 legacy=0x7f9990139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 1 -- 172.21.15.71:0/3428991279 >> v1:172.21.15.71:6789/0 conn(0x7f99900a57c0 legacy=0x7f9990139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 1 monclient: found mon.noname-h 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:14:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.196+0000 7f998e59c640 1 -- 172.21.15.71:0/3428991279 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99900a3650 con 0x7f99900a6950 2024-08-19T11:14:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.199+0000 7f998e59c640 1 -- 172.21.15.71:0/3428991279 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 msgr2=0x7f99900a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.199+0000 7f998e59c640 1 --2- 172.21.15.71:0/3428991279 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 0x7f99900a6d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99880097d0 tx=0x7f9988029fb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=b62b8dc57225d3a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.199+0000 7f998d59a640 1 -- 172.21.15.71:0/3428991279 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9988037070 con 0x7f99900a6950 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: dump: 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: _finish_auth 0 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 5 monclient: authenticate success, global_id 44321 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 1 -- 172.21.15.71:0/3428991279 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998802adf0 con 0x7f99900a6950 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 4 set_mon_vals no callback set 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 1 -- 172.21.15.71:0/3428991279 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9988030c20 con 0x7f99900a6950 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f998d59a640 10 monclient: dump: 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 10 monclient: shutdown 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 -- 172.21.15.71:0/3428991279 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 msgr2=0x7f99900a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 --2- 172.21.15.71:0/3428991279 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 0x7f99900a6d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99880097d0 tx=0x7f9988029fb0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 -- 172.21.15.71:0/3428991279 shutdown_connections 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 --2- 172.21.15.71:0/3428991279 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f99900a6950 0x7f99900a6d30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 -- 172.21.15.71:0/3428991279 >> 172.21.15.71:0/3428991279 conn(0x7f99900abf50 msgr2=0x7f99900ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 -- 172.21.15.71:0/3428991279 shutdown_connections 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.200+0000 7f9994ce5640 1 -- 172.21.15.71:0/3428991279 wait complete. 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.201+0000 7f9994ce5640 10 monclient: build_initial_monmap 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.201+0000 7f9994ce5640 10 monclient: monmap: 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.201+0000 7f9994ce5640 1 Processor -- start 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 -- start start 2024-08-19T11:14:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient: init 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient: _add_conns ranks=[1,8,3,6,0,4,5,2,7] 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 0x7f9990125f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): picked mon.noname-f con 0x7f99900a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f99900a6950 0x7f9990126440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): picked mon.noname-e con 0x7f99900a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99900a7270 0x7f9990126980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): picked mon.noname-g con 0x7f99900a7270 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99900a84c0 con 0x7f99900a57c0 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f99900a7d40 con 0x7f99900a7270 2024-08-19T11:14:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f99900a76c0 con 0x7f99900a6950 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f9994ce5640 10 monclient(hunting): authenticate will time out at 926.244449s 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998dd9b640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f99900a6950 msgr2=0x7f9990126440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998dd9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f99900a6950 0x7f9990126440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 0x7f9990125f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99900a7270 0x7f9990126980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 0x7f9990125f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:35000/0 (socket says 172.21.15.71:35000) 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 -- 172.21.15.71:0/3471838648 learned_addr learned my addr 172.21.15.71:0/3471838648 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): get_auth_request con 0x7f99900a57c0 auth_method 0 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): get_auth_request con 0x7f99900a7270 auth_method 0 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient(hunting): handle_auth_done global_id 5482 payload 824 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f99900a6950 msgr2=0x7f9990126440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f99900a6950 0x7f9990126440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99900a7270 msgr2=0x7f9990126980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99900a7270 0x7f9990126980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 1 monclient: found mon.noname-f 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.202+0000 7f998e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.203+0000 7f998e59c640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.203+0000 7f998e59c640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9990129900 con 0x7f99900a57c0 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.203+0000 7f998ed9d640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99900a7270 0x7f9990126980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f998e59c640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 msgr2=0x7f9990125f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f998e59c640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 0x7f9990125f00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9988035040 tx=0x7f99880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9988041030 con 0x7f99900a57c0 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:14:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: dump: 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: _finish_auth 0 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9988003bf0 con 0x7f99900a57c0 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 5 monclient: authenticate success, global_id 5482 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 10 monclient: _renew_subs 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999012a090 con 0x7f99900a57c0 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9988037040 con 0x7f99900a57c0 2024-08-19T11:14:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9986ffd640 10 monclient: dump: 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f998cd99640 4 set_mon_vals no callback set 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 10 monclient: _renew_subs 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.205+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99900a24f0 con 0x7f99900a57c0 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f9994ce5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f9994ce5640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 0x7f99901ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f9994ce5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f99900a1fc0 con 0x7f99901ce940 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 0x7f99901ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient: get_auth_request con 0x7f99901ce940 auth_method 0 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9988044070 con 0x7f99900a57c0 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 10 monclient(hunting): handle_auth_done global_id 44247 payload 824 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f998dd9b640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99900a8700 con 0x7f99901ce940 2024-08-19T11:14:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.206+0000 7f9986ffd640 1 --2- 172.21.15.71:0/3471838648 >> v2:172.21.15.135:6800/726754104 conn(0x7f997003eae0 0x7f9970040fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.207+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 3898+0+0 (secure 0 0 0) 0x7f9988042070 con 0x7f99900a57c0 2024-08-19T11:14:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.207+0000 7f998ed9d640 1 --2- 172.21.15.71:0/3471838648 >> v2:172.21.15.135:6800/726754104 conn(0x7f997003eae0 0x7f9970040fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.207+0000 7f998ed9d640 10 monclient: get_auth_request con 0x7f997003eae0 auth_method 0 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f998dd9b640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 msgr2=0x7f99901ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f998dd9b640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 0x7f99901ced20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9990127ef0 tx=0x7f997800c8e0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9978017070 con 0x7f99901ce940 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 10 monclient: dump: 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.228 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9978005d70 con 0x7f99901ce940 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:28.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 msgr2=0x7f99901ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 0x7f99901ced20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9990127ef0 tx=0x7f997800c8e0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 msgr2=0x7f99901ced20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f9986ffd640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901ce940 0x7f99901ced20 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9990127ef0 tx=0x7f997800c8e0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.209+0000 7f998ed9d640 1 --2- 172.21.15.71:0/3471838648 >> v2:172.21.15.135:6800/726754104 conn(0x7f997003eae0 0x7f9970040fa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f998000b7a0 tx=0x7f998000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f9994ce5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f9994ce5640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 0x7f99901225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f9994ce5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9990076c60 con 0x7f99901cf260 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 0x7f99901225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient: get_auth_request con 0x7f99901cf260 auth_method 0 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 10 monclient(hunting): handle_auth_done global_id 44256 payload 824 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.216+0000 7f998dd9b640 1 -- 172.21.15.71:0/3471838648 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99900a9460 con 0x7f99901cf260 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.218+0000 7f998dd9b640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 msgr2=0x7f99901225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.218+0000 7f998dd9b640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 0x7f99901225a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9978011000 tx=0x7f99780049d0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.218+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9978017030 con 0x7f99901cf260 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.218+0000 7f9986ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.218+0000 7f9986ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.218+0000 7f9986ffd640 10 monclient: dump: 2024-08-19T11:14:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9244 (secure 0 0 0) 0x7f9978019a40 con 0x7f99901cf260 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 msgr2=0x7f99901225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 0x7f99901225a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9978011000 tx=0x7f99780049d0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 msgr2=0x7f99901225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9986ffd640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f99901cf260 0x7f99901225a0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9978011000 tx=0x7f99780049d0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 37242, 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:28.257 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 >> v2:172.21.15.135:6800/726754104 conn(0x7f997003eae0 msgr2=0x7f9970040fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 --2- 172.21.15.71:0/3471838648 >> v2:172.21.15.135:6800/726754104 conn(0x7f997003eae0 0x7f9970040fa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f998000b7a0 tx=0x7f998000d040 comp rx=0 tx=0).stop 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 10 monclient: shutdown 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 msgr2=0x7f9990125f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 --2- 172.21.15.71:0/3471838648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99900a57c0 0x7f9990125f00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9988035040 tx=0x7f99880046c0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f998ed9d640 1 -- 172.21.15.71:0/3471838648 reap_dead start 2024-08-19T11:14:28.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f998ed9d640 1 -- 172.21.15.71:0/3471838648 reap_dead start 2024-08-19T11:14:28.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 shutdown_connections 2024-08-19T11:14:28.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 >> 172.21.15.71:0/3471838648 conn(0x7f99900abf50 msgr2=0x7f9990139ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:28.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 shutdown_connections 2024-08-19T11:14:28.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.219+0000 7f9994ce5640 1 -- 172.21.15.71:0/3471838648 wait complete. 2024-08-19T11:14:28.260 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:28.260 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-08-19T11:14:28.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:14:28.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.358+0000 7f47d1458640 10 monclient: get_monmap_and_config 2024-08-19T11:14:28.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.358+0000 7f47d1458640 10 monclient: build_initial_monmap 2024-08-19T11:14:28.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.358+0000 7f47d1458640 10 monclient: monmap: 2024-08-19T11:14:28.360 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:14:28.359887+0000 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:14:28.359887+0000 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.358+0000 7f47d1458640 1 Processor -- start 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.358+0000 7f47d1458640 1 -- start start 2024-08-19T11:14:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.358+0000 7f47d1458640 10 monclient: init 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient: _add_conns ranks=[6,4,8,9,3,0,7,5,2,1,10] 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 0x7f47cc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): picked mon.noname-d con 0x7f47cc0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47cc0a57c0 0x7f47cc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): picked mon.noname-c con 0x7f47cc0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc139710 0x7f47cc139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): picked mon.noname-e con 0x7f47cc139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f47cc0a5020 con 0x7f47cc0a57c0 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f47cc0a77b0 con 0x7f47cc0a6950 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f47cc0a7d40 con 0x7f47cc139710 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47d1458640 10 monclient(hunting): authenticate will time out at 926.401422s 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47cb7fe640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc139710 msgr2=0x7f47cc139b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47cb7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc139710 0x7f47cc139b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 0x7f47cc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47cc0a57c0 0x7f47cc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 0x7f47cc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:53856/0 (socket says 172.21.15.71:53856) 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 -- 172.21.15.71:0/2047279648 learned_addr learned my addr 172.21.15.71:0/2047279648 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:28.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): get_auth_request con 0x7f47cc0a6950 auth_method 0 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): get_auth_request con 0x7f47cc0a57c0 auth_method 0 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient(hunting): handle_auth_done global_id 25080 payload 274 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 -- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc139710 msgr2=0x7f47cc139b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc139710 0x7f47cc139b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 -- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47cc0a57c0 msgr2=0x7f47cc0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47cc0a57c0 0x7f47cc0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient: _finish_hunting 0 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 monclient: found mon.noname-d 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47caffd640 1 -- 172.21.15.71:0/2047279648 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc0a6380 con 0x7f47cc0a6950 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.359+0000 7f47ca7fc640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47cc0a57c0 0x7f47cc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47caffd640 1 -- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 msgr2=0x7f47cc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47caffd640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 0x7f47cc0a6d30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009eb0 tx=0x7f47c402a580 comp rx=0 tx=0).ready entity=mon.6 client_cookie=81db1f882a7c060e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 1 -- 172.21.15.71:0/2047279648 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47c4036070 con 0x7f47cc0a6950 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: dump: 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47d1458640 5 monclient: authenticate success, global_id 25080 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47d1458640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 1 -- 172.21.15.71:0/2047279648 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c4007a70 con 0x7f47cc0a6950 2024-08-19T11:14:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47d1458640 10 monclient: get_monmap_and_config success 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47d1458640 4 set_mon_vals no callback set 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 1 -- 172.21.15.71:0/2047279648 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47c4007c60 con 0x7f47cc0a6950 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.362+0000 7f47c9ffb640 10 monclient: dump: 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 10 monclient: shutdown 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 -- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 msgr2=0x7f47cc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 0x7f47cc0a6d30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009eb0 tx=0x7f47c402a580 comp rx=0 tx=0).stop 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 -- 172.21.15.71:0/2047279648 shutdown_connections 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc139710 0x7f47cc139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47cc0a57c0 0x7f47cc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 --2- 172.21.15.71:0/2047279648 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47cc0a6950 0x7f47cc0a6d30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 -- 172.21.15.71:0/2047279648 >> 172.21.15.71:0/2047279648 conn(0x7f47cc0abf50 msgr2=0x7f47cc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 -- 172.21.15.71:0/2047279648 shutdown_connections 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 1 -- 172.21.15.71:0/2047279648 wait complete. 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 10 monclient: build_initial_monmap 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.363+0000 7f47d1458640 10 monclient: monmap: 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:14:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 Processor -- start 2024-08-19T11:14:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 -- start start 2024-08-19T11:14:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient: init 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient: _reopen_session rank -1 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient: _add_conns ranks=[8,7,0,2,1,5,4,3,6] 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc0a57c0 0x7f47cc1ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): picked mon.noname-e con 0x7f47cc0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47cc0a6950 0x7f47cc138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): picked mon.noname-i con 0x7f47cc0a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 0x7f47cc1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): picked mon.noname-a con 0x7f47cc139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:14:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0a84c0 con 0x7f47cc139710 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f47cc0a3650 con 0x7f47cc0a6950 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f47cc0a8700 con 0x7f47cc0a57c0 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): _renew_subs 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47d1458640 10 monclient(hunting): authenticate will time out at 926.406961s 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47caffd640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc0a57c0 msgr2=0x7f47cc1ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.364+0000 7f47caffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc0a57c0 0x7f47cc1ce5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47ca7fc640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47cc0a6950 msgr2=0x7f47cc138b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47ca7fc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47cc0a6950 0x7f47cc138b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 0x7f47cc1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 0x7f47cc1225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59394/0 (socket says 172.21.15.71:59394) 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 learned_addr learned my addr 172.21.15.71:0/1061546251 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): get_auth_request con 0x7f47cc139710 auth_method 0 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient(hunting): handle_auth_done global_id 34704 payload 824 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc0a57c0 msgr2=0x7f47cc1ce5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f47cc0a57c0 0x7f47cc1ce5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47cc0a6950 msgr2=0x7f47cc138b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f47cc0a6950 0x7f47cc138b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 monclient: found mon.noname-a 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.365+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc123fc0 con 0x7f47cc139710 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 msgr2=0x7f47cc1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47cb7fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 0x7f47cc1225a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b440 tx=0x7f47bc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47bc017070 con 0x7f47cc139710 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:14:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: dump: 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: _finish_auth 0 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 5 monclient: authenticate success, global_id 34704 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc003e00 con 0x7f47cc139710 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 10 monclient: _renew_subs 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc0a2580 con 0x7f47cc139710 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:14:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47bc00f300 con 0x7f47cc139710 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c97fa640 4 set_mon_vals no callback set 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47c37fe640 10 monclient: dump: 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 10 monclient: _renew_subs 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.367+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc139df0 con 0x7f47cc139710 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47d1458640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47d1458640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 0x7f47cc122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f47cc076c60 con 0x7f47cc1390d0 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f47bc0060d0 con 0x7f47cc139710 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47c37fe640 1 --2- 172.21.15.71:0/1061546251 >> v2:172.21.15.135:6800/726754104 conn(0x7f47ac03ea80 0x7f47ac040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47caffd640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 0x7f47cc122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47caffd640 10 monclient: get_auth_request con 0x7f47cc1390d0 auth_method 0 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.368+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 3898+0+0 (secure 0 0 0) 0x7f47bc050e10 con 0x7f47cc139710 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47ca7fc640 1 --2- 172.21.15.71:0/1061546251 >> v2:172.21.15.135:6800/726754104 conn(0x7f47ac03ea80 0x7f47ac040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47ca7fc640 10 monclient: get_auth_request con 0x7f47ac03ea80 auth_method 0 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47caffd640 10 monclient(hunting): handle_auth_done global_id 44330 payload 824 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.369+0000 7f47caffd640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47cc0a6d30 con 0x7f47cc1390d0 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47caffd640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 msgr2=0x7f47cc122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47caffd640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 0x7f47cc122ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47c4033000 tx=0x7f47c4004a40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47ca7fc640 1 --2- 172.21.15.71:0/1061546251 >> v2:172.21.15.135:6800/726754104 conn(0x7f47ac03ea80 0x7f47ac040f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f47cc123c30 tx=0x7f47b4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47c4036030 con 0x7f47cc1390d0 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47c37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.371+0000 7f47c37fe640 10 monclient: dump: 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f47c4037040 con 0x7f47cc1390d0 2024-08-19T11:14:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 msgr2=0x7f47cc122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 0x7f47cc122ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47c4033000 tx=0x7f47c4004a40 comp rx=0 tx=0).stop 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 msgr2=0x7f47cc122ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.372+0000 7f47c37fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc1390d0 0x7f47cc122ae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47d1458640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47d1458640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 0x7f47cc09da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47d1458640 10 monclient(hunting): start opening mon connection 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f47cc123430 con 0x7f47cc123020 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 0x7f47cc09da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient: get_auth_request con 0x7f47cc123020 auth_method 0 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:14:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:14:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:14:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:14:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.378+0000 7f47caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:14:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.379+0000 7f47caffd640 10 monclient(hunting): handle_auth_done global_id 44339 payload 824 2024-08-19T11:14:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.379+0000 7f47caffd640 1 -- 172.21.15.71:0/1061546251 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f47cc125e80 con 0x7f47cc123020 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.381+0000 7f47caffd640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 msgr2=0x7f47cc09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.381+0000 7f47caffd640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 0x7f47cc09da00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e20 tx=0x7f47c4009810 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.381+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47c4036070 con 0x7f47cc123020 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.381+0000 7f47c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.381+0000 7f47c37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.381+0000 7f47c37fe640 10 monclient: dump: 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:14:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9244 (secure 0 0 0) 0x7f47c4048070 con 0x7f47cc123020 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 msgr2=0x7f47cc09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 0x7f47cc09da00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e20 tx=0x7f47c4009810 comp rx=0 tx=0).stop 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 msgr2=0x7f47cc09da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47c37fe640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47cc123020 0x7f47cc09da00 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e20 tx=0x7f47c4009810 comp rx=0 tx=0).stop 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:14:28.397 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 80, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 37405, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: 6 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:28.398 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.399 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.400 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:14:28.401 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:14:28.402 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:14:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:14:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:14:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:14:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:14:28.420 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:14:28.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:14:28.420 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:14:28.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:14:28.420 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:14:28.420 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:14:28.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 >> v2:172.21.15.135:6800/726754104 conn(0x7f47ac03ea80 msgr2=0x7f47ac040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 --2- 172.21.15.71:0/1061546251 >> v2:172.21.15.135:6800/726754104 conn(0x7f47ac03ea80 0x7f47ac040f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f47cc123c30 tx=0x7f47b4009190 comp rx=0 tx=0).stop 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 10 monclient: shutdown 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 msgr2=0x7f47cc1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 --2- 172.21.15.71:0/1061546251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47cc139710 0x7f47cc1225a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b440 tx=0x7f47bc00b900 comp rx=0 tx=0).stop 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 reap_dead start 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47cb7fe640 1 -- 172.21.15.71:0/1061546251 reap_dead start 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 shutdown_connections 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 >> 172.21.15.71:0/1061546251 conn(0x7f47cc0abf50 msgr2=0x7f47cc1c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 shutdown_connections 2024-08-19T11:14:28.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:14:28.382+0000 7f47d1458640 1 -- 172.21.15.71:0/1061546251 wait complete. 2024-08-19T11:14:28.423 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-08-19T11:14:28.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:14:29.036 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: starting. 2024-08-19T11:14:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25681 2024-08-19T11:14:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: created object 0... 2024-08-19T11:14:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: created object 25... 2024-08-19T11:14:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: created object 49... 2024-08-19T11:14:29.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: finishing. 2024-08-19T11:14:29.038 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25716]: shutting down. 2024-08-19T11:14:29.073 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:29.073 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25718]: starting. 2024-08-19T11:14:29.073 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25718]: listing objects. 2024-08-19T11:14:29.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25718]: listed object 0... 2024-08-19T11:14:29.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25718]: listed object 25... 2024-08-19T11:14:29.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25718]: saw 50 objects 2024-08-19T11:14:29.074 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25718]: shutting down. 2024-08-19T11:14:29.930 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:29.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25717]: starting. 2024-08-19T11:14:29.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25717]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25681 2024-08-19T11:14:29.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25717]: shutting down. 2024-08-19T11:14:29.932 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:29.932 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:29.932 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:14:29.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:14:32.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: starting. 2024-08-19T11:14:32.041 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25784 2024-08-19T11:14:32.041 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: created object 0... 2024-08-19T11:14:32.041 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: created object 25... 2024-08-19T11:14:32.041 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: created object 49... 2024-08-19T11:14:32.041 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: finishing. 2024-08-19T11:14:32.041 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25785]: shutting down. 2024-08-19T11:14:32.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25786]: starting. 2024-08-19T11:14:32.959 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25786]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25784 2024-08-19T11:14:32.959 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25786]: shutting down. 2024-08-19T11:14:34.631 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:34.631 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: starting. 2024-08-19T11:14:34.632 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25784 2024-08-19T11:14:34.632 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: created object 0... 2024-08-19T11:14:34.632 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: created object 25... 2024-08-19T11:14:34.632 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: created object 49... 2024-08-19T11:14:34.632 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: finishing. 2024-08-19T11:14:34.632 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25819]: shutting down. 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25821]: starting. 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25821]: listing objects. 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25821]: listed object 0... 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25821]: listed object 25... 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25821]: saw 50 objects 2024-08-19T11:14:34.669 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25821]: shutting down. 2024-08-19T11:14:35.913 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:35.913 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25820]: starting. 2024-08-19T11:14:35.913 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25820]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25784 2024-08-19T11:14:35.913 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25820]: shutting down. 2024-08-19T11:14:35.914 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:35.914 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:35.914 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:14:35.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:14:38.247 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: starting. 2024-08-19T11:14:38.247 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25887 2024-08-19T11:14:38.247 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: created object 0... 2024-08-19T11:14:38.248 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: created object 25... 2024-08-19T11:14:38.248 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: created object 49... 2024-08-19T11:14:38.248 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: finishing. 2024-08-19T11:14:38.248 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25888]: shutting down. 2024-08-19T11:14:39.156 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25889]: starting. 2024-08-19T11:14:39.156 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25889]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25887 2024-08-19T11:14:39.156 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25889]: shutting down. 2024-08-19T11:14:41.265 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: starting. 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25887 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: created object 0... 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: created object 25... 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: created object 49... 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: finishing. 2024-08-19T11:14:41.266 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[25922]: shutting down. 2024-08-19T11:14:41.304 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:41.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25924]: starting. 2024-08-19T11:14:41.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25924]: listing objects. 2024-08-19T11:14:41.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25924]: listed object 0... 2024-08-19T11:14:41.305 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25924]: listed object 25... 2024-08-19T11:14:41.305 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25924]: saw 50 objects 2024-08-19T11:14:41.305 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[25924]: shutting down. 2024-08-19T11:14:42.228 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:42.228 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25923]: starting. 2024-08-19T11:14:42.228 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25923]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25887 2024-08-19T11:14:42.228 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[25923]: shutting down. 2024-08-19T11:14:42.229 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:42.229 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:42.229 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:14:42.233 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:14:44.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: starting. 2024-08-19T11:14:44.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25990 2024-08-19T11:14:44.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: created object 0... 2024-08-19T11:14:44.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: created object 25... 2024-08-19T11:14:44.353 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: created object 49... 2024-08-19T11:14:44.354 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: finishing. 2024-08-19T11:14:44.354 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[25991]: shutting down. 2024-08-19T11:14:44.662 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25992]: starting. 2024-08-19T11:14:44.663 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25992]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25990 2024-08-19T11:14:44.663 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[25992]: shutting down. 2024-08-19T11:14:47.030 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:47.030 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: starting. 2024-08-19T11:14:47.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-25990 2024-08-19T11:14:47.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: created object 0... 2024-08-19T11:14:47.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: created object 25... 2024-08-19T11:14:47.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: created object 49... 2024-08-19T11:14:47.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: finishing. 2024-08-19T11:14:47.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26025]: shutting down. 2024-08-19T11:14:47.068 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:47.068 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26027]: starting. 2024-08-19T11:14:47.069 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26027]: listing objects. 2024-08-19T11:14:47.069 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26027]: listed object 0... 2024-08-19T11:14:47.069 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26027]: listed object 25... 2024-08-19T11:14:47.069 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26027]: saw 50 objects 2024-08-19T11:14:47.069 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26027]: shutting down. 2024-08-19T11:14:47.931 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:47.931 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26026]: starting. 2024-08-19T11:14:47.931 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26026]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-25990 2024-08-19T11:14:47.931 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26026]: shutting down. 2024-08-19T11:14:47.932 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:47.932 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:14:47.932 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:14:47.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:14:48.423 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-08-19T11:14:48.424 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-19T11:14:48.424 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-19T11:14:48.427 INFO:tasks.ceph.mon.i:Started 2024-08-19T11:14:48.427 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-19T11:14:48.427 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-19T11:14:48.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-19T11:14:48.430 INFO:tasks.ceph.mon.e:Started 2024-08-19T11:14:48.430 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-08-19T11:14:48.430 INFO:tasks.ceph.mon.h:Sent signal 19 2024-08-19T11:14:48.430 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:14:55.206 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: starting. 2024-08-19T11:14:55.206 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26093 2024-08-19T11:14:55.206 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: created object 0... 2024-08-19T11:14:55.206 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: created object 25... 2024-08-19T11:14:55.206 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: created object 49... 2024-08-19T11:14:55.206 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: finishing. 2024-08-19T11:14:55.207 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26094]: shutting down. 2024-08-19T11:15:03.431 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-08-19T11:15:03.432 INFO:tasks.ceph.mon.h:Sent signal 18 2024-08-19T11:15:03.432 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:15:03.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:03.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.540+0000 7fc143456640 10 monclient: get_monmap_and_config 2024-08-19T11:15:03.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.540+0000 7fc143456640 10 monclient: build_initial_monmap 2024-08-19T11:15:03.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.540+0000 7fc143456640 10 monclient: monmap: 2024-08-19T11:15:03.541 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:03.541 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:03.541 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:03.540681+0000 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:03.540681+0000 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:03.542 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:03.543 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:03.543 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:03.543 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:03.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.540+0000 7fc143456640 1 Processor -- start 2024-08-19T11:15:03.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.540+0000 7fc143456640 1 -- start start 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.540+0000 7fc143456640 10 monclient: init 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient: _add_conns ranks=[0,9,2,7,4,5,6,10,1,3,8] 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc13c0a6a30 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): picked mon.noname-a con 0x7fc13c0a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): picked mon.noname-b con 0x7fc13c13eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:03.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13c0a4f90 con 0x7fc13c0a6a30 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc13c0a3650 con 0x7fc13c0a6e10 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc13c0a6380 con 0x7fc13c13eb10 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc143456640 10 monclient(hunting): authenticate will time out at 961.582574s 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1411f2640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc13c0a6a30 0x7fc13c0a57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45452/0 (socket says 172.21.15.71:45452) 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1411f2640 1 -- 172.21.15.71:0/3139843151 learned_addr learned my addr 172.21.15.71:0/3139843151 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 10 monclient(hunting): get_auth_request con 0x7fc13c13eb10 auth_method 0 2024-08-19T11:15:03.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 10 monclient(hunting): get_auth_request con 0x7fc13c0a6e10 auth_method 0 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:03.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:03.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:03.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.541+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:03.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.543+0000 7fc1411f2640 1 -- 172.21.15.71:0/3139843151 >> v1:172.21.15.71:6789/0 conn(0x7fc13c0a6a30 legacy=0x7fc13c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 10 monclient(hunting): get_auth_request con 0x7fc13c13eb10 auth_method 0 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 10 monclient(hunting): get_auth_request con 0x7fc13c0a6e10 auth_method 0 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:03.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:03.742+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 10 monclient(hunting): get_auth_request con 0x7fc13c13eb10 auth_method 0 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 10 monclient(hunting): get_auth_request con 0x7fc13c0a6e10 auth_method 0 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:04.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:15:04.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.142+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 10 monclient(hunting): get_auth_request con 0x7fc13c0a6e10 auth_method 0 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:04.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 10 monclient(hunting): get_auth_request con 0x7fc13c13eb10 auth_method 0 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:04.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:04.943+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:15:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.311+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251131645 0 0) 0x7fc13c0a4f90 con 0x7fc13c0a6a30 2024-08-19T11:15:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.311+0000 7fc133fff640 10 monclient(hunting): _negotiate 2024-08-19T11:15:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.311+0000 7fc133fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.311+0000 7fc133fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.311+0000 7fc133fff640 10 monclient(hunting): my global_id is 34848 2024-08-19T11:15:06.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.311+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc128003520 con 0x7fc13c0a6a30 2024-08-19T11:15:06.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2185822206 0 0) 0x7fc128003520 con 0x7fc13c0a6a30 2024-08-19T11:15:06.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 msgr2=0x7fc13c140f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:06.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc13c13eb10 0x7fc13c140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 msgr2=0x7fc13c0a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:06.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 --2- 172.21.15.71:0/3139843151 >> v2:172.21.15.71:3300/0 conn(0x7fc13c0a6e10 0x7fc13c0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c0a49d0 con 0x7fc13c0a6a30 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: _finish_auth 0 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7fc138001c10 con 0x7fc13c0a6a30 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: dump: 2024-08-19T11:15:06.317 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:06.318 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 >> v1:172.21.15.71:6789/0 conn(0x7fc13c0a6a30 legacy=0x7fc13c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient: _add_conns ranks=[4,3,0,6,7,1,2,8,5] 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 0x7fc128004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient(hunting): picked mon.c con 0x7fc128004300 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc128004f20 0x7fc1280099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 10 monclient(hunting): picked mon.g con 0x7fc128004f20 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.312+0000 7fc133fff640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc128009ef0 0x7fc12800c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 0x7fc128004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 10 monclient(hunting): picked mon.a con 0x7fc128009ef0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c0a6380 con 0x7fc128009ef0 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc12800ca80 con 0x7fc128004f20 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc12800cc30 con 0x7fc128004300 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc133fff640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): get_auth_request con 0x7fc128004300 auth_method 0 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:06.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc128009ef0 0x7fc12800c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): get_auth_request con 0x7fc128009ef0 auth_method 0 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc128004f20 0x7fc1280099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1409f1640 10 monclient(hunting): get_auth_request con 0x7fc128004f20 auth_method 0 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1409f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1409f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1409f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:06.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient(hunting): handle_auth_done global_id 34848 payload 293 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc128004f20 msgr2=0x7fc1280099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc128004f20 0x7fc1280099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc128009ef0 msgr2=0x7fc12800c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc128009ef0 0x7fc12800c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient: _finish_hunting 0 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 monclient: found mon.c 2024-08-19T11:15:06.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 1 -- 172.21.15.71:0/3139843151 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc128003520 con 0x7fc128004300 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1419f3640 1 -- 172.21.15.71:0/3139843151 reap_dead start 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient: _finish_auth 0 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 10 monclient: _check_auth_tickets 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1411f2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc143456640 5 monclient: authenticate success, global_id 34848 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc143456640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:06.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.313+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc128004f20 0x7fc1280099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:15:06.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc1411f2640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 msgr2=0x7fc128004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:06.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 0x7fc128004800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1380014d0 tx=0x7fc128005830 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8c0f577a5635541f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:06.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc138008cd0 con 0x7fc128004300 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 10 monclient: dump: 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:06.330 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc138005d40 con 0x7fc128004300 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc143456640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 1 -- 172.21.15.71:0/3139843151 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc138008540 con 0x7fc128004300 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc143456640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc143456640 4 set_mon_vals no callback set 2024-08-19T11:15:06.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.316+0000 7fc133fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc133fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc133fff640 10 monclient: dump: 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:06.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 10 monclient: shutdown 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 1 -- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 msgr2=0x7fc128004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 0x7fc128004800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1380014d0 tx=0x7fc128005830 comp rx=0 tx=0).stop 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 1 -- 172.21.15.71:0/3139843151 shutdown_connections 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 1 --2- 172.21.15.71:0/3139843151 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc128004300 0x7fc128004800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.317+0000 7fc143456640 1 -- 172.21.15.71:0/3139843151 >> 172.21.15.71:0/3139843151 conn(0x7fc13c0ac030 msgr2=0x7fc13c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.318+0000 7fc143456640 1 -- 172.21.15.71:0/3139843151 shutdown_connections 2024-08-19T11:15:06.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.318+0000 7fc143456640 1 -- 172.21.15.71:0/3139843151 wait complete. 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.318+0000 7fc143456640 10 monclient: build_initial_monmap 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.318+0000 7fc143456640 10 monclient: monmap: 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:06.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 Processor -- start 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 -- start start 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient: init 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient: _add_conns ranks=[7,6,1,4,0,5,8,2,3] 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc128004300 0x7fc13c1ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): picked mon.noname-i con 0x7fc128004300 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 0x7fc13c0a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): picked mon.noname-d con 0x7fc13c0a1d90 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc13c0a26d0 0x7fc13c09cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): picked mon.noname-f con 0x7fc13c0a26d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c0a5970 con 0x7fc13c0a26d0 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc13c0a57f0 con 0x7fc13c0a1d90 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc13c0a5af0 con 0x7fc128004300 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.319+0000 7fc143456640 10 monclient(hunting): authenticate will time out at 964.361907s 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 0x7fc13c0a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 0x7fc13c0a2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36960/0 (socket says 172.21.15.71:36960) 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 -- 172.21.15.71:0/3620570456 learned_addr learned my addr 172.21.15.71:0/3620570456 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:06.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): get_auth_request con 0x7fc13c0a1d90 auth_method 0 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1419f3640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc13c0a26d0 0x7fc13c09cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc128004300 0x7fc13c1ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1419f3640 10 monclient(hunting): get_auth_request con 0x7fc13c0a26d0 auth_method 0 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1419f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1419f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1419f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:06.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1411f2640 10 monclient(hunting): get_auth_request con 0x7fc128004300 auth_method 0 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1411f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1411f2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1411f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient(hunting): handle_auth_done global_id 25188 payload 824 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 -- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc128004300 msgr2=0x7fc13c1ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc128004300 0x7fc13c1ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 -- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc13c0a26d0 msgr2=0x7fc13c09cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc13c0a26d0 0x7fc13c09cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient: _finish_hunting 0 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 monclient: found mon.noname-d 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:06.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.320+0000 7fc1409f1640 1 -- 172.21.15.71:0/3620570456 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c09e600 con 0x7fc13c0a1d90 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc1409f1640 1 -- 172.21.15.71:0/3620570456 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 msgr2=0x7fc13c0a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc1409f1640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 0x7fc13c0a2190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0156b0 tx=0x7fc12c015b70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc12c017440 con 0x7fc13c0a1d90 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: dump: 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:06.339 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c017600 con 0x7fc13c0a1d90 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc143456640 5 monclient: authenticate success, global_id 25188 2024-08-19T11:15:06.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc12c017c20 con 0x7fc13c0a1d90 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc143456640 10 monclient: _renew_subs 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc143456640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c0a0960 con 0x7fc13c0a1d90 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc131ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.323+0000 7fc131ffb640 10 monclient: dump: 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:06.341 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.322+0000 7fc1337fe640 4 set_mon_vals no callback set 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.323+0000 7fc143456640 10 monclient: _renew_subs 2024-08-19T11:15:06.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.323+0000 7fc143456640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.323+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c09f160 con 0x7fc13c0a1d90 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc12c0177b0 con 0x7fc13c0a1d90 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc143456640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc143456640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc143456640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13c0a71f0 con 0x7fc13c0a1d90 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc131ffb640 1 --2- 172.21.15.71:0/3620570456 >> v2:172.21.15.135:6800/726754104 conn(0x7fc12003ea80 0x7fc120040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(140..140 src has 1..140) ==== 3898+0+0 (secure 0 0 0) 0x7fc12c00f040 con 0x7fc13c0a1d90 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.324+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3620570456 >> v2:172.21.15.135:6800/726754104 conn(0x7fc12003ea80 0x7fc120040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.325+0000 7fc1411f2640 10 monclient: get_auth_request con 0x7fc12003ea80 auth_method 0 2024-08-19T11:15:06.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.327+0000 7fc1411f2640 1 --2- 172.21.15.71:0/3620570456 >> v2:172.21.15.135:6800/726754104 conn(0x7fc12003ea80 0x7fc120040f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc138032000 tx=0x7fc138037040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.330+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc12c01f340 con 0x7fc13c0a1d90 2024-08-19T11:15:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.330+0000 7fc131ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:06.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.330+0000 7fc131ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:06.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.580+0000 7fc143456640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.580+0000 7fc143456640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.580+0000 7fc143456640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.580+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc13c06ca70 con 0x7fc13c0a1d90 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.580+0000 7fc131ffb640 1 -- 172.21.15.71:0/3620570456 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3186 (secure 0 0 0) 0x7fc12c0513a0 con 0x7fc13c0a1d90 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.581+0000 7fc131ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.581+0000 7fc131ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:06.583 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":90,"quorum":[0,1,2,3,4,5,6,8],"quorum_names":["a","f","b","g","c","h","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 >> v2:172.21.15.135:6800/726754104 conn(0x7fc12003ea80 msgr2=0x7fc120040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 --2- 172.21.15.71:0/3620570456 >> v2:172.21.15.135:6800/726754104 conn(0x7fc12003ea80 0x7fc120040f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc138032000 tx=0x7fc138037040 comp rx=0 tx=0).stop 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 10 monclient: shutdown 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 msgr2=0x7fc13c0a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 0x7fc13c0a2190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0156b0 tx=0x7fc12c015b70 comp rx=0 tx=0).stop 2024-08-19T11:15:06.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 shutdown_connections 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 --2- 172.21.15.71:0/3620570456 >> v2:172.21.15.135:6800/726754104 conn(0x7fc12003ea80 0x7fc120040f40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc13c0a26d0 0x7fc13c09cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc13c0a1d90 0x7fc13c0a2190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 --2- 172.21.15.71:0/3620570456 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc128004300 0x7fc13c1ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 >> 172.21.15.71:0/3620570456 conn(0x7fc13c0ac030 msgr2=0x7fc13c137200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 shutdown_connections 2024-08-19T11:15:06.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:06.583+0000 7fc143456640 1 -- 172.21.15.71:0/3620570456 wait complete. 2024-08-19T11:15:07.341 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26095]: starting. 2024-08-19T11:15:07.342 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26095]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26093 2024-08-19T11:15:07.342 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26095]: shutting down. 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: starting. 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26093 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: created object 0... 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: created object 25... 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: created object 49... 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: finishing. 2024-08-19T11:15:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26187]: shutting down. 2024-08-19T11:15:09.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:09.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.695+0000 7f754ebd9640 10 monclient: get_monmap_and_config 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.695+0000 7f754ebd9640 10 monclient: build_initial_monmap 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.695+0000 7f754ebd9640 10 monclient: monmap: 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:09.696697+0000 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:09.696697+0000 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:09.697 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26189]: starting. 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26189]: listing objects. 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26189]: listed object 0... 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26189]: listed object 25... 2024-08-19T11:15:09.698 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26189]: saw 50 objects 2024-08-19T11:15:09.699 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26189]: shutting down. 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.695+0000 7f754ebd9640 1 Processor -- start 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.695+0000 7f754ebd9640 1 -- start start 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.695+0000 7f754ebd9640 10 monclient: init 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient: _add_conns ranks=[3,10,9,2,1,4,7,5,0,6,8] 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75480a47c0 0x7f75480a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): picked mon.noname-g con 0x7f75480a47c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f754806d4e0 0x7f75480a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): picked mon.noname-f con 0x7f754806d4e0 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7548139ac0 0x7f7548139f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): picked mon.noname-a con 0x7f7548139ac0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f75480a5620 con 0x7f7548139ac0 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f754806d2a0 con 0x7f754806d4e0 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f754806d020 con 0x7f75480a47c0 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754ebd9640 10 monclient(hunting): authenticate will time out at 967.738299s 2024-08-19T11:15:09.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7548139ac0 0x7f7548139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f754806d4e0 0x7f75480a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75480a47c0 0x7f75480a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7548139ac0 0x7f7548139f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60668/0 (socket says 172.21.15.71:60668) 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 -- 172.21.15.71:0/2790321246 learned_addr learned my addr 172.21.15.71:0/2790321246 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): get_auth_request con 0x7f7548139ac0 auth_method 0 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): get_auth_request con 0x7f75480a47c0 auth_method 0 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): get_auth_request con 0x7f754806d4e0 auth_method 0 2024-08-19T11:15:09.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754c975640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient(hunting): handle_auth_done global_id 34866 payload 274 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 -- 172.21.15.71:0/2790321246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75480a47c0 msgr2=0x7f75480a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:09.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 --2- 172.21.15.71:0/2790321246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75480a47c0 0x7f75480a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 -- 172.21.15.71:0/2790321246 >> v2:172.21.15.135:3300/0 conn(0x7f754806d4e0 msgr2=0x7f75480a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 --2- 172.21.15.71:0/2790321246 >> v2:172.21.15.135:3300/0 conn(0x7f754806d4e0 0x7f75480a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient: _finish_hunting 0 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 monclient: found mon.noname-a 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f754d176640 1 -- 172.21.15.71:0/2790321246 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75480a0c70 con 0x7f7548139ac0 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.696+0000 7f7547fff640 1 --2- 172.21.15.71:0/2790321246 >> v2:172.21.15.135:3300/0 conn(0x7f754806d4e0 0x7f75480a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f754d176640 1 -- 172.21.15.71:0/2790321246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7548139ac0 msgr2=0x7f7548139f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f754d176640 1 --2- 172.21.15.71:0/2790321246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7548139ac0 0x7f7548139f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f75480a6230 tx=0x7f754002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac24f6f82d130974 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 1 -- 172.21.15.71:0/2790321246 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7540036070 con 0x7f7548139ac0 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:09.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: dump: 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:09.710 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f754ebd9640 5 monclient: authenticate success, global_id 34866 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f754ebd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 1 -- 172.21.15.71:0/2790321246 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7540007a70 con 0x7f7548139ac0 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f754ebd9640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f754ebd9640 4 set_mon_vals no callback set 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 1 -- 172.21.15.71:0/2790321246 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7540007ca0 con 0x7f7548139ac0 2024-08-19T11:15:09.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.699+0000 7f75477fe640 10 monclient: dump: 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:09.712 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 10 monclient: shutdown 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 -- 172.21.15.71:0/2790321246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7548139ac0 msgr2=0x7f7548139f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 --2- 172.21.15.71:0/2790321246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7548139ac0 0x7f7548139f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f75480a6230 tx=0x7f754002a570 comp rx=0 tx=0).stop 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 -- 172.21.15.71:0/2790321246 shutdown_connections 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 --2- 172.21.15.71:0/2790321246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7548139ac0 0x7f7548139f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 --2- 172.21.15.71:0/2790321246 >> v2:172.21.15.135:3300/0 conn(0x7f754806d4e0 0x7f75480a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 --2- 172.21.15.71:0/2790321246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f75480a47c0 0x7f75480a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 -- 172.21.15.71:0/2790321246 >> 172.21.15.71:0/2790321246 conn(0x7f75480a93e0 msgr2=0x7f75480a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 -- 172.21.15.71:0/2790321246 shutdown_connections 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 1 -- 172.21.15.71:0/2790321246 wait complete. 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 10 monclient: build_initial_monmap 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.700+0000 7f754ebd9640 10 monclient: monmap: 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:09.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 Processor -- start 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 -- start start 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient: init 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient: _add_conns ranks=[6,8,3,2,4,0,5,7,1] 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 0x7f75481cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): picked mon.noname-d con 0x7f754806d4e0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:09.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75480a47c0 0x7f7548139070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): picked mon.noname-e con 0x7f75480a47c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7548139ac0 0x7f75481ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): picked mon.noname-g con 0x7f7548139ac0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f75480a20c0 con 0x7f7548139ac0 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f75480a1f40 con 0x7f754806d4e0 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f754813a460 con 0x7f75480a47c0 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754ebd9640 10 monclient(hunting): authenticate will time out at 967.743820s 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 0x7f75481cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f7547fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75480a47c0 0x7f7548139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 0x7f75481cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36980/0 (socket says 172.21.15.71:36980) 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 1 -- 172.21.15.71:0/3816930438 learned_addr learned my addr 172.21.15.71:0/3816930438 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 10 monclient(hunting): get_auth_request con 0x7f754806d4e0 auth_method 0 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f754c975640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f7547fff640 10 monclient(hunting): get_auth_request con 0x7f75480a47c0 auth_method 0 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f7547fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f7547fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.701+0000 7f7547fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f7547fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f7547fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:09.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f7547fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754d176640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7548139ac0 0x7f75481ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 10 monclient(hunting): handle_auth_done global_id 25224 payload 824 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 1 -- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75480a47c0 msgr2=0x7f7548139070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75480a47c0 0x7f7548139070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 1 -- 172.21.15.71:0/3816930438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7548139ac0 msgr2=0x7f75481ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7548139ac0 0x7f75481ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 10 monclient: _finish_hunting 0 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 1 monclient: found mon.noname-d 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754c975640 1 -- 172.21.15.71:0/3816930438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7548127700 con 0x7f754806d4e0 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754d176640 10 monclient: get_auth_request con 0x7f7548139ac0 auth_method 0 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f754d176640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7548139ac0 0x7f75481ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:15:09.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.702+0000 7f7547fff640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75480a47c0 0x7f7548139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754c975640 1 -- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 msgr2=0x7f75481cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754c975640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 0x7f75481cacf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f753c00e960 tx=0x7f753c00ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f753c017070 con 0x7f754806d4e0 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: dump: 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:09.721 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:09.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c00cc10 con 0x7f754806d4e0 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 5 monclient: authenticate success, global_id 25224 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f753c00ce00 con 0x7f754806d4e0 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 10 monclient: _renew_subs 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75480a87d0 con 0x7f754806d4e0 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f7546ffd640 4 set_mon_vals no callback set 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f75457fa640 10 monclient: dump: 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.723 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 10 monclient: _renew_subs 2024-08-19T11:15:09.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.704+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f7548129a60 con 0x7f754806d4e0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f753c01a070 con 0x7f754806d4e0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f754ebd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f754ebd9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f754ebd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7548068650 con 0x7f754806d4e0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f75457fa640 1 --2- 172.21.15.71:0/3816930438 >> v2:172.21.15.135:6800/726754104 conn(0x7f752c03ea80 0x7f752c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7f753c00f040 con 0x7f754806d4e0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.705+0000 7f7547fff640 1 --2- 172.21.15.71:0/3816930438 >> v2:172.21.15.135:6800/726754104 conn(0x7f752c03ea80 0x7f752c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.706+0000 7f7547fff640 10 monclient: get_auth_request con 0x7f752c03ea80 auth_method 0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.708+0000 7f7547fff640 1 --2- 172.21.15.71:0/3816930438 >> v2:172.21.15.135:6800/726754104 conn(0x7f752c03ea80 0x7f752c040f40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7548127460 tx=0x7f7534009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.710+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f753c058080 con 0x7f754806d4e0 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.710+0000 7f75457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:09.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.710+0000 7f75457fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f754ebd9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f754ebd9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f754ebd9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:09.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f754813a7c0 con 0x7f754806d4e0 2024-08-19T11:15:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f75457fa640 1 -- 172.21.15.71:0/3816930438 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f75480a87d0 con 0x7f754806d4e0 2024-08-19T11:15:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f75457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:09.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.955+0000 7f75457fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:09.958 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:09.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 >> v2:172.21.15.135:6800/726754104 conn(0x7f752c03ea80 msgr2=0x7f752c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 --2- 172.21.15.71:0/3816930438 >> v2:172.21.15.135:6800/726754104 conn(0x7f752c03ea80 0x7f752c040f40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7548127460 tx=0x7f7534009190 comp rx=0 tx=0).stop 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 10 monclient: shutdown 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 msgr2=0x7f75481cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 0x7f75481cacf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f753c00e960 tx=0x7f753c00ee20 comp rx=0 tx=0).stop 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 shutdown_connections 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 --2- 172.21.15.71:0/3816930438 >> v2:172.21.15.135:6800/726754104 conn(0x7f752c03ea80 0x7f752c040f40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7548139ac0 0x7f75481ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75480a47c0 0x7f7548139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 --2- 172.21.15.71:0/3816930438 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f754806d4e0 0x7f75481cacf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 >> 172.21.15.71:0/3816930438 conn(0x7f75480a93e0 msgr2=0x7f754809efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 shutdown_connections 2024-08-19T11:15:09.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:09.957+0000 7f754ebd9640 1 -- 172.21.15.71:0/3816930438 wait complete. 2024-08-19T11:15:09.970 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:15:09.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:15:09.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:15:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.067+0000 7ff7b193a640 10 monclient: get_monmap_and_config 2024-08-19T11:15:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.067+0000 7ff7b193a640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.067+0000 7ff7b193a640 10 monclient: monmap: 2024-08-19T11:15:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.069 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:10.069105+0000 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:10.069105+0000 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.070 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:10.071 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:10.071 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 Processor -- start 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 -- start start 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient: init 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient: _add_conns ranks=[4,2,0,3,1,8,6,10,5,7,9] 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): picked mon.noname-c con 0x7ff7ac0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): picked mon.noname-b con 0x7ff7ac0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff7ac139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ac0a6380 con 0x7ff7ac139710 2024-08-19T11:15:10.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0a5020 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff7ac0a77b0 con 0x7ff7ac0a6950 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7b193a640 10 monclient(hunting): authenticate will time out at 968.110601s 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7ab7fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff7ac139710 0x7ff7ac139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37938/0 (socket says 172.21.15.71:37938) 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7ab7fe640 1 -- 172.21.15.71:0/1732119369 learned_addr learned my addr 172.21.15.71:0/1732119369 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): get_auth_request con 0x7ff7ac0a6950 auth_method 0 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): get_auth_request con 0x7ff7ac0a57c0 auth_method 0 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_done global_id 44401 payload 274 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 msgr2=0x7ff7ac0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 1 --2- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1732119369 >> v1:172.21.15.71:6789/0 conn(0x7ff7ac139710 legacy=0x7ff7ac139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 1 monclient: found mon.noname-c 2024-08-19T11:15:10.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.068+0000 7ff7aaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.069+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1732119369 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac0a3650 con 0x7ff7ac0a6950 2024-08-19T11:15:10.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.069+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 msgr2=0x7ff7ac0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7aaffd640 1 --2- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac0a6d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009800 tx=0x7ff79c029fd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=84fb358f7d083dee server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 1 -- 172.21.15.71:0/1732119369 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff79c037070 con 0x7ff7ac0a6950 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: dump: 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.082 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 1 -- 172.21.15.71:0/1732119369 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c02acf0 con 0x7ff7ac0a6950 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7b193a640 5 monclient: authenticate success, global_id 44401 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7b193a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7b193a640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 1 -- 172.21.15.71:0/1732119369 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff79c030c20 con 0x7ff7ac0a6950 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7b193a640 4 set_mon_vals no callback set 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.071+0000 7ff7a9ffb640 10 monclient: dump: 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.084 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 10 monclient: shutdown 2024-08-19T11:15:10.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 -- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 msgr2=0x7ff7ac0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac0a6d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009800 tx=0x7ff79c029fd0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 -- 172.21.15.71:0/1732119369 shutdown_connections 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1732119369 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac0a6d30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 -- 172.21.15.71:0/1732119369 >> 172.21.15.71:0/1732119369 conn(0x7ff7ac0abf50 msgr2=0x7ff7ac0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 -- 172.21.15.71:0/1732119369 shutdown_connections 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.072+0000 7ff7b193a640 1 -- 172.21.15.71:0/1732119369 wait complete. 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.073+0000 7ff7b193a640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.073+0000 7ff7b193a640 10 monclient: monmap: 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.073+0000 7ff7b193a640 1 Processor -- start 2024-08-19T11:15:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.073+0000 7ff7b193a640 1 -- start start 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.073+0000 7ff7b193a640 10 monclient: init 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient: _add_conns ranks=[2,5,7,4,3,0,8,1,6] 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac124ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): picked mon.noname-b con 0x7ff7ac0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): picked mon.noname-h con 0x7ff7ac0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff7ac139710 0x7ff7ac125760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): picked mon.noname-i con 0x7ff7ac139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0a84c0 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff7ac0a7d40 con 0x7ff7ac0a6950 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7ff7ac0a8700 con 0x7ff7ac139710 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7b193a640 10 monclient(hunting): authenticate will time out at 968.116092s 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac124ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac124ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44104/0 (socket says 172.21.15.71:44104) 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1297650063 learned_addr learned my addr 172.21.15.71:0/1297650063 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): get_auth_request con 0x7ff7ac0a57c0 auth_method 0 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient(hunting): handle_auth_done global_id 5960 payload 824 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff7ac139710 msgr2=0x7ff7ac125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff7ac139710 0x7ff7ac125760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7ac0a6950 msgr2=0x7ff7ac125220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7ac0a6950 0x7ff7ac125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 monclient: found mon.noname-b 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.074+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac128b00 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7aaffd640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 msgr2=0x7ff7ac124ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7aaffd640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac124ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009800 tx=0x7ff79c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff79c041020 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: dump: 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c003c30 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 5 monclient: authenticate success, global_id 5960 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 10 monclient: _renew_subs 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac0a1f00 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff79c037040 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a3fff640 10 monclient: dump: 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.093 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7a97fa640 4 set_mon_vals no callback set 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 10 monclient: _renew_subs 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.076+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac127c90 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7b193a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0a3f10 con 0x7ff7ac02e340 2024-08-19T11:15:10.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff79c044020 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7aa7fc640 10 monclient: get_auth_request con 0x7ff7ac02e340 auth_method 0 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7aa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.077+0000 7ff7aa7fc640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 msgr2=0x7ff7ac063a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7aa7fc640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 msgr2=0x7ff7ac063a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7a3fff640 1 --2- 172.21.15.71:0/1297650063 >> v2:172.21.15.135:6800/726754104 conn(0x7ff78c03ea80 0x7ff78c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7ff79c071e70 con 0x7ff7ac0a57c0 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7ab7fe640 1 --2- 172.21.15.71:0/1297650063 >> v2:172.21.15.135:6800/726754104 conn(0x7ff78c03ea80 0x7ff78c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.078+0000 7ff7ab7fe640 10 monclient: get_auth_request con 0x7ff78c03ea80 auth_method 0 2024-08-19T11:15:10.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.080+0000 7ff7ab7fe640 1 --2- 172.21.15.71:0/1297650063 >> v2:172.21.15.135:6800/726754104 conn(0x7ff78c03ea80 0x7ff78c040f40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400ab10 tx=0x7ff7a4009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient: get_auth_request con 0x7ff7ac02e340 auth_method 0 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_done global_id 34884 payload 824 2024-08-19T11:15:10.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.279+0000 7ff7aa7fc640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7ac02e720 con 0x7ff7ac02e340 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7aa7fc640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 msgr2=0x7ff7ac063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff7940115d0 tx=0x7ff794011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff794015dd0 con 0x7ff7ac02e340 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 10 monclient: dump: 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.284 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.285 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff794015960 con 0x7ff7ac02e340 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 msgr2=0x7ff7ac063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff7940115d0 tx=0x7ff794011a90 comp rx=0 tx=0).stop 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 msgr2=0x7ff7ac063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.282+0000 7ff7a3fff640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac02e340 0x7ff7ac063a80 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff7940115d0 tx=0x7ff794011a90 comp rx=0 tx=0).stop 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7b193a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 0x7ff7ac1d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7b193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac076c60 con 0x7ff7ac063fc0 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 0x7ff7ac1d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 10 monclient: get_auth_request con 0x7ff7ac063fc0 auth_method 0 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.288+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.289+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.289+0000 7ff7aa7fc640 10 monclient(hunting): handle_auth_done global_id 34893 payload 824 2024-08-19T11:15:10.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.289+0000 7ff7aa7fc640 1 -- 172.21.15.71:0/1297650063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff7ac0a6d30 con 0x7ff7ac063fc0 2024-08-19T11:15:10.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7aa7fc640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 msgr2=0x7ff7ac1d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7aa7fc640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 0x7ff7ac1d8990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff79401b000 tx=0x7ff794009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff794004020 con 0x7ff7ac063fc0 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 10 monclient: dump: 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.294 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9436 (secure 0 0 0) 0x7ff794006540 con 0x7ff7ac063fc0 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 msgr2=0x7ff7ac1d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 0x7ff7ac1d8990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff79401b000 tx=0x7ff794009190 comp rx=0 tx=0).stop 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 msgr2=0x7ff7ac1d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.291+0000 7ff7a3fff640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7ac063fc0 0x7ff7ac1d8990 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff79401b000 tx=0x7ff794009190 comp rx=0 tx=0).stop 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 145808, 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:10.296 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:10.297 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:10.298 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:10.299 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:10.300 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.301 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:10.302 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:10.305 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.306 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.308 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:10.310 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:10.312 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:10.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.317 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.318 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:10.319 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 >> v2:172.21.15.135:6800/726754104 conn(0x7ff78c03ea80 msgr2=0x7ff78c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1297650063 >> v2:172.21.15.135:6800/726754104 conn(0x7ff78c03ea80 0x7ff78c040f40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400ab10 tx=0x7ff7a4009210 comp rx=0 tx=0).stop 2024-08-19T11:15:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 10 monclient: shutdown 2024-08-19T11:15:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 msgr2=0x7ff7ac124ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 --2- 172.21.15.71:0/1297650063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0a57c0 0x7ff7ac124ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009800 tx=0x7ff79c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7ab7fe640 1 -- 172.21.15.71:0/1297650063 reap_dead start 2024-08-19T11:15:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7ab7fe640 1 -- 172.21.15.71:0/1297650063 reap_dead start 2024-08-19T11:15:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 shutdown_connections 2024-08-19T11:15:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 >> 172.21.15.71:0/1297650063 conn(0x7ff7ac0abf50 msgr2=0x7ff7ac138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 shutdown_connections 2024-08-19T11:15:10.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.292+0000 7ff7b193a640 1 -- 172.21.15.71:0/1297650063 wait complete. 2024-08-19T11:15:10.321 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:10.321 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:15:10.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:15:10.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.418+0000 7f09bc492640 10 monclient: get_monmap_and_config 2024-08-19T11:15:10.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.418+0000 7f09bc492640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.418+0000 7f09bc492640 10 monclient: monmap: 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:10.420304+0000 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:10.420304+0000 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.421 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.422 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.422 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:10.422 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:10.422 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 Processor -- start 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 -- start start 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient: init 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient: _add_conns ranks=[9,3,1,7,10,0,4,2,6,5,8] 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09b40a6950 0x7f09b40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): picked mon.noname-a con 0x7f09b40a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09b40a57c0 0x7f09b40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): picked mon.noname-g con 0x7f09b40a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:10.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f09b4139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09b40a6380 con 0x7f09b4139710 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f09b40a5020 con 0x7f09b40a6950 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09b40a77b0 con 0x7f09b40a57c0 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.419+0000 7f09bc492640 10 monclient(hunting): authenticate will time out at 968.461931s 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09b40a6950 0x7f09b40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f09b40a6950 0x7f09b40a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60710/0 (socket says 172.21.15.71:60710) 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 -- 172.21.15.71:0/555794077 learned_addr learned my addr 172.21.15.71:0/555794077 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): get_auth_request con 0x7f09b40a6950 auth_method 0 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient(hunting): handle_auth_done global_id 34902 payload 274 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 -- 172.21.15.71:0/555794077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09b40a57c0 msgr2=0x7f09b40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 --2- 172.21.15.71:0/555794077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09b40a57c0 0x7f09b40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 -- 172.21.15.71:0/555794077 >> v1:172.21.15.135:6789/0 conn(0x7f09b4139710 legacy=0x7f09b4139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 monclient: found mon.noname-a 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.420+0000 7f09ba22e640 1 -- 172.21.15.71:0/555794077 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b40a3650 con 0x7f09b40a6950 2024-08-19T11:15:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09ba22e640 1 -- 172.21.15.71:0/555794077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 msgr2=0x7f09b40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09ba22e640 1 --2- 172.21.15.71:0/555794077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b40a6d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1d9c213374a2a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 1 -- 172.21.15.71:0/555794077 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09b0037070 con 0x7f09b40a6950 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: dump: 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.434 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 1 -- 172.21.15.71:0/555794077 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b00307b0 con 0x7f09b40a6950 2024-08-19T11:15:10.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 5 monclient: authenticate success, global_id 34902 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 1 -- 172.21.15.71:0/555794077 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09b0030dd0 con 0x7f09b40a6950 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 4 set_mon_vals no callback set 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09b922c640 10 monclient: dump: 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.436 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 10 monclient: shutdown 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 -- 172.21.15.71:0/555794077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 msgr2=0x7f09b40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 --2- 172.21.15.71:0/555794077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b40a6d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 -- 172.21.15.71:0/555794077 shutdown_connections 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 --2- 172.21.15.71:0/555794077 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09b40a57c0 0x7f09b40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 --2- 172.21.15.71:0/555794077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b40a6d30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 -- 172.21.15.71:0/555794077 >> 172.21.15.71:0/555794077 conn(0x7f09b40abf50 msgr2=0x7f09b40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 -- 172.21.15.71:0/555794077 shutdown_connections 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.423+0000 7f09bc492640 1 -- 172.21.15.71:0/555794077 wait complete. 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.424+0000 7f09bc492640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.424+0000 7f09bc492640 10 monclient: monmap: 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.438 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.439 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.424+0000 7f09bc492640 1 Processor -- start 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.424+0000 7f09bc492640 1 -- start start 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.424+0000 7f09bc492640 10 monclient: init 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient: _add_conns ranks=[7,0,2,5,4,6,1,8,3] 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09b40a57c0 0x7f09b4138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): picked mon.noname-i con 0x7f09b40a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b4138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): picked mon.noname-a con 0x7f09b40a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4139710 0x7f09b41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): picked mon.noname-b con 0x7f09b4139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09b40a84c0 con 0x7f09b40a6950 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09b40a7d40 con 0x7f09b4139710 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f09b40a8700 con 0x7f09b40a57c0 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09bc492640 10 monclient(hunting): authenticate will time out at 968.467259s 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b4138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4139710 0x7f09b41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b4138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60726/0 (socket says 172.21.15.71:60726) 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4139710 0x7f09b41225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44120/0 (socket says 172.21.15.71:44120) 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 -- 172.21.15.71:0/2393296370 learned_addr learned my addr 172.21.15.71:0/2393296370 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): get_auth_request con 0x7f09b40a6950 auth_method 0 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): get_auth_request con 0x7f09b4139710 auth_method 0 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09ba22e640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09b40a57c0 0x7f09b4138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09ba22e640 10 monclient(hunting): get_auth_request con 0x7f09b40a57c0 auth_method 0 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09ba22e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09ba22e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09ba22e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient(hunting): handle_auth_done global_id 34911 payload 824 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09b40a57c0 msgr2=0x7f09b4138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09b40a57c0 0x7f09b4138890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4139710 msgr2=0x7f09b41225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4139710 0x7f09b41225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 monclient: found mon.noname-a 2024-08-19T11:15:10.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09b9a2d640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b413a390 con 0x7f09b40a6950 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.425+0000 7f09baa2f640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4139710 0x7f09b41225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.427+0000 7f09b9a2d640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 msgr2=0x7f09b4138dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.427+0000 7f09b9a2d640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b4138dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b410 tx=0x7f09a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09a4015020 con 0x7f09b40a6950 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: dump: 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.444 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a4011cb0 con 0x7f09b40a6950 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 5 monclient: authenticate success, global_id 34911 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 10 monclient: _renew_subs 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b4139e40 con 0x7f09b40a6950 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09a40107f0 con 0x7f09b40a6950 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09aaffd640 10 monclient: dump: 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.446 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09b8a2b640 4 set_mon_vals no callback set 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 10 monclient: _renew_subs 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b4125c90 con 0x7f09b40a6950 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 0x7f09b4122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09b406a590 con 0x7f09b41ce490 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09ba22e640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 0x7f09b4122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09ba22e640 10 monclient: get_auth_request con 0x7f09b41ce490 auth_method 0 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09ba22e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09ba22e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.428+0000 7f09ba22e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f09a4018020 con 0x7f09b40a6950 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09ba22e640 10 monclient(hunting): handle_auth_done global_id 5978 payload 824 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09ba22e640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09b40a6d30 con 0x7f09b41ce490 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09aaffd640 1 --2- 172.21.15.71:0/2393296370 >> v2:172.21.15.135:6800/726754104 conn(0x7f099803ea80 0x7f0998040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7f09a4051b20 con 0x7f09b40a6950 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09baa2f640 1 --2- 172.21.15.71:0/2393296370 >> v2:172.21.15.135:6800/726754104 conn(0x7f099803ea80 0x7f0998040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.429+0000 7f09baa2f640 10 monclient: get_auth_request con 0x7f099803ea80 auth_method 0 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09ba22e640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 msgr2=0x7f09b4122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09ba22e640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 0x7f09b4122ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f09b406c930 tx=0x7f09b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09b0042070 con 0x7f09b41ce490 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 10 monclient: dump: 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.450 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f09b0003a30 con 0x7f09b41ce490 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 msgr2=0x7f09b4122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 0x7f09b4122ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f09b406c930 tx=0x7f09b00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 msgr2=0x7f09b4122ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09aaffd640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b41ce490 0x7f09b4122ae0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f09b406c930 tx=0x7f09b00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.431+0000 7f09baa2f640 1 --2- 172.21.15.71:0/2393296370 >> v2:172.21.15.135:6800/726754104 conn(0x7f099803ea80 0x7f0998040f40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00f1d0 tx=0x7f09ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09bc492640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:10.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09bc492640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 0x7f09b409da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09bc492640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09b4123430 con 0x7f09b4123020 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 0x7f09b409da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient: get_auth_request con 0x7f09b4123020 auth_method 0 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 10 monclient(hunting): handle_auth_done global_id 5987 payload 824 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.438+0000 7f09ba22e640 1 -- 172.21.15.71:0/2393296370 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f09b406ca70 con 0x7f09b4123020 2024-08-19T11:15:10.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09ba22e640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 msgr2=0x7f09b409da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09ba22e640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 0x7f09b409da00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f09b002a0e0 tx=0x7f09b0009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09b0037040 con 0x7f09b4123020 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 10 monclient: dump: 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.455 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f09b003ee10 con 0x7f09b4123020 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 msgr2=0x7f09b409da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 0x7f09b409da00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f09b002a0e0 tx=0x7f09b0009240 comp rx=0 tx=0).stop 2024-08-19T11:15:10.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 msgr2=0x7f09b409da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.440+0000 7f09aaffd640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09b4123020 0x7f09b409da00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 307320, 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.472 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.474 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:10.479 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 >> v2:172.21.15.135:6800/726754104 conn(0x7f099803ea80 msgr2=0x7f0998040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 --2- 172.21.15.71:0/2393296370 >> v2:172.21.15.135:6800/726754104 conn(0x7f099803ea80 0x7f0998040f40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00f1d0 tx=0x7f09ac009040 comp rx=0 tx=0).stop 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 10 monclient: shutdown 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 msgr2=0x7f09b4138dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 --2- 172.21.15.71:0/2393296370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b40a6950 0x7f09b4138dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b410 tx=0x7f09a400b8d0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09baa2f640 1 -- 172.21.15.71:0/2393296370 reap_dead start 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09baa2f640 1 -- 172.21.15.71:0/2393296370 reap_dead start 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 shutdown_connections 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 >> 172.21.15.71:0/2393296370 conn(0x7f09b40abf50 msgr2=0x7f09b41c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 shutdown_connections 2024-08-19T11:15:10.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.441+0000 7f09bc492640 1 -- 172.21.15.71:0/2393296370 wait complete. 2024-08-19T11:15:10.482 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:10.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:15:10.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.580+0000 7f92a2de2640 10 monclient: get_monmap_and_config 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.580+0000 7f92a2de2640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.580+0000 7f92a2de2640 10 monclient: monmap: 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:10.582073+0000 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:10.582073+0000 2024-08-19T11:15:10.582 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:10.583 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 Processor -- start 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 -- start start 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient: init 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient: _add_conns ranks=[4,9,7,2,3,5,10,0,8,1,6] 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 0x7f929c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): picked mon.noname-c con 0x7f929c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 0x7f929c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): picked mon.noname-a con 0x7f929c0a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f929c139710 0x7f929c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): picked mon.noname-i con 0x7f929c139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f929c0a5020 con 0x7f929c0a57c0 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f929c0a77b0 con 0x7f929c0a6950 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f929c0a7d40 con 0x7f929c139710 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a2de2640 10 monclient(hunting): authenticate will time out at 968.623693s 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 0x7f929c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 0x7f929c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 0x7f929c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60738/0 (socket says 172.21.15.71:60738) 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 1 -- 172.21.15.71:0/3630688344 learned_addr learned my addr 172.21.15.71:0/3630688344 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): get_auth_request con 0x7f929c0a57c0 auth_method 0 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 0x7f929c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55244/0 (socket says 172.21.15.71:55244) 2024-08-19T11:15:10.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): get_auth_request con 0x7f929c0a6950 auth_method 0 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f929bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.581+0000 7f92a137f640 1 --2- 172.21.15.71:0/3630688344 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f929c139710 0x7f929c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a137f640 10 monclient(hunting): get_auth_request con 0x7f929c139710 auth_method 0 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a137f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a137f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a137f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_done global_id 44410 payload 274 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 1 -- 172.21.15.71:0/3630688344 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f929c139710 msgr2=0x7f929c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/3630688344 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f929c139710 0x7f929c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 1 -- 172.21.15.71:0/3630688344 >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 msgr2=0x7f929c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/3630688344 >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 0x7f929c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 1 monclient: found mon.noname-c 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f92a0b7e640 1 -- 172.21.15.71:0/3630688344 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c0a6380 con 0x7f929c0a6950 2024-08-19T11:15:10.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.582+0000 7f929bfff640 1 --2- 172.21.15.71:0/3630688344 >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 0x7f929c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.584+0000 7f92a0b7e640 1 -- 172.21.15.71:0/3630688344 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 msgr2=0x7f929c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.584+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/3630688344 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 0x7f929c0a6d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9290009800 tx=0x7f929002a030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=13a93e8849ec42c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.584+0000 7f929b7fe640 1 -- 172.21.15.71:0/3630688344 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9290037070 con 0x7f929c0a6950 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: dump: 2024-08-19T11:15:10.596 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.597 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 1 -- 172.21.15.71:0/3630688344 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929002ad50 con 0x7f929c0a6950 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 5 monclient: authenticate success, global_id 44410 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 1 -- 172.21.15.71:0/3630688344 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9290030c20 con 0x7f929c0a6950 2024-08-19T11:15:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 4 set_mon_vals no callback set 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f929b7fe640 10 monclient: dump: 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.599 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 10 monclient: shutdown 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 -- 172.21.15.71:0/3630688344 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 msgr2=0x7f929c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 --2- 172.21.15.71:0/3630688344 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 0x7f929c0a6d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9290009800 tx=0x7f929002a030 comp rx=0 tx=0).stop 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 -- 172.21.15.71:0/3630688344 shutdown_connections 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 --2- 172.21.15.71:0/3630688344 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f929c139710 0x7f929c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 --2- 172.21.15.71:0/3630688344 >> v2:172.21.15.71:3300/0 conn(0x7f929c0a57c0 0x7f929c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 --2- 172.21.15.71:0/3630688344 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c0a6950 0x7f929c0a6d30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 -- 172.21.15.71:0/3630688344 >> 172.21.15.71:0/3630688344 conn(0x7f929c0abf50 msgr2=0x7f929c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 -- 172.21.15.71:0/3630688344 shutdown_connections 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.585+0000 7f92a2de2640 1 -- 172.21.15.71:0/3630688344 wait complete. 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.586+0000 7f92a2de2640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.586+0000 7f92a2de2640 10 monclient: monmap: 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.601 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.586+0000 7f92a2de2640 1 Processor -- start 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.586+0000 7f92a2de2640 1 -- start start 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.586+0000 7f92a2de2640 10 monclient: init 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient: _add_conns ranks=[6,0,3,7,2,4,1,8,5] 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f929c0a57c0 0x7f929c1ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): picked mon.noname-d con 0x7f929c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 0x7f929c1cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): picked mon.noname-a con 0x7f929c0a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f929c139710 0x7f929c1cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): picked mon.noname-g con 0x7f929c139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f929c0a84c0 con 0x7f929c0a6950 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f929c0a3650 con 0x7f929c139710 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f929c0a8700 con 0x7f929c0a57c0 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a2de2640 10 monclient(hunting): authenticate will time out at 968.629252s 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 0x7f929c1cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f929c0a57c0 0x7f929c1ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 0x7f929c1cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60740/0 (socket says 172.21.15.71:60740) 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 -- 172.21.15.71:0/1339582696 learned_addr learned my addr 172.21.15.71:0/1339582696 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): get_auth_request con 0x7f929c0a6950 auth_method 0 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): get_auth_request con 0x7f929c0a57c0 auth_method 0 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a137f640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f929c139710 0x7f929c1cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a137f640 10 monclient(hunting): get_auth_request con 0x7f929c139710 auth_method 0 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a137f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a137f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f92a137f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient(hunting): handle_auth_done global_id 34929 payload 824 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f929c0a57c0 msgr2=0x7f929c1ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f929c0a57c0 0x7f929c1ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f929c139710 msgr2=0x7f929c1cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f929c139710 0x7f929c1cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 monclient: found mon.noname-a 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.587+0000 7f929bfff640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c13a170 con 0x7f929c0a6950 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.589+0000 7f929bfff640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 msgr2=0x7f929c1cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.589+0000 7f929bfff640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 0x7f929c1cee80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f928800e9d0 tx=0x7f928800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.589+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9288017070 con 0x7f929c0a6950 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.589+0000 7f92997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.589+0000 7f92997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.589+0000 7f92997fa640 10 monclient: dump: 2024-08-19T11:15:10.606 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.607 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928800cc70 con 0x7f929c0a6950 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 5 monclient: authenticate success, global_id 34929 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f928800ce20 con 0x7f929c0a6950 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 10 monclient: _renew_subs 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929c127d60 con 0x7f929c0a6950 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f929affd640 4 set_mon_vals no callback set 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 10 monclient: dump: 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 10 monclient: _renew_subs 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f929c128bd0 con 0x7f929c0a6950 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 0x7f929c1252f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f929c128850 con 0x7f929c124f10 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 0x7f929c1252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.590+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f928801a070 con 0x7f929c0a6950 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient: get_auth_request con 0x7f929c124f10 auth_method 0 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92997fa640 1 --2- 172.21.15.71:0/1339582696 >> v2:172.21.15.135:6800/726754104 conn(0x7f928003ea80 0x7f9280040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_done global_id 44419 payload 824 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7f928800f040 con 0x7f929c0a6950 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a0b7e640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f929c0a1f70 con 0x7f929c124f10 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a137f640 1 --2- 172.21.15.71:0/1339582696 >> v2:172.21.15.135:6800/726754104 conn(0x7f928003ea80 0x7f9280040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.591+0000 7f92a137f640 10 monclient: get_auth_request con 0x7f928003ea80 auth_method 0 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92a0b7e640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 msgr2=0x7f929c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 0x7f929c1252f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f929c0a5730 tx=0x7f92900046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9290037040 con 0x7f929c124f10 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92a137f640 1 --2- 172.21.15.71:0/1339582696 >> v2:172.21.15.135:6800/726754104 conn(0x7f928003ea80 0x7f9280040f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9294009e60 tx=0x7f929400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.593+0000 7f92997fa640 10 monclient: dump: 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.612 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f929002ad50 con 0x7f929c124f10 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:10.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 msgr2=0x7f929c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 0x7f929c1252f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f929c0a5730 tx=0x7f92900046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 msgr2=0x7f929c1252f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.594+0000 7f92997fa640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c124f10 0x7f929c1252f0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f929c0a5730 tx=0x7f92900046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a2de2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a2de2640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 0x7f929c09fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a2de2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f929c076c60 con 0x7f929c125830 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 0x7f929c09fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient: get_auth_request con 0x7f929c125830 auth_method 0 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 10 monclient(hunting): handle_auth_done global_id 44428 payload 824 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.600+0000 7f92a0b7e640 1 -- 172.21.15.71:0/1339582696 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f929c0a6d30 con 0x7f929c125830 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.602+0000 7f92a0b7e640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 msgr2=0x7f929c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.602+0000 7f92a0b7e640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 0x7f929c09fa10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f929002a070 tx=0x7f9290009190 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.602+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9290037030 con 0x7f929c125830 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.602+0000 7f92997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.602+0000 7f92997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.602+0000 7f92997fa640 10 monclient: dump: 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.617 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9433 (secure 0 0 0) 0x7f9290047c50 con 0x7f929c125830 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:10.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 msgr2=0x7f929c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 0x7f929c09fa10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f929002a070 tx=0x7f9290009190 comp rx=0 tx=0).stop 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 msgr2=0x7f929c09fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92997fa640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f929c125830 0x7f929c09fa10 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f929002a070 tx=0x7f9290009190 comp rx=0 tx=0).stop 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 79616, 2024-08-19T11:15:10.619 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:10.620 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:10.621 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.622 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:10.623 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.624 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:10.625 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.627 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.628 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.629 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:10.632 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.633 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.634 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.635 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.636 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:10.639 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:10.640 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.641 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:10.642 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:10.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 >> v2:172.21.15.135:6800/726754104 conn(0x7f928003ea80 msgr2=0x7f9280040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 --2- 172.21.15.71:0/1339582696 >> v2:172.21.15.135:6800/726754104 conn(0x7f928003ea80 0x7f9280040f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9294009e60 tx=0x7f929400b040 comp rx=0 tx=0).stop 2024-08-19T11:15:10.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 10 monclient: shutdown 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 msgr2=0x7f929c1cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 0x7f929c1cee80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f928800e9d0 tx=0x7f928800ee90 comp rx=0 tx=0).stop 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a137f640 1 -- 172.21.15.71:0/1339582696 reap_dead start 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 shutdown_connections 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 --2- 172.21.15.71:0/1339582696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f929c0a6950 0x7f929c1cee80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 >> 172.21.15.71:0/1339582696 conn(0x7f929c0abf50 msgr2=0x7f929c138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 shutdown_connections 2024-08-19T11:15:10.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.603+0000 7f92a2de2640 1 -- 172.21.15.71:0/1339582696 wait complete. 2024-08-19T11:15:10.644 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:10.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:15:10.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:15:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.741+0000 7f5c45d3a640 10 monclient: get_monmap_and_config 2024-08-19T11:15:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.741+0000 7f5c45d3a640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.741+0000 7f5c45d3a640 10 monclient: monmap: 2024-08-19T11:15:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:10.743130+0000 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:10.743130+0000 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:10.744 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 Processor -- start 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 -- start start 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient: init 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient: _add_conns ranks=[4,7,10,5,8,2,1,3,9,6,0] 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 0x7f5c400a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): picked mon.noname-c con 0x7f5c400a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5c400a57c0 0x7f5c400a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): picked mon.noname-i con 0x7f5c400a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5c40139710 0x7f5c40139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): picked mon.noname-f con 0x7f5c40139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5c400a5020 con 0x7f5c40139710 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5c400a77b0 con 0x7f5c400a6950 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f5c400a7d40 con 0x7f5c400a57c0 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c45d3a640 10 monclient(hunting): authenticate will time out at 968.784775s 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 0x7f5c400a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 0x7f5c400a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55272/0 (socket says 172.21.15.71:55272) 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2797851465 learned_addr learned my addr 172.21.15.71:0/2797851465 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 10 monclient(hunting): get_auth_request con 0x7f5c400a6950 auth_method 0 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.742+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3effd640 1 --2- 172.21.15.71:0/2797851465 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5c400a57c0 0x7f5c400a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3effd640 10 monclient(hunting): get_auth_request con 0x7f5c400a57c0 auth_method 0 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3ffff640 1 --2- 172.21.15.71:0/2797851465 >> v2:172.21.15.135:3300/0 conn(0x7f5c40139710 0x7f5c40139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3ffff640 10 monclient(hunting): get_auth_request con 0x7f5c40139710 auth_method 0 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_done global_id 44437 payload 274 2024-08-19T11:15:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2797851465 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5c400a57c0 msgr2=0x7f5c400a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2797851465 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5c400a57c0 0x7f5c400a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2797851465 >> v2:172.21.15.135:3300/0 conn(0x7f5c40139710 msgr2=0x7f5c40139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2797851465 >> v2:172.21.15.135:3300/0 conn(0x7f5c40139710 0x7f5c40139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 1 monclient: found mon.noname-c 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.743+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2797851465 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c400a6380 con 0x7f5c400a6950 2024-08-19T11:15:10.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.745+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2797851465 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 msgr2=0x7f5c400a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.745+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2797851465 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 0x7f5c400a6d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5c300098a0 tx=0x7f5c3002a0d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=844908679c6bb7a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 1 -- 172.21.15.71:0/2797851465 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5c30037070 con 0x7f5c400a6950 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: dump: 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.756 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 5 monclient: authenticate success, global_id 44437 2024-08-19T11:15:10.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 1 -- 172.21.15.71:0/2797851465 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3002adf0 con 0x7f5c400a6950 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 1 -- 172.21.15.71:0/2797851465 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5c30030c20 con 0x7f5c400a6950 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 4 set_mon_vals no callback set 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c3e7fc640 10 monclient: dump: 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.758 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 10 monclient: shutdown 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2797851465 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 msgr2=0x7f5c400a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2797851465 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 0x7f5c400a6d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5c300098a0 tx=0x7f5c3002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2797851465 shutdown_connections 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2797851465 >> v2:172.21.15.135:3300/0 conn(0x7f5c40139710 0x7f5c40139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2797851465 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5c400a57c0 0x7f5c400a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2797851465 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a6950 0x7f5c400a6d30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2797851465 >> 172.21.15.71:0/2797851465 conn(0x7f5c400abf50 msgr2=0x7f5c400ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2797851465 shutdown_connections 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.746+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2797851465 wait complete. 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.747+0000 7f5c45d3a640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.747+0000 7f5c45d3a640 10 monclient: monmap: 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.747+0000 7f5c45d3a640 1 Processor -- start 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.747+0000 7f5c45d3a640 1 -- start start 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.747+0000 7f5c45d3a640 10 monclient: init 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient: _add_conns ranks=[4,1,0,3,2,6,7,8,5] 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): picked mon.noname-c con 0x7f5c400a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c400a6950 0x7f5c401251a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): picked mon.noname-f con 0x7f5c400a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c40139710 0x7f5c401256e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): picked mon.noname-a con 0x7f5c40139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400a84c0 con 0x7f5c40139710 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400a3650 con 0x7f5c400a6950 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5c400a8700 con 0x7f5c400a57c0 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c45d3a640 10 monclient(hunting): authenticate will time out at 968.790337s 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55282/0 (socket says 172.21.15.71:55282) 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c40139710 0x7f5c401256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2333662376 learned_addr learned my addr 172.21.15.71:0/2333662376 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): get_auth_request con 0x7f5c400a57c0 auth_method 0 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): get_auth_request con 0x7f5c40139710 auth_method 0 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c400a6950 0x7f5c401251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): get_auth_request con 0x7f5c400a6950 auth_method 0 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient(hunting): handle_auth_done global_id 44446 payload 824 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c400a6950 msgr2=0x7f5c401251a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c400a6950 0x7f5c401251a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c40139710 msgr2=0x7f5c401256e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5c40139710 0x7f5c401256e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 monclient: found mon.noname-c 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.748+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c40128ab0 con 0x7f5c400a57c0 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.750+0000 7f5c3f7fe640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 msgr2=0x7f5c40124c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.750+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c300098a0 tx=0x7f5c300046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5c30037040 con 0x7f5c400a57c0 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: dump: 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 5 monclient: authenticate success, global_id 44446 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c30042070 con 0x7f5c400a57c0 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 10 monclient: _renew_subs 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4013a340 con 0x7f5c400a57c0 2024-08-19T11:15:10.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5c30030c20 con 0x7f5c400a57c0 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c27fff640 10 monclient: dump: 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.768 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 10 monclient: _renew_subs 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c3dffb640 4 set_mon_vals no callback set 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c40126750 con 0x7f5c400a57c0 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 0x7f5c4009fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.751+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5c4006a590 con 0x7f5c4009fa10 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 0x7f5c4009fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3f7fe640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c300098a0 tx=0x7f5c300046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f5c30072000 osd_map(143..143 src has 1..143) 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient: get_auth_request con 0x7f5c4009fa10 auth_method 0 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5c30003c50 con 0x7f5c400a57c0 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 10 monclient(hunting): handle_auth_done global_id 25242 payload 824 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c27fff640 1 --2- 172.21.15.71:0/2333662376 >> v2:172.21.15.135:6800/726754104 conn(0x7f5c2c03ea80 0x7f5c2c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3effd640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c400a20a0 con 0x7f5c4009fa10 2024-08-19T11:15:10.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3ffff640 1 --2- 172.21.15.71:0/2333662376 >> v2:172.21.15.135:6800/726754104 conn(0x7f5c2c03ea80 0x7f5c2c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.752+0000 7f5c3ffff640 10 monclient: get_auth_request con 0x7f5c2c03ea80 auth_method 0 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c3effd640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 msgr2=0x7f5c4009fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c3effd640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 0x7f5c4009fdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c40126dc0 tx=0x7f5c34010c10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5c34018020 con 0x7f5c4009fa10 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 10 monclient: dump: 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.773 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5c34004450 con 0x7f5c4009fa10 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:10.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 msgr2=0x7f5c4009fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 0x7f5c4009fdf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c40126dc0 tx=0x7f5c34010c10 comp rx=0 tx=0).stop 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 msgr2=0x7f5c4009fdf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.754+0000 7f5c27fff640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c4009fa10 0x7f5c4009fdf0 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5c40126dc0 tx=0x7f5c34010c10 comp rx=0 tx=0).stop 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.755+0000 7f5c3ffff640 1 --2- 172.21.15.71:0/2333662376 >> v2:172.21.15.135:6800/726754104 conn(0x7f5c2c03ea80 0x7f5c2c040f40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5c38003990 tx=0x7f5c38009780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c45d3a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 0x7f5c401d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c45d3a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5c40076c60 con 0x7f5c400a0330 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 0x7f5c401d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient: get_auth_request con 0x7f5c400a0330 auth_method 0 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 10 monclient(hunting): handle_auth_done global_id 25251 payload 824 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.761+0000 7f5c3effd640 1 -- 172.21.15.71:0/2333662376 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5c400a6d30 con 0x7f5c400a0330 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c3effd640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 msgr2=0x7f5c401d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c3effd640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 0x7f5c401d8990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c34019000 tx=0x7f5c340046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5c34018040 con 0x7f5c400a0330 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 10 monclient: dump: 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.776 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7f5c34003610 con 0x7f5c400a0330 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 msgr2=0x7f5c401d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.763+0000 7f5c27fff640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 0x7f5c401d8990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c34019000 tx=0x7f5c340046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 msgr2=0x7f5c401d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c27fff640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5c400a0330 0x7f5c401d8990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 218378, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:10.801 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 >> v2:172.21.15.135:6800/726754104 conn(0x7f5c2c03ea80 msgr2=0x7f5c2c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2333662376 >> v2:172.21.15.135:6800/726754104 conn(0x7f5c2c03ea80 0x7f5c2c040f40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5c38003990 tx=0x7f5c38009780 comp rx=0 tx=0).stop 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 10 monclient: shutdown 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 msgr2=0x7f5c40124c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c300098a0 tx=0x7f5c300046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c3ffff640 1 -- 172.21.15.71:0/2333662376 reap_dead start 2024-08-19T11:15:10.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c27fff640 1 -- 172.21.15.71:0/2333662376 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (unknown 0 0 0) 0x7f5c30072000 con 0x7f5c400a57c0 2024-08-19T11:15:10.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 shutdown_connections 2024-08-19T11:15:10.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 --2- 172.21.15.71:0/2333662376 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5c400a57c0 0x7f5c40124c60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 >> 172.21.15.71:0/2333662376 conn(0x7f5c400abf50 msgr2=0x7f5c40138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 shutdown_connections 2024-08-19T11:15:10.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.764+0000 7f5c45d3a640 1 -- 172.21.15.71:0/2333662376 wait complete. 2024-08-19T11:15:10.804 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:10.804 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:15:10.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:15:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.901+0000 7f7f8a3ba640 10 monclient: get_monmap_and_config 2024-08-19T11:15:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.901+0000 7f7f8a3ba640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.901+0000 7f7f8a3ba640 10 monclient: monmap: 2024-08-19T11:15:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.903 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:10.902803+0000 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:10.902803+0000 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.904 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:10.905 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:10.905 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.901+0000 7f7f8a3ba640 1 Processor -- start 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.901+0000 7f7f8a3ba640 1 -- start start 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.901+0000 7f7f8a3ba640 10 monclient: init 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient: _add_conns ranks=[1,9,4,0,3,10,2,5,8,6,7] 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7f840a47c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 0x7f7f8413c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): picked mon.noname-a con 0x7f7f840a2a40 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 0x7f7f8413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): picked mon.noname-c con 0x7f7f840a52b0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8406d690 con 0x7f7f840a47c0 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7f8409cc90 con 0x7f7f840a2a40 2024-08-19T11:15:10.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7f8409c9f0 con 0x7f7f840a52b0 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f8a3ba640 10 monclient(hunting): authenticate will time out at 968.944544s 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 0x7f7f8413c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 0x7f7f8413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 0x7f7f8413ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55292/0 (socket says 172.21.15.71:55292) 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 0x7f7f8413c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60766/0 (socket says 172.21.15.71:60766) 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 -- 172.21.15.71:0/1412322626 learned_addr learned my addr 172.21.15.71:0/1412322626 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): get_auth_request con 0x7f7f840a52b0 auth_method 0 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): get_auth_request con 0x7f7f840a2a40 auth_method 0 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient(hunting): handle_auth_done global_id 44455 payload 274 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 -- 172.21.15.71:0/1412322626 >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 msgr2=0x7f7f8413c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 --2- 172.21.15.71:0/1412322626 >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 0x7f7f8413c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 -- 172.21.15.71:0/1412322626 >> v1:172.21.15.135:6789/0 conn(0x7f7f840a47c0 legacy=0x7f7f840a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:10.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 monclient: found mon.noname-c 2024-08-19T11:15:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f88957640 1 -- 172.21.15.71:0/1412322626 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f840a2ec0 con 0x7f7f840a52b0 2024-08-19T11:15:10.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.902+0000 7f7f837fe640 1 --2- 172.21.15.71:0/1412322626 >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 0x7f7f8413c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.905+0000 7f7f88957640 1 -- 172.21.15.71:0/1412322626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 msgr2=0x7f7f8413ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.905+0000 7f7f88957640 1 --2- 172.21.15.71:0/1412322626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 0x7f7f8413ed10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009e50 tx=0x7f7f7c02a560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6380c5792847ae49 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 1 -- 172.21.15.71:0/1412322626 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f7c036070 con 0x7f7f840a52b0 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: dump: 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.917 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.918 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 5 monclient: authenticate success, global_id 44455 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 1 -- 172.21.15.71:0/1412322626 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c007a70 con 0x7f7f840a52b0 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 1 -- 172.21.15.71:0/1412322626 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f7c007ca0 con 0x7f7f840a52b0 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 4 set_mon_vals no callback set 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f82ffd640 10 monclient: dump: 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.920 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 10 monclient: shutdown 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/1412322626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 msgr2=0x7f7f8413ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/1412322626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 0x7f7f8413ed10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009e50 tx=0x7f7f7c02a560 comp rx=0 tx=0).stop 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/1412322626 shutdown_connections 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/1412322626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7f840a52b0 0x7f7f8413ed10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/1412322626 >> v2:172.21.15.71:3300/0 conn(0x7f7f840a2a40 0x7f7f8413c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/1412322626 >> 172.21.15.71:0/1412322626 conn(0x7f7f840a93e0 msgr2=0x7f7f840a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/1412322626 shutdown_connections 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.906+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/1412322626 wait complete. 2024-08-19T11:15:10.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.907+0000 7f7f8a3ba640 10 monclient: build_initial_monmap 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.907+0000 7f7f8a3ba640 10 monclient: monmap: 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:10.922 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.907+0000 7f7f8a3ba640 1 Processor -- start 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.907+0000 7f7f8a3ba640 1 -- start start 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.907+0000 7f7f8a3ba640 10 monclient: init 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient: _add_conns ranks=[1,7,2,0,5,4,8,6,3] 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f840a2a40 0x7f7f8411f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): picked mon.noname-f con 0x7f7f840a2a40 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7f840a47c0 0x7f7f8411f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): picked mon.noname-i con 0x7f7f840a47c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:10.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 0x7f7f8411fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): picked mon.noname-b con 0x7f7f840a52b0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f840a3280 con 0x7f7f840a2a40 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7f840a3100 con 0x7f7f840a52b0 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7f8413f250 con 0x7f7f840a47c0 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f8a3ba640 10 monclient(hunting): authenticate will time out at 968.950386s 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 0x7f7f8411fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 0x7f7f8411fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44138/0 (socket says 172.21.15.71:44138) 2024-08-19T11:15:10.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f840a2a40 0x7f7f8411f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 -- 172.21.15.71:0/180471952 learned_addr learned my addr 172.21.15.71:0/180471952 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): get_auth_request con 0x7f7f840a52b0 auth_method 0 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7f840a47c0 0x7f7f8411f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): get_auth_request con 0x7f7f840a2a40 auth_method 0 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): get_auth_request con 0x7f7f840a47c0 auth_method 0 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient(hunting): handle_auth_done global_id 5996 payload 824 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7f840a47c0 msgr2=0x7f7f8411f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7f840a47c0 0x7f7f8411f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f840a2a40 msgr2=0x7f7f8411f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f840a2a40 0x7f7f8411f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient: _finish_hunting 0 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 monclient: found mon.noname-b 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.908+0000 7f7f88957640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8409ee40 con 0x7f7f840a52b0 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f88957640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 msgr2=0x7f7f8411fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f88957640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 0x7f7f8411fe80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c02a5a0 tx=0x7f7f7c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f7c040020 con 0x7f7f840a52b0 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: dump: 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.928 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: _finish_auth 0 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f7c003ba0 con 0x7f7f840a52b0 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 5 monclient: authenticate success, global_id 5996 2024-08-19T11:15:10.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 10 monclient: _renew_subs 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f84121c20 con 0x7f7f840a52b0 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f7c036040 con 0x7f7f840a52b0 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f80ff9640 10 monclient: dump: 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.930 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 10 monclient: _renew_subs 2024-08-19T11:15:10.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f84121f00 con 0x7f7f840a52b0 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f827fc640 4 set_mon_vals no callback set 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.911+0000 7f7f8a3ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 0x7f7f841371e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7f84076c60 con 0x7f7f84136e00 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 0x7f7f841371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient: get_auth_request con 0x7f7f84136e00 auth_method 0 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7f7c043020 con 0x7f7f840a52b0 2024-08-19T11:15:10.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 10 monclient(hunting): handle_auth_done global_id 64115 payload 824 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f83fff640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f8409e8f0 con 0x7f7f84136e00 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f80ff9640 1 --2- 172.21.15.71:0/180471952 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f7003ea80 0x7f7f70040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7f7f7c072470 con 0x7f7f840a52b0 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f837fe640 1 --2- 172.21.15.71:0/180471952 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f7003ea80 0x7f7f70040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.912+0000 7f7f837fe640 10 monclient: get_auth_request con 0x7f7f7003ea80 auth_method 0 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.914+0000 7f7f83fff640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 msgr2=0x7f7f841371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.914+0000 7f7f83fff640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 0x7f7f841371e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400f7a0 tx=0x7f7f7400fc60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.914+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f74018030 con 0x7f7f84136e00 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.914+0000 7f7f80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.914+0000 7f7f80ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.914+0000 7f7f80ff9640 10 monclient: dump: 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.934 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f837fe640 1 --2- 172.21.15.71:0/180471952 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f7003ea80 0x7f7f70040f40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009560 tx=0x7f7f78009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7f7400d9b0 con 0x7f7f84136e00 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 msgr2=0x7f7f841371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 0x7f7f841371e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400f7a0 tx=0x7f7f7400fc60 comp rx=0 tx=0).stop 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 msgr2=0x7f7f841371e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.915+0000 7f7f80ff9640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84136e00 0x7f7f841371e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400f7a0 tx=0x7f7f7400fc60 comp rx=0 tx=0).stop 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f8a3ba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 0x7f7f84071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f8a3ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7f84120700 con 0x7f7f84137720 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 0x7f7f84071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient: get_auth_request con 0x7f7f84137720 auth_method 0 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:10.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 10 monclient(hunting): handle_auth_done global_id 64124 payload 824 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.921+0000 7f7f83fff640 1 -- 172.21.15.71:0/180471952 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f840a8760 con 0x7f7f84137720 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.923+0000 7f7f83fff640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 msgr2=0x7f7f84071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.923+0000 7f7f83fff640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 0x7f7f84071340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400fca0 tx=0x7f7f74003760 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.923+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f74007490 con 0x7f7f84137720 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.923+0000 7f7f80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.923+0000 7f7f80ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:10.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.923+0000 7f7f80ff9640 10 monclient: dump: 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:10.939 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f7f74003fc0 con 0x7f7f84137720 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 msgr2=0x7f7f84071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 0x7f7f84071340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400fca0 tx=0x7f7f74003760 comp rx=0 tx=0).stop 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 msgr2=0x7f7f84071340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f80ff9640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f84137720 0x7f7f84071340 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400fca0 tx=0x7f7f74003760 comp rx=0 tx=0).stop 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:10.940 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 22405, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:10.941 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.942 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.943 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:10.944 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:10.945 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:10.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:10.949 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.950 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:10.952 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.954 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:10.955 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:10.958 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:10.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.960 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:10.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.962 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:10.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:10.964 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:10.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:10.964 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:10.964 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:10.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f7003ea80 msgr2=0x7f7f70040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/180471952 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f7003ea80 0x7f7f70040f40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009560 tx=0x7f7f78009190 comp rx=0 tx=0).stop 2024-08-19T11:15:10.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 10 monclient: shutdown 2024-08-19T11:15:10.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 msgr2=0x7f7f8411fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f88957640 1 -- 172.21.15.71:0/180471952 reap_dead start 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 0x7f7f8411fe80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c02a5a0 tx=0x7f7f7c004a40 comp rx=0 tx=0).stop 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 shutdown_connections 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 --2- 172.21.15.71:0/180471952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f840a52b0 0x7f7f8411fe80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 >> 172.21.15.71:0/180471952 conn(0x7f7f840a93e0 msgr2=0x7f7f8409e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 shutdown_connections 2024-08-19T11:15:10.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:10.924+0000 7f7f8a3ba640 1 -- 172.21.15.71:0/180471952 wait complete. 2024-08-19T11:15:10.966 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:10.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:15:10.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:15:11.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.063+0000 7f332b9cf640 10 monclient: get_monmap_and_config 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.063+0000 7f332b9cf640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.063+0000 7f332b9cf640 10 monclient: monmap: 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:11.065300+0000 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:11.065300+0000 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:11.066 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 Processor -- start 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 -- start start 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient: init 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient: _add_conns ranks=[7,4,5,6,9,3,10,0,1,2,8] 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a6950 0x7f33240a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): picked mon.noname-i con 0x7f33240a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 0x7f33240a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): picked mon.noname-c con 0x7f33240a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:11.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): picked mon.noname-h con 0x7f3324139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f33240a5020 con 0x7f33240a57c0 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f33240a77b0 con 0x7f3324139710 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f33240a7d40 con 0x7f33240a6950 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.064+0000 7f332b9cf640 10 monclient(hunting): authenticate will time out at 969.106978s 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 0x7f33240a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 0x7f33240a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55304/0 (socket says 172.21.15.71:55304) 2024-08-19T11:15:11.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 -- 172.21.15.71:0/4236720571 learned_addr learned my addr 172.21.15.71:0/4236720571 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): get_auth_request con 0x7f33240a57c0 auth_method 0 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient(hunting): handle_auth_done global_id 44464 payload 274 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 -- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a6950 msgr2=0x7f33240a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a6950 0x7f33240a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 -- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 msgr2=0x7f3324139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3329f6c640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 monclient: found mon.noname-c 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3328f6a640 1 -- 172.21.15.71:0/4236720571 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33240a6380 con 0x7f33240a57c0 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3329f6c640 10 monclient: get_auth_request con 0x7f3324139710 auth_method 0 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.065+0000 7f3329f6c640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f3328f6a640 1 -- 172.21.15.71:0/4236720571 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 msgr2=0x7f33240a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f3328f6a640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 0x7f33240a7270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33140098d0 tx=0x7f331402a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=294e4c9f81d87246 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 1 -- 172.21.15.71:0/4236720571 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3314037070 con 0x7f33240a57c0 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: dump: 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.076 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 1 -- 172.21.15.71:0/4236720571 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33140307b0 con 0x7f33240a57c0 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 5 monclient: authenticate success, global_id 44464 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 1 -- 172.21.15.71:0/4236720571 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3314030e50 con 0x7f33240a57c0 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 4 set_mon_vals no callback set 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f331bfff640 10 monclient: dump: 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 10 monclient: shutdown 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 -- 172.21.15.71:0/4236720571 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 msgr2=0x7f33240a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 0x7f33240a7270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33140098d0 tx=0x7f331402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 -- 172.21.15.71:0/4236720571 shutdown_connections 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f33240a57c0 0x7f33240a7270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 --2- 172.21.15.71:0/4236720571 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a6950 0x7f33240a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.068+0000 7f332b9cf640 1 -- 172.21.15.71:0/4236720571 >> 172.21.15.71:0/4236720571 conn(0x7f33240abf50 msgr2=0x7f33240ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 1 -- 172.21.15.71:0/4236720571 shutdown_connections 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 1 -- 172.21.15.71:0/4236720571 wait complete. 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 10 monclient: monmap: 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 1 Processor -- start 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 1 -- start start 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.069+0000 7f332b9cf640 10 monclient: init 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient: _add_conns ranks=[7,1,5,3,0,4,2,6,8] 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a57c0 0x7f33241ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): picked mon.noname-i con 0x7f33240a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 0x7f33241389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): picked mon.noname-f con 0x7f33240a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): picked mon.noname-h con 0x7f3324139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33240a84c0 con 0x7f33240a6950 2024-08-19T11:15:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f33240a3650 con 0x7f3324139710 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f33240a8700 con 0x7f33240a57c0 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332b9cf640 10 monclient(hunting): authenticate will time out at 969.112413s 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a57c0 0x7f33241ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 0x7f33241389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a57c0 0x7f33241ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:45584/0 (socket says 172.21.15.71:45584) 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 1 -- 172.21.15.71:0/3890258752 learned_addr learned my addr 172.21.15.71:0/3890258752 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): get_auth_request con 0x7f33240a57c0 auth_method 0 2024-08-19T11:15:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:59836/0 (socket says 172.21.15.71:59836) 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 0x7f33241389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:34044/0 (socket says 172.21.15.71:34044) 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): get_auth_request con 0x7f3324139710 auth_method 0 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): get_auth_request con 0x7f33240a6950 auth_method 0 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient(hunting): handle_auth_done global_id 5617 payload 824 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a57c0 msgr2=0x7f33241ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a57c0 0x7f33241ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 msgr2=0x7f3324138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 monclient: found mon.noname-f 2024-08-19T11:15:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:15:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3328f6a640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3324125af0 con 0x7f33240a6950 2024-08-19T11:15:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f332976b640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f33240a57c0 0x7f33241ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.070+0000 7f3329f6c640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3324139710 0x7f3324138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:11.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3328f6a640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 msgr2=0x7f33241389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3328f6a640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 0x7f33241389d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3314031000 tx=0x7f33140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3314037040 con 0x7f33240a6950 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: dump: 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f332b9cf640 5 monclient: authenticate success, global_id 5617 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3314003610 con 0x7f33240a6950 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f332b9cf640 10 monclient: _renew_subs 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f332b9cf640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:15:11.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332413a290 con 0x7f33240a6950 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3314003c30 con 0x7f33240a6950 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f3319ffb640 10 monclient: dump: 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.073+0000 7f331b7fe640 4 set_mon_vals no callback set 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 10 monclient: _renew_subs 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3324126390 con 0x7f33240a6950 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 0x7f332402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3324076c60 con 0x7f3324122d60 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 0x7f332402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient: get_auth_request con 0x7f3324122d60 auth_method 0 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.074+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f33140037c0 con 0x7f33240a6950 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f332976b640 10 monclient(hunting): handle_auth_done global_id 5626 payload 824 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f332976b640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33240a1e70 con 0x7f3324122d60 2024-08-19T11:15:11.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f3319ffb640 1 --2- 172.21.15.71:0/3890258752 >> v2:172.21.15.135:6800/726754104 conn(0x7f330803ea80 0x7f3308040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7f3314071ed0 con 0x7f33240a6950 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f3329f6c640 1 --2- 172.21.15.71:0/3890258752 >> v2:172.21.15.135:6800/726754104 conn(0x7f330803ea80 0x7f3308040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.075+0000 7f3329f6c640 10 monclient: get_auth_request con 0x7f330803ea80 auth_method 0 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f332976b640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 msgr2=0x7f332402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f332976b640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 0x7f332402d1c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb10 tx=0x7f332000c150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3320017070 con 0x7f3324122d60 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 10 monclient: dump: 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.096 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3320013470 con 0x7f3324122d60 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 msgr2=0x7f332402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 0x7f332402d1c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb10 tx=0x7f332000c150 comp rx=0 tx=0).stop 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 msgr2=0x7f332402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3319ffb640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324122d60 0x7f332402d1c0 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb10 tx=0x7f332000c150 comp rx=0 tx=0).stop 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.077+0000 7f3329f6c640 1 --2- 172.21.15.71:0/3890258752 >> v2:172.21.15.135:6800/726754104 conn(0x7f330803ea80 0x7f3308040f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3324074f90 tx=0x7f331c007700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.083+0000 7f332b9cf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.083+0000 7f332b9cf640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 0x7f332402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.083+0000 7f332b9cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.083+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33240a20a0 con 0x7f3324123140 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 0x7f332402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient: get_auth_request con 0x7f3324123140 auth_method 0 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 10 monclient(hunting): handle_auth_done global_id 5635 payload 824 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.084+0000 7f332976b640 1 -- 172.21.15.71:0/3890258752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f33240a6d30 con 0x7f3324123140 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.086+0000 7f332976b640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 msgr2=0x7f332402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.086+0000 7f332976b640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 0x7f332402d700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb10 tx=0x7f33200047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3320017070 con 0x7f3324123140 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 10 monclient: dump: 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.099 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f3320006000 con 0x7f3324123140 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 msgr2=0x7f332402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 0x7f332402d700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb10 tx=0x7f33200047d0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 msgr2=0x7f332402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.087+0000 7f3319ffb640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3324123140 0x7f332402d700 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f332000eb10 tx=0x7f33200047d0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:11.101 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 307928, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:11.102 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.103 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:11.105 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.106 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:11.107 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.111 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:11.113 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.116 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:11.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:11.118 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:11.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.122 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:11.123 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 >> v2:172.21.15.135:6800/726754104 conn(0x7f330803ea80 msgr2=0x7f3308040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 --2- 172.21.15.71:0/3890258752 >> v2:172.21.15.135:6800/726754104 conn(0x7f330803ea80 0x7f3308040f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3324074f90 tx=0x7f331c007700 comp rx=0 tx=0).stop 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 10 monclient: shutdown 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 msgr2=0x7f33241389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 --2- 172.21.15.71:0/3890258752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33240a6950 0x7f33241389d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3314031000 tx=0x7f33140046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f3329f6c640 1 -- 172.21.15.71:0/3890258752 reap_dead start 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f3329f6c640 1 -- 172.21.15.71:0/3890258752 reap_dead start 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 shutdown_connections 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 >> 172.21.15.71:0/3890258752 conn(0x7f33240abf50 msgr2=0x7f33240aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 shutdown_connections 2024-08-19T11:15:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.088+0000 7f332b9cf640 1 -- 172.21.15.71:0/3890258752 wait complete. 2024-08-19T11:15:11.126 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:11.126 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:15:11.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:15:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.223+0000 7ff813cda640 10 monclient: get_monmap_and_config 2024-08-19T11:15:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.223+0000 7ff813cda640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.223+0000 7ff813cda640 10 monclient: monmap: 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:11.225202+0000 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:11.225202+0000 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:11.226 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:11.227 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 Processor -- start 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 -- start start 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient: init 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient: _add_conns ranks=[2,3,10,8,4,0,7,6,1,5,9] 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 0x7ff80c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): picked mon.noname-b con 0x7ff80c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): picked mon.noname-g con 0x7ff80c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff80c139710 0x7ff80c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): picked mon.noname-f con 0x7ff80c139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff80c0a5020 con 0x7ff80c139710 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c0a77b0 con 0x7ff80c0a6950 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c0a7d40 con 0x7ff80c0a57c0 2024-08-19T11:15:11.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff813cda640 10 monclient(hunting): authenticate will time out at 969.266910s 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.224+0000 7ff811a76640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 0x7ff80c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 0x7ff80c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44144/0 (socket says 172.21.15.71:44144) 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 -- 172.21.15.71:0/298291948 learned_addr learned my addr 172.21.15.71:0/298291948 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): get_auth_request con 0x7ff80c0a6950 auth_method 0 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811275640 1 --2- 172.21.15.71:0/298291948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff812277640 1 --2- 172.21.15.71:0/298291948 >> v2:172.21.15.135:3300/0 conn(0x7ff80c139710 0x7ff80c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811275640 10 monclient(hunting): get_auth_request con 0x7ff80c0a57c0 auth_method 0 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811275640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811275640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811275640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff812277640 10 monclient(hunting): get_auth_request con 0x7ff80c139710 auth_method 0 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff812277640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff812277640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff812277640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-08-19T11:15:11.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 -- 172.21.15.71:0/298291948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 msgr2=0x7ff80c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 --2- 172.21.15.71:0/298291948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 -- 172.21.15.71:0/298291948 >> v2:172.21.15.135:3300/0 conn(0x7ff80c139710 msgr2=0x7ff80c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 --2- 172.21.15.71:0/298291948 >> v2:172.21.15.135:3300/0 conn(0x7ff80c139710 0x7ff80c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 monclient: found mon.noname-b 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff811a76640 1 -- 172.21.15.71:0/298291948 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c0a6380 con 0x7ff80c0a6950 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.225+0000 7ff812277640 1 --2- 172.21.15.71:0/298291948 >> v2:172.21.15.135:3300/0 conn(0x7ff80c139710 0x7ff80c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.227+0000 7ff811a76640 1 -- 172.21.15.71:0/298291948 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 msgr2=0x7ff80c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.227+0000 7ff811a76640 1 --2- 172.21.15.71:0/298291948 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 0x7ff80c0a6d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff808009e80 tx=0x7ff80802a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f621e0ea7be6d1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 1 -- 172.21.15.71:0/298291948 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff808036070 con 0x7ff80c0a6950 2024-08-19T11:15:11.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: dump: 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.242 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 1 -- 172.21.15.71:0/298291948 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff808007a70 con 0x7ff80c0a6950 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 5 monclient: authenticate success, global_id 6005 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 1 -- 172.21.15.71:0/298291948 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff808007c20 con 0x7ff80c0a6950 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 4 set_mon_vals no callback set 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff810a74640 10 monclient: dump: 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.244 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.245 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 10 monclient: shutdown 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 -- 172.21.15.71:0/298291948 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 msgr2=0x7ff80c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 --2- 172.21.15.71:0/298291948 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 0x7ff80c0a6d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff808009e80 tx=0x7ff80802a580 comp rx=0 tx=0).stop 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 -- 172.21.15.71:0/298291948 shutdown_connections 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 --2- 172.21.15.71:0/298291948 >> v2:172.21.15.135:3300/0 conn(0x7ff80c139710 0x7ff80c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 --2- 172.21.15.71:0/298291948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 --2- 172.21.15.71:0/298291948 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff80c0a6950 0x7ff80c0a6d30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 -- 172.21.15.71:0/298291948 >> 172.21.15.71:0/298291948 conn(0x7ff80c0abf50 msgr2=0x7ff80c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 -- 172.21.15.71:0/298291948 shutdown_connections 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.228+0000 7ff813cda640 1 -- 172.21.15.71:0/298291948 wait complete. 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.229+0000 7ff813cda640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.229+0000 7ff813cda640 10 monclient: monmap: 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.247 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.229+0000 7ff813cda640 1 Processor -- start 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.229+0000 7ff813cda640 1 -- start start 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.229+0000 7ff813cda640 10 monclient: init 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient: _add_conns ranks=[3,8,5,7,2,6,4,1,0] 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c1ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): picked mon.noname-g con 0x7ff80c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:11.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 0x7ff80c1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): picked mon.noname-e con 0x7ff80c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff80c139710 0x7ff80c138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): picked mon.noname-h con 0x7ff80c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c0a84c0 con 0x7ff80c0a57c0 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff80c0a3650 con 0x7ff80c139710 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff80c0a8700 con 0x7ff80c0a6950 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff813cda640 10 monclient(hunting): authenticate will time out at 969.272286s 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 0x7ff80c1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 0x7ff80c1388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:52326/0 (socket says 172.21.15.71:52326) 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 -- 172.21.15.71:0/4220908001 learned_addr learned my addr 172.21.15.71:0/4220908001 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): get_auth_request con 0x7ff80c0a6950 auth_method 0 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff812277640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff80c139710 0x7ff80c138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811a76640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c1ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff812277640 10 monclient(hunting): get_auth_request con 0x7ff80c139710 auth_method 0 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff812277640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff812277640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff812277640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811a76640 10 monclient(hunting): get_auth_request con 0x7ff80c0a57c0 auth_method 0 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811a76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811a76640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811a76640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient(hunting): handle_auth_done global_id 64133 payload 824 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff80c139710 msgr2=0x7ff80c138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff80c139710 0x7ff80c138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 msgr2=0x7ff80c1ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c0a57c0 0x7ff80c1ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 monclient: found mon.noname-e 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.230+0000 7ff811275640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c123f70 con 0x7ff80c0a6950 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.232+0000 7ff811275640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 msgr2=0x7ff80c1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.232+0000 7ff811275640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 0x7ff80c1388f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00d620 tx=0x7ff7fc00dae0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7fc00bca0 con 0x7ff80c0a6950 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: dump: 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.252 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.253 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc019070 con 0x7ff80c0a6950 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 5 monclient: authenticate success, global_id 64133 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 10 monclient: _renew_subs 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c13a370 con 0x7ff80c0a6950 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7fc0148a0 con 0x7ff80c0a6950 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff803fff640 4 set_mon_vals no callback set 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 10 monclient: dump: 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.255 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.256 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.256 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 10 monclient: _renew_subs 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c1262d0 con 0x7ff80c0a6950 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 0x7ff80c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c076c60 con 0x7ff80c122d60 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.233+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff7fc014430 con 0x7ff80c0a6950 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff8027fc640 1 --2- 172.21.15.71:0/4220908001 >> v2:172.21.15.135:6800/726754104 conn(0x7ff7f003ea80 0x7ff7f0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(143..143 src has 1..143) ==== 3898+0+0 (secure 0 0 0) 0x7ff7fc00f040 con 0x7ff80c0a6950 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 0x7ff80c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient: get_auth_request con 0x7ff80c122d60 auth_method 0 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff812277640 1 --2- 172.21.15.71:0/4220908001 >> v2:172.21.15.135:6800/726754104 conn(0x7ff7f003ea80 0x7ff7f0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff812277640 10 monclient: get_auth_request con 0x7ff7f003ea80 auth_method 0 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 10 monclient(hunting): handle_auth_done global_id 44418 payload 824 2024-08-19T11:15:11.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.234+0000 7ff811a76640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff80c0a1e90 con 0x7ff80c122d60 2024-08-19T11:15:11.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff811a76640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 msgr2=0x7ff80c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff811a76640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 0x7ff80c02d1c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff80c074f90 tx=0x7ff808004a40 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff812277640 1 --2- 172.21.15.71:0/4220908001 >> v2:172.21.15.135:6800/726754104 conn(0x7ff7f003ea80 0x7ff7f0040f40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff804006fd0 tx=0x7ff804008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff808040070 con 0x7ff80c122d60 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff8027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff8027fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.236+0000 7ff8027fc640 10 monclient: dump: 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.262 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff808007a40 con 0x7ff80c122d60 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 msgr2=0x7ff80c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 0x7ff80c02d1c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff80c074f90 tx=0x7ff808004a40 comp rx=0 tx=0).stop 2024-08-19T11:15:11.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 msgr2=0x7ff80c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.237+0000 7ff8027fc640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c122d60 0x7ff80c02d1c0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff80c074f90 tx=0x7ff808004a40 comp rx=0 tx=0).stop 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff813cda640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff813cda640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 0x7ff80c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff813cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c0a6d30 con 0x7ff80c123140 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 0x7ff80c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient: get_auth_request con 0x7ff80c123140 auth_method 0 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.243+0000 7ff811a76640 10 monclient(hunting): handle_auth_done global_id 44427 payload 824 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.244+0000 7ff811a76640 1 -- 172.21.15.71:0/4220908001 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff80c09e100 con 0x7ff80c123140 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff811a76640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 msgr2=0x7ff80c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff811a76640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 0x7ff80c02d700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff808000f80 tx=0x7ff80802f000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff808036040 con 0x7ff80c123140 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 10 monclient: dump: 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.265 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7ff808031400 con 0x7ff80c123140 2024-08-19T11:15:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 msgr2=0x7ff80c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 0x7ff80c02d700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff808000f80 tx=0x7ff80802f000 comp rx=0 tx=0).stop 2024-08-19T11:15:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 msgr2=0x7ff80c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff8027fc640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff80c123140 0x7ff80c02d700 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff808000f80 tx=0x7ff80802f000 comp rx=0 tx=0).stop 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 80270, 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:11.268 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.269 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.270 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.271 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:11.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.273 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:11.290 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 >> v2:172.21.15.135:6800/726754104 conn(0x7ff7f003ea80 msgr2=0x7ff7f0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.246+0000 7ff813cda640 1 --2- 172.21.15.71:0/4220908001 >> v2:172.21.15.135:6800/726754104 conn(0x7ff7f003ea80 0x7ff7f0040f40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff804006fd0 tx=0x7ff804008040 comp rx=0 tx=0).stop 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 10 monclient: shutdown 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 msgr2=0x7ff80c1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 0x7ff80c1388f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00d620 tx=0x7ff7fc00dae0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff812277640 1 -- 172.21.15.71:0/4220908001 reap_dead start 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 shutdown_connections 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 --2- 172.21.15.71:0/4220908001 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff80c0a6950 0x7ff80c1388f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 >> 172.21.15.71:0/4220908001 conn(0x7ff80c0abf50 msgr2=0x7ff80c0aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 shutdown_connections 2024-08-19T11:15:11.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.247+0000 7ff813cda640 1 -- 172.21.15.71:0/4220908001 wait complete. 2024-08-19T11:15:11.293 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:11.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:15:11.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:15:11.326 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:11.326 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26188]: starting. 2024-08-19T11:15:11.326 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26188]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26093 2024-08-19T11:15:11.326 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26188]: shutting down. 2024-08-19T11:15:11.327 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:11.328 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:11.328 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:15:11.330 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:15:11.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.399+0000 7f6c72f22640 10 monclient: get_monmap_and_config 2024-08-19T11:15:11.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.399+0000 7f6c72f22640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.399+0000 7f6c72f22640 10 monclient: monmap: 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:11.401208+0000 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:11.401208+0000 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.402 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:11.403 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:11.403 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 Processor -- start 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 -- start start 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient: init 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient: _add_conns ranks=[8,5,2,6,9,4,0,1,3,7,10] 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 0x7f6c6c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): picked mon.noname-e con 0x7f6c6c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a57c0 0x7f6c6c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): picked mon.noname-h con 0x7f6c6c0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 0x7f6c6c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): picked mon.noname-b con 0x7f6c6c139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c0a5020 con 0x7f6c6c139710 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6c6c0a77b0 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6c6c0a7d40 con 0x7f6c6c0a6950 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c72f22640 10 monclient(hunting): authenticate will time out at 969.442853s 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c70cbe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 0x7f6c6c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.400+0000 7f6c714bf640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 0x7f6c6c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 0x7f6c6c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:52330/0 (socket says 172.21.15.71:52330) 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 0x7f6c6c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44156/0 (socket says 172.21.15.71:44156) 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 1 -- 172.21.15.71:0/48609042 learned_addr learned my addr 172.21.15.71:0/48609042 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): get_auth_request con 0x7f6c6c0a6950 auth_method 0 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): get_auth_request con 0x7f6c6c139710 auth_method 0 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a57c0 0x7f6c6c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient(hunting): handle_auth_done global_id 6014 payload 274 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 -- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 msgr2=0x7f6c6c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 0x7f6c6c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 -- 172.21.15.71:0/48609042 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a57c0 msgr2=0x7f6c6c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a57c0 0x7f6c6c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 monclient: found mon.noname-b 2024-08-19T11:15:11.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c714bf640 1 -- 172.21.15.71:0/48609042 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c0a6380 con 0x7f6c6c139710 2024-08-19T11:15:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c6bfff640 10 monclient: get_auth_request con 0x7f6c6c0a57c0 auth_method 0 2024-08-19T11:15:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c70cbe640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 0x7f6c6c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:11.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.401+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a57c0 0x7f6c6c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c714bf640 1 -- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 msgr2=0x7f6c6c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c714bf640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 0x7f6c6c139b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009df0 tx=0x7f6c6402a4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44415d392dce372 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 1 -- 172.21.15.71:0/48609042 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c64007bc0 con 0x7f6c6c139710 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: dump: 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.416 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.417 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 1 -- 172.21.15.71:0/48609042 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c64007d80 con 0x7f6c6c139710 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 5 monclient: authenticate success, global_id 6014 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 1 -- 172.21.15.71:0/48609042 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c64031870 con 0x7f6c6c139710 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 4 set_mon_vals no callback set 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:11.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c6b7fe640 10 monclient: dump: 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 10 monclient: shutdown 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 -- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 msgr2=0x7f6c6c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 0x7f6c6c139b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009df0 tx=0x7f6c6402a4b0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 -- 172.21.15.71:0/48609042 shutdown_connections 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c6c139710 0x7f6c6c139b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a57c0 0x7f6c6c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 --2- 172.21.15.71:0/48609042 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6c6c0a6950 0x7f6c6c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 -- 172.21.15.71:0/48609042 >> 172.21.15.71:0/48609042 conn(0x7f6c6c0abf50 msgr2=0x7f6c6c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 -- 172.21.15.71:0/48609042 shutdown_connections 2024-08-19T11:15:11.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.404+0000 7f6c72f22640 1 -- 172.21.15.71:0/48609042 wait complete. 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.405+0000 7f6c72f22640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.405+0000 7f6c72f22640 10 monclient: monmap: 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.421 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.405+0000 7f6c72f22640 1 Processor -- start 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.405+0000 7f6c72f22640 1 -- start start 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.405+0000 7f6c72f22640 10 monclient: init 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient: _add_conns ranks=[3,5,0,7,6,1,8,4,2] 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 0x7f6c6c1ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): picked mon.noname-g con 0x7f6c6c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a6950 0x7f6c6c138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): picked mon.noname-h con 0x7f6c6c0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c6c139710 0x7f6c6c122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): picked mon.noname-a con 0x7f6c6c139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c0a84c0 con 0x7f6c6c139710 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c0a3650 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6c6c0a8700 con 0x7f6c6c0a6950 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c72f22640 10 monclient(hunting): authenticate will time out at 969.448468s 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 0x7f6c6c1ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a6950 0x7f6c6c138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 0x7f6c6c1ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:58966/0 (socket says 172.21.15.71:58966) 2024-08-19T11:15:11.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c6c139710 0x7f6c6c122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 -- 172.21.15.71:0/2188570851 learned_addr learned my addr 172.21.15.71:0/2188570851 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): get_auth_request con 0x7f6c6c0a57c0 auth_method 0 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): get_auth_request con 0x7f6c6c0a6950 auth_method 0 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): get_auth_request con 0x7f6c6c139710 auth_method 0 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c714bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient(hunting): handle_auth_done global_id 44445 payload 824 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a6950 msgr2=0x7f6c6c138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a6950 0x7f6c6c138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c6c139710 msgr2=0x7f6c6c122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c6c139710 0x7f6c6c122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 monclient: found mon.noname-g 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c70cbe640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c126650 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.406+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c0a6950 0x7f6c6c138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c70cbe640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 msgr2=0x7f6c6c1ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c70cbe640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 0x7f6c6c1ce1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e9d0 tx=0x7f6c6000ee90 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c60017070 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: dump: 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.427 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6000cc70 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 5 monclient: authenticate success, global_id 44445 2024-08-19T11:15:11.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 10 monclient: _renew_subs 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c13a260 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c6000ce20 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c697fa640 10 monclient: dump: 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.429 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c6affd640 4 set_mon_vals no callback set 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 10 monclient: _renew_subs 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.409+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c124e50 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6c6001a070 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c72f22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c72f22640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 0x7f6c6c02d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6c6c06a590 con 0x7f6c6c02d1c0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c697fa640 1 --2- 172.21.15.71:0/2188570851 >> v2:172.21.15.135:6800/726754104 conn(0x7f6c5003ea80 0x7f6c50040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(144..144 src has 1..144) ==== 3506+0+0 (secure 0 0 0) 0x7f6c6000f040 con 0x7f6c6c0a57c0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 0x7f6c6c02d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c714bf640 1 --2- 172.21.15.71:0/2188570851 >> v2:172.21.15.135:6800/726754104 conn(0x7f6c5003ea80 0x7f6c50040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient: get_auth_request con 0x7f6c6c02d1c0 auth_method 0 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c714bf640 10 monclient: get_auth_request con 0x7f6c5003ea80 auth_method 0 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_done global_id 44510 payload 824 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.410+0000 7f6c6bfff640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c6c1cf0b0 con 0x7f6c6c02d1c0 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c6bfff640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 msgr2=0x7f6c6c02d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 0x7f6c6c02d5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800fc70 tx=0x7f6c5800d590 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c714bf640 1 --2- 172.21.15.71:0/2188570851 >> v2:172.21.15.135:6800/726754104 conn(0x7f6c5003ea80 0x7f6c50040f40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009dc0 tx=0x7f6c6402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c5800fe80 con 0x7f6c6c02d1c0 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 10 monclient: dump: 2024-08-19T11:15:11.432 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.433 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6c5800fe80 con 0x7f6c6c02d1c0 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 msgr2=0x7f6c6c02d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 0x7f6c6c02d5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800fc70 tx=0x7f6c5800d590 comp rx=0 tx=0).stop 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 msgr2=0x7f6c6c02d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.413+0000 7f6c697fa640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02d1c0 0x7f6c6c02d5a0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800fc70 tx=0x7f6c5800d590 comp rx=0 tx=0).stop 2024-08-19T11:15:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.419+0000 7f6c72f22640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c72f22640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 0x7f6c6c02def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c72f22640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6c6c125ff0 con 0x7f6c6c02dae0 2024-08-19T11:15:11.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 0x7f6c6c02def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient: get_auth_request con 0x7f6c6c02dae0 auth_method 0 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 10 monclient(hunting): handle_auth_done global_id 44519 payload 824 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.420+0000 7f6c6bfff640 1 -- 172.21.15.71:0/2188570851 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c6c0a1d90 con 0x7f6c6c02dae0 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.422+0000 7f6c6bfff640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 msgr2=0x7f6c6c02def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.422+0000 7f6c6bfff640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 0x7f6c6c02def0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800fc70 tx=0x7f6c580046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6c58013d90 con 0x7f6c6c02dae0 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 10 monclient: dump: 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.438 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f6c58013920 con 0x7f6c6c02dae0 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 msgr2=0x7f6c6c02def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 0x7f6c6c02def0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800fc70 tx=0x7f6c580046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 msgr2=0x7f6c6c02def0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c697fa640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6c6c02dae0 0x7f6c6c02def0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800fc70 tx=0x7f6c580046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 80446, 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:11.440 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.441 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.442 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.443 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.444 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.445 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.446 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.448 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.449 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:11.452 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:11.453 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.454 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.455 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.456 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.457 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:11.458 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.460 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.461 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:11.463 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 >> v2:172.21.15.135:6800/726754104 conn(0x7f6c5003ea80 msgr2=0x7f6c50040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 --2- 172.21.15.71:0/2188570851 >> v2:172.21.15.135:6800/726754104 conn(0x7f6c5003ea80 0x7f6c50040f40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009dc0 tx=0x7f6c6402f000 comp rx=0 tx=0).stop 2024-08-19T11:15:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 10 monclient: shutdown 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 msgr2=0x7f6c6c1ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 0x7f6c6c1ce1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e9d0 tx=0x7f6c6000ee90 comp rx=0 tx=0).stop 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c714bf640 1 -- 172.21.15.71:0/2188570851 reap_dead start 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 shutdown_connections 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 --2- 172.21.15.71:0/2188570851 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c6c0a57c0 0x7f6c6c1ce1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 >> 172.21.15.71:0/2188570851 conn(0x7f6c6c0abf50 msgr2=0x7f6c6c0aa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 shutdown_connections 2024-08-19T11:15:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.423+0000 7f6c72f22640 1 -- 172.21.15.71:0/2188570851 wait complete. 2024-08-19T11:15:11.465 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:11.465 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:15:11.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.564+0000 7fdefd9e7640 10 monclient: get_monmap_and_config 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.564+0000 7fdefd9e7640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.564+0000 7fdefd9e7640 10 monclient: monmap: 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:11.566039+0000 2024-08-19T11:15:11.566 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:11.566039+0000 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:11.567 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 Processor -- start 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 -- start start 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient: init 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient: _add_conns ranks=[7,3,6,8,9,1,5,0,4,2,10] 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): picked mon.noname-i con 0x7fdef80a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef80a57c0 0x7fdef80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): picked mon.noname-g con 0x7fdef80a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 0x7fdef8139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): picked mon.noname-d con 0x7fdef8139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:11.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdef80a5020 con 0x7fdef80a57c0 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fdef80a77b0 con 0x7fdef8139710 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fdef80a7d40 con 0x7fdef80a6950 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdefd9e7640 10 monclient(hunting): authenticate will time out at 969.607769s 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 0x7fdef8139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 0x7fdef8139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36994/0 (socket says 172.21.15.71:36994) 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 1 -- 172.21.15.71:0/2016423204 learned_addr learned my addr 172.21.15.71:0/2016423204 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 10 monclient(hunting): get_auth_request con 0x7fdef8139710 auth_method 0 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.565+0000 7fdef77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef6ffd640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdeeffff640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef80a57c0 0x7fdef80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef6ffd640 10 monclient(hunting): get_auth_request con 0x7fdef80a6950 auth_method 0 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdeeffff640 10 monclient(hunting): get_auth_request con 0x7fdef80a57c0 auth_method 0 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdeeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdeeffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdeeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 10 monclient(hunting): handle_auth_done global_id 25269 payload 274 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 1 -- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 msgr2=0x7fdef80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 1 -- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef80a57c0 msgr2=0x7fdef80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef80a57c0 0x7fdef80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 1 monclient: found mon.noname-d 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.566+0000 7fdef77fe640 1 -- 172.21.15.71:0/2016423204 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef80a6380 con 0x7fdef8139710 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.568+0000 7fdef77fe640 1 -- 172.21.15.71:0/2016423204 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 msgr2=0x7fdef8139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.568+0000 7fdef77fe640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 0x7fdef8139b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009eb0 tx=0x7fdef002a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e89b41d0af927880 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 1 -- 172.21.15.71:0/2016423204 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdef0036070 con 0x7fdef8139710 2024-08-19T11:15:11.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: dump: 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.576 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 5 monclient: authenticate success, global_id 25269 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 1 -- 172.21.15.71:0/2016423204 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef0007a70 con 0x7fdef8139710 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 1 -- 172.21.15.71:0/2016423204 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdef0007ca0 con 0x7fdef8139710 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 4 set_mon_vals no callback set 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdef67fc640 10 monclient: dump: 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.578 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 10 monclient: shutdown 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 -- 172.21.15.71:0/2016423204 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 msgr2=0x7fdef8139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 0x7fdef8139b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009eb0 tx=0x7fdef002a560 comp rx=0 tx=0).stop 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 -- 172.21.15.71:0/2016423204 shutdown_connections 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdef8139710 0x7fdef8139b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdef80a57c0 0x7fdef80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/2016423204 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 -- 172.21.15.71:0/2016423204 >> 172.21.15.71:0/2016423204 conn(0x7fdef80abf50 msgr2=0x7fdef80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 -- 172.21.15.71:0/2016423204 shutdown_connections 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.569+0000 7fdefd9e7640 1 -- 172.21.15.71:0/2016423204 wait complete. 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.570+0000 7fdefd9e7640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.570+0000 7fdefd9e7640 10 monclient: monmap: 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:11.580 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.581 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.570+0000 7fdefd9e7640 1 Processor -- start 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.570+0000 7fdefd9e7640 1 -- start start 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.570+0000 7fdefd9e7640 10 monclient: init 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient: _add_conns ranks=[4,7,8,1,5,3,6,2,0] 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 0x7fdef81ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): picked mon.noname-c con 0x7fdef80a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:11.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef81cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): picked mon.noname-i con 0x7fdef80a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdef8139710 0x7fdef8125090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): picked mon.noname-e con 0x7fdef8139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fdef80a84c0 con 0x7fdef80a57c0 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fdef80a3650 con 0x7fdef80a6950 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fdef80a8700 con 0x7fdef8139710 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdefd9e7640 10 monclient(hunting): authenticate will time out at 969.613322s 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 0x7fdef81ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 0x7fdef81ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55310/0 (socket says 172.21.15.71:55310) 2024-08-19T11:15:11.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 -- 172.21.15.71:0/3115405990 learned_addr learned my addr 172.21.15.71:0/3115405990 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): get_auth_request con 0x7fdef80a57c0 auth_method 0 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdef8139710 0x7fdef8125090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): get_auth_request con 0x7fdef8139710 auth_method 0 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef81cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): get_auth_request con 0x7fdef80a6950 auth_method 0 2024-08-19T11:15:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient(hunting): handle_auth_done global_id 44482 payload 824 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdef8139710 msgr2=0x7fdef8125090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdef8139710 0x7fdef8125090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 msgr2=0x7fdef81cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef80a6950 0x7fdef81cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 monclient: found mon.noname-c 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.571+0000 7fdef6ffd640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef81383c0 con 0x7fdef80a57c0 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.573+0000 7fdef6ffd640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 msgr2=0x7fdef81ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.573+0000 7fdef6ffd640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 0x7fdef81ced20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdee800d800 tx=0x7fdee800dcc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdee800bd40 con 0x7fdef80a57c0 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: dump: 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 5 monclient: authenticate success, global_id 44482 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee8019070 con 0x7fdef80a57c0 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdee80148a0 con 0x7fdef80a57c0 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 10 monclient: _renew_subs 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef8126aa0 con 0x7fdef80a57c0 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef5ffb640 4 set_mon_vals no callback set 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdef4ff9640 10 monclient: dump: 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 10 monclient: _renew_subs 2024-08-19T11:15:11.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.574+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef8128560 con 0x7fdef80a57c0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdefd9e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 0x7fdef81259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fdef806a590 con 0x7fdef81255d0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fdee8014430 con 0x7fdef80a57c0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdef4ff9640 1 --2- 172.21.15.71:0/3115405990 >> v2:172.21.15.135:6800/726754104 conn(0x7fded803ea80 0x7fded8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 0x7fdef81259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient: get_auth_request con 0x7fdef81255d0 auth_method 0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(144..144 src has 1..144) ==== 3506+0+0 (secure 0 0 0) 0x7fdee800f040 con 0x7fdef80a57c0 2024-08-19T11:15:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdef77fe640 1 --2- 172.21.15.71:0/3115405990 >> v2:172.21.15.135:6800/726754104 conn(0x7fded803ea80 0x7fded8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdef77fe640 10 monclient: get_auth_request con 0x7fded803ea80 auth_method 0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 10 monclient(hunting): handle_auth_done global_id 64195 payload 824 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.575+0000 7fdeeffff640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdef80a1f60 con 0x7fdef81255d0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.577+0000 7fdeeffff640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 msgr2=0x7fdef81259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.577+0000 7fdeeffff640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 0x7fdef81259b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdef8127110 tx=0x7fdee0010c10 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef77fe640 1 --2- 172.21.15.71:0/3115405990 >> v2:172.21.15.135:6800/726754104 conn(0x7fded803ea80 0x7fded8040f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdef0033000 tx=0x7fdef0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdee0018020 con 0x7fdef81255d0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 10 monclient: dump: 2024-08-19T11:15:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.596 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdee0004450 con 0x7fdef81255d0 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 msgr2=0x7fdef81259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 0x7fdef81259b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdef8127110 tx=0x7fdee0010c10 comp rx=0 tx=0).stop 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 msgr2=0x7fdef81259b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.578+0000 7fdef4ff9640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef81255d0 0x7fdef81259b0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdef8127110 tx=0x7fdee0010c10 comp rx=0 tx=0).stop 2024-08-19T11:15:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.584+0000 7fdefd9e7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.584+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 0x7fdef809fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdefd9e7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fdef8076c60 con 0x7fdef8125ef0 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 0x7fdef809fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient: get_auth_request con 0x7fdef8125ef0 auth_method 0 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 10 monclient(hunting): handle_auth_done global_id 64204 payload 824 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.585+0000 7fdeeffff640 1 -- 172.21.15.71:0/3115405990 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdef80a6d30 con 0x7fdef8125ef0 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.587+0000 7fdeeffff640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 msgr2=0x7fdef809fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.587+0000 7fdeeffff640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 0x7fdef809fa10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdee0019000 tx=0x7fdee00046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdee0018040 con 0x7fdef8125ef0 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 10 monclient: dump: 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.600 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7fdee0003610 con 0x7fdef8125ef0 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 msgr2=0x7fdef809fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 0x7fdef809fa10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdee0019000 tx=0x7fdee00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 msgr2=0x7fdef809fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef4ff9640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdef8125ef0 0x7fdef809fa10 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdee0019000 tx=0x7fdee00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 23082, 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:11.602 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:11.603 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.604 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:11.605 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:11.606 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:11.607 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.609 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.611 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.612 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:11.613 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.615 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.619 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:11.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:11.624 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:11.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:11.624 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:11.624 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 >> v2:172.21.15.135:6800/726754104 conn(0x7fded803ea80 msgr2=0x7fded8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/3115405990 >> v2:172.21.15.135:6800/726754104 conn(0x7fded803ea80 0x7fded8040f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdef0033000 tx=0x7fdef0009000 comp rx=0 tx=0).stop 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 10 monclient: shutdown 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 msgr2=0x7fdef81ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 --2- 172.21.15.71:0/3115405990 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fdef80a57c0 0x7fdef81ced20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdee800d800 tx=0x7fdee800dcc0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef77fe640 1 -- 172.21.15.71:0/3115405990 reap_dead start 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdef77fe640 1 -- 172.21.15.71:0/3115405990 reap_dead start 2024-08-19T11:15:11.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 shutdown_connections 2024-08-19T11:15:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 >> 172.21.15.71:0/3115405990 conn(0x7fdef80abf50 msgr2=0x7fdef8138f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 shutdown_connections 2024-08-19T11:15:11.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.588+0000 7fdefd9e7640 1 -- 172.21.15.71:0/3115405990 wait complete. 2024-08-19T11:15:11.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:11.626 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:15:11.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.722+0000 7f3ebf5b8640 10 monclient: get_monmap_and_config 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.722+0000 7f3ebf5b8640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.722+0000 7f3ebf5b8640 10 monclient: monmap: 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:11.723807+0000 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:11.723807+0000 2024-08-19T11:15:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.722+0000 7f3ebf5b8640 1 Processor -- start 2024-08-19T11:15:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.722+0000 7f3ebf5b8640 1 -- start start 2024-08-19T11:15:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.722+0000 7f3ebf5b8640 10 monclient: init 2024-08-19T11:15:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient: _add_conns ranks=[5,6,2,7,9,1,4,3,0,8,10] 2024-08-19T11:15:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3eb80a6a30 0x7f3eb80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): picked mon.noname-h con 0x7f3eb80a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3eb80a6e10 0x7f3eb80a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): picked mon.noname-d con 0x7f3eb80a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 0x7f3eb8139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): picked mon.noname-b con 0x7f3eb8139860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb80a4f90 con 0x7f3eb8139860 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3eb80a6380 con 0x7f3eb80a6a30 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3eb80a49d0 con 0x7f3eb80a6e10 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebf5b8640 10 monclient(hunting): authenticate will time out at 969.765508s 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 0x7f3eb8139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3eb80a6e10 0x7f3eb80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 0x7f3eb8139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44170/0 (socket says 172.21.15.71:44170) 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3eb80a6e10 0x7f3eb80a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:37002/0 (socket says 172.21.15.71:37002) 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 -- 172.21.15.71:0/3254864867 learned_addr learned my addr 172.21.15.71:0/3254864867 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): get_auth_request con 0x7f3eb8139860 auth_method 0 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): get_auth_request con 0x7f3eb80a6e10 auth_method 0 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebd354640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3eb80a6a30 0x7f3eb80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebd354640 10 monclient(hunting): get_auth_request con 0x7f3eb80a6a30 auth_method 0 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebd354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebd354640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebd354640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_done global_id 6023 payload 274 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 -- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3eb80a6e10 msgr2=0x7f3eb80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3eb80a6e10 0x7f3eb80a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 -- 172.21.15.71:0/3254864867 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3eb80a6a30 msgr2=0x7f3eb80a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3eb80a6a30 0x7f3eb80a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 monclient: found mon.noname-b 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebdb55640 1 -- 172.21.15.71:0/3254864867 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb80a46f0 con 0x7f3eb8139860 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.723+0000 7f3ebd354640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3eb80a6a30 0x7f3eb80a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3ebdb55640 1 -- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 msgr2=0x7f3eb8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3ebdb55640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 0x7f3eb8139c60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009eb0 tx=0x7f3eb002a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be8858e458e9702e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 1 -- 172.21.15.71:0/3254864867 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3eb0036070 con 0x7f3eb8139860 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: dump: 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.733 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.734 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 1 -- 172.21.15.71:0/3254864867 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0007a70 con 0x7f3eb8139860 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3ebf5b8640 5 monclient: authenticate success, global_id 6023 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3ebf5b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3ebf5b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 1 -- 172.21.15.71:0/3254864867 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3eb0007c60 con 0x7f3eb8139860 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3ebf5b8640 4 set_mon_vals no callback set 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:11.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.726+0000 7f3eaffff640 10 monclient: dump: 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.736 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 10 monclient: shutdown 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 msgr2=0x7f3eb8139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 0x7f3eb8139c60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009eb0 tx=0x7f3eb002a560 comp rx=0 tx=0).stop 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/3254864867 shutdown_connections 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3eb8139860 0x7f3eb8139c60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3eb80a6e10 0x7f3eb80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/3254864867 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3eb80a6a30 0x7f3eb80a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/3254864867 >> 172.21.15.71:0/3254864867 conn(0x7f3eb80ac030 msgr2=0x7f3eb80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/3254864867 shutdown_connections 2024-08-19T11:15:11.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.727+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/3254864867 wait complete. 2024-08-19T11:15:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient: build_initial_monmap 2024-08-19T11:15:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient: monmap: 2024-08-19T11:15:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:11.742 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 Processor -- start 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 -- start start 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient: init 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient: _add_conns ranks=[1,3,7,6,4,2,0,8,5] 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb80a6a30 0x7f3eb81ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): picked mon.noname-f con 0x7f3eb80a6a30 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 0x7f3eb8138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): picked mon.noname-g con 0x7f3eb80a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3eb8139860 0x7f3eb8138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): picked mon.noname-i con 0x7f3eb8139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb80a7730 con 0x7f3eb80a6a30 2024-08-19T11:15:11.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb813a1a0 con 0x7f3eb80a6e10 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3eb8124bf0 con 0x7f3eb8139860 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.728+0000 7f3ebf5b8640 10 monclient(hunting): authenticate will time out at 969.770914s 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 0x7f3eb8138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3eb8139860 0x7f3eb8138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 0x7f3eb8138a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:58986/0 (socket says 172.21.15.71:58986) 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 -- 172.21.15.71:0/311200820 learned_addr learned my addr 172.21.15.71:0/311200820 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): get_auth_request con 0x7f3eb80a6e10 auth_method 0 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): get_auth_request con 0x7f3eb8139860 auth_method 0 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb80a6a30 0x7f3eb81ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): get_auth_request con 0x7f3eb80a6a30 auth_method 0 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebd354640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient(hunting): handle_auth_done global_id 44463 payload 824 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 -- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3eb8139860 msgr2=0x7f3eb8138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3eb8139860 0x7f3eb8138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 -- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb80a6a30 msgr2=0x7f3eb81ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb80a6a30 0x7f3eb81ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient: _finish_hunting 0 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 monclient: found mon.noname-g 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebcb53640 1 -- 172.21.15.71:0/311200820 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb8124090 con 0x7f3eb80a6e10 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.729+0000 7f3ebdb55640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3eb8139860 0x7f3eb8138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3ebcb53640 1 -- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 msgr2=0x7f3eb8138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3ebcb53640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 0x7f3eb8138a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800e9b0 tx=0x7f3ea800ee70 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ea8017070 con 0x7f3eb80a6e10 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 10 monclient: dump: 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.748 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.749 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3ebf5b8640 5 monclient: authenticate success, global_id 44463 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3ebf5b8640 10 monclient: _renew_subs 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.731+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea800cbb0 con 0x7f3eb80a6e10 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3ebf5b8640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb80a2160 con 0x7f3eb80a6e10 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eadffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ea800cd60 con 0x7f3eb80a6e10 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eadffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:11.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eadffb640 10 monclient: dump: 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:11.751 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3ebf5b8640 10 monclient: _renew_subs 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3ebf5b8640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eaf7fe640 4 set_mon_vals no callback set 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb8126110 con 0x7f3eb80a6e10 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.732+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3ea801a070 con 0x7f3eb80a6e10 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3ebf5b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3ebf5b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3ebf5b8640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb813a500 con 0x7f3eb80a6e10 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3eadffb640 1 --2- 172.21.15.71:0/311200820 >> v2:172.21.15.135:6800/726754104 conn(0x7f3e9c03ea80 0x7f3e9c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:11.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(144..144 src has 1..144) ==== 3506+0+0 (secure 0 0 0) 0x7f3ea800f040 con 0x7f3eb80a6e10 2024-08-19T11:15:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3ebd354640 1 --2- 172.21.15.71:0/311200820 >> v2:172.21.15.135:6800/726754104 conn(0x7f3e9c03ea80 0x7f3e9c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.733+0000 7f3ebd354640 10 monclient: get_auth_request con 0x7f3e9c03ea80 auth_method 0 2024-08-19T11:15:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.735+0000 7f3ebd354640 1 --2- 172.21.15.71:0/311200820 >> v2:172.21.15.135:6800/726754104 conn(0x7f3e9c03ea80 0x7f3e9c040f40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4006e80 tx=0x7f3eb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.738+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f3ea8021070 con 0x7f3eb80a6e10 2024-08-19T11:15:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.738+0000 7f3eadffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:11.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.738+0000 7f3eadffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:11.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.980+0000 7f3ebf5b8640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:15:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.980+0000 7f3ebf5b8640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:15:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.980+0000 7f3ebf5b8640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.980+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3eb80008d0 con 0x7f3eb80a6e10 2024-08-19T11:15:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.982+0000 7f3eadffb640 1 -- 172.21.15.71:0/311200820 <== mon.3 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3eb80a2160 con 0x7f3eb80a6e10 2024-08-19T11:15:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.982+0000 7f3eadffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:15:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.982+0000 7f3eadffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 >> v2:172.21.15.135:6800/726754104 conn(0x7f3e9c03ea80 msgr2=0x7f3e9c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/311200820 >> v2:172.21.15.135:6800/726754104 conn(0x7f3e9c03ea80 0x7f3e9c040f40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4006e80 tx=0x7f3eb4008040 comp rx=0 tx=0).stop 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 10 monclient: shutdown 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 msgr2=0x7f3eb8138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 0x7f3eb8138a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800e9b0 tx=0x7f3ea800ee70 comp rx=0 tx=0).stop 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 shutdown_connections 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/311200820 >> v2:172.21.15.135:6800/726754104 conn(0x7f3e9c03ea80 0x7f3e9c040f40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3eb8139860 0x7f3eb8138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3eb80a6e10 0x7f3eb8138a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 --2- 172.21.15.71:0/311200820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3eb80a6a30 0x7f3eb81ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 >> 172.21.15.71:0/311200820 conn(0x7f3eb80ac030 msgr2=0x7f3eb81c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 shutdown_connections 2024-08-19T11:15:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:11.984+0000 7f3ebf5b8640 1 -- 172.21.15.71:0/311200820 wait complete. 2024-08-19T11:15:11.996 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:15:12.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=10,logm=63} crc {auth=1163434738,config=2586702516,health=1757975353,kv=677995545,logm=1317169816}) 2024-08-19T11:15:12.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=11,kv=12,logm=62} crc {auth=1163434738,config=2586702516,health=2614551353,kv=3646823213,logm=542424252}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=13,config=2,health=11,kv=11,logm=63} crc {auth=1163434738,config=2586702516,health=3945549674,kv=2561735805,logm=1131108614}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3831557721,config=2586702516,health=1757975353,kv=3646823213,logm=449965836}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=1163434738,config=2586702516,health=1757975353,kv=3646823213,logm=827425277}) 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=10,config=2,health=11,kv=12,logm=65} crc {auth=2668886924,config=2586702516,health=3945549674,kv=3646823213,logm=1020998953}) 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.310+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=13,config=1,health=12,kv=12,logm=62} crc {auth=4090523357,config=1228700967,health=1757975353,kv=3646823213,logm=148526111}) 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=804861223,config=2586702516,health=1757975353,kv=1437691841,logm=2107212260}) 2024-08-19T11:15:12.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.311+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=13,config=2,health=11,kv=12,logm=62} crc {auth=1163434738,config=2586702516,health=2013530260,kv=3646823213,logm=1670094844}) 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.313+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.313+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1437455782}) 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=535420571}) 2024-08-19T11:15:12.318 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1013765521}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2139068162}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2199123503}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.319 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4024970083}) 2024-08-19T11:15:12.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2649421149}) 2024-08-19T11:15:12.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3378954292}) 2024-08-19T11:15:12.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.314+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2976675609}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.321+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.321+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.321+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3672945993}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.321+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=939886280}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1049094864}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2888726626}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3175908362}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=841686691}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3355106146}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4225032843}) 2024-08-19T11:15:12.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.322+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3862061716}) 2024-08-19T11:15:12.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1291907175}) 2024-08-19T11:15:12.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1291977082}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1606839959}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3460085178}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=926747674}) 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.394 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=465860608}) 2024-08-19T11:15:12.394 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.394 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.394 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2474534761}) 2024-08-19T11:15:12.394 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289328487}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.386+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=422682063}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3261949945}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1669986633}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4019855011}) 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1089720858}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=217683696}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=278461030}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807260712}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163325697}) 2024-08-19T11:15:12.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.387+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1466162527}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2043680352}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=212499412}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1585228791}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=690860815}) 2024-08-19T11:15:12.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3951441800}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3190699635}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3303389545}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277995180}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.388+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1295683891}) 2024-08-19T11:15:12.398 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3767311088}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=715570810}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1994375062}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1296601000}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3097772509}) 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3185748476}) 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2829919279}) 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3150894930}) 2024-08-19T11:15:12.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.389+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=864112118}) 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4113188231}) 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1165907364}) 2024-08-19T11:15:12.402 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3305412284}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2376744071}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1379169785}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2425046753}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.403 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664196648}) 2024-08-19T11:15:12.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30245917}) 2024-08-19T11:15:12.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.397+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2897593125}) 2024-08-19T11:15:12.428 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.428 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.428 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3416843017}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3029888157}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=647154286}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1844087674}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.429 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1415450760}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2665744692}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.404+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.405+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.405+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1388601752}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.405+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.405+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2036600691}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.405+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=960563493}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=342293398}) 2024-08-19T11:15:12.430 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1127850369}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3680585014}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=388816750}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2536460749}) 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.431 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4253202751}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3378586247}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2586920291}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.406+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1893794131}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=245923450}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.432 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1530433418}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1143452864}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=503390544}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1715029226}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.407+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3569736231}) 2024-08-19T11:15:12.433 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1740280296}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443986413}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.408+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1063499195}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=350039427}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1743372784}) 2024-08-19T11:15:12.434 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3797611935}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2198814565}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2769402742}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4036318838}) 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.435 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3121861566}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=500140982}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.409+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3592164087}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3993925999}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4214625073}) 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.436 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2908320729}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3744624308}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4089189845}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3245957465}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.437 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=319987134}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412098847}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.410+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3226083794}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4258333304}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1128306351}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3565153161}) 2024-08-19T11:15:12.438 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1203122429}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3092547213}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=97000285}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3164080483}) 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.439 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791034094}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.412+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1106950104}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1011019664}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1642943114}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2679381699}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.440 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2583126290}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3837059940}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3766459802}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2967890326}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1281876760}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.413+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4238317406}) 2024-08-19T11:15:12.441 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=634660691}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1172721107}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.414+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3590157038}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1896792809}) 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.442 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2382947530}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2251262329}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1933882478}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=126861890}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.415+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3032602289}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.443 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3735242366}) 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1794778058}) 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3342668668}) 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.444 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=231621684}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1636499478}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=501219272}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3679698314}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233918197}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.416+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=841150961}) 2024-08-19T11:15:12.445 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2975807347}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1124742506}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=620429005}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.417+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3760402223}) 2024-08-19T11:15:12.446 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=518278539}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3740440296}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2168632703}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2016326948}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.418+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=321326075}) 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3032902726}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3698440987}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2325408565}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3484293652}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1737544311}) 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3688024895}) 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=920910191}) 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24964806}) 2024-08-19T11:15:12.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.419+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3878102172}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=45833552}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1393516797}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=691654726}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1315540526}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3516890876}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=208602070}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1396561762}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=527336804}) 2024-08-19T11:15:12.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.517+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2461364619}) 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3481044525}) 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2198034468}) 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4165864562}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2132123419}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1808176446}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2676222657}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=170867403}) 2024-08-19T11:15:12.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440534655}) 2024-08-19T11:15:12.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.523+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=965969090}) 2024-08-19T11:15:12.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1090245467}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1133853889}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1788656094}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=392907979}) 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1060628737}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3516340235}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2355621610}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1929578782}) 2024-08-19T11:15:12.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.545+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1608115606}) 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=774668170}) 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=403794395}) 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.661 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3745029530}) 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1831107939}) 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.657+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2320633406}) 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.662 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1967174824}) 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1709201680}) 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2277546375}) 2024-08-19T11:15:12.663 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.658+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=875035390}) 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.661+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.661+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.661+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=817398803}) 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.661+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.661+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.661+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2379107427}) 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.681 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3922649460}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1880124026}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1780676647}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.682 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3013814775}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641436220}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=828228352}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3891846949}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3520238212}) 2024-08-19T11:15:12.683 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1444536587}) 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2370775690}) 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=579265622}) 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.684 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4089893442}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2599216230}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.662+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=98528141}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1675195847}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=456132330}) 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.685 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3046487547}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3578210003}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1661208993}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3390185777}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3255423400}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1104986401}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1464202950}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521470245}) 2024-08-19T11:15:12.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.663+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2038600188}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=933176139}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1865595959}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1010881866}) 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2068611568}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1584725074}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1305836793}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3528431942}) 2024-08-19T11:15:12.689 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=164038732}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.664+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1045899045}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=90,mdsmap=3,mgr=7} crc {logm=3764772859,mdsmap=4204236774,mgr=1057647138}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=91,mdsmap=2,mgr=7} crc {logm=3770789608,mdsmap=4081106307,mgr=3044166884}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.690 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.665+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=87,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=1} crc {logm=3640906381,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=4239591852}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=90,mdsmap=3,mgr=7} crc {logm=2587848454,mdsmap=4204236774,mgr=3044166884}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=89,mdsmap=3,mgr=8} crc {logm=736713517,mdsmap=4204236774,mgr=1229682511}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=86,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=2} crc {logm=3770194888,mdsmap=4204236774,mgr=2051360393,mgr_command_descs=3626727126,mgrstat=3009879570}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.691 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=2798199559,mdsmap=4204236774,mgr=2202201911}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2236855696,mdsmap=4204236774,mgr=3566476167}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.666+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=88,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1} crc {logm=3360123734,mdsmap=4204236774,mgr=4091103352,mgr_command_descs=3626727126,mgr_metadata=880626121}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=59} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761110,monmap=2667667542,osd_metadata=186790487,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=1781534928}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=60} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2225547729,mon_config_key=4042291128,monmap=1080203526,osd_metadata=306360182,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=2037972880}) 2024-08-19T11:15:12.692 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=60} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1757102126,mon_config_key=4216891212,monmap=1080203526,osd_metadata=3210085904,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=78003394}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=61} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1149980599,mon_config_key=1903644540,monmap=157213729,osd_metadata=2544538045,osd_pg_creating=1940057426,osd_snap=2639422064,osdmap=3716500558}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=6,osd_snap=2,osdmap=60} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=396476115,mon_config_key=3399514852,monmap=1080203526,osd_metadata=2544538045,osd_snap=421676469,osdmap=2721088331}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.693 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761110,monmap=1080203526,osd_metadata=667316944,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=1506595641}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mgr=1,mgr_metadata=1,mgrstat=9,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=61} crc {mgr=1228700967,mgr_metadata=880626121,mgrstat=2101226427,mon_config_key=2720761110,monmap=1080203526,osd_metadata=3462306538,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=459531608}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761111,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=3319558094}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.667+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=58} crc {mgr=2586702516,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1516403463,mon_config_key=2720761110,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=1940057426,osd_snap=421676469,osdmap=1907160558}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1035209274}) 2024-08-19T11:15:12.694 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3655314369}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2675953543}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1995607633}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.695 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3856493028}) 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=626259933}) 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3433103287}) 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.696 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=169636125}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.669+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2433369092}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=66} crc {osdmap=2320244097}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=67} crc {osdmap=3137863756}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=65} crc {osdmap=3467742245}) 2024-08-19T11:15:12.697 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=68} crc {osdmap=3418909655}) 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=66} crc {osdmap=2979291283}) 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=68} crc {osdmap=2975731728}) 2024-08-19T11:15:12.698 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.699 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.699 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=64} crc {osdmap=1626845422}) 2024-08-19T11:15:12.699 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:15:12.699 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=2292439124}) 2024-08-19T11:15:12.699 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:15:12.674+0000 7f50838c2640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=69} crc {osdmap=1133140150}) 2024-08-19T11:15:12.997 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:15:12.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.093+0000 7f0ccfe56640 10 monclient: get_monmap_and_config 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.093+0000 7f0ccfe56640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.093+0000 7f0ccfe56640 10 monclient: monmap: 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:13.095285+0000 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:13.095285+0000 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.096 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 Processor -- start 2024-08-19T11:15:13.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 -- start start 2024-08-19T11:15:13.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient: init 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient: _add_conns ranks=[2,5,3,1,10,4,0,8,7,6,9] 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc80a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): picked mon.noname-b con 0x7f0cc80a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0cc80a6e10 0x7f0cc80a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): picked mon.noname-h con 0x7f0cc80a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:13.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cc8139860 0x7f0cc8139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): picked mon.noname-g con 0x7f0cc8139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc80a4f90 con 0x7f0cc80a6a30 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc80a6380 con 0x7f0cc8139860 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0cc80a49d0 con 0x7f0cc80a6e10 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.094+0000 7f0ccfe56640 10 monclient(hunting): authenticate will time out at 971.136999s 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc80a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc80a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44178/0 (socket says 172.21.15.71:44178) 2024-08-19T11:15:13.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 -- 172.21.15.71:0/3613485820 learned_addr learned my addr 172.21.15.71:0/3613485820 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): get_auth_request con 0x7f0cc80a6a30 auth_method 0 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_done global_id 6032 payload 274 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccd3f1640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0cc80a6e10 0x7f0cc80a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 -- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0cc80a6e10 msgr2=0x7f0cc80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0cce3f3640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cc8139860 0x7f0cc8139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0cc80a6e10 0x7f0cc80a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 -- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cc8139860 msgr2=0x7f0cc8139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cc8139860 0x7f0cc8139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 monclient: found mon.noname-b 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0ccdbf2640 1 -- 172.21.15.71:0/3613485820 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc80a46f0 con 0x7f0cc80a6a30 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0cce3f3640 10 monclient: get_auth_request con 0x7f0cc8139860 auth_method 0 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.095+0000 7f0cce3f3640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cc8139860 0x7f0cc8139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccdbf2640 1 -- 172.21.15.71:0/3613485820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 msgr2=0x7f0cc80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccdbf2640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc80a57f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40098d0 tx=0x7f0cc402a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab84eed49ab18af server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 1 -- 172.21.15.71:0/3613485820 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cc4037070 con 0x7f0cc80a6a30 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:13.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: dump: 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 1 -- 172.21.15.71:0/3613485820 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc40307b0 con 0x7f0cc80a6a30 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 5 monclient: authenticate success, global_id 6032 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 1 -- 172.21.15.71:0/3613485820 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cc4030e50 con 0x7f0cc80a6a30 2024-08-19T11:15:13.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 4 set_mon_vals no callback set 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0cccbf0640 10 monclient: dump: 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.109 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 10 monclient: shutdown 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 -- 172.21.15.71:0/3613485820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 msgr2=0x7f0cc80a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc80a57f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40098d0 tx=0x7f0cc402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 -- 172.21.15.71:0/3613485820 shutdown_connections 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0cc80a6e10 0x7f0cc80a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0cc8139860 0x7f0cc8139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/3613485820 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc80a57f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.098+0000 7f0ccfe56640 1 -- 172.21.15.71:0/3613485820 >> 172.21.15.71:0/3613485820 conn(0x7f0cc80ac030 msgr2=0x7f0cc80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 1 -- 172.21.15.71:0/3613485820 shutdown_connections 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 1 -- 172.21.15.71:0/3613485820 wait complete. 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 10 monclient: monmap: 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:13.111 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 1 Processor -- start 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 1 -- start start 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.099+0000 7f0ccfe56640 10 monclient: init 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient: _add_conns ranks=[2,4,8,5,1,7,0,3,6] 2024-08-19T11:15:13.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc81ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): picked mon.noname-b con 0x7f0cc80a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 0x7f0cc8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): picked mon.noname-c con 0x7f0cc80a6e10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0cc8139860 0x7f0cc8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): picked mon.noname-e con 0x7f0cc8139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc80a7730 con 0x7f0cc80a6a30 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0cc813a1a0 con 0x7f0cc80a6e10 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0cc80a27b0 con 0x7f0cc8139860 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccfe56640 10 monclient(hunting): authenticate will time out at 971.142417s 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc81ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc81ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44184/0 (socket says 172.21.15.71:44184) 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 1 -- 172.21.15.71:0/527985823 learned_addr learned my addr 172.21.15.71:0/527985823 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): get_auth_request con 0x7f0cc80a6a30 auth_method 0 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 0x7f0cc8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0cc8139860 0x7f0cc8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): get_auth_request con 0x7f0cc80a6e10 auth_method 0 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): get_auth_request con 0x7f0cc8139860 auth_method 0 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0cce3f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient(hunting): handle_auth_done global_id 44491 payload 824 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 -- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0cc8139860 msgr2=0x7f0cc8138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0cc8139860 0x7f0cc8138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 -- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 msgr2=0x7f0cc81ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc81ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 monclient: found mon.noname-c 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccd3f1640 1 -- 172.21.15.71:0/527985823 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc8124060 con 0x7f0cc80a6e10 2024-08-19T11:15:13.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.100+0000 7f0ccdbf2640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc81ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccd3f1640 1 -- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 msgr2=0x7f0cc8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccd3f1640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 0x7f0cc8138a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c5e0 tx=0x7f0cb800caa0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cb8015070 con 0x7f0cc80a6e10 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: dump: 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.119 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8011c80 con 0x7f0cc80a6e10 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 5 monclient: authenticate success, global_id 44491 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 10 monclient: _renew_subs 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc8139cf0 con 0x7f0cc80a6e10 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0cb8011e30 con 0x7f0cc80a6e10 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbe7fc640 10 monclient: dump: 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.121 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.122 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 10 monclient: _renew_subs 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0cbffff640 4 set_mon_vals no callback set 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.103+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc81263c0 con 0x7f0cc80a6e10 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0ccfe56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0ccfe56640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0ccfe56640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0cb8011810 con 0x7f0cc80a6e10 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc80a2280 con 0x7f0cc80a6e10 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0cbe7fc640 1 --2- 172.21.15.71:0/527985823 >> v2:172.21.15.135:6800/726754104 conn(0x7f0cac03ea80 0x7f0cac040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(145..145 src has 1..145) ==== 3898+0+0 (secure 0 0 0) 0x7f0cb8051950 con 0x7f0cc80a6e10 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0ccdbf2640 1 --2- 172.21.15.71:0/527985823 >> v2:172.21.15.135:6800/726754104 conn(0x7f0cac03ea80 0x7f0cac040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.104+0000 7f0ccdbf2640 10 monclient: get_auth_request con 0x7f0cac03ea80 auth_method 0 2024-08-19T11:15:13.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.107+0000 7f0ccdbf2640 1 --2- 172.21.15.71:0/527985823 >> v2:172.21.15.135:6800/726754104 conn(0x7f0cac03ea80 0x7f0cac040f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4000c00 tx=0x7f0cc402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.109+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f0cb801e030 con 0x7f0cc80a6e10 2024-08-19T11:15:13.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.109+0000 7f0cbe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.109+0000 7f0cbe7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:13.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.362+0000 7f0ccfe56640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:13.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.362+0000 7f0ccfe56640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:13.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.362+0000 7f0ccfe56640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:13.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.362+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0cc813a500 con 0x7f0cc80a6e10 2024-08-19T11:15:13.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.363+0000 7f0cbe7fc640 1 -- 172.21.15.71:0/527985823 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f0cc8139cf0 con 0x7f0cc80a6e10 2024-08-19T11:15:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.363+0000 7f0cbe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:13.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.363+0000 7f0cbe7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:13.366 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:13.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 >> v2:172.21.15.135:6800/726754104 conn(0x7f0cac03ea80 msgr2=0x7f0cac040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/527985823 >> v2:172.21.15.135:6800/726754104 conn(0x7f0cac03ea80 0x7f0cac040f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4000c00 tx=0x7f0cc402e000 comp rx=0 tx=0).stop 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 10 monclient: shutdown 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 msgr2=0x7f0cc8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 0x7f0cc8138a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c5e0 tx=0x7f0cb800caa0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 shutdown_connections 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/527985823 >> v2:172.21.15.135:6800/726754104 conn(0x7f0cac03ea80 0x7f0cac040f40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0cc8139860 0x7f0cc8138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0cc80a6e10 0x7f0cc8138a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 --2- 172.21.15.71:0/527985823 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0cc80a6a30 0x7f0cc81ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 >> 172.21.15.71:0/527985823 conn(0x7f0cc80ac030 msgr2=0x7f0cc81c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 shutdown_connections 2024-08-19T11:15:13.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.365+0000 7f0ccfe56640 1 -- 172.21.15.71:0/527985823 wait complete. 2024-08-19T11:15:13.379 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:15:13.379 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:15:13.380 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:15:13.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:15:13.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.477+0000 7f164d741640 10 monclient: get_monmap_and_config 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.477+0000 7f164d741640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.477+0000 7f164d741640 10 monclient: monmap: 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:13.479443+0000 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:13.479443+0000 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:13.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 Processor -- start 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 -- start start 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient: init 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient: _add_conns ranks=[8,0,5,9,6,3,2,7,10,4,1] 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 0x7f16480a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): picked mon.noname-e con 0x7f16480a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f16480a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f16480a7270 0x7f1648139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): picked mon.noname-h con 0x7f16480a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16480a6380 con 0x7f16480a57c0 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f16480a5020 con 0x7f16480a7270 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f16480a7d40 con 0x7f16480a6950 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.478+0000 7f164d741640 10 monclient(hunting): authenticate will time out at 971.520994s 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 0x7f16480a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 0x7f16480a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:52360/0 (socket says 172.21.15.71:52360) 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f16467fc640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f16480a57c0 0x7f1648139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37948/0 (socket says 172.21.15.71:37948) 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 -- 172.21.15.71:0/3793119640 learned_addr learned my addr 172.21.15.71:0/3793119640 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): get_auth_request con 0x7f16480a6950 auth_method 0 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f16477fe640 1 --2- 172.21.15.71:0/3793119640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f16480a7270 0x7f1648139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f16477fe640 10 monclient(hunting): get_auth_request con 0x7f16480a7270 auth_method 0 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f16477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f16477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f16477fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient(hunting): handle_auth_done global_id 64187 payload 274 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 -- 172.21.15.71:0/3793119640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f16480a7270 msgr2=0x7f1648139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3793119640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f16480a7270 0x7f1648139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 -- 172.21.15.71:0/3793119640 >> v1:172.21.15.71:6789/0 conn(0x7f16480a57c0 legacy=0x7f1648139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 monclient: found mon.noname-e 2024-08-19T11:15:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.479+0000 7f1646ffd640 1 -- 172.21.15.71:0/3793119640 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16480a3650 con 0x7f16480a6950 2024-08-19T11:15:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1646ffd640 1 -- 172.21.15.71:0/3793119640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 msgr2=0x7f16480a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3793119640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 0x7f16480a6d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1638009eb0 tx=0x7f163802a560 comp rx=0 tx=0).ready entity=mon.8 client_cookie=d705e8baadd0641b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 1 -- 172.21.15.71:0/3793119640 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1638036070 con 0x7f16480a6950 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: dump: 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.490 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 5 monclient: authenticate success, global_id 64187 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 1 -- 172.21.15.71:0/3793119640 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1638007a70 con 0x7f16480a6950 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 1 -- 172.21.15.71:0/3793119640 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1638007c20 con 0x7f16480a6950 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 4 set_mon_vals no callback set 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f1645ffb640 10 monclient: dump: 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.492 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.493 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 10 monclient: shutdown 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 -- 172.21.15.71:0/3793119640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 msgr2=0x7f16480a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 --2- 172.21.15.71:0/3793119640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 0x7f16480a6d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1638009eb0 tx=0x7f163802a560 comp rx=0 tx=0).stop 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 -- 172.21.15.71:0/3793119640 shutdown_connections 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 --2- 172.21.15.71:0/3793119640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f16480a7270 0x7f1648139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 --2- 172.21.15.71:0/3793119640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f16480a6950 0x7f16480a6d30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 -- 172.21.15.71:0/3793119640 >> 172.21.15.71:0/3793119640 conn(0x7f16480abf50 msgr2=0x7f16480ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.482+0000 7f164d741640 1 -- 172.21.15.71:0/3793119640 shutdown_connections 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.483+0000 7f164d741640 1 -- 172.21.15.71:0/3793119640 wait complete. 2024-08-19T11:15:13.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.483+0000 7f164d741640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.483+0000 7f164d741640 10 monclient: monmap: 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.495 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 Processor -- start 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 -- start start 2024-08-19T11:15:13.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient: init 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient: _add_conns ranks=[3,0,7,2,6,5,8,1,4] 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16480a57c0 0x7f16481cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): picked mon.noname-g con 0x7f16480a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 0x7f1648139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): picked mon.noname-a con 0x7f16480a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f16480a7270 0x7f16481ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): picked mon.noname-i con 0x7f16480a7270 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f16480a8700 con 0x7f16480a6950 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16480a84c0 con 0x7f16480a57c0 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f16480a7690 con 0x7f16480a7270 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f164d741640 10 monclient(hunting): authenticate will time out at 971.526631s 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 0x7f1648139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 0x7f1648139cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60786/0 (socket says 172.21.15.71:60786) 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 1 -- 172.21.15.71:0/3091716055 learned_addr learned my addr 172.21.15.71:0/3091716055 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): get_auth_request con 0x7f16480a6950 auth_method 0 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16477fe640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f16480a7270 0x7f16481ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16480a57c0 0x7f16481cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16477fe640 10 monclient(hunting): get_auth_request con 0x7f16480a7270 auth_method 0 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f16477fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f1646ffd640 10 monclient(hunting): get_auth_request con 0x7f16480a57c0 auth_method 0 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f1646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f1646ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.484+0000 7f1646ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 10 monclient(hunting): handle_auth_done global_id 34974 payload 824 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f16480a7270 msgr2=0x7f16481ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f16480a7270 0x7f16481ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16480a57c0 msgr2=0x7f16481cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f16480a57c0 0x7f16481cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 1 monclient: found mon.noname-a 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16467fc640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16480a2180 con 0x7f16480a6950 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.485+0000 7f16477fe640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f16480a7270 0x7f16481ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:15:13.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f16467fc640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 msgr2=0x7f1648139cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f16467fc640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 0x7f1648139cb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f163000c450 tx=0x7f163000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1630017070 con 0x7f16480a6950 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: dump: 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.508 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1630007490 con 0x7f16480a6950 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 5 monclient: authenticate success, global_id 34974 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 10 monclient: _renew_subs 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16480a9620 con 0x7f16480a6950 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1630007640 con 0x7f16480a6950 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f163f7fe640 10 monclient: dump: 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.510 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.511 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 10 monclient: _renew_subs 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1648127670 con 0x7f16480a6950 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.487+0000 7f16457fa640 4 set_mon_vals no callback set 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f164d741640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f164d741640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 0x7f16481ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f164806a590 con 0x7f1648125e70 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 0x7f16481ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient: get_auth_request con 0x7f1648125e70 auth_method 0 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f16300057f0 con 0x7f16480a6950 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 10 monclient(hunting): handle_auth_done global_id 34983 payload 824 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f1646ffd640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1648077730 con 0x7f1648125e70 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f163f7fe640 1 --2- 172.21.15.71:0/3091716055 >> v2:172.21.15.135:6800/726754104 conn(0x7f162803ea80 0x7f1628040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.488+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (secure 0 0 0) 0x7f1630050f40 con 0x7f16480a6950 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.489+0000 7f16477fe640 1 --2- 172.21.15.71:0/3091716055 >> v2:172.21.15.135:6800/726754104 conn(0x7f162803ea80 0x7f1628040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.489+0000 7f16477fe640 10 monclient: get_auth_request con 0x7f162803ea80 auth_method 0 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.490+0000 7f1646ffd640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 msgr2=0x7f16481ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.490+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 0x7f16481ceb40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f16480a5730 tx=0x7f1638004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1638041030 con 0x7f1648125e70 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 10 monclient: dump: 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.514 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1638037040 con 0x7f1648125e70 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 msgr2=0x7f16481ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 0x7f16481ceb40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f16480a5730 tx=0x7f1638004a40 comp rx=0 tx=0).stop 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 msgr2=0x7f16481ceb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f163f7fe640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1648125e70 0x7f16481ceb40 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f16480a5730 tx=0x7f1638004a40 comp rx=0 tx=0).stop 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.491+0000 7f16477fe640 1 --2- 172.21.15.71:0/3091716055 >> v2:172.21.15.135:6800/726754104 conn(0x7f162803ea80 0x7f1628040f40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1640006fd0 tx=0x7f1640008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f164d741640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f164d741640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 0x7f164813a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f164d741640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f16481cf490 con 0x7f16481cf080 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 0x7f164813a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient: get_auth_request con 0x7f16481cf080 auth_method 0 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 10 monclient(hunting): handle_auth_done global_id 34992 payload 824 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.497+0000 7f1646ffd640 1 -- 172.21.15.71:0/3091716055 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16480a6d30 con 0x7f16481cf080 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f1646ffd640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 msgr2=0x7f164813a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f1646ffd640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 0x7f164813a1f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e80 tx=0x7f163802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1638041070 con 0x7f16481cf080 2024-08-19T11:15:13.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 10 monclient: dump: 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.518 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9436 (secure 0 0 0) 0x7f1638007b10 con 0x7f16481cf080 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 msgr2=0x7f164813a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 0x7f164813a1f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e80 tx=0x7f163802f000 comp rx=0 tx=0).stop 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 msgr2=0x7f164813a1f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:13.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f163f7fe640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16481cf080 0x7f164813a1f0 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1638009e80 tx=0x7f163802f000 comp rx=0 tx=0).stop 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 149017, 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:13.544 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 >> v2:172.21.15.135:6800/726754104 conn(0x7f162803ea80 msgr2=0x7f1628040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 --2- 172.21.15.71:0/3091716055 >> v2:172.21.15.135:6800/726754104 conn(0x7f162803ea80 0x7f1628040f40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1640006fd0 tx=0x7f1640008040 comp rx=0 tx=0).stop 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 10 monclient: shutdown 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 msgr2=0x7f1648139cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 0x7f1648139cb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f163000c450 tx=0x7f163000c910 comp rx=0 tx=0).stop 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f16477fe640 1 -- 172.21.15.71:0/3091716055 reap_dead start 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 shutdown_connections 2024-08-19T11:15:13.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 --2- 172.21.15.71:0/3091716055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16480a6950 0x7f1648139cb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 >> 172.21.15.71:0/3091716055 conn(0x7f16480abf50 msgr2=0x7f16481c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 shutdown_connections 2024-08-19T11:15:13.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.500+0000 7f164d741640 1 -- 172.21.15.71:0/3091716055 wait complete. 2024-08-19T11:15:13.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:13.547 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:15:13.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: starting. 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26255 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: created object 0... 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: created object 25... 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: created object 49... 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: finishing. 2024-08-19T11:15:13.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26256]: shutting down. 2024-08-19T11:15:13.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.648+0000 7f6552379640 10 monclient: get_monmap_and_config 2024-08-19T11:15:13.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.648+0000 7f6552379640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.648+0000 7f6552379640 10 monclient: monmap: 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:13.650472+0000 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:13.650472+0000 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:13.651 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:13.652 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.649+0000 7f6552379640 1 Processor -- start 2024-08-19T11:15:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.649+0000 7f6552379640 1 -- start start 2024-08-19T11:15:13.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.649+0000 7f6552379640 10 monclient: init 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient: _add_conns ranks=[6,9,0,2,4,5,3,1,10,7,8] 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f654c0a6950 0x7f654c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): picked mon.noname-d con 0x7f654c0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f654c0a57c0 0x7f654c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): picked mon.noname-a con 0x7f654c0a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f654c139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654c0a6380 con 0x7f654c139710 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f654c0a5020 con 0x7f654c0a57c0 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f654c0a77b0 con 0x7f654c0a6950 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6552379640 10 monclient(hunting): authenticate will time out at 971.692347s 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f654c0a6950 0x7f654c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f654c0a57c0 0x7f654c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6550916640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f654c139710 0x7f654c139b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37958/0 (socket says 172.21.15.71:37958) 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6550916640 1 -- 172.21.15.71:0/1236329169 learned_addr learned my addr 172.21.15.71:0/1236329169 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): get_auth_request con 0x7f654c0a6950 auth_method 0 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): get_auth_request con 0x7f654c0a57c0 auth_method 0 2024-08-19T11:15:13.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient(hunting): handle_auth_done global_id 35001 payload 274 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 1 -- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f654c0a6950 msgr2=0x7f654c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 1 --2- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f654c0a6950 0x7f654c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 1 -- 172.21.15.71:0/1236329169 >> v1:172.21.15.71:6789/0 conn(0x7f654c139710 legacy=0x7f654c139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 1 monclient: found mon.noname-a 2024-08-19T11:15:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f6543fff640 1 -- 172.21.15.71:0/1236329169 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c0a3650 con 0x7f654c0a57c0 2024-08-19T11:15:13.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.650+0000 7f654bfff640 1 --2- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f654c0a6950 0x7f654c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f6543fff640 1 -- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c0a57c0 msgr2=0x7f654c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f6543fff640 1 --2- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c0a57c0 0x7f654c0a7270 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f65340097a0 tx=0x7f6534029fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290906f5fb2c9280 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 1 -- 172.21.15.71:0/1236329169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6534037070 con 0x7f654c0a57c0 2024-08-19T11:15:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:13.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: dump: 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 1 -- 172.21.15.71:0/1236329169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653402ad30 con 0x7f654c0a57c0 2024-08-19T11:15:13.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f6552379640 5 monclient: authenticate success, global_id 35001 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f6552379640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f6552379640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 1 -- 172.21.15.71:0/1236329169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6534030c20 con 0x7f654c0a57c0 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f6552379640 4 set_mon_vals no callback set 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.653+0000 7f654b7fe640 10 monclient: dump: 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.669 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 10 monclient: shutdown 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 -- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c0a57c0 msgr2=0x7f654c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 --2- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c0a57c0 0x7f654c0a7270 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f65340097a0 tx=0x7f6534029fd0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 -- 172.21.15.71:0/1236329169 shutdown_connections 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 --2- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c0a57c0 0x7f654c0a7270 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 --2- 172.21.15.71:0/1236329169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f654c0a6950 0x7f654c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 -- 172.21.15.71:0/1236329169 >> 172.21.15.71:0/1236329169 conn(0x7f654c0abf50 msgr2=0x7f654c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 -- 172.21.15.71:0/1236329169 shutdown_connections 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.654+0000 7f6552379640 1 -- 172.21.15.71:0/1236329169 wait complete. 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient: monmap: 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:13.671 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 Processor -- start 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 -- start start 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient: init 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient: _add_conns ranks=[2,4,0,6,3,8,5,7,1] 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c0a57c0 0x7f654c1ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): picked mon.noname-b con 0x7f654c0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f654c0a6950 0x7f654c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): picked mon.noname-c con 0x7f654c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:13.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 0x7f654c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): picked mon.noname-a con 0x7f654c139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f654c0a84c0 con 0x7f654c139710 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f654c0a7d40 con 0x7f654c0a57c0 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f654c0a8700 con 0x7f654c0a6950 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.655+0000 7f6552379640 10 monclient(hunting): authenticate will time out at 971.697938s 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c0a57c0 0x7f654c1ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 0x7f654c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f654c0a6950 0x7f654c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c0a57c0 0x7f654c1ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44188/0 (socket says 172.21.15.71:44188) 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): get_auth_request con 0x7f654c139710 auth_method 0 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 1 -- 172.21.15.71:0/3227427795 learned_addr learned my addr 172.21.15.71:0/3227427795 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): get_auth_request con 0x7f654c0a57c0 auth_method 0 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): get_auth_request con 0x7f654c0a6950 auth_method 0 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient(hunting): handle_auth_done global_id 35010 payload 824 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f654c0a6950 msgr2=0x7f654c1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f654c0a6950 0x7f654c1386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c0a57c0 msgr2=0x7f654c1ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c0a57c0 0x7f654c1ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 monclient: found mon.noname-a 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6550916640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c1390e0 con 0x7f654c139710 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f654bfff640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c0a57c0 0x7f654c1ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.656+0000 7f6543fff640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f654c0a6950 0x7f654c1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6550916640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 msgr2=0x7f654c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6550916640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 0x7f654c1225a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f654400caf0 tx=0x7f654400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f654400abe0 con 0x7f654c139710 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: dump: 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 5 monclient: authenticate success, global_id 35010 2024-08-19T11:15:13.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f654400adc0 con 0x7f654c139710 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6544012ce0 con 0x7f654c139710 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 10 monclient: _renew_subs 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654c1261a0 con 0x7f654c139710 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f654affd640 4 set_mon_vals no callback set 2024-08-19T11:15:13.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f65497fa640 10 monclient: dump: 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.681 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 10 monclient: _renew_subs 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.658+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f654c13a480 con 0x7f654c139710 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f6552379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f6552379640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 0x7f654c122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f654c076c60 con 0x7f654c138c20 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 0x7f654c122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6544012400 con 0x7f654c139710 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient: get_auth_request con 0x7f654c138c20 auth_method 0 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.659+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.660+0000 7f654bfff640 10 monclient(hunting): handle_auth_done global_id 6059 payload 824 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.660+0000 7f654bfff640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f654c0a6d30 con 0x7f654c138c20 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.660+0000 7f65497fa640 1 --2- 172.21.15.71:0/3227427795 >> v2:172.21.15.135:6800/726754104 conn(0x7f652c03ea80 0x7f652c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.660+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (secure 0 0 0) 0x7f65440521d0 con 0x7f654c139710 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.660+0000 7f6543fff640 1 --2- 172.21.15.71:0/3227427795 >> v2:172.21.15.135:6800/726754104 conn(0x7f652c03ea80 0x7f652c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.660+0000 7f6543fff640 10 monclient: get_auth_request con 0x7f652c03ea80 auth_method 0 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f654bfff640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 msgr2=0x7f654c122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f654bfff640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 0x7f654c122ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f653c009ed0 tx=0x7f653c00f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f653c014cd0 con 0x7f654c138c20 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 10 monclient: dump: 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.684 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f653c014860 con 0x7f654c138c20 2024-08-19T11:15:13.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:13.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 msgr2=0x7f654c122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 0x7f654c122ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f653c009ed0 tx=0x7f653c00f610 comp rx=0 tx=0).stop 2024-08-19T11:15:13.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 msgr2=0x7f654c122ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:13.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f65497fa640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c138c20 0x7f654c122ae0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.662+0000 7f6543fff640 1 --2- 172.21.15.71:0/3227427795 >> v2:172.21.15.135:6800/726754104 conn(0x7f652c03ea80 0x7f652c040f40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65340097a0 tx=0x7f653402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f6552379640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f6552379640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 0x7f654c09da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f6552379640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f654c123430 con 0x7f654c123020 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 0x7f654c09da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient: get_auth_request con 0x7f654c123020 auth_method 0 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.668+0000 7f654bfff640 10 monclient(hunting): handle_auth_done global_id 6068 payload 824 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.669+0000 7f654bfff640 1 -- 172.21.15.71:0/3227427795 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f654c124b20 con 0x7f654c123020 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f654bfff640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 msgr2=0x7f654c09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f654bfff640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 0x7f654c09da00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f653c009ed0 tx=0x7f653c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f653c01ddc0 con 0x7f654c123020 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 10 monclient: dump: 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.690 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f653c02a410 con 0x7f654c123020 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 msgr2=0x7f654c09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 0x7f654c09da00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f653c009ed0 tx=0x7f653c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 msgr2=0x7f654c09da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f65497fa640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f654c123020 0x7f654c09da00 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f653c009ed0 tx=0x7f653c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.691 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 310551, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:13.692 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.693 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.694 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:13.695 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.696 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.697 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:13.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:13.702 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.704 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.711 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:13.712 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.714 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:13.715 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 >> v2:172.21.15.135:6800/726754104 conn(0x7f652c03ea80 msgr2=0x7f652c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 1 --2- 172.21.15.71:0/3227427795 >> v2:172.21.15.135:6800/726754104 conn(0x7f652c03ea80 0x7f652c040f40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f65340097a0 tx=0x7f653402e000 comp rx=0 tx=0).stop 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 10 monclient: shutdown 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 msgr2=0x7f654c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6550916640 1 -- 172.21.15.71:0/3227427795 reap_dead start 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 0x7f654c1225a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f654400caf0 tx=0x7f654400cef0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 shutdown_connections 2024-08-19T11:15:13.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.671+0000 7f6552379640 1 --2- 172.21.15.71:0/3227427795 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654c139710 0x7f654c1225a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.672+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 >> 172.21.15.71:0/3227427795 conn(0x7f654c0abf50 msgr2=0x7f654c1c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.672+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 shutdown_connections 2024-08-19T11:15:13.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.672+0000 7f6552379640 1 -- 172.21.15.71:0/3227427795 wait complete. 2024-08-19T11:15:13.718 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:13.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:15:13.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:15:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.820+0000 7ff983a48640 10 monclient: get_monmap_and_config 2024-08-19T11:15:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.820+0000 7ff983a48640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.820+0000 7ff983a48640 10 monclient: monmap: 2024-08-19T11:15:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:13.822184+0000 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:13.822184+0000 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.823 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:13.824 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:13.824 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 Processor -- start 2024-08-19T11:15:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 -- start start 2024-08-19T11:15:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient: init 2024-08-19T11:15:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient: _add_conns ranks=[7,10,4,1,9,6,5,0,8,3,2] 2024-08-19T11:15:13.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff97c09b510 0x7ff97c09b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): picked mon.noname-i con 0x7ff97c09b510 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff97c0a25c0 0x7ff97c0a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): picked mon.noname-f con 0x7ff97c0a25c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c0a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): picked mon.noname-c con 0x7ff97c0a42c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff97c0a1be0 con 0x7ff97c0a25c0 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff97c0a5bd0 con 0x7ff97c0a42c0 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7ff97c0a0f90 con 0x7ff97c09b510 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff983a48640 10 monclient(hunting): authenticate will time out at 971.863794s 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c0a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c0a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55332/0 (socket says 172.21.15.71:55332) 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 1 -- 172.21.15.71:0/2599795043 learned_addr learned my addr 172.21.15.71:0/2599795043 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 10 monclient(hunting): get_auth_request con 0x7ff97c0a42c0 auth_method 0 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff981fe5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff980fe3640 1 --2- 172.21.15.71:0/2599795043 >> v2:172.21.15.135:3300/0 conn(0x7ff97c0a25c0 0x7ff97c0a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.821+0000 7ff9817e4640 1 --2- 172.21.15.71:0/2599795043 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff97c09b510 0x7ff97c09b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): get_auth_request con 0x7ff97c0a25c0 auth_method 0 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): get_auth_request con 0x7ff97c09b510 auth_method 0 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff9817e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 10 monclient(hunting): handle_auth_done global_id 44509 payload 274 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 1 -- 172.21.15.71:0/2599795043 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff97c09b510 msgr2=0x7ff97c09b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 1 --2- 172.21.15.71:0/2599795043 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff97c09b510 0x7ff97c09b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 1 -- 172.21.15.71:0/2599795043 >> v2:172.21.15.135:3300/0 conn(0x7ff97c0a25c0 msgr2=0x7ff97c0a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 1 --2- 172.21.15.71:0/2599795043 >> v2:172.21.15.135:3300/0 conn(0x7ff97c0a25c0 0x7ff97c0a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 1 monclient: found mon.noname-c 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff981fe5640 1 -- 172.21.15.71:0/2599795043 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c0a1900 con 0x7ff97c0a42c0 2024-08-19T11:15:13.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.822+0000 7ff980fe3640 1 --2- 172.21.15.71:0/2599795043 >> v2:172.21.15.135:3300/0 conn(0x7ff97c0a25c0 0x7ff97c0a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff981fe5640 1 -- 172.21.15.71:0/2599795043 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 msgr2=0x7ff97c0a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff981fe5640 1 --2- 172.21.15.71:0/2599795043 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c0a4720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff974009e50 tx=0x7ff97402a560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5912b70a5314aa80 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 1 -- 172.21.15.71:0/2599795043 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff974036070 con 0x7ff97c0a42c0 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: dump: 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.837 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.838 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 5 monclient: authenticate success, global_id 44509 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 1 -- 172.21.15.71:0/2599795043 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974007a70 con 0x7ff97c0a42c0 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 4 set_mon_vals no callback set 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 1 -- 172.21.15.71:0/2599795043 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff974007ca0 con 0x7ff97c0a42c0 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:13.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff973fff640 10 monclient: dump: 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.840 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 10 monclient: shutdown 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 -- 172.21.15.71:0/2599795043 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 msgr2=0x7ff97c0a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 --2- 172.21.15.71:0/2599795043 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c0a4720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff974009e50 tx=0x7ff97402a560 comp rx=0 tx=0).stop 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 -- 172.21.15.71:0/2599795043 shutdown_connections 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 --2- 172.21.15.71:0/2599795043 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c0a4720 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 --2- 172.21.15.71:0/2599795043 >> v2:172.21.15.135:3300/0 conn(0x7ff97c0a25c0 0x7ff97c0a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 --2- 172.21.15.71:0/2599795043 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff97c09b510 0x7ff97c09b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 -- 172.21.15.71:0/2599795043 >> 172.21.15.71:0/2599795043 conn(0x7ff97c0a4e70 msgr2=0x7ff97c0a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 -- 172.21.15.71:0/2599795043 shutdown_connections 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.825+0000 7ff983a48640 1 -- 172.21.15.71:0/2599795043 wait complete. 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.826+0000 7ff983a48640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.826+0000 7ff983a48640 10 monclient: monmap: 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:13.842 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.826+0000 7ff983a48640 1 Processor -- start 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.826+0000 7ff983a48640 1 -- start start 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.826+0000 7ff983a48640 10 monclient: init 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient: _add_conns ranks=[6,0,4,3,2,7,8,1,5] 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): picked mon.noname-d con 0x7ff97c09b510 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0a25c0 0x7ff97c1ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): picked mon.noname-a con 0x7ff97c0a25c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c1ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): picked mon.noname-c con 0x7ff97c0a42c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c09c370 con 0x7ff97c0a25c0 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff97c09be30 con 0x7ff97c0a42c0 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff97c0a3e80 con 0x7ff97c09b510 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff983a48640 10 monclient(hunting): authenticate will time out at 971.869479s 2024-08-19T11:15:13.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0a25c0 0x7ff97c1ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c1ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:37022/0 (socket says 172.21.15.71:37022) 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c1ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55342/0 (socket says 172.21.15.71:55342) 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): get_auth_request con 0x7ff97c0a25c0 auth_method 0 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 -- 172.21.15.71:0/3427071708 learned_addr learned my addr 172.21.15.71:0/3427071708 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): get_auth_request con 0x7ff97c09b510 auth_method 0 2024-08-19T11:15:13.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): get_auth_request con 0x7ff97c0a42c0 auth_method 0 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient(hunting): handle_auth_done global_id 25296 payload 824 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 msgr2=0x7ff97c1ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c1ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0a25c0 msgr2=0x7ff97c1ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0a25c0 0x7ff97c1ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 monclient: found mon.noname-d 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff9817e4640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c0960e0 con 0x7ff97c09b510 2024-08-19T11:15:13.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff981fe5640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c0a42c0 0x7ff97c1ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.827+0000 7ff980fe3640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff97c0a25c0 0x7ff97c1ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff9817e4640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 msgr2=0x7ff97c1ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff9817e4640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e9e0 tx=0x7ff97800eea0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff978017070 con 0x7ff97c09b510 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff9817e4640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e9e0 tx=0x7ff97800eea0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7ff97800cd90 mon_map magic: 0 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 10 monclient: dump: 2024-08-19T11:15:13.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 5 monclient: authenticate success, global_id 25296 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97800cbe0 con 0x7ff97c09b510 2024-08-19T11:15:13.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 10 monclient: _renew_subs 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c0963c0 con 0x7ff97c09b510 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff971ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff9737fe640 4 set_mon_vals no callback set 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 10 monclient: _renew_subs 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.830+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c098e70 con 0x7ff97c09b510 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff983a48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff983a48640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 0x7ff97c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff97c06a590 con 0x7ff97c093ba0 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff97800cd90 con 0x7ff97c09b510 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff971ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff971ffb640 10 monclient: dump: 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.852 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff97801a070 con 0x7ff97c09b510 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 0x7ff97c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient: get_auth_request con 0x7ff97c093ba0 auth_method 0 2024-08-19T11:15:13.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 10 monclient(hunting): handle_auth_done global_id 44527 payload 824 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff971ffb640 1 --2- 172.21.15.71:0/3427071708 >> v2:172.21.15.135:6800/726754104 conn(0x7ff96003ead0 0x7ff960040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff980fe3640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff97c096870 con 0x7ff97c093ba0 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff981fe5640 1 --2- 172.21.15.71:0/3427071708 >> v2:172.21.15.135:6800/726754104 conn(0x7ff96003ead0 0x7ff960040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.831+0000 7ff981fe5640 10 monclient: get_auth_request con 0x7ff96003ead0 auth_method 0 2024-08-19T11:15:13.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.833+0000 7ff980fe3640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 msgr2=0x7ff97c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.833+0000 7ff980fe3640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 0x7ff97c02d1c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff97c094c90 tx=0x7ff96c00f7a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.833+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff96c003a80 con 0x7ff97c093ba0 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.833+0000 7ff971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.833+0000 7ff971ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.833+0000 7ff971ffb640 10 monclient: dump: 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.855 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff96c003610 con 0x7ff97c093ba0 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 msgr2=0x7ff97c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 0x7ff97c02d1c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff97c094c90 tx=0x7ff96c00f7a0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 msgr2=0x7ff97c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff971ffb640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093ba0 0x7ff97c02d1c0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff97c094c90 tx=0x7ff96c00f7a0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.834+0000 7ff981fe5640 1 --2- 172.21.15.71:0/3427071708 >> v2:172.21.15.135:6800/726754104 conn(0x7ff96003ead0 0x7ff960040f90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff974033000 tx=0x7ff974009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff983a48640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff983a48640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 0x7ff97c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff983a48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff97c09c4f0 con 0x7ff97c093f80 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 0x7ff97c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient: get_auth_request con 0x7ff97c093f80 auth_method 0 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 10 monclient(hunting): handle_auth_done global_id 44536 payload 824 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.840+0000 7ff980fe3640 1 -- 172.21.15.71:0/3427071708 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff97c09b8f0 con 0x7ff97c093f80 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.842+0000 7ff980fe3640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 msgr2=0x7ff97c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.842+0000 7ff980fe3640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 0x7ff97c02d700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff97c094c90 tx=0x7ff96c0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.842+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff96c029430 con 0x7ff97c093f80 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.842+0000 7ff971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.842+0000 7ff971ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.842+0000 7ff971ffb640 10 monclient: dump: 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:13.860 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9433 (secure 0 0 0) 0x7ff96c020040 con 0x7ff97c093f80 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:13.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 msgr2=0x7ff97c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 0x7ff97c02d700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff97c094c90 tx=0x7ff96c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 msgr2=0x7ff97c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff97c093f80 0x7ff97c02d700 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff97c094c90 tx=0x7ff96c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 82856, 2024-08-19T11:15:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.864 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:13.866 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:13.867 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.869 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:13.876 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:13.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.878 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:13.880 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:13.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:13.883 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:13.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:13.885 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:13.886 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 >> v2:172.21.15.135:6800/726754104 conn(0x7ff96003ead0 msgr2=0x7ff960040f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 --2- 172.21.15.71:0/3427071708 >> v2:172.21.15.135:6800/726754104 conn(0x7ff96003ead0 0x7ff960040f90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff974033000 tx=0x7ff974009000 comp rx=0 tx=0).stop 2024-08-19T11:15:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 10 monclient: shutdown 2024-08-19T11:15:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 msgr2=0x7ff97c1ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:13.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e9e0 tx=0x7ff97800eea0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff981fe5640 1 -- 172.21.15.71:0/3427071708 reap_dead start 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff971ffb640 1 -- 172.21.15.71:0/3427071708 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (unknown 0 0 0) 0x7ff97800f040 con 0x7ff97c09b510 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 shutdown_connections 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 --2- 172.21.15.71:0/3427071708 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff97c09b510 0x7ff97c1ce300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 >> 172.21.15.71:0/3427071708 conn(0x7ff97c0a4e70 msgr2=0x7ff97c09e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 shutdown_connections 2024-08-19T11:15:13.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.843+0000 7ff983a48640 1 -- 172.21.15.71:0/3427071708 wait complete. 2024-08-19T11:15:13.888 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:13.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:15:13.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.985+0000 7f3b3bfba640 10 monclient: get_monmap_and_config 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.985+0000 7f3b3bfba640 10 monclient: build_initial_monmap 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.985+0000 7f3b3bfba640 10 monclient: monmap: 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:13.986982+0000 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:13.986982+0000 2024-08-19T11:15:13.987 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:13.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.985+0000 7f3b3bfba640 1 Processor -- start 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 1 -- start start 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient: init 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient: _add_conns ranks=[9,1,2,4,6,8,10,5,0,7,3] 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3b340a6950 0x7f3b340a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): picked mon.noname-a con 0x7f3b340a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3b340a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 0x7f3b34139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): picked mon.noname-b con 0x7f3b340a7270 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b340a6380 con 0x7f3b340a57c0 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3b340a5020 con 0x7f3b340a6950 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b340a7d40 con 0x7f3b340a7270 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3bfba640 10 monclient(hunting): authenticate will time out at 972.028721s 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 0x7f3b34139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3b340a6950 0x7f3b340a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 0x7f3b34139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44212/0 (socket says 172.21.15.71:44212) 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 1 -- 172.21.15.71:0/2260853667 learned_addr learned my addr 172.21.15.71:0/2260853667 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): get_auth_request con 0x7f3b340a7270 auth_method 0 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): get_auth_request con 0x7f3b340a6950 auth_method 0 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.986+0000 7f3b3a557640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 10 monclient(hunting): handle_auth_done global_id 6077 payload 274 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 1 -- 172.21.15.71:0/2260853667 >> v2:172.21.15.71:3300/0 conn(0x7f3b340a6950 msgr2=0x7f3b340a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 1 --2- 172.21.15.71:0/2260853667 >> v2:172.21.15.71:3300/0 conn(0x7f3b340a6950 0x7f3b340a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 1 -- 172.21.15.71:0/2260853667 >> v1:172.21.15.135:6789/0 conn(0x7f3b340a57c0 legacy=0x7f3b34139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 10 monclient: _finish_hunting 0 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 1 monclient: found mon.noname-b 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b3a557640 1 -- 172.21.15.71:0/2260853667 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b340a3650 con 0x7f3b340a7270 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.987+0000 7f3b39d56640 1 --2- 172.21.15.71:0/2260853667 >> v2:172.21.15.71:3300/0 conn(0x7f3b340a6950 0x7f3b340a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.989+0000 7f3b3a557640 1 -- 172.21.15.71:0/2260853667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 msgr2=0x7f3b34139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.989+0000 7f3b3a557640 1 --2- 172.21.15.71:0/2260853667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 0x7f3b34139e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009e50 tx=0x7f3b2c02a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5665d66f1660fbf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 1 -- 172.21.15.71:0/2260853667 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b2c036070 con 0x7f3b340a7270 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:13.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: dump: 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.000 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 1 -- 172.21.15.71:0/2260853667 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c007a70 con 0x7f3b340a7270 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 5 monclient: authenticate success, global_id 6077 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 1 -- 172.21.15.71:0/2260853667 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b2c007c60 con 0x7f3b340a7270 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 4 set_mon_vals no callback set 2024-08-19T11:15:14.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b38d54640 10 monclient: dump: 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.002 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 10 monclient: shutdown 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2260853667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 msgr2=0x7f3b34139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2260853667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 0x7f3b34139e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009e50 tx=0x7f3b2c02a560 comp rx=0 tx=0).stop 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2260853667 shutdown_connections 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2260853667 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b340a7270 0x7f3b34139e20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2260853667 >> v2:172.21.15.71:3300/0 conn(0x7f3b340a6950 0x7f3b340a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2260853667 >> 172.21.15.71:0/2260853667 conn(0x7f3b340abf50 msgr2=0x7f3b340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2260853667 shutdown_connections 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.990+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2260853667 wait complete. 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.991+0000 7f3b3bfba640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.991+0000 7f3b3bfba640 10 monclient: monmap: 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:14.004 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.991+0000 7f3b3bfba640 1 Processor -- start 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.991+0000 7f3b3bfba640 1 -- start start 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.991+0000 7f3b3bfba640 10 monclient: init 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient: _add_conns ranks=[7,4,6,5,2,0,8,3,1] 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b340a57c0 0x7f3b341cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): picked mon.noname-i con 0x7f3b340a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b340a6950 0x7f3b341cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): picked mon.noname-c con 0x7f3b340a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 0x7f3b34126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): picked mon.noname-d con 0x7f3b340a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3b340a76c0 con 0x7f3b340a6950 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b340a84c0 con 0x7f3b340a7270 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3b340a8700 con 0x7f3b340a57c0 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3bfba640 10 monclient(hunting): authenticate will time out at 972.034154s 2024-08-19T11:15:14.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b340a6950 0x7f3b341cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 0x7f3b34126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b340a6950 0x7f3b341cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55366/0 (socket says 172.21.15.71:55366) 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 1 -- 172.21.15.71:0/2004255378 learned_addr learned my addr 172.21.15.71:0/2004255378 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): get_auth_request con 0x7f3b340a6950 auth_method 0 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): get_auth_request con 0x7f3b340a7270 auth_method 0 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b340a57c0 0x7f3b341cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): get_auth_request con 0x7f3b340a57c0 auth_method 0 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient(hunting): handle_auth_done global_id 25305 payload 824 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b340a57c0 msgr2=0x7f3b341cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b340a57c0 0x7f3b341cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b340a6950 msgr2=0x7f3b341cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b340a6950 0x7f3b341cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 monclient: found mon.noname-d 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b3a557640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b34127ac0 con 0x7f3b340a7270 2024-08-19T11:15:14.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.992+0000 7f3b39555640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b340a6950 0x7f3b341cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.994+0000 7f3b3a557640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 msgr2=0x7f3b34126020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.994+0000 7f3b3a557640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 0x7f3b34126020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c030000 tx=0x7f3b2c004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.994+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b2c040020 con 0x7f3b340a7270 2024-08-19T11:15:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.994+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.994+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.994+0000 7f3b2a7fc640 10 monclient: dump: 2024-08-19T11:15:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.017 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.018 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c003ba0 con 0x7f3b340a7270 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 5 monclient: authenticate success, global_id 25305 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 10 monclient: _renew_subs 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b340a9510 con 0x7f3b340a7270 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b2c036040 con 0x7f3b340a7270 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:14.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 10 monclient: dump: 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.020 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 10 monclient: _renew_subs 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2bfff640 4 set_mon_vals no callback set 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b34129e20 con 0x7f3b340a7270 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 0x7f3b34126940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b34129aa0 con 0x7f3b34126560 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3b2c043020 con 0x7f3b340a7270 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 0x7f3b34126940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient: get_auth_request con 0x7f3b34126560 auth_method 0 2024-08-19T11:15:14.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.995+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.996+0000 7f3b39d56640 10 monclient(hunting): handle_auth_done global_id 25314 payload 824 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.996+0000 7f3b39d56640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b340a6d30 con 0x7f3b34126560 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.996+0000 7f3b2a7fc640 1 --2- 172.21.15.71:0/2004255378 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b1803eab0 0x7f3b18040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.996+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (secure 0 0 0) 0x7f3b2c071db0 con 0x7f3b340a7270 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.996+0000 7f3b39555640 1 --2- 172.21.15.71:0/2004255378 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b1803eab0 0x7f3b18040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.996+0000 7f3b39555640 10 monclient: get_auth_request con 0x7f3b1803eab0 auth_method 0 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b39d56640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 msgr2=0x7f3b34126940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b39d56640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 0x7f3b34126940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b300118e0 tx=0x7f3b30011da0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b300148b0 con 0x7f3b34126560 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 10 monclient: dump: 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.023 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3b30014440 con 0x7f3b34126560 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 msgr2=0x7f3b34126940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 0x7f3b34126940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b300118e0 tx=0x7f3b30011da0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 msgr2=0x7f3b34126940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b2a7fc640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126560 0x7f3b34126940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:13.998+0000 7f3b39555640 1 --2- 172.21.15.71:0/2004255378 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b1803eab0 0x7f3b18040f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3b34127780 tx=0x7f3b24009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b3bfba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 0x7f3b341225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b3bfba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b34076c60 con 0x7f3b34126e80 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b39d56640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 0x7f3b341225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b39d56640 10 monclient: get_auth_request con 0x7f3b34126e80 auth_method 0 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b39d56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b39d56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.004+0000 7f3b39d56640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.005+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.005+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.005+0000 7f3b39d56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.005+0000 7f3b39d56640 10 monclient(hunting): handle_auth_done global_id 25323 payload 824 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.005+0000 7f3b39d56640 1 -- 172.21.15.71:0/2004255378 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b3409d290 con 0x7f3b34126e80 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b39d56640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 msgr2=0x7f3b341225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b39d56640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 0x7f3b341225a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b300118e0 tx=0x7f3b300046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b30022e00 con 0x7f3b34126e80 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 10 monclient: dump: 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.026 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9601 (secure 0 0 0) 0x7f3b30022990 con 0x7f3b34126e80 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:14.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 msgr2=0x7f3b341225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 0x7f3b341225a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b300118e0 tx=0x7f3b300046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 msgr2=0x7f3b341225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.007+0000 7f3b2a7fc640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b34126e80 0x7f3b341225a0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b300118e0 tx=0x7f3b300046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 221622, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:14.053 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:14.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b1803eab0 msgr2=0x7f3b18040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2004255378 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b1803eab0 0x7f3b18040f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3b34127780 tx=0x7f3b24009110 comp rx=0 tx=0).stop 2024-08-19T11:15:14.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 10 monclient: shutdown 2024-08-19T11:15:14.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 msgr2=0x7f3b34126020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 0x7f3b34126020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c030000 tx=0x7f3b2c004a40 comp rx=0 tx=0).stop 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3a557640 1 -- 172.21.15.71:0/2004255378 reap_dead start 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 shutdown_connections 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 --2- 172.21.15.71:0/2004255378 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b340a7270 0x7f3b34126020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 >> 172.21.15.71:0/2004255378 conn(0x7f3b340abf50 msgr2=0x7f3b3413a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 shutdown_connections 2024-08-19T11:15:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.008+0000 7f3b3bfba640 1 -- 172.21.15.71:0/2004255378 wait complete. 2024-08-19T11:15:14.055 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:14.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:15:14.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.151+0000 7f4cee141640 10 monclient: get_monmap_and_config 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.151+0000 7f4cee141640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.152+0000 7f4cee141640 10 monclient: monmap: 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:14.153635+0000 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:14.153635+0000 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.154 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:14.155 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.152+0000 7f4cee141640 1 Processor -- start 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.152+0000 7f4cee141640 1 -- start start 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.152+0000 7f4cee141640 10 monclient: init 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient: _add_conns ranks=[9,7,6,4,1,5,0,3,10,8,2] 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ce80a6950 0x7f4ce80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): picked mon.noname-a con 0x7f4ce80a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ce80a57c0 0x7f4ce80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): picked mon.noname-i con 0x7f4ce80a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4ce8139710 0x7f4ce8139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): picked mon.noname-d con 0x7f4ce8139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:14.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce80a5020 con 0x7f4ce80a6950 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4ce80a77b0 con 0x7f4ce8139710 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4ce80a7d40 con 0x7f4ce80a57c0 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cee141640 10 monclient(hunting): authenticate will time out at 972.195467s 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ce80a6950 0x7f4ce80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ce80a6950 0x7f4ce80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60850/0 (socket says 172.21.15.71:60850) 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4ce8139710 0x7f4ce8139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 -- 172.21.15.71:0/1229548016 learned_addr learned my addr 172.21.15.71:0/1229548016 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): get_auth_request con 0x7f4ce80a6950 auth_method 0 2024-08-19T11:15:14.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): get_auth_request con 0x7f4ce8139710 auth_method 0 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_done global_id 35037 payload 274 2024-08-19T11:15:14.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 -- 172.21.15.71:0/1229548016 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ce80a57c0 msgr2=0x7f4ce80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4cdeffd640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ce80a57c0 0x7f4ce80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ce80a57c0 0x7f4ce80a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 -- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4ce8139710 msgr2=0x7f4ce8139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4ce8139710 0x7f4ce8139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 monclient: found mon.noname-a 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce77fe640 1 -- 172.21.15.71:0/1229548016 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80a6380 con 0x7f4ce80a6950 2024-08-19T11:15:14.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.153+0000 7f4ce7fff640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4ce8139710 0x7f4ce8139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.156+0000 7f4ce77fe640 1 -- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a6950 msgr2=0x7f4ce80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.156+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a6950 0x7f4ce80a6d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80098a0 tx=0x7f4cd802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9fb8d2b7c1d12b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 1 -- 172.21.15.71:0/1229548016 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cd8037070 con 0x7f4ce80a6950 2024-08-19T11:15:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: dump: 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.169 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 1 -- 172.21.15.71:0/1229548016 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd802adf0 con 0x7f4ce80a6950 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 5 monclient: authenticate success, global_id 35037 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:14.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 1 -- 172.21.15.71:0/1229548016 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cd8030c20 con 0x7f4ce80a6950 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 4 set_mon_vals no callback set 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4ce6ffd640 10 monclient: dump: 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 10 monclient: shutdown 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 -- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a6950 msgr2=0x7f4ce80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a6950 0x7f4ce80a6d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80098a0 tx=0x7f4cd802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 -- 172.21.15.71:0/1229548016 shutdown_connections 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4ce8139710 0x7f4ce8139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4ce80a57c0 0x7f4ce80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 --2- 172.21.15.71:0/1229548016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a6950 0x7f4ce80a6d30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 -- 172.21.15.71:0/1229548016 >> 172.21.15.71:0/1229548016 conn(0x7f4ce80abf50 msgr2=0x7f4ce80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 -- 172.21.15.71:0/1229548016 shutdown_connections 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.157+0000 7f4cee141640 1 -- 172.21.15.71:0/1229548016 wait complete. 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.158+0000 7f4cee141640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.158+0000 7f4cee141640 10 monclient: monmap: 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.173 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.158+0000 7f4cee141640 1 Processor -- start 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.158+0000 7f4cee141640 1 -- start start 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.158+0000 7f4cee141640 10 monclient: init 2024-08-19T11:15:14.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient: _add_conns ranks=[0,8,1,4,6,5,3,2,7] 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 0x7f4ce8138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): picked mon.noname-a con 0x7f4ce80a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce80a6950 0x7f4ce8138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): picked mon.noname-e con 0x7f4ce80a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce8139710 0x7f4ce81225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): picked mon.noname-f con 0x7f4ce8139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80a84c0 con 0x7f4ce80a57c0 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80a3650 con 0x7f4ce8139710 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4ce80a8700 con 0x7f4ce80a6950 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cee141640 10 monclient(hunting): authenticate will time out at 972.201338s 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 0x7f4ce8138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 0x7f4ce8138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:60856/0 (socket says 172.21.15.71:60856) 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce80a6950 0x7f4ce8138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 -- 172.21.15.71:0/3209858022 learned_addr learned my addr 172.21.15.71:0/3209858022 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): get_auth_request con 0x7f4ce80a57c0 auth_method 0 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): get_auth_request con 0x7f4ce80a6950 auth_method 0 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce7fff640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce8139710 0x7f4ce81225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce7fff640 10 monclient(hunting): get_auth_request con 0x7f4ce8139710 auth_method 0 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient(hunting): handle_auth_done global_id 35046 payload 824 2024-08-19T11:15:14.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce80a6950 msgr2=0x7f4ce8138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce80a6950 0x7f4ce8138a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce8139710 msgr2=0x7f4ce81225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce8139710 0x7f4ce81225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 monclient: found mon.noname-a 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce77fe640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80a1e00 con 0x7f4ce80a57c0 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.159+0000 7f4ce7fff640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce8139710 0x7f4ce81225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.161+0000 7f4ce77fe640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 msgr2=0x7f4ce8138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.161+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 0x7f4ce8138550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80090b0 tx=0x7f4cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cd8041030 con 0x7f4ce80a57c0 2024-08-19T11:15:14.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: dump: 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.179 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd8003bd0 con 0x7f4ce80a57c0 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 5 monclient: authenticate success, global_id 35046 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 10 monclient: _renew_subs 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce8125e20 con 0x7f4ce80a57c0 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cd8037040 con 0x7f4ce80a57c0 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce4ff9640 10 monclient: dump: 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.181 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4ce67fc640 4 set_mon_vals no callback set 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 10 monclient: _renew_subs 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.162+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce8124900 con 0x7f4ce80a57c0 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cee141640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cee141640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 0x7f4ce802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4ce806a590 con 0x7f4ce81232a0 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 0x7f4ce802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce77fe640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 0x7f4ce8138550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80090b0 tx=0x7f4cd80046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f4cd8042070 osd_map(146..146 src has 1..146) 2024-08-19T11:15:14.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient: get_auth_request con 0x7f4ce81232a0 auth_method 0 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4cd8044070 con 0x7f4ce80a57c0 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_done global_id 64205 payload 824 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4cdeffd640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ce80a6d30 con 0x7f4ce81232a0 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce4ff9640 1 --2- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 0x7f4cc8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce7fff640 1 --2- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 0x7f4cc8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce7fff640 10 monclient: get_auth_request con 0x7f4cc803ea80 auth_method 0 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce7fff640 1 -- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 msgr2=0x7f4cc8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce7fff640 1 -- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 msgr2=0x7f4cc8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:15:14.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce7fff640 1 --2- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 0x7f4cc8040f40 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0007520 tx=0x7f4ce000b040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.163+0000 7f4ce7fff640 1 --2- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 0x7f4cc8040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4cdeffd640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 msgr2=0x7f4ce802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4cdeffd640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 0x7f4ce802d1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8125710 tx=0x7f4cd000fc70 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cd000dc00 con 0x7f4ce81232a0 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 10 monclient: dump: 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.184 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4cd000dc00 con 0x7f4ce81232a0 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 msgr2=0x7f4ce802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 0x7f4ce802d1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8125710 tx=0x7f4cd000fc70 comp rx=0 tx=0).stop 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 msgr2=0x7f4ce802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.165+0000 7f4ce4ff9640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce81232a0 0x7f4ce802d1c0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8125710 tx=0x7f4cd000fc70 comp rx=0 tx=0).stop 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.171+0000 7f4cee141640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.171+0000 7f4cee141640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 0x7f4ce802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cee141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4ce8076c60 con 0x7f4ce8123680 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 0x7f4ce802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient: get_auth_request con 0x7f4ce8123680 auth_method 0 2024-08-19T11:15:14.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 10 monclient(hunting): handle_auth_done global_id 64214 payload 824 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.172+0000 7f4cdeffd640 1 -- 172.21.15.71:0/3209858022 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ce809e100 con 0x7f4ce8123680 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4cdeffd640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 msgr2=0x7f4ce802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4cdeffd640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 0x7f4ce802d700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8125710 tx=0x7f4cd0004730 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4cd0013e00 con 0x7f4ce8123680 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 10 monclient: dump: 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.188 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f4cd0013e00 con 0x7f4ce8123680 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 msgr2=0x7f4ce802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 0x7f4ce802d700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8125710 tx=0x7f4cd0004730 comp rx=0 tx=0).stop 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 msgr2=0x7f4ce802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.174+0000 7f4ce4ff9640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4ce8123680 0x7f4ce802d700 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8125710 tx=0x7f4cd0004730 comp rx=0 tx=0).stop 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.190 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 25656, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:14.191 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.193 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.194 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:14.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.199 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.201 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.203 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.204 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.206 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:14.212 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:14.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 msgr2=0x7f4cc8040f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:14.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 --2- 172.21.15.71:0/3209858022 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cc803ea80 0x7f4cc8040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 10 monclient: shutdown 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 msgr2=0x7f4ce8138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 --2- 172.21.15.71:0/3209858022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ce80a57c0 0x7f4ce8138550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80090b0 tx=0x7f4cd80046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4ce7fff640 1 -- 172.21.15.71:0/3209858022 reap_dead start 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4ce7fff640 1 -- 172.21.15.71:0/3209858022 reap_dead start 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4ce4ff9640 1 -- 172.21.15.71:0/3209858022 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (unknown 0 0 0) 0x7f4cd8042070 con 0x7f4ce80a57c0 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 shutdown_connections 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 >> 172.21.15.71:0/3209858022 conn(0x7f4ce80abf50 msgr2=0x7f4ce80aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 shutdown_connections 2024-08-19T11:15:14.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.175+0000 7f4cee141640 1 -- 172.21.15.71:0/3209858022 wait complete. 2024-08-19T11:15:14.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:14.215 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:15:14.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.311+0000 7fa522e27640 10 monclient: get_monmap_and_config 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.311+0000 7fa522e27640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.311+0000 7fa522e27640 10 monclient: monmap: 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:14.312981+0000 2024-08-19T11:15:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:14.312981+0000 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:14.315 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 Processor -- start 2024-08-19T11:15:14.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 -- start start 2024-08-19T11:15:14.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient: init 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient: _add_conns ranks=[7,4,2,5,0,6,3,10,9,8,1] 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa51c0a6950 0x7fa51c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): picked mon.noname-i con 0x7fa51c0a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 0x7fa51c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): picked mon.noname-c con 0x7fa51c0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 0x7fa51c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): picked mon.noname-b con 0x7fa51c139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa51c0a5020 con 0x7fa51c139710 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa51c0a77b0 con 0x7fa51c0a57c0 2024-08-19T11:15:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa51c0a7d40 con 0x7fa51c0a6950 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa522e27640 10 monclient(hunting): authenticate will time out at 972.354693s 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 0x7fa51c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 0x7fa51c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 0x7fa51c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44216/0 (socket says 172.21.15.71:44216) 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 0x7fa51c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55370/0 (socket says 172.21.15.71:55370) 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 1 -- 172.21.15.71:0/1305920314 learned_addr learned my addr 172.21.15.71:0/1305920314 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): get_auth_request con 0x7fa51c139710 auth_method 0 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): get_auth_request con 0x7fa51c0a57c0 auth_method 0 2024-08-19T11:15:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa5213c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa51bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.312+0000 7fa520bc3640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa51c0a6950 0x7fa51c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa520bc3640 10 monclient(hunting): get_auth_request con 0x7fa51c0a6950 auth_method 0 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa520bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa520bc3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa520bc3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 10 monclient(hunting): handle_auth_done global_id 44554 payload 274 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 1 -- 172.21.15.71:0/1305920314 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa51c0a6950 msgr2=0x7fa51c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa51c0a6950 0x7fa51c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 1 -- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 msgr2=0x7fa51c139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 0x7fa51c139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 1 monclient: found mon.noname-c 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa51bfff640 1 -- 172.21.15.71:0/1305920314 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c0a6380 con 0x7fa51c0a57c0 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.313+0000 7fa5213c4640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 0x7fa51c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.315+0000 7fa51bfff640 1 -- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 msgr2=0x7fa51c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.315+0000 7fa51bfff640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 0x7fa51c0a7270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa508009800 tx=0x7fa508029fe0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4e2c81df5f543fe4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.315+0000 7fa51b7fe640 1 -- 172.21.15.71:0/1305920314 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa508037070 con 0x7fa51c0a57c0 2024-08-19T11:15:14.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.315+0000 7fa51b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.315+0000 7fa51b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.315+0000 7fa51b7fe640 10 monclient: dump: 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.326 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 1 -- 172.21.15.71:0/1305920314 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50802ad00 con 0x7fa51c0a57c0 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 5 monclient: authenticate success, global_id 44554 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 1 -- 172.21.15.71:0/1305920314 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa508030c20 con 0x7fa51c0a57c0 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 4 set_mon_vals no callback set 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa51b7fe640 10 monclient: dump: 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 10 monclient: shutdown 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 -- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 msgr2=0x7fa51c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 0x7fa51c0a7270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa508009800 tx=0x7fa508029fe0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 -- 172.21.15.71:0/1305920314 shutdown_connections 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa51c139710 0x7fa51c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a57c0 0x7fa51c0a7270 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 --2- 172.21.15.71:0/1305920314 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa51c0a6950 0x7fa51c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 -- 172.21.15.71:0/1305920314 >> 172.21.15.71:0/1305920314 conn(0x7fa51c0abf50 msgr2=0x7fa51c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 -- 172.21.15.71:0/1305920314 shutdown_connections 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.316+0000 7fa522e27640 1 -- 172.21.15.71:0/1305920314 wait complete. 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.317+0000 7fa522e27640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.317+0000 7fa522e27640 10 monclient: monmap: 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.317+0000 7fa522e27640 1 Processor -- start 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.317+0000 7fa522e27640 1 -- start start 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.317+0000 7fa522e27640 10 monclient: init 2024-08-19T11:15:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient: _add_conns ranks=[5,4,0,3,7,2,1,6,8] 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa51c0a57c0 0x7fa51c1ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): picked mon.noname-h con 0x7fa51c0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 0x7fa51c138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): picked mon.noname-c con 0x7fa51c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c139710 0x7fa51c139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): picked mon.noname-a con 0x7fa51c139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c0a84c0 con 0x7fa51c139710 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa51c0a3650 con 0x7fa51c0a6950 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa51c0a8700 con 0x7fa51c0a57c0 2024-08-19T11:15:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa522e27640 10 monclient(hunting): authenticate will time out at 972.360120s 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 0x7fa51c138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c139710 0x7fa51c139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 0x7fa51c138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55378/0 (socket says 172.21.15.71:55378) 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 -- 172.21.15.71:0/2383273744 learned_addr learned my addr 172.21.15.71:0/2383273744 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): get_auth_request con 0x7fa51c0a6950 auth_method 0 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): get_auth_request con 0x7fa51c139710 auth_method 0 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient(hunting): handle_auth_done global_id 44563 payload 824 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa520bc3640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa51c0a57c0 0x7fa51c1ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa51c0a57c0 msgr2=0x7fa51c1ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa51c0a57c0 0x7fa51c1ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c139710 msgr2=0x7fa51c139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c139710 0x7fa51c139100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 monclient: found mon.noname-c 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa51bfff640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c1254f0 con 0x7fa51c0a6950 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.318+0000 7fa5213c4640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa51c139710 0x7fa51c139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26257]: starting. 2024-08-19T11:15:14.335 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26257]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26255 2024-08-19T11:15:14.336 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26257]: shutting down. 2024-08-19T11:15:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.320+0000 7fa51bfff640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 msgr2=0x7fa51c138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.320+0000 7fa51bfff640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 0x7fa51c138bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa508000c00 tx=0x7fa5080046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa508037040 con 0x7fa51c0a6950 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: dump: 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa508042070 con 0x7fa51c0a6950 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 5 monclient: authenticate success, global_id 44563 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa50803dd20 con 0x7fa51c0a6950 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 10 monclient: _renew_subs 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c13a300 con 0x7fa51c0a6950 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa51affd640 4 set_mon_vals no callback set 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa5197fa640 10 monclient: dump: 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 10 monclient: _renew_subs 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.321+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c126580 con 0x7fa51c0a6950 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa522e27640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa522e27640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 0x7fa51c122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c06a590 con 0x7fa51c124d80 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 0x7fa51c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient: get_auth_request con 0x7fa51c124d80 auth_method 0 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 10 monclient(hunting): handle_auth_done global_id 5680 payload 824 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.322+0000 7fa520bc3640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa51c1ce920 con 0x7fa51c124d80 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.325+0000 7fa520bc3640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 msgr2=0x7fa51c122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.325+0000 7fa520bc3640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 0x7fa51c122fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e710 tx=0x7fa51000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.326+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa510017070 con 0x7fa51c124d80 2024-08-19T11:15:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.326+0000 7fa5197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.326+0000 7fa5197fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.326+0000 7fa5197fa640 10 monclient: dump: 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.326+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa508003bd0 con 0x7fa51c0a6950 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.326+0000 7fa5197fa640 1 --2- 172.21.15.71:0/2383273744 >> v2:172.21.15.135:6800/726754104 conn(0x7fa50003ed20 0x7fa5000411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa51000cbb0 con 0x7fa51c124d80 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 msgr2=0x7fa51c122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 0x7fa51c122fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e710 tx=0x7fa51000ebd0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 msgr2=0x7fa51c122fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c124d80 0x7fa51c122fa0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e710 tx=0x7fa51000ebd0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7fa508071f80 con 0x7fa51c0a6950 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5213c4640 1 --2- 172.21.15.71:0/2383273744 >> v2:172.21.15.135:6800/726754104 conn(0x7fa50003ed20 0x7fa5000411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.327+0000 7fa5213c4640 10 monclient: get_auth_request con 0x7fa50003ed20 auth_method 0 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.330+0000 7fa5213c4640 1 --2- 172.21.15.71:0/2383273744 >> v2:172.21.15.135:6800/726754104 conn(0x7fa50003ed20 0x7fa5000411e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5140072e0 tx=0x7fa51400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.334+0000 7fa522e27640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.334+0000 7fa522e27640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 0x7fa51c02d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.334+0000 7fa522e27640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.334+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c076c60 con 0x7fa51c02d1c0 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 0x7fa51c02d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient: get_auth_request con 0x7fa51c02d1c0 auth_method 0 2024-08-19T11:15:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 10 monclient(hunting): handle_auth_done global_id 5689 payload 824 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.335+0000 7fa520bc3640 1 -- 172.21.15.71:0/2383273744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa51c0a2070 con 0x7fa51c02d1c0 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.337+0000 7fa520bc3640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 msgr2=0x7fa51c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.337+0000 7fa520bc3640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 0x7fa51c02d5d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e710 tx=0x7fa510004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa51000f040 con 0x7fa51c02d1c0 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 10 monclient: dump: 2024-08-19T11:15:14.349 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.351 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fa51001cc70 con 0x7fa51c02d1c0 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 msgr2=0x7fa51c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 0x7fa51c02d5d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa51000e710 tx=0x7fa510004730 comp rx=0 tx=0).stop 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 msgr2=0x7fa51c02d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5197fa640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c02d1c0 0x7fa51c02d5d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 311178, 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:14.353 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:14.354 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:14.357 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.358 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.360 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:14.362 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:14.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:14.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.370 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.376 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:14.376 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 >> v2:172.21.15.135:6800/726754104 conn(0x7fa50003ed20 msgr2=0x7fa5000411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa522e27640 1 --2- 172.21.15.71:0/2383273744 >> v2:172.21.15.135:6800/726754104 conn(0x7fa50003ed20 0x7fa5000411e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5140072e0 tx=0x7fa51400b040 comp rx=0 tx=0).stop 2024-08-19T11:15:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa522e27640 10 monclient: shutdown 2024-08-19T11:15:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa522e27640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 msgr2=0x7fa51c138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa522e27640 1 --2- 172.21.15.71:0/2383273744 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa51c0a6950 0x7fa51c138bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa508000c00 tx=0x7fa5080046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.338+0000 7fa5213c4640 1 -- 172.21.15.71:0/2383273744 reap_dead start 2024-08-19T11:15:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.339+0000 7fa5213c4640 1 -- 172.21.15.71:0/2383273744 reap_dead start 2024-08-19T11:15:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.339+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 shutdown_connections 2024-08-19T11:15:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.339+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 >> 172.21.15.71:0/2383273744 conn(0x7fa51c0abf50 msgr2=0x7fa51c0aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.339+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 shutdown_connections 2024-08-19T11:15:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.339+0000 7fa522e27640 1 -- 172.21.15.71:0/2383273744 wait complete. 2024-08-19T11:15:14.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:14.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:15:14.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:15:14.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.475+0000 7f47f2ca6640 10 monclient: get_monmap_and_config 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.475+0000 7f47f2ca6640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.475+0000 7f47f2ca6640 10 monclient: monmap: 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:14.477404+0000 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:14.477404+0000 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:14.478 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:14.479 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 1 Processor -- start 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 1 -- start start 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 10 monclient: init 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 10 monclient: _add_conns ranks=[2,3,5,7,0,10,8,6,9,1,4] 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 0x7f47ec0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.476+0000 7f47f2ca6640 10 monclient(hunting): picked mon.noname-b con 0x7f47ec0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec0a57c0 0x7f47ec0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): picked mon.noname-g con 0x7f47ec0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec139710 0x7f47ec139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): picked mon.noname-h con 0x7f47ec139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec0a5020 con 0x7f47ec0a6950 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec0a77b0 con 0x7f47ec0a57c0 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f47ec0a7d40 con 0x7f47ec139710 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f2ca6640 10 monclient(hunting): authenticate will time out at 972.519060s 2024-08-19T11:15:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 0x7f47ec0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 0x7f47ec0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44228/0 (socket says 172.21.15.71:44228) 2024-08-19T11:15:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 -- 172.21.15.71:0/757102618 learned_addr learned my addr 172.21.15.71:0/757102618 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): get_auth_request con 0x7f47ec0a6950 auth_method 0 2024-08-19T11:15:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47ebfff640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec0a57c0 0x7f47ec0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f1243640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec139710 0x7f47ec139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47ebfff640 10 monclient(hunting): get_auth_request con 0x7f47ec0a57c0 auth_method 0 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f1243640 10 monclient(hunting): get_auth_request con 0x7f47ec139710 auth_method 0 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f1243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f1243640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f1243640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient(hunting): handle_auth_done global_id 6113 payload 274 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 -- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec139710 msgr2=0x7f47ec139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec139710 0x7f47ec139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 -- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec0a57c0 msgr2=0x7f47ec0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec0a57c0 0x7f47ec0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 monclient: found mon.noname-b 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.477+0000 7f47f0a42640 1 -- 172.21.15.71:0/757102618 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec0a6380 con 0x7f47ec0a6950 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f0a42640 1 -- 172.21.15.71:0/757102618 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 msgr2=0x7f47ec0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f0a42640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 0x7f47ec0a6d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47e00098d0 tx=0x7f47e002a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53bedc7be0008c58 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 1 -- 172.21.15.71:0/757102618 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0037070 con 0x7f47ec0a6950 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: dump: 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 1 -- 172.21.15.71:0/757102618 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e002adc0 con 0x7f47ec0a6950 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 5 monclient: authenticate success, global_id 6113 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 4 set_mon_vals no callback set 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 1 -- 172.21.15.71:0/757102618 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0030c20 con 0x7f47ec0a6950 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47eb7fe640 10 monclient: dump: 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.491 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 10 monclient: shutdown 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 -- 172.21.15.71:0/757102618 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 msgr2=0x7f47ec0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 0x7f47ec0a6d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47e00098d0 tx=0x7f47e002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 -- 172.21.15.71:0/757102618 shutdown_connections 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec139710 0x7f47ec139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec0a57c0 0x7f47ec0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/757102618 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47ec0a6950 0x7f47ec0a6d30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.480+0000 7f47f2ca6640 1 -- 172.21.15.71:0/757102618 >> 172.21.15.71:0/757102618 conn(0x7f47ec0abf50 msgr2=0x7f47ec0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 1 -- 172.21.15.71:0/757102618 shutdown_connections 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 1 -- 172.21.15.71:0/757102618 wait complete. 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 10 monclient: monmap: 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 1 Processor -- start 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 1 -- start start 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.481+0000 7f47f2ca6640 10 monclient: init 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient: _add_conns ranks=[1,5,4,0,8,3,6,7,2] 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47ec0a57c0 0x7f47ec1387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): picked mon.noname-f con 0x7f47ec0a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec0a6950 0x7f47ec138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): picked mon.noname-h con 0x7f47ec0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 0x7f47ec1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): picked mon.noname-c con 0x7f47ec139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec0a84c0 con 0x7f47ec0a57c0 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f47ec0a3650 con 0x7f47ec139710 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f47ec0a8700 con 0x7f47ec0a6950 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f2ca6640 10 monclient(hunting): authenticate will time out at 972.524637s 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 0x7f47ec1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec0a6950 0x7f47ec138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 0x7f47ec1225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:55394/0 (socket says 172.21.15.71:55394) 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 1 -- 172.21.15.71:0/3931111743 learned_addr learned my addr 172.21.15.71:0/3931111743 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): get_auth_request con 0x7f47ec139710 auth_method 0 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): get_auth_request con 0x7f47ec0a6950 auth_method 0 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47ec0a57c0 0x7f47ec1387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): get_auth_request con 0x7f47ec0a57c0 auth_method 0 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f1243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.482+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 10 monclient(hunting): handle_auth_done global_id 44590 payload 824 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec0a6950 msgr2=0x7f47ec138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47ec0a6950 0x7f47ec138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47ec0a57c0 msgr2=0x7f47ec1387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47ec0a57c0 0x7f47ec1387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 1 monclient: found mon.noname-c 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.483+0000 7f47f1243640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec126170 con 0x7f47ec139710 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f1243640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 msgr2=0x7f47ec1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f1243640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 0x7f47ec1225a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47e4007d80 tx=0x7f47e400e4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e4014890 con 0x7f47ec139710 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: dump: 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.504 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.505 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e4019070 con 0x7f47ec139710 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 5 monclient: authenticate success, global_id 44590 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 10 monclient: _renew_subs 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e4013380 con 0x7f47ec139710 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec123e10 con 0x7f47ec139710 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47eaffd640 4 set_mon_vals no callback set 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47e97fa640 10 monclient: dump: 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.507 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 10 monclient: _renew_subs 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.485+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec125bb0 con 0x7f47ec139710 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f2ca6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 0x7f47ec1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec06a590 con 0x7f47ec1ce3d0 2024-08-19T11:15:14.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f47e4014420 con 0x7f47ec139710 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 0x7f47ec1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient: get_auth_request con 0x7f47ec1ce3d0 auth_method 0 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47e97fa640 1 --2- 172.21.15.71:0/3931111743 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003ea80 0x7f47d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f47e40521f0 con 0x7f47ec139710 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 10 monclient(hunting): handle_auth_done global_id 44517 payload 824 2024-08-19T11:15:14.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47f0a42640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47ec125db0 con 0x7f47ec1ce3d0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47ebfff640 1 --2- 172.21.15.71:0/3931111743 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003ea80 0x7f47d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.486+0000 7f47ebfff640 10 monclient: get_auth_request con 0x7f47d003ea80 auth_method 0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47f0a42640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 msgr2=0x7f47ec1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47f0a42640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 0x7f47ec1232a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47e00098a0 tx=0x7f47e00046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47ebfff640 1 --2- 172.21.15.71:0/3931111743 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003ea80 0x7f47d0040f40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0a1a80 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0042070 con 0x7f47ec1ce3d0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 10 monclient: dump: 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.510 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f47e002adc0 con 0x7f47ec1ce3d0 2024-08-19T11:15:14.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 msgr2=0x7f47ec1232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 0x7f47ec1232a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47e00098a0 tx=0x7f47e00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 msgr2=0x7f47ec1232a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.489+0000 7f47e97fa640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec1ce3d0 0x7f47ec1232a0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47e00098a0 tx=0x7f47e00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.495+0000 7f47f2ca6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.495+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 0x7f47ec02d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.495+0000 7f47f2ca6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.495+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47ec076c60 con 0x7f47ec02d1c0 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 0x7f47ec02d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient: get_auth_request con 0x7f47ec02d1c0 auth_method 0 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 10 monclient(hunting): handle_auth_done global_id 44526 payload 824 2024-08-19T11:15:14.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.496+0000 7f47f0a42640 1 -- 172.21.15.71:0/3931111743 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f47ec0a6d30 con 0x7f47ec02d1c0 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.498+0000 7f47f0a42640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 msgr2=0x7f47ec02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.498+0000 7f47f0a42640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 0x7f47ec02d5d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097c0 tx=0x7f47e0009240 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.498+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0037040 con 0x7f47ec02d1c0 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 10 monclient: dump: 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f47e0030aa0 con 0x7f47ec02d1c0 2024-08-19T11:15:14.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 msgr2=0x7f47ec02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 0x7f47ec02d5d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097c0 tx=0x7f47e0009240 comp rx=0 tx=0).stop 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 msgr2=0x7f47ec02d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47e97fa640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47ec02d1c0 0x7f47ec02d5d0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e00097c0 tx=0x7f47e0009240 comp rx=0 tx=0).stop 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 83522, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:14.539 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003ea80 msgr2=0x7f47d0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/3931111743 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003ea80 0x7f47d0040f40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0a1a80 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2024-08-19T11:15:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 10 monclient: shutdown 2024-08-19T11:15:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 msgr2=0x7f47ec1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 0x7f47ec1225a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47e4007d80 tx=0x7f47e400e4b0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f1243640 1 -- 172.21.15.71:0/3931111743 reap_dead start 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 shutdown_connections 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 --2- 172.21.15.71:0/3931111743 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f47ec139710 0x7f47ec1225a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 >> 172.21.15.71:0/3931111743 conn(0x7f47ec0abf50 msgr2=0x7f47ec0aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 shutdown_connections 2024-08-19T11:15:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.499+0000 7f47f2ca6640 1 -- 172.21.15.71:0/3931111743 wait complete. 2024-08-19T11:15:14.541 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:14.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:15:14.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:15:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.637+0000 7f6aaf7b8640 10 monclient: get_monmap_and_config 2024-08-19T11:15:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.637+0000 7f6aaf7b8640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.637+0000 7f6aaf7b8640 10 monclient: monmap: 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:14.639308+0000 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:14.639308+0000 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.640 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.641 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.641 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:14.641 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:14.641 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 Processor -- start 2024-08-19T11:15:14.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 -- start start 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient: init 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient: _add_conns ranks=[1,10,2,7,4,9,8,6,3,5,0] 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6aa80a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6aa80a57c0 0x7f6aa813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): picked mon.noname-f con 0x7f6aa80a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 0x7f6aa81410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): picked mon.noname-b con 0x7f6aa80a7440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa80a6380 con 0x7f6aa80a6950 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa80a5020 con 0x7f6aa80a57c0 2024-08-19T11:15:14.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa80a7d40 con 0x7f6aa80a7440 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.638+0000 7f6aaf7b8640 10 monclient(hunting): authenticate will time out at 972.680961s 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 0x7f6aa81410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 0x7f6aa81410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44244/0 (socket says 172.21.15.71:44244) 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 -- 172.21.15.71:0/45623662 learned_addr learned my addr 172.21.15.71:0/45623662 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): get_auth_request con 0x7f6aa80a7440 auth_method 0 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 1 --2- 172.21.15.71:0/45623662 >> v2:172.21.15.135:3300/0 conn(0x7f6aa80a57c0 0x7f6aa813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): get_auth_request con 0x7f6aa80a57c0 auth_method 0 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aacd53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient(hunting): handle_auth_done global_id 6122 payload 274 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 -- 172.21.15.71:0/45623662 >> v2:172.21.15.135:3300/0 conn(0x7f6aa80a57c0 msgr2=0x7f6aa813eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 --2- 172.21.15.71:0/45623662 >> v2:172.21.15.135:3300/0 conn(0x7f6aa80a57c0 0x7f6aa813eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 -- 172.21.15.71:0/45623662 >> v1:172.21.15.135:6789/0 conn(0x7f6aa80a6950 legacy=0x7f6aa80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 monclient: found mon.noname-b 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.639+0000 7f6aadd55640 1 -- 172.21.15.71:0/45623662 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa80a3650 con 0x7f6aa80a7440 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aadd55640 1 -- 172.21.15.71:0/45623662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 msgr2=0x7f6aa81410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aadd55640 1 --2- 172.21.15.71:0/45623662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 0x7f6aa81410b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009e80 tx=0x7f6aa002a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87601ee5519a320 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 1 -- 172.21.15.71:0/45623662 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa0036070 con 0x7f6aa80a7440 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: dump: 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 1 -- 172.21.15.71:0/45623662 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa0007a70 con 0x7f6aa80a7440 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 5 monclient: authenticate success, global_id 6122 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 1 -- 172.21.15.71:0/45623662 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa0007c20 con 0x7f6aa80a7440 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 4 set_mon_vals no callback set 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6a9ffff640 10 monclient: dump: 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 10 monclient: shutdown 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/45623662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 msgr2=0x7f6aa81410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/45623662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 0x7f6aa81410b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009e80 tx=0x7f6aa002a580 comp rx=0 tx=0).stop 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/45623662 shutdown_connections 2024-08-19T11:15:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/45623662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6aa80a7440 0x7f6aa81410b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/45623662 >> v2:172.21.15.135:3300/0 conn(0x7f6aa80a57c0 0x7f6aa813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.642+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/45623662 >> 172.21.15.71:0/45623662 conn(0x7f6aa80abf50 msgr2=0x7f6aa80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.643+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/45623662 shutdown_connections 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.643+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/45623662 wait complete. 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.643+0000 7f6aaf7b8640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.643+0000 7f6aaf7b8640 10 monclient: monmap: 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.643+0000 7f6aaf7b8640 1 Processor -- start 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 -- start start 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient: init 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient: _add_conns ranks=[5,8,4,6,0,1,7,3,2] 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa80a57c0 0x7f6aa8128b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): picked mon.noname-h con 0x7f6aa80a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 0x7f6aa813fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): picked mon.noname-e con 0x7f6aa80a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6aa80a7440 0x7f6aa8126660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): picked mon.noname-c con 0x7f6aa80a7440 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6aa80a8700 con 0x7f6aa80a7440 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6aa80a84c0 con 0x7f6aa80a57c0 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6aa81415f0 con 0x7f6aa80a6950 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aaf7b8640 10 monclient(hunting): authenticate will time out at 972.686548s 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 0x7f6aa813fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6aa80a7440 0x7f6aa8126660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 0x7f6aa813fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:52394/0 (socket says 172.21.15.71:52394) 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 -- 172.21.15.71:0/149512051 learned_addr learned my addr 172.21.15.71:0/149512051 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): get_auth_request con 0x7f6aa80a6950 auth_method 0 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): get_auth_request con 0x7f6aa80a7440 auth_method 0 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aad554640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa80a57c0 0x7f6aa8128b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aad554640 10 monclient(hunting): get_auth_request con 0x7f6aa80a57c0 auth_method 0 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aad554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aad554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aad554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient(hunting): handle_auth_done global_id 64223 payload 824 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa80a57c0 msgr2=0x7f6aa8128b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa80a57c0 0x7f6aa8128b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6aa80a7440 msgr2=0x7f6aa8126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6aa80a7440 0x7f6aa8126660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 monclient: found mon.noname-e 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aacd53640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa80a94a0 con 0x7f6aa80a6950 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.644+0000 7f6aadd55640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6aa80a7440 0x7f6aa8126660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aacd53640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 msgr2=0x7f6aa813fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aacd53640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 0x7f6aa813fa00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800e9b0 tx=0x7f6a9800ee70 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a98017070 con 0x7f6aa80a6950 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: dump: 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.664 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9800cbb0 con 0x7f6aa80a6950 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 5 monclient: authenticate success, global_id 64223 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 10 monclient: _renew_subs 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa8129dd0 con 0x7f6aa80a6950 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a9800cd60 con 0x7f6aa80a6950 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9dffb640 10 monclient: dump: 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.666 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6a9f7fe640 4 set_mon_vals no callback set 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 10 monclient: _renew_subs 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.647+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa81c6480 con 0x7f6aa80a6950 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6a9801a070 con 0x7f6aa80a6950 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aaf7b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 0x7f6aa8126f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6aa8140dc0 con 0x7f6aa8126ba0 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6a9dffb640 1 --2- 172.21.15.71:0/149512051 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a8c03ea80 0x7f6a8c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f6a9800f040 con 0x7f6aa80a6950 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 0x7f6aa8126f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient: get_auth_request con 0x7f6aa8126ba0 auth_method 0 2024-08-19T11:15:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aadd55640 1 --2- 172.21.15.71:0/149512051 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a8c03ea80 0x7f6a8c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aadd55640 10 monclient: get_auth_request con 0x7f6a8c03ea80 auth_method 0 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 10 monclient(hunting): handle_auth_done global_id 44591 payload 824 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.648+0000 7f6aad554640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6aa8129520 con 0x7f6aa8126ba0 2024-08-19T11:15:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6aad554640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 msgr2=0x7f6aa8126f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6aad554640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 0x7f6aa8126f80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e4d0 tx=0x7f6aa400e990 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6aadd55640 1 --2- 172.21.15.71:0/149512051 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a8c03ea80 0x7f6a8c040f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009e80 tx=0x7f6aa0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa4006c40 con 0x7f6aa8126ba0 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 10 monclient: dump: 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6aa4007450 con 0x7f6aa8126ba0 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 msgr2=0x7f6aa8126f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 0x7f6aa8126f80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e4d0 tx=0x7f6aa400e990 comp rx=0 tx=0).stop 2024-08-19T11:15:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 msgr2=0x7f6aa8126f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.651+0000 7f6a9dffb640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa8126ba0 0x7f6aa8126f80 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e4d0 tx=0x7f6aa400e990 comp rx=0 tx=0).stop 2024-08-19T11:15:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aaf7b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 0x7f6aa8122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aaf7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6aa8076c60 con 0x7f6aa81225a0 2024-08-19T11:15:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aad554640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 0x7f6aa8122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aad554640 10 monclient: get_auth_request con 0x7f6aa81225a0 auth_method 0 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aad554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aad554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.657+0000 7f6aad554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.658+0000 7f6aad554640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.658+0000 7f6aad554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.658+0000 7f6aad554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.658+0000 7f6aad554640 10 monclient(hunting): handle_auth_done global_id 44600 payload 824 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.658+0000 7f6aad554640 1 -- 172.21.15.71:0/149512051 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6aa81274c0 con 0x7f6aa81225a0 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.660+0000 7f6aad554640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 msgr2=0x7f6aa8122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.660+0000 7f6aad554640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 0x7f6aa8122980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009010 tx=0x7f6aa4003760 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.660+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6aa401ede0 con 0x7f6aa81225a0 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.660+0000 7f6a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.660+0000 7f6a9dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.660+0000 7f6a9dffb640 10 monclient: dump: 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f6aa401e970 con 0x7f6aa81225a0 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 msgr2=0x7f6aa8122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 0x7f6aa8122980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009010 tx=0x7f6aa4003760 comp rx=0 tx=0).stop 2024-08-19T11:15:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 msgr2=0x7f6aa8122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6a9dffb640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6aa81225a0 0x7f6aa8122980 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009010 tx=0x7f6aa4003760 comp rx=0 tx=0).stop 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 83684, 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:14.698 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a8c03ea80 msgr2=0x7f6a8c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/149512051 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a8c03ea80 0x7f6a8c040f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009e80 tx=0x7f6aa0009000 comp rx=0 tx=0).stop 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 10 monclient: shutdown 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 msgr2=0x7f6aa813fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 0x7f6aa813fa00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800e9b0 tx=0x7f6a9800ee70 comp rx=0 tx=0).stop 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aadd55640 1 -- 172.21.15.71:0/149512051 reap_dead start 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 shutdown_connections 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 --2- 172.21.15.71:0/149512051 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6aa80a6950 0x7f6aa813fa00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 >> 172.21.15.71:0/149512051 conn(0x7f6aa80abf50 msgr2=0x7f6aa809f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 shutdown_connections 2024-08-19T11:15:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.661+0000 7f6aaf7b8640 1 -- 172.21.15.71:0/149512051 wait complete. 2024-08-19T11:15:14.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:14.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:15:14.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.798+0000 7f8ffc13a640 10 monclient: get_monmap_and_config 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.798+0000 7f8ffc13a640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.798+0000 7f8ffc13a640 10 monclient: monmap: 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:14.800421+0000 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:14.800421+0000 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.801 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.799+0000 7f8ffc13a640 1 Processor -- start 2024-08-19T11:15:14.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.799+0000 7f8ffc13a640 1 -- start start 2024-08-19T11:15:14.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.799+0000 7f8ffc13a640 10 monclient: init 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient: _add_conns ranks=[2,10,8,7,0,1,5,4,3,9,6] 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 0x7f8ff40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): picked mon.noname-b con 0x7f8ff40a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8ff40a57c0 0x7f8ff40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): picked mon.noname-f con 0x7f8ff40a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8ff4139710 0x7f8ff4139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): picked mon.noname-e con 0x7f8ff4139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40a5020 con 0x7f8ff40a57c0 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff40a77b0 con 0x7f8ff40a6950 2024-08-19T11:15:14.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8ff40a7d40 con 0x7f8ff4139710 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffc13a640 10 monclient(hunting): authenticate will time out at 972.842233s 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 0x7f8ff40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8ff4139710 0x7f8ff4139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 0x7f8ff40a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44250/0 (socket says 172.21.15.71:44250) 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/1099743761 learned_addr learned my addr 172.21.15.71:0/1099743761 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): get_auth_request con 0x7f8ff40a6950 auth_method 0 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): get_auth_request con 0x7f8ff4139710 auth_method 0 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ffa6d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_done global_id 6131 payload 274 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8ff4139710 msgr2=0x7f8ff4139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8ff4139710 0x7f8ff4139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/1099743761 >> v2:172.21.15.135:3300/0 conn(0x7f8ff40a57c0 msgr2=0x7f8ff40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/1099743761 >> v2:172.21.15.135:3300/0 conn(0x7f8ff40a57c0 0x7f8ff40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 monclient: found mon.noname-b 2024-08-19T11:15:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.800+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/1099743761 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff40a6380 con 0x7f8ff40a6950 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 msgr2=0x7f8ff40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 0x7f8ff40a6d30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009eb0 tx=0x7f8ff002a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b8071854d44de8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 1 -- 172.21.15.71:0/1099743761 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ff0036070 con 0x7f8ff40a6950 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: dump: 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 1 -- 172.21.15.71:0/1099743761 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff0007a70 con 0x7f8ff40a6950 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ffc13a640 5 monclient: authenticate success, global_id 6131 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ffc13a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 1 -- 172.21.15.71:0/1099743761 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ff0007c20 con 0x7f8ff40a6950 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ff8ed4640 10 monclient: dump: 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.812 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ffc13a640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.803+0000 7f8ffc13a640 4 set_mon_vals no callback set 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 10 monclient: shutdown 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 -- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 msgr2=0x7f8ff40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 0x7f8ff40a6d30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009eb0 tx=0x7f8ff002a5b0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 -- 172.21.15.71:0/1099743761 shutdown_connections 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8ff4139710 0x7f8ff4139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/1099743761 >> v2:172.21.15.135:3300/0 conn(0x7f8ff40a57c0 0x7f8ff40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/1099743761 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8ff40a6950 0x7f8ff40a6d30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 -- 172.21.15.71:0/1099743761 >> 172.21.15.71:0/1099743761 conn(0x7f8ff40abf50 msgr2=0x7f8ff40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 -- 172.21.15.71:0/1099743761 shutdown_connections 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 1 -- 172.21.15.71:0/1099743761 wait complete. 2024-08-19T11:15:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 10 monclient: build_initial_monmap 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.804+0000 7f8ffc13a640 10 monclient: monmap: 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 Processor -- start 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 -- start start 2024-08-19T11:15:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient: init 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient: _add_conns ranks=[1,3,7,4,2,8,0,5,6] 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff40a57c0 0x7f8ff41ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): picked mon.noname-f con 0x7f8ff40a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 0x7f8ff41387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): picked mon.noname-g con 0x7f8ff40a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:14.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4139710 0x7f8ff4138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): picked mon.noname-i con 0x7f8ff4139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40a84c0 con 0x7f8ff40a57c0 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff40a3650 con 0x7f8ff40a6950 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8ff40a8700 con 0x7f8ff4139710 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffc13a640 10 monclient(hunting): authenticate will time out at 972.847617s 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 0x7f8ff41387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffa6d7640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4139710 0x7f8ff4138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 0x7f8ff41387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:41156/0 (socket says 172.21.15.71:41156) 2024-08-19T11:15:14.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 1 -- 172.21.15.71:0/2328636793 learned_addr learned my addr 172.21.15.71:0/2328636793 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffa6d7640 10 monclient(hunting): get_auth_request con 0x7f8ff4139710 auth_method 0 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffa6d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffa6d7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ffa6d7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 10 monclient(hunting): get_auth_request con 0x7f8ff40a6950 auth_method 0 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.805+0000 7f8ff96d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ffa6d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ffa6d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ffa6d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 10 monclient(hunting): handle_auth_done global_id 44535 payload 824 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4139710 msgr2=0x7f8ff4138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4139710 0x7f8ff4138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff40a57c0 msgr2=0x7f8ff41ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ff40a57c0 0x7f8ff41ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 10 monclient: _finish_hunting 0 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 1 monclient: found mon.noname-g 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.806+0000 7f8ff96d5640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff40a1ee0 con 0x7f8ff40a6950 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ff96d5640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 msgr2=0x7f8ff41387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ff96d5640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 0x7f8ff41387f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400b4d0 tx=0x7f8fe400b990 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fe4014070 con 0x7f8ff40a6950 2024-08-19T11:15:14.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: dump: 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.826 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe4010cf0 con 0x7f8ff40a6950 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 5 monclient: authenticate success, global_id 44535 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 10 monclient: _renew_subs 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:14.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff4124bc0 con 0x7f8ff40a6950 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fe400f830 con 0x7f8ff40a6950 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8fea7fc640 10 monclient: dump: 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.828 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8febfff640 4 set_mon_vals no callback set 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 10 monclient: _renew_subs 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.808+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff4124f60 con 0x7f8ff40a6950 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ffc13a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 0x7f8ff402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8ff4076c60 con 0x7f8ff4122d60 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 0x7f8ff402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient: get_auth_request con 0x7f8ff4122d60 auth_method 0 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8fe4017070 con 0x7f8ff40a6950 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.809+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.810+0000 7f8fea7fc640 1 --2- 172.21.15.71:0/2328636793 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fd803ea80 0x7f8fd8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.810+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_done global_id 64276 payload 824 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.810+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ff4125e80 con 0x7f8ff4122d60 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.810+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f8fe4051830 con 0x7f8ff40a6950 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.810+0000 7f8ffa6d7640 1 --2- 172.21.15.71:0/2328636793 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fd803ea80 0x7f8fd8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.810+0000 7f8ffa6d7640 10 monclient: get_auth_request con 0x7f8fd803ea80 auth_method 0 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 msgr2=0x7f8ff402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 0x7f8ff402d1c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0033000 tx=0x7f8ff0008840 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ff0036050 con 0x7f8ff4122d60 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 10 monclient: dump: 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.831 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8ffa6d7640 1 --2- 172.21.15.71:0/2328636793 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fd803ea80 0x7f8fd8040f40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009aa0 tx=0x7f8fec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8ff0037040 con 0x7f8ff4122d60 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 msgr2=0x7f8ff402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 0x7f8ff402d1c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0033000 tx=0x7f8ff0008840 comp rx=0 tx=0).stop 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 msgr2=0x7f8ff402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.812+0000 7f8fea7fc640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4122d60 0x7f8ff402d1c0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0033000 tx=0x7f8ff0008840 comp rx=0 tx=0).stop 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ffc13a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 0x7f8ff402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ffc13a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8ff40a6d30 con 0x7f8ff4123140 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 0x7f8ff402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient: get_auth_request con 0x7f8ff4123140 auth_method 0 2024-08-19T11:15:14.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 10 monclient(hunting): handle_auth_done global_id 64285 payload 824 2024-08-19T11:15:14.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.819+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/2328636793 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ff409e100 con 0x7f8ff4123140 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8ff9ed6640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 msgr2=0x7f8ff402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8ff9ed6640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 0x7f8ff402d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0034040 tx=0x7f8ff002f000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8ff004a070 con 0x7f8ff4123140 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 10 monclient: dump: 2024-08-19T11:15:14.835 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:14.836 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f8ff0046770 con 0x7f8ff4123140 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 msgr2=0x7f8ff402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 0x7f8ff402d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0034040 tx=0x7f8ff002f000 comp rx=0 tx=0).stop 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 msgr2=0x7f8ff402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.822+0000 7f8fea7fc640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8ff4123140 0x7f8ff402d700 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0034040 tx=0x7f8ff002f000 comp rx=0 tx=0).stop 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:14.837 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 92, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 26316, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:14.838 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.839 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:14.841 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:14.842 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:14.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.846 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:14.847 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:14.851 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:14.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:14.858 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:14.859 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:14.860 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:14.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:14.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:14.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:14.860 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:14.860 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fd803ea80 msgr2=0x7f8fd8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/2328636793 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fd803ea80 0x7f8fd8040f40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009aa0 tx=0x7f8fec009190 comp rx=0 tx=0).stop 2024-08-19T11:15:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 10 monclient: shutdown 2024-08-19T11:15:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 msgr2=0x7f8ff41387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:14.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 --2- 172.21.15.71:0/2328636793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8ff40a6950 0x7f8ff41387f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400b4d0 tx=0x7f8fe400b990 comp rx=0 tx=0).stop 2024-08-19T11:15:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffa6d7640 1 -- 172.21.15.71:0/2328636793 reap_dead start 2024-08-19T11:15:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffa6d7640 1 -- 172.21.15.71:0/2328636793 reap_dead start 2024-08-19T11:15:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 shutdown_connections 2024-08-19T11:15:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 >> 172.21.15.71:0/2328636793 conn(0x7f8ff40abf50 msgr2=0x7f8ff40aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 shutdown_connections 2024-08-19T11:15:14.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:14.823+0000 7f8ffc13a640 1 -- 172.21.15.71:0/2328636793 wait complete. 2024-08-19T11:15:14.862 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:15:14.862 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c', 'b', 'a'] 2024-08-19T11:15:14.863 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-19T11:15:14.863 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-19T11:15:14.863 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-19T11:15:14.863 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-19T11:15:14.863 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:15:14.873 INFO:tasks.ceph.mon.c:Stopped 2024-08-19T11:15:14.873 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-08-19T11:15:14.873 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-08-19T11:15:14.873 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-19T11:15:14.873 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:15:14.926 INFO:tasks.ceph.mon.b:Stopped 2024-08-19T11:15:14.926 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-08-19T11:15:14.926 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-08-19T11:15:14.926 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-19T11:15:14.926 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:15:14.978 INFO:tasks.ceph.mon.a:Stopped 2024-08-19T11:15:14.978 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-08-19T11:15:14.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:15.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.114+0000 7f529bf98640 10 monclient: get_monmap_and_config 2024-08-19T11:15:15.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.114+0000 7f529bf98640 10 monclient: build_initial_monmap 2024-08-19T11:15:15.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.114+0000 7f529bf98640 10 monclient: monmap: 2024-08-19T11:15:15.116 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:15.116235+0000 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:15.116235+0000 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:15.117 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:15.118 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:15.118 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:15.118 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:15.118 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:15.118 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:15.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 Processor -- start 2024-08-19T11:15:15.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 -- start start 2024-08-19T11:15:15.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient: init 2024-08-19T11:15:15.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:15.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient: _add_conns ranks=[6,0,2,3,7,8,1,10,9,4,5] 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 0x7f52940a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): picked mon.noname-d con 0x7f52940a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f52940a6e10 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f529413eb10 0x7f5294140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): picked mon.noname-b con 0x7f529413eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52940a4f90 con 0x7f52940a6e10 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f52940a3650 con 0x7f529413eb10 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f52940a6380 con 0x7f52940a6a30 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:15.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529bf98640 10 monclient(hunting): authenticate will time out at 973.157939s 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f529a535640 1 -- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f529413eb10 msgr2=0x7f5294140f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3301/0 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.115+0000 7f5299533640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7f52940a6e10 legacy=0x7f52940a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f529a535640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f529413eb10 0x7f5294140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 0x7f52940a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 0x7f52940a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47382/0 (socket says 172.21.15.71:47382) 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 -- 172.21.15.71:0/2271605980 learned_addr learned my addr 172.21.15.71:0/2271605980 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): get_auth_request con 0x7f52940a6a30 auth_method 0 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient(hunting): handle_auth_done global_id 25368 payload 274 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 -- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f529413eb10 msgr2=0x7f5294140f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 --2- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f529413eb10 0x7f5294140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 -- 172.21.15.71:0/2271605980 >> v1:172.21.15.71:6789/0 conn(0x7f52940a6e10 legacy=0x7f52940a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient: _finish_hunting 0 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 monclient: found mon.noname-d 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:15.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.116+0000 7f5299d34640 1 -- 172.21.15.71:0/2271605980 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52940a49d0 con 0x7f52940a6a30 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5299d34640 1 -- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 msgr2=0x7f52940a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5299d34640 1 --2- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 0x7f52940a57f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52900098a0 tx=0x7f529002a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=6b8ea49715768f38 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 1 -- 172.21.15.71:0/2271605980 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5290037070 con 0x7f52940a6a30 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: dump: 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:15.128 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: _finish_auth 0 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: _check_auth_tickets 2024-08-19T11:15:15.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 5 monclient: authenticate success, global_id 25368 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 1 -- 172.21.15.71:0/2271605980 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52900307b0 con 0x7f52940a6a30 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 4 set_mon_vals no callback set 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 1 -- 172.21.15.71:0/2271605980 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5290030dd0 con 0x7f52940a6a30 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f5298d32640 10 monclient: dump: 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:15.131 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 10 monclient: shutdown 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 -- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 msgr2=0x7f52940a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 --2- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 0x7f52940a57f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52900098a0 tx=0x7f529002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 -- 172.21.15.71:0/2271605980 shutdown_connections 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 --2- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f529413eb10 0x7f5294140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 --2- 172.21.15.71:0/2271605980 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f52940a6a30 0x7f52940a57f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 -- 172.21.15.71:0/2271605980 >> 172.21.15.71:0/2271605980 conn(0x7f52940ac030 msgr2=0x7f52940ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 -- 172.21.15.71:0/2271605980 shutdown_connections 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.119+0000 7f529bf98640 1 -- 172.21.15.71:0/2271605980 wait complete. 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.120+0000 7f529bf98640 10 monclient: build_initial_monmap 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.120+0000 7f529bf98640 10 monclient: monmap: 2024-08-19T11:15:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.120+0000 7f529bf98640 1 Processor -- start 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.120+0000 7f529bf98640 1 -- start start 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.120+0000 7f529bf98640 10 monclient: init 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient: _add_conns ranks=[7,2,5,3,0,8,6,4,1] 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 0x7f5294125db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): picked mon.noname-i con 0x7f52940a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52940a6e10 0x7f5294123ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): picked mon.noname-b con 0x7f52940a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f529413eb10 0x7f529413cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): picked mon.noname-h con 0x7f529413eb10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5294141440 con 0x7f52940a6e10 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f52940a5d30 con 0x7f529413eb10 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f52941415c0 con 0x7f52940a6a30 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529bf98640 10 monclient(hunting): authenticate will time out at 973.163232s 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299533640 1 -- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52940a6e10 msgr2=0x7f5294123ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3301/0 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299533640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52940a6e10 0x7f5294123ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f529413eb10 0x7f529413cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 0x7f5294125db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 0x7f5294125db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:33080/0 (socket says 172.21.15.71:33080) 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 -- 172.21.15.71:0/3950488790 learned_addr learned my addr 172.21.15.71:0/3950488790 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): get_auth_request con 0x7f52940a6a30 auth_method 0 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): get_auth_request con 0x7f529413eb10 auth_method 0 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f529a535640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient(hunting): handle_auth_done global_id 64294 payload 824 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 -- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f529413eb10 msgr2=0x7f529413cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f529413eb10 0x7f529413cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 -- 172.21.15.71:0/3950488790 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52940a6e10 msgr2=0x7f5294123ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52940a6e10 0x7f5294123ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient: _finish_hunting 0 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 monclient: found mon.noname-i 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:15:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.121+0000 7f5299d34640 1 -- 172.21.15.71:0/3950488790 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529413d8c0 con 0x7f52940a6a30 2024-08-19T11:15:15.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f5299d34640 1 -- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 msgr2=0x7f5294125db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f5299d34640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 0x7f5294125db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f52900097c0 tx=0x7f52900046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5290037040 con 0x7f52940a6a30 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: dump: 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:15.140 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5290030b70 con 0x7f52940a6a30 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 5 monclient: authenticate success, global_id 64294 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 10 monclient: _renew_subs 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5290030d20 con 0x7f52940a6a30 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5294124cf0 con 0x7f52940a6a30 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528bfff640 4 set_mon_vals no callback set 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f528a7fc640 10 monclient: dump: 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:15.142 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 10 monclient: _renew_subs 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.124+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941275b0 con 0x7f52940a6a30 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.125+0000 7f529bf98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.125+0000 7f529bf98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.125+0000 7f529bf98640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.125+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52940a4230 con 0x7f52940a6a30 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.125+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5290003610 con 0x7f52940a6a30 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.126+0000 7f528a7fc640 1 --2- 172.21.15.71:0/3950488790 >> v2:172.21.15.135:6800/726754104 conn(0x7f527803ea80 0x7f5278040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.126+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f5290071e30 con 0x7f52940a6a30 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.126+0000 7f5299533640 1 --2- 172.21.15.71:0/3950488790 >> v2:172.21.15.135:6800/726754104 conn(0x7f527803ea80 0x7f5278040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.126+0000 7f5299533640 10 monclient: get_auth_request con 0x7f527803ea80 auth_method 0 2024-08-19T11:15:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.128+0000 7f5299533640 1 --2- 172.21.15.71:0/3950488790 >> v2:172.21.15.135:6800/726754104 conn(0x7f527803ea80 0x7f5278040f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5284006fd0 tx=0x7f5284006ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.131+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f52940a4230 con 0x7f52940a6a30 2024-08-19T11:15:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.131+0000 7f528a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.131+0000 7f528a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.372+0000 7f529bf98640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.372+0000 7f529bf98640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.372+0000 7f529bf98640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:15:15.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.372+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f52940773b0 con 0x7f52940a6a30 2024-08-19T11:15:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.373+0000 7f528a7fc640 1 -- 172.21.15.71:0/3950488790 <== mon.7 v2:172.21.15.135:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7f52940773b0 con 0x7f52940a6a30 2024-08-19T11:15:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.373+0000 7f528a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:15.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.373+0000 7f528a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:15.375 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 >> v2:172.21.15.135:6800/726754104 conn(0x7f527803ea80 msgr2=0x7f5278040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 --2- 172.21.15.71:0/3950488790 >> v2:172.21.15.135:6800/726754104 conn(0x7f527803ea80 0x7f5278040f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5284006fd0 tx=0x7f5284006ce0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 10 monclient: shutdown 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 msgr2=0x7f5294125db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 0x7f5294125db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f52900097c0 tx=0x7f52900046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 shutdown_connections 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 --2- 172.21.15.71:0/3950488790 >> v2:172.21.15.135:6800/726754104 conn(0x7f527803ea80 0x7f5278040f40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f529413eb10 0x7f529413cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f52940a6e10 0x7f5294123ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 --2- 172.21.15.71:0/3950488790 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f52940a6a30 0x7f5294125db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 >> 172.21.15.71:0/3950488790 conn(0x7f52940ac030 msgr2=0x7f529413fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 shutdown_connections 2024-08-19T11:15:15.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:15.375+0000 7f529bf98640 1 -- 172.21.15.71:0/3950488790 wait complete. 2024-08-19T11:15:18.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:18.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.495+0000 7fd21a772640 10 monclient: get_monmap_and_config 2024-08-19T11:15:18.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.495+0000 7fd21a772640 10 monclient: build_initial_monmap 2024-08-19T11:15:18.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.495+0000 7fd21a772640 10 monclient: monmap: 2024-08-19T11:15:18.498 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:18.498 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:18.501 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:18.497372+0000 2024-08-19T11:15:18.501 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:18.497372+0000 2024-08-19T11:15:18.501 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:18.501 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:18.502 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:18.502 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:18.502 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:18.502 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:18.503 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.496+0000 7fd21a772640 1 Processor -- start 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.496+0000 7fd21a772640 1 -- start start 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.496+0000 7fd21a772640 10 monclient: init 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient: _add_conns ranks=[5,7,4,0,9,3,8,6,1,2,10] 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 0x7fd2140a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): picked mon.noname-h con 0x7fd2140a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 0x7fd2140a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): picked mon.noname-i con 0x7fd2140a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd214139860 0x7fd214139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): picked mon.noname-c con 0x7fd214139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd2140a4f90 con 0x7fd214139860 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd2140a6380 con 0x7fd2140a6a30 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd2140a49d0 con 0x7fd2140a6e10 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:18.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd21a772640 10 monclient(hunting): authenticate will time out at 976.539165s 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd218d0f640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd214139860 msgr2=0x7fd214139c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd218d0f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd214139860 0x7fd214139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 0x7fd2140a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 0x7fd2140a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 0x7fd2140a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:60098/0 (socket says 172.21.15.71:60098) 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 0x7fd2140a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:33092/0 (socket says 172.21.15.71:33092) 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 -- 172.21.15.71:0/715478481 learned_addr learned my addr 172.21.15.71:0/715478481 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): get_auth_request con 0x7fd2140a6a30 auth_method 0 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): get_auth_request con 0x7fd2140a6e10 auth_method 0 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:18.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient(hunting): handle_auth_done global_id 44618 payload 274 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 -- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 msgr2=0x7fd2140a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 0x7fd2140a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 -- 172.21.15.71:0/715478481 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd214139860 msgr2=0x7fd214139c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd214139860 0x7fd214139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:18.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 monclient: found mon.noname-h 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd213fff640 1 -- 172.21.15.71:0/715478481 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2140a46f0 con 0x7fd2140a6a30 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.497+0000 7fd2137fe640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 0x7fd2140a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd213fff640 1 -- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 msgr2=0x7fd2140a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd213fff640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 0x7fd2140a57f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd2040098d0 tx=0x7fd20402a0d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=4b866a149d247b7e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 1 -- 172.21.15.71:0/715478481 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd204037070 con 0x7fd2140a6a30 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: dump: 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:18.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 1 -- 172.21.15.71:0/715478481 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20402adf0 con 0x7fd2140a6a30 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 1 -- 172.21.15.71:0/715478481 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd204030c20 con 0x7fd2140a6a30 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 5 monclient: authenticate success, global_id 44618 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 4 set_mon_vals no callback set 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd212ffd640 10 monclient: dump: 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.516 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 10 monclient: shutdown 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 -- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 msgr2=0x7fd2140a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:18.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 0x7fd2140a57f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd2040098d0 tx=0x7fd20402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 -- 172.21.15.71:0/715478481 shutdown_connections 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd214139860 0x7fd214139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6e10 0x7fd2140a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 --2- 172.21.15.71:0/715478481 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2140a6a30 0x7fd2140a57f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 -- 172.21.15.71:0/715478481 >> 172.21.15.71:0/715478481 conn(0x7fd2140ac030 msgr2=0x7fd2140ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 -- 172.21.15.71:0/715478481 shutdown_connections 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.501+0000 7fd21a772640 1 -- 172.21.15.71:0/715478481 wait complete. 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.502+0000 7fd21a772640 10 monclient: build_initial_monmap 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.502+0000 7fd21a772640 10 monclient: monmap: 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:18.518 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.502+0000 7fd21a772640 1 Processor -- start 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 -- start start 2024-08-19T11:15:18.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient: init 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient: _add_conns ranks=[7,3,0,5,6,8,1,2,4] 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): picked mon.noname-i con 0x7fd2140a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2140a6e10 0x7fd2141cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): picked mon.noname-g con 0x7fd2140a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd214139860 0x7fd2141cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): picked mon.noname-a con 0x7fd214139860 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2140a7730 con 0x7fd214139860 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd21413a1a0 con 0x7fd2140a6e10 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd2140a2700 con 0x7fd2140a6a30 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd21a772640 10 monclient(hunting): authenticate will time out at 976.545611s 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd218d0f640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd214139860 msgr2=0x7fd2141cf370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd218d0f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd214139860 0x7fd2141cf370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd2137fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2140a6e10 0x7fd2141cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:33104/0 (socket says 172.21.15.71:33104) 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 learned_addr learned my addr 172.21.15.71:0/3015094182 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd2137fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2140a6e10 0x7fd2141cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:41172/0 (socket says 172.21.15.71:41172) 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 10 monclient(hunting): get_auth_request con 0x7fd2140a6a30 auth_method 0 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:18.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd213fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd2137fe640 10 monclient(hunting): get_auth_request con 0x7fd2140a6e10 auth_method 0 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd2137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd2137fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.503+0000 7fd2137fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 10 monclient(hunting): handle_auth_done global_id 64312 payload 824 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2140a6e10 msgr2=0x7fd2141cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:18.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2140a6e10 0x7fd2141cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd214139860 msgr2=0x7fd2141cf370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd214139860 0x7fd2141cf370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 monclient: found mon.noname-i 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd214128aa0 con 0x7fd2140a6a30 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 msgr2=0x7fd2141ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 msgr2=0x7fd2141ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fd2040098d0 tx=0x7fd2040046c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:18.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.504+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:18.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient: get_auth_request con 0x7fd2140a6a30 auth_method 0 2024-08-19T11:15:18.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 0 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:15:18.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient: ms_handle_reset current mon [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 msgr2=0x7fd2141ce8f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd2140a6a30 0x7fd2141ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient: _add_conns ranks=[5,1,4,2,8,6] 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 0x7fd200005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): picked mon.noname-h con 0x7fd2000035d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd200006570 0x7fd200008a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): picked mon.noname-f con 0x7fd200006570 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd2000095a0 0x7fd20000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): picked mon.noname-c con 0x7fd2000095a0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd20000c650 con 0x7fd200006570 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd20000c7d0 con 0x7fd2000095a0 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd20000c9d0 con 0x7fd2000035d0 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd210ff9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd218d0f640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd2000095a0 msgr2=0x7fd20000ba60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd218d0f640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd2000095a0 0x7fd20000ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 0x7fd200005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): get_auth_request con 0x7fd2000035d0 auth_method 0 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:18.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd200006570 0x7fd200008a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): get_auth_request con 0x7fd200006570 auth_method 0 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd2137fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient(hunting): handle_auth_done global_id 64312 payload 293 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd2000095a0 msgr2=0x7fd20000ba60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd2000095a0 0x7fd20000ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd200006570 msgr2=0x7fd200008a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd200006570 0x7fd200008a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 monclient: found mon.noname-h 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd218d0f640 1 -- 172.21.15.71:0/3015094182 reap_dead start 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:15:18.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.705+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20000cc90 con 0x7fd2000035d0 2024-08-19T11:15:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.707+0000 7fd213fff640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 msgr2=0x7fd200005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.707+0000 7fd213fff640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 0x7fd200005a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd204000c00 tx=0x7fd20402e000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:18.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd204037040 con 0x7fd2000035d0 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: dump: 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:18.716 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: _finish_auth 0 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204003bd0 con 0x7fd2000035d0 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd204030c20 con 0x7fd2000035d0 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 5 monclient: authenticate success, global_id 64312 2024-08-19T11:15:18.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 10 monclient: _renew_subs 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd214128d80 con 0x7fd2000035d0 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd210ff9640 10 monclient: dump: 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:18.718 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd2127fc640 4 set_mon_vals no callback set 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 10 monclient: _renew_subs 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.708+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2140a57f0 con 0x7fd2000035d0 2024-08-19T11:15:18.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.709+0000 7fd21a772640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.709+0000 7fd21a772640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.709+0000 7fd21a772640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.709+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21413a500 con 0x7fd2000035d0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.709+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd204044070 con 0x7fd2000035d0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.709+0000 7fd210ff9640 1 --2- 172.21.15.71:0/3015094182 >> v2:172.21.15.135:6800/726754104 conn(0x7fd200043140 0x7fd200045600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.710+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7fd204071a20 con 0x7fd2000035d0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.710+0000 7fd2137fe640 1 --2- 172.21.15.71:0/3015094182 >> v2:172.21.15.135:6800/726754104 conn(0x7fd200043140 0x7fd200045600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.710+0000 7fd2137fe640 10 monclient: get_auth_request con 0x7fd200043140 auth_method 0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.712+0000 7fd2137fe640 1 --2- 172.21.15.71:0/3015094182 >> v2:172.21.15.135:6800/726754104 conn(0x7fd200043140 0x7fd200045600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd208009560 tx=0x7fd208009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:18.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.715+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fd204003d80 con 0x7fd2000035d0 2024-08-19T11:15:18.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.715+0000 7fd210ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:18.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.715+0000 7fd210ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:18.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd21a772640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:18.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd21a772640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:18.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd21a772640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:15:18.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd2140008d0 con 0x7fd2000035d0 2024-08-19T11:15:18.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd210ff9640 1 -- 172.21.15.71:0/3015094182 <== mon.5 v2:172.21.15.135:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3192 (secure 0 0 0) 0x7fd204030340 con 0x7fd2000035d0 2024-08-19T11:15:18.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd210ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:18.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.957+0000 7fd210ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:18.960 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.959+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 >> v2:172.21.15.135:6800/726754104 conn(0x7fd200043140 msgr2=0x7fd200045600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.959+0000 7fd21a772640 1 --2- 172.21.15.71:0/3015094182 >> v2:172.21.15.135:6800/726754104 conn(0x7fd200043140 0x7fd200045600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd208009560 tx=0x7fd208009190 comp rx=0 tx=0).stop 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.959+0000 7fd21a772640 10 monclient: shutdown 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 msgr2=0x7fd200005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 0x7fd200005a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd204000c00 tx=0x7fd20402e000 comp rx=0 tx=0).stop 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 shutdown_connections 2024-08-19T11:15:18.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 --2- 172.21.15.71:0/3015094182 >> v2:172.21.15.135:6800/726754104 conn(0x7fd200043140 0x7fd200045600 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 --2- 172.21.15.71:0/3015094182 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2000035d0 0x7fd200005a20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:18.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 >> 172.21.15.71:0/3015094182 conn(0x7fd2140ac030 msgr2=0x7fd2141390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:18.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 shutdown_connections 2024-08-19T11:15:18.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:18.960+0000 7fd21a772640 1 -- 172.21.15.71:0/3015094182 wait complete. 2024-08-19T11:15:21.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.080+0000 7f630bdf2640 10 monclient: get_monmap_and_config 2024-08-19T11:15:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.080+0000 7f630bdf2640 10 monclient: build_initial_monmap 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.080+0000 7f630bdf2640 10 monclient: monmap: 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:22.082311+0000 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:22.082311+0000 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:22.086 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:22.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.081+0000 7f630bdf2640 1 Processor -- start 2024-08-19T11:15:22.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.081+0000 7f630bdf2640 1 -- start start 2024-08-19T11:15:22.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.081+0000 7f630bdf2640 10 monclient: init 2024-08-19T11:15:22.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.081+0000 7f630bdf2640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:22.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient: _add_conns ranks=[10,5,4,8,1,6,2,9,3,0,7] 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f63040a6a30 0x7f63040a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): picked mon.noname-f con 0x7f63040a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 0x7f63040a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): picked mon.noname-h con 0x7f63040a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): picked mon.noname-c con 0x7f6304139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f63040a4f90 con 0x7f63040a6a30 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f63040a6380 con 0x7f6304139860 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f63040a49d0 con 0x7f63040a6e10 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630bdf2640 10 monclient(hunting): authenticate will time out at 980.124124s 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630a38f640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 msgr2=0x7f6304139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630a38f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 0x7f63040a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f63040a6a30 0x7f63040a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 0x7f63040a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:60108/0 (socket says 172.21.15.71:60108) 2024-08-19T11:15:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 -- 172.21.15.71:0/3590852425 learned_addr learned my addr 172.21.15.71:0/3590852425 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): get_auth_request con 0x7f63040a6a30 auth_method 0 2024-08-19T11:15:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): get_auth_request con 0x7f63040a6e10 auth_method 0 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient(hunting): handle_auth_done global_id 44627 payload 274 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 -- 172.21.15.71:0/3590852425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 msgr2=0x7f6304139cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 --2- 172.21.15.71:0/3590852425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 -- 172.21.15.71:0/3590852425 >> v2:172.21.15.135:3300/0 conn(0x7f63040a6a30 msgr2=0x7f63040a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 --2- 172.21.15.71:0/3590852425 >> v2:172.21.15.135:3300/0 conn(0x7f63040a6a30 0x7f63040a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient: _finish_hunting 0 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 monclient: found mon.noname-h 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f630938d640 1 -- 172.21.15.71:0/3590852425 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63040a46f0 con 0x7f63040a6e10 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.082+0000 7f6309b8e640 1 --2- 172.21.15.71:0/3590852425 >> v2:172.21.15.135:3300/0 conn(0x7f63040a6a30 0x7f63040a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.085+0000 7f630938d640 1 -- 172.21.15.71:0/3590852425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 msgr2=0x7f63040a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.085+0000 7f630938d640 1 --2- 172.21.15.71:0/3590852425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 0x7f63040a71f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009870 tx=0x7f62f802a0d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=1c30c73f1c0f756d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 1 -- 172.21.15.71:0/3590852425 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f62f8037070 con 0x7f63040a6e10 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: dump: 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: _finish_auth 0 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: _check_auth_tickets 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 5 monclient: authenticate success, global_id 44627 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 1 -- 172.21.15.71:0/3590852425 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f802ae30 con 0x7f63040a6e10 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 4 set_mon_vals no callback set 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 1 -- 172.21.15.71:0/3590852425 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f62f8030c20 con 0x7f63040a6e10 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f6308b8c640 10 monclient: dump: 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 10 monclient: shutdown 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 -- 172.21.15.71:0/3590852425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 msgr2=0x7f63040a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 --2- 172.21.15.71:0/3590852425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 0x7f63040a71f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009870 tx=0x7f62f802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 -- 172.21.15.71:0/3590852425 shutdown_connections 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 --2- 172.21.15.71:0/3590852425 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 --2- 172.21.15.71:0/3590852425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63040a6e10 0x7f63040a71f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 --2- 172.21.15.71:0/3590852425 >> v2:172.21.15.135:3300/0 conn(0x7f63040a6a30 0x7f63040a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 -- 172.21.15.71:0/3590852425 >> 172.21.15.71:0/3590852425 conn(0x7f63040ac030 msgr2=0x7f63040ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 -- 172.21.15.71:0/3590852425 shutdown_connections 2024-08-19T11:15:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.086+0000 7f630bdf2640 1 -- 172.21.15.71:0/3590852425 wait complete. 2024-08-19T11:15:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.087+0000 7f630bdf2640 10 monclient: build_initial_monmap 2024-08-19T11:15:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.087+0000 7f630bdf2640 10 monclient: monmap: 2024-08-19T11:15:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.087+0000 7f630bdf2640 1 Processor -- start 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.087+0000 7f630bdf2640 1 -- start start 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.087+0000 7f630bdf2640 10 monclient: init 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient: _add_conns ranks=[8,0,4,6,2,5,1,3,7] 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): picked mon.noname-e con 0x7f63040a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63040a6e10 0x7f6304139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): picked mon.noname-a con 0x7f63040a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): picked mon.noname-c con 0x7f6304139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63040a7730 con 0x7f63040a6e10 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f630413a200 con 0x7f6304139860 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6304125b20 con 0x7f63040a6a30 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630bdf2640 10 monclient(hunting): authenticate will time out at 980.130326s 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630938d640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63040a6e10 msgr2=0x7f6304139170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630a38f640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 msgr2=0x7f6304122a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630a38f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304122a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f630938d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63040a6e10 0x7f6304139170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:33442/0 (socket says 172.21.15.71:33442) 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 -- 172.21.15.71:0/1906255767 learned_addr learned my addr 172.21.15.71:0/1906255767 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): get_auth_request con 0x7f63040a6a30 auth_method 0 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient(hunting): handle_auth_done global_id 64241 payload 824 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 -- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 msgr2=0x7f6304122a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304122a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 -- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63040a6e10 msgr2=0x7f6304139170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63040a6e10 0x7f6304139170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient: _finish_hunting 0 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 monclient: found mon.noname-e 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.088+0000 7f6309b8e640 1 -- 172.21.15.71:0/1906255767 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6304139d30 con 0x7f63040a6a30 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f6309b8e640 1 -- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 msgr2=0x7f6304138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f6309b8e640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f630000ebe0 tx=0x7f630000c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f6309b8e640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f630000ebe0 tx=0x7f630000c520 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f6300017070 mon_map magic: 0 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6300017070 con 0x7f63040a6a30 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 10 monclient: dump: 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630000ce40 con 0x7f63040a6a30 2024-08-19T11:15:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 5 monclient: authenticate success, global_id 64241 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 10 monclient: _renew_subs 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6304126030 con 0x7f63040a6a30 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f67fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f62f7fff640 4 set_mon_vals no callback set 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 10 monclient: _renew_subs 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.091+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6304124df0 con 0x7f63040a6a30 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f630bdf2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f630bdf2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f630bdf2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630413a560 con 0x7f63040a6a30 2024-08-19T11:15:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6300013d50 con 0x7f63040a6a30 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f62f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f62f67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f62f67fc640 10 monclient: dump: 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f630001a070 con 0x7f63040a6a30 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.092+0000 7f62f67fc640 1 --2- 172.21.15.71:0/1906255767 >> v2:172.21.15.135:6800/726754104 conn(0x7f62e803ead0 0x7f62e8040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.093+0000 7f630938d640 1 --2- 172.21.15.71:0/1906255767 >> v2:172.21.15.135:6800/726754104 conn(0x7f62e803ead0 0x7f62e8040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.093+0000 7f630938d640 10 monclient: get_auth_request con 0x7f62e803ead0 auth_method 0 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.095+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.095+0000 7f630938d640 1 --2- 172.21.15.71:0/1906255767 >> v2:172.21.15.135:6800/726754104 conn(0x7f62e803ead0 0x7f62e8040f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009870 tx=0x7f62f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.097+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f630000f040 con 0x7f63040a6a30 2024-08-19T11:15:22.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.715+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f6300021070 con 0x7f63040a6a30 2024-08-19T11:15:22.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.715+0000 7f62f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:22.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.715+0000 7f62f67fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f630bdf2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f630bdf2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f630bdf2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f63040a26f0 con 0x7f63040a6a30 2024-08-19T11:15:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f62f67fc640 1 -- 172.21.15.71:0/1906255767 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f6304139d30 con 0x7f63040a6a30 2024-08-19T11:15:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f62f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.959+0000 7f62f67fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:22.962 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.961+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 >> v2:172.21.15.135:6800/726754104 conn(0x7f62e803ead0 msgr2=0x7f62e8040f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.961+0000 7f630bdf2640 1 --2- 172.21.15.71:0/1906255767 >> v2:172.21.15.135:6800/726754104 conn(0x7f62e803ead0 0x7f62e8040f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009870 tx=0x7f62f802e000 comp rx=0 tx=0).stop 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.961+0000 7f630bdf2640 10 monclient: shutdown 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.961+0000 7f630bdf2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.961+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 msgr2=0x7f6304138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.961+0000 7f630bdf2640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f630000ebe0 tx=0x7f630000c520 comp rx=0 tx=0).stop 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 shutdown_connections 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 --2- 172.21.15.71:0/1906255767 >> v2:172.21.15.135:6800/726754104 conn(0x7f62e803ead0 0x7f62e8040f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63040a6e10 0x7f6304139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6304139860 0x7f6304122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 --2- 172.21.15.71:0/1906255767 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63040a6a30 0x7f6304138c30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 >> 172.21.15.71:0/1906255767 conn(0x7f63040ac030 msgr2=0x7f63041c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 shutdown_connections 2024-08-19T11:15:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:22.962+0000 7f630bdf2640 1 -- 172.21.15.71:0/1906255767 wait complete. 2024-08-19T11:15:25.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:26.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 10 monclient: get_monmap_and_config 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 10 monclient: build_initial_monmap 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 10 monclient: monmap: 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:26.084322+0000 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:26.084322+0000 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:26.085 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:26.086 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 1 Processor -- start 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 1 -- start start 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 10 monclient: init 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.083+0000 7f9cda88b640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient: _add_conns ranks=[6,9,4,7,0,8,3,1,2,5,10] 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): picked mon.noname-d con 0x7f9cd40a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 0x7f9cd40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd40a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:26.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 0x7f9cd4139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd4139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd40a4f90 con 0x7f9cd40a6e10 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd40a6380 con 0x7f9cd4139860 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9cd40a49d0 con 0x7f9cd40a6a30 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cda88b640 10 monclient(hunting): authenticate will time out at 984.126106s 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd37fe640 1 -- >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 msgr2=0x7f9cd40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:26.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd8e28640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 msgr2=0x7f9cd4139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd37fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 0x7f9cd40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd8e28640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 0x7f9cd4139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54664/0 (socket says 172.21.15.71:54664) 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 learned_addr learned my addr 172.21.15.71:0/3423473719 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cd40a6a30 auth_method 0 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:26.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.084+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:26.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 msgr2=0x7f9cd40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 0x7f9cd40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd8e28640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 msgr2=0x7f9cd4139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd8e28640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 0x7f9cd4139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cd40a6a30 auth_method 0 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:26.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.285+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 msgr2=0x7f9cd40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd8e28640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 msgr2=0x7f9cd4139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 0x7f9cd40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd8e28640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 0x7f9cd4139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cd40a6a30 auth_method 0 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:26.687+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd8e28640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 msgr2=0x7f9cd4139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd8e28640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 0x7f9cd4139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cd40a6a30 auth_method 0 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:27.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:27.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:27.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:27.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.488+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:15:27.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.489+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 msgr2=0x7f9cd40a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:27.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:27.489+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 0x7f9cd40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:15:29.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): tick 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 msgr2=0x7f9cd40a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cd40a6a30 0x7f9cd40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 msgr2=0x7f9cd4139cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cd4139860 0x7f9cd4139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 msgr2=0x7f9cd40a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.71:3300/0 conn(0x7f9cd40a6e10 0x7f9cd40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient: _add_conns ranks=[7,10,1,5,8,3,2,0] 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f9cb4003820 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): picked mon.noname-f con 0x7f9cb4006270 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f9cb4008dc0 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 -- 172.21.15.71:0/3423473719 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd40a46f0 con 0x7f9cb4008dc0 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 -- 172.21.15.71:0/3423473719 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd40a4f90 con 0x7f9cb4006270 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 1 -- 172.21.15.71:0/3423473719 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9cd40a6380 con 0x7f9cb4003820 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd1ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cb4003820 auth_method 0 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request con 0x7f9cb4006270 auth_method 0 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 msgr2=0x7f9cb4005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 msgr2=0x7f9cb4005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 msgr2=0x7f9cb4008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 msgr2=0x7f9cb4008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:29.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.085+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:29.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.087+0000 7f9cd8e28640 1 -- 172.21.15.71:0/3423473719 >> v1:172.21.15.135:6789/0 conn(0x7f9cb4008dc0 legacy=0x7f9cb400b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cb4003820 auth_method 0 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request con 0x7f9cb4006270 auth_method 0 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:29.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 msgr2=0x7f9cb4005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 msgr2=0x7f9cb4005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 msgr2=0x7f9cb4008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 msgr2=0x7f9cb4008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:29.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.286+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.342+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633307688 0 0) 0x7f9cd40a46f0 con 0x7f9cb4008dc0 2024-08-19T11:15:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.342+0000 7f9cd2ffd640 10 monclient(hunting): _negotiate 2024-08-19T11:15:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.342+0000 7f9cd2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.342+0000 7f9cd2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.342+0000 7f9cd2ffd640 10 monclient(hunting): my global_id is 5743 2024-08-19T11:15:29.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.342+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cc0003520 con 0x7f9cb4008dc0 2024-08-19T11:15:29.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.351+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 527041421 0 0) 0x7f9cc0003520 con 0x7f9cb4008dc0 2024-08-19T11:15:29.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.351+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 msgr2=0x7f9cb4005c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.351+0000 7f9cd2ffd640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9cb4003820 0x7f9cb4005c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.351+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 msgr2=0x7f9cb4008700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 --2- 172.21.15.71:0/3423473719 >> v2:172.21.15.135:3300/0 conn(0x7f9cb4006270 0x7f9cb4008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 monclient: found mon.noname-f-legacy 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd8e28640 1 -- 172.21.15.71:0/3423473719 reap_dead start 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.135:6789/0 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb400dc50 con 0x7f9cb4008dc0 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f9ccc004ab0 con 0x7f9cb4008dc0 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cda88b640 5 monclient: authenticate success, global_id 5743 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cda88b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-19T11:15:29.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: dump: 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.357 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] but i'm connected to v1:172.21.15.135:6789/0, reconnecting 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 >> v1:172.21.15.135:6789/0 conn(0x7f9cb4008dc0 legacy=0x7f9cb400b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient: _add_conns ranks=[1,8,4,3,0,6,2,7,5] 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc0004200 0x7f9cc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): picked mon.f con 0x7f9cc0004200 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 0x7f9cc0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): picked mon.e con 0x7f9cc0004e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:29.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cc0009bf0 0x7f9cc000c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): picked mon.c con 0x7f9cc0009bf0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40a4f90 con 0x7f9cc0004200 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd40a6380 con 0x7f9cc0009bf0 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9cc000c990 con 0x7f9cc0004e10 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd2ffd640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cda88b640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd8e28640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cc0009bf0 msgr2=0x7f9cc000c080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:29.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 0x7f9cc0005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd8e28640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cc0009bf0 0x7f9cc000c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request con 0x7f9cc0004e10 auth_method 0 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc0004200 0x7f9cc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cc0004200 auth_method 0 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:29.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_done global_id 5743 payload 293 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cc0009bf0 msgr2=0x7f9cc000c080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cc0009bf0 0x7f9cc000c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc0004200 msgr2=0x7f9cc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:29.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc0004200 0x7f9cc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 monclient: found mon.e 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc0003520 con 0x7f9cc0004e10 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:29.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.352+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc0004200 0x7f9cc0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:29.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.355+0000 7f9cd37fe640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 msgr2=0x7f9cc0005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.355+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 0x7f9cc0005290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009f10 tx=0x7f9cc0005830 comp rx=0 tx=0).ready entity=mon.8 client_cookie=40a2fd6316c83084 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cbc031070 con 0x7f9cc0004e10 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: dump: 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc02be00 con 0x7f9cc0004e10 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 1 -- 172.21.15.71:0/3423473719 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cbc009b90 con 0x7f9cc0004e10 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 4 set_mon_vals no callback set 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cd2ffd640 10 monclient: dump: 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.371 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 10 monclient: shutdown 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 -- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 msgr2=0x7f9cc0005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 0x7f9cc0005290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009f10 tx=0x7f9cc0005830 comp rx=0 tx=0).stop 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 -- 172.21.15.71:0/3423473719 shutdown_connections 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9cc0009bf0 0x7f9cc000c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004e10 0x7f9cc0005290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 --2- 172.21.15.71:0/3423473719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cc0004200 0x7f9cc0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 -- 172.21.15.71:0/3423473719 >> 172.21.15.71:0/3423473719 conn(0x7f9cd40ac030 msgr2=0x7f9cd40ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.356+0000 7f9cda88b640 1 -- 172.21.15.71:0/3423473719 shutdown_connections 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.357+0000 7f9cda88b640 1 -- 172.21.15.71:0/3423473719 wait complete. 2024-08-19T11:15:29.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.357+0000 7f9cda88b640 10 monclient: build_initial_monmap 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.357+0000 7f9cda88b640 10 monclient: monmap: 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:29.373 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.358+0000 7f9cda88b640 1 Processor -- start 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.358+0000 7f9cda88b640 1 -- start start 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.358+0000 7f9cda88b640 10 monclient: init 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.358+0000 7f9cda88b640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient: _add_conns ranks=[6,8,5,0,2,4,3,1,7] 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 0x7f9cd41cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): picked mon.noname-d con 0x7f9cb4008dc0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:29.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 0x7f9cd4136b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): picked mon.noname-e con 0x7f9cc0004200 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9cc0004e10 0x7f9cd40a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): picked mon.noname-h con 0x7f9cc0004e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd40a5b80 con 0x7f9cc0004e10 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9cd40a5a00 con 0x7f9cb4008dc0 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9cd40a5d00 con 0x7f9cc0004200 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cda88b640 10 monclient(hunting): authenticate will time out at 987.400108s 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 0x7f9cd41cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 0x7f9cd4136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 0x7f9cd41cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54696/0 (socket says 172.21.15.71:54696) 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 -- 172.21.15.71:0/2440927169 learned_addr learned my addr 172.21.15.71:0/2440927169 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 0x7f9cd4136b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59470/0 (socket says 172.21.15.71:59470) 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request con 0x7f9cb4008dc0 auth_method 0 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request con 0x7f9cc0004200 auth_method 0 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd8e28640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9cc0004e10 0x7f9cd40a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd8e28640 10 monclient(hunting): get_auth_request con 0x7f9cc0004e10 auth_method 0 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd8e28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd8e28640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd8e28640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient(hunting): handle_auth_done global_id 25377 payload 824 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 -- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 msgr2=0x7f9cd4136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 0x7f9cd4136b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 -- 172.21.15.71:0/2440927169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9cc0004e10 msgr2=0x7f9cd40a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9cc0004e10 0x7f9cd40a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 monclient: found mon.noname-d 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd3fff640 1 -- 172.21.15.71:0/2440927169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd4124240 con 0x7f9cb4008dc0 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 0x7f9cd4136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.359+0000 7f9cd8e28640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9cc0004e10 0x7f9cd40a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.361+0000 7f9cd3fff640 1 -- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 msgr2=0x7f9cd41cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.361+0000 7f9cd3fff640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 0x7f9cd41cea20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4016ed0 tx=0x7f9cc40039e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cc4026070 con 0x7f9cb4008dc0 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: dump: 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.379 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: _finish_auth 0 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 5 monclient: authenticate success, global_id 25377 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc4018e40 con 0x7f9cb4008dc0 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 10 monclient: _renew_subs 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd4124520 con 0x7f9cb4008dc0 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9cc401f780 con 0x7f9cb4008dc0 2024-08-19T11:15:29.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd0ff9640 10 monclient: dump: 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.381 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 10 monclient: _renew_subs 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd41ce180 con 0x7f9cb4008dc0 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.362+0000 7f9cd27fc640 4 set_mon_vals no callback set 2024-08-19T11:15:29.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9cc401f310 con 0x7f9cb4008dc0 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cda88b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cd0ff9640 1 --2- 172.21.15.71:0/2440927169 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb403fbb0 0x7f9cb4042070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cda88b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cda88b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd40a71f0 con 0x7f9cb4008dc0 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f9cc401e070 con 0x7f9cb4008dc0 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/2440927169 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb403fbb0 0x7f9cb4042070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.363+0000 7f9cd37fe640 10 monclient: get_auth_request con 0x7f9cb403fbb0 auth_method 0 2024-08-19T11:15:29.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.366+0000 7f9cd37fe640 1 --2- 172.21.15.71:0/2440927169 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb403fbb0 0x7f9cb4042070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc003980 tx=0x7f9cbc031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.368+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9cc401fe40 con 0x7f9cb4008dc0 2024-08-19T11:15:29.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.368+0000 7f9cd0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:29.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.368+0000 7f9cd0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.614+0000 7f9cda88b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.614+0000 7f9cda88b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.614+0000 7f9cda88b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.614+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9cd40a8730 con 0x7f9cb4008dc0 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.615+0000 7f9cd0ff9640 1 -- 172.21.15.71:0/2440927169 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3174 (secure 0 0 0) 0x7f9cc4051200 con 0x7f9cb4008dc0 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.615+0000 7f9cd0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:29.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.615+0000 7f9cd0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:29.617 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":96,"quorum":[1,3,5,6,7,8],"quorum_names":["f","g","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:29.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb403fbb0 msgr2=0x7f9cb4042070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 --2- 172.21.15.71:0/2440927169 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb403fbb0 0x7f9cb4042070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc003980 tx=0x7f9cbc031000 comp rx=0 tx=0).stop 2024-08-19T11:15:29.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 10 monclient: shutdown 2024-08-19T11:15:29.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:29.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 msgr2=0x7f9cd41cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 0x7f9cd41cea20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4016ed0 tx=0x7f9cc40039e0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 shutdown_connections 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 --2- 172.21.15.71:0/2440927169 >> v2:172.21.15.135:6800/726754104 conn(0x7f9cb403fbb0 0x7f9cb4042070 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9cc0004200 0x7f9cd4136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9cc0004e10 0x7f9cd40a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 --2- 172.21.15.71:0/2440927169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9cb4008dc0 0x7f9cd41cea20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 >> 172.21.15.71:0/2440927169 conn(0x7f9cd40ac030 msgr2=0x7f9cd40a9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 shutdown_connections 2024-08-19T11:15:29.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.617+0000 7f9cda88b640 1 -- 172.21.15.71:0/2440927169 wait complete. 2024-08-19T11:15:29.629 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-08-19T11:15:29.629 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2024-08-19T11:15:29.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.725+0000 7f12e45aa640 10 monclient: get_monmap_and_config 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.725+0000 7f12e45aa640 10 monclient: build_initial_monmap 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.725+0000 7f12e45aa640 10 monclient: monmap: 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:29.726523+0000 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:29.726523+0000 2024-08-19T11:15:29.727 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:29.728 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:29.729 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:29.729 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:29.729 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:29.729 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.726+0000 7f12e45aa640 1 Processor -- start 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.726+0000 7f12e45aa640 1 -- start start 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.726+0000 7f12e45aa640 10 monclient: init 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient: _add_conns ranks=[0,2,8,10,4,6,9,5,7,1,3] 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f12dc0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12dc0a57c0 0x7f12dc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): picked mon.noname-b con 0x7f12dc0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): picked mon.noname-e con 0x7f12dc0a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc0a6380 con 0x7f12dc0a6950 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc0a5020 con 0x7f12dc0a57c0 2024-08-19T11:15:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2346640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7f12dc0a6950 legacy=0x7f12dc0a6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f12dc0a7d40 con 0x7f12dc0a7440 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e45aa640 10 monclient(hunting): authenticate will time out at 987.768377s 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e1b45640 1 -- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12dc0a57c0 msgr2=0x7f12dc13eb60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3301/0 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e1b45640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12dc0a57c0 0x7f12dc13eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc1410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59478/0 (socket says 172.21.15.71:59478) 2024-08-19T11:15:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 -- 172.21.15.71:0/837708066 learned_addr learned my addr 172.21.15.71:0/837708066 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): get_auth_request con 0x7f12dc0a7440 auth_method 0 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient(hunting): handle_auth_done global_id 64259 payload 274 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 -- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12dc0a57c0 msgr2=0x7f12dc13eb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 --2- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12dc0a57c0 0x7f12dc13eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 -- 172.21.15.71:0/837708066 >> v1:172.21.15.71:6789/0 conn(0x7f12dc0a6950 legacy=0x7f12dc0a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient: _finish_hunting 0 2024-08-19T11:15:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 monclient: found mon.noname-e 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.727+0000 7f12e2b47640 1 -- 172.21.15.71:0/837708066 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc0a3650 con 0x7f12dc0a7440 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e2b47640 1 -- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 msgr2=0x7f12dc1410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e2b47640 1 --2- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc1410b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009eb0 tx=0x7f12d402a580 comp rx=0 tx=0).ready entity=mon.8 client_cookie=56e1cbaf28810ef3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 1 -- 172.21.15.71:0/837708066 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12d4036070 con 0x7f12dc0a7440 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: dump: 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: _finish_auth 0 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: _check_auth_tickets 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 1 -- 172.21.15.71:0/837708066 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d4007a70 con 0x7f12dc0a7440 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e45aa640 5 monclient: authenticate success, global_id 64259 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e45aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e45aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 1 -- 172.21.15.71:0/837708066 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12d4007c60 con 0x7f12dc0a7440 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e45aa640 4 set_mon_vals no callback set 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.730+0000 7f12e1344640 10 monclient: dump: 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.757 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 10 monclient: shutdown 2024-08-19T11:15:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 -- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 msgr2=0x7f12dc1410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 --2- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc1410b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009eb0 tx=0x7f12d402a580 comp rx=0 tx=0).stop 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 -- 172.21.15.71:0/837708066 shutdown_connections 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 --2- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12dc0a57c0 0x7f12dc13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 --2- 172.21.15.71:0/837708066 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc1410b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 -- 172.21.15.71:0/837708066 >> 172.21.15.71:0/837708066 conn(0x7f12dc0abf50 msgr2=0x7f12dc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 -- 172.21.15.71:0/837708066 shutdown_connections 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 1 -- 172.21.15.71:0/837708066 wait complete. 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 10 monclient: build_initial_monmap 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.731+0000 7f12e45aa640 10 monclient: monmap: 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:29.760 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 Processor -- start 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 -- start start 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient: init 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient: _add_conns ranks=[0,6,8,2,5,4,7,1,3] 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12dc0a57c0 0x7f12dc128de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): picked mon.noname-a con 0x7f12dc0a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc0a6950 0x7f12dc13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): picked mon.noname-d con 0x7f12dc0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc126830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): picked mon.noname-e con 0x7f12dc0a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc0a8700 con 0x7f12dc0a57c0 2024-08-19T11:15:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f12dc0a84c0 con 0x7f12dc0a6950 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f12dc1415f0 con 0x7f12dc0a7440 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e45aa640 10 monclient(hunting): authenticate will time out at 987.773817s 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2346640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12dc0a57c0 msgr2=0x7f12dc128de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2346640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12dc0a57c0 0x7f12dc128de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc126830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc126830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59494/0 (socket says 172.21.15.71:59494) 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e1b45640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc0a6950 0x7f12dc13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 1 -- 172.21.15.71:0/1152841497 learned_addr learned my addr 172.21.15.71:0/1152841497 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 10 monclient(hunting): get_auth_request con 0x7f12dc0a7440 auth_method 0 2024-08-19T11:15:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e2b47640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e1b45640 10 monclient(hunting): get_auth_request con 0x7f12dc0a6950 auth_method 0 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e1b45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e1b45640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.732+0000 7f12e1b45640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e2b47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e2b47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e2b47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 10 monclient(hunting): handle_auth_done global_id 25386 payload 824 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 msgr2=0x7f12dc126830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc126830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12dc0a57c0 msgr2=0x7f12dc128de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12dc0a57c0 0x7f12dc128de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 10 monclient: _finish_hunting 0 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 1 monclient: found mon.noname-d 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e1b45640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc12a300 con 0x7f12dc0a6950 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.733+0000 7f12e2b47640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12dc0a7440 0x7f12dc126830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e1b45640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc0a6950 msgr2=0x7f12dc13fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e1b45640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc0a6950 0x7f12dc13fc50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b400 tx=0x7f12cc00b8c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12cc016070 con 0x7f12dc0a6950 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: dump: 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.765 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:29.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 5 monclient: authenticate success, global_id 25386 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc003dd0 con 0x7f12dc0a6950 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 10 monclient: _renew_subs 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc12a5e0 con 0x7f12dc0a6950 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12cc0103a0 con 0x7f12dc0a6950 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12d2ffd640 10 monclient: dump: 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.767 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e0b43640 4 set_mon_vals no callback set 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 10 monclient: _renew_subs 2024-08-19T11:15:29.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.735+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc128280 con 0x7f12dc0a6950 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e45aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e45aa640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 0x7f12dc126d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f12dc076c60 con 0x7f12dc140190 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f12cc005070 con 0x7f12dc0a6950 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 0x7f12dc126d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient: get_auth_request con 0x7f12dc140190 auth_method 0 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12d2ffd640 1 --2- 172.21.15.71:0/1152841497 >> v2:172.21.15.135:6800/726754104 conn(0x7f12c003ea80 0x7f12c0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 10 monclient(hunting): handle_auth_done global_id 25395 payload 824 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12e2346640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12dc1cf440 con 0x7f12dc140190 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.736+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f12cc050c70 con 0x7f12dc0a6950 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.737+0000 7f12e2b47640 1 --2- 172.21.15.71:0/1152841497 >> v2:172.21.15.135:6800/726754104 conn(0x7f12c003ea80 0x7f12c0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.737+0000 7f12e2b47640 10 monclient: get_auth_request con 0x7f12c003ea80 auth_method 0 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12e2346640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 msgr2=0x7f12dc126d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12e2346640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 0x7f12dc126d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f12d8003980 tx=0x7f12d800b830 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12d8016070 con 0x7f12dc140190 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 10 monclient: dump: 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.771 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f12d8005070 con 0x7f12dc140190 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 msgr2=0x7f12dc126d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 0x7f12dc126d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f12d8003980 tx=0x7f12d800b830 comp rx=0 tx=0).stop 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 msgr2=0x7f12dc126d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:29.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12d2ffd640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc140190 0x7f12dc126d70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.739+0000 7f12e2b47640 1 --2- 172.21.15.71:0/1152841497 >> v2:172.21.15.135:6800/726754104 conn(0x7f12c003ea80 0x7f12c0040f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009c90 tx=0x7f12d4009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e45aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e45aa640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 0x7f12dc1272b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e45aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f12dc140ef0 con 0x7f12dc1c6480 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 0x7f12dc1272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient: get_auth_request con 0x7f12dc1c6480 auth_method 0 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 10 monclient(hunting): handle_auth_done global_id 25404 payload 824 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.745+0000 7f12e2346640 1 -- 172.21.15.71:0/1152841497 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12dc0a6d30 con 0x7f12dc1c6480 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e2346640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 msgr2=0x7f12dc1272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e2346640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 0x7f12dc1272b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12d8013000 tx=0x7f12d80037f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12d8016040 con 0x7f12dc1c6480 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 10 monclient: dump: 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.774 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9568 (secure 0 0 0) 0x7f12d8018a60 con 0x7f12dc1c6480 2024-08-19T11:15:29.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 msgr2=0x7f12dc1272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 0x7f12dc1272b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12d8013000 tx=0x7f12d80037f0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 msgr2=0x7f12dc1272b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12d2ffd640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc1c6480 0x7f12dc1272b0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12d8013000 tx=0x7f12d80037f0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 96, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 237362, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:29.803 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:29.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 >> v2:172.21.15.135:6800/726754104 conn(0x7f12c003ea80 msgr2=0x7f12c0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 --2- 172.21.15.71:0/1152841497 >> v2:172.21.15.135:6800/726754104 conn(0x7f12c003ea80 0x7f12c0040f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009c90 tx=0x7f12d4009000 comp rx=0 tx=0).stop 2024-08-19T11:15:29.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 10 monclient: shutdown 2024-08-19T11:15:29.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:29.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc0a6950 msgr2=0x7f12dc13fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 --2- 172.21.15.71:0/1152841497 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f12dc0a6950 0x7f12dc13fc50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b400 tx=0x7f12cc00b8c0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e2b47640 1 -- 172.21.15.71:0/1152841497 reap_dead start 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e2b47640 1 -- 172.21.15.71:0/1152841497 reap_dead start 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 shutdown_connections 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 >> 172.21.15.71:0/1152841497 conn(0x7f12dc0abf50 msgr2=0x7f12dc0ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 shutdown_connections 2024-08-19T11:15:29.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.748+0000 7f12e45aa640 1 -- 172.21.15.71:0/1152841497 wait complete. 2024-08-19T11:15:29.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:15:29.807 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2024-08-19T11:15:29.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:15:29.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.903+0000 7fdd77dc9640 10 monclient: get_monmap_and_config 2024-08-19T11:15:29.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.903+0000 7fdd77dc9640 10 monclient: build_initial_monmap 2024-08-19T11:15:29.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.903+0000 7fdd77dc9640 10 monclient: monmap: 2024-08-19T11:15:29.911 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:29.911 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:29.911 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:29.904082+0000 2024-08-19T11:15:29.911 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:29.904082+0000 2024-08-19T11:15:29.911 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:29.912 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:29.912 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:29.912 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:29.912 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:29.912 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:29.913 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:29.913 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:29.913 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:29.913 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:29.913 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:29.913 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:29.914 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:29.914 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:29.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 Processor -- start 2024-08-19T11:15:29.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 -- start start 2024-08-19T11:15:29.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient: init 2024-08-19T11:15:29.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient: _add_conns ranks=[3,9,0,10,7,4,6,1,5,2,8] 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): picked mon.noname-g con 0x7fdd700a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd700a57c0 0x7fdd700a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): picked mon.noname-a con 0x7fdd700a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdd70139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:29.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd700a6380 con 0x7fdd70139710 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fdd700a5020 con 0x7fdd700a57c0 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdd700a77b0 con 0x7fdd700a6950 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd77dc9640 10 monclient(hunting): authenticate will time out at 987.945741s 2024-08-19T11:15:29.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd75364640 1 -- >> v2:172.21.15.71:3300/0 conn(0x7fdd700a57c0 msgr2=0x7fdd700a7270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd76366640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7fdd70139710 legacy=0x7fdd70139b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.904+0000 7fdd75364640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd700a57c0 0x7fdd700a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:37118/0 (socket says 172.21.15.71:37118) 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 learned_addr learned my addr 172.21.15.71:0/1482978376 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): get_auth_request con 0x7fdd700a6950 auth_method 0 2024-08-19T11:15:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient(hunting): handle_auth_done global_id 44553 payload 274 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> v2:172.21.15.71:3300/0 conn(0x7fdd700a57c0 msgr2=0x7fdd700a7270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> v2:172.21.15.71:3300/0 conn(0x7fdd700a57c0 0x7fdd700a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> v1:172.21.15.71:6789/0 conn(0x7fdd70139710 legacy=0x7fdd70139b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient: _finish_hunting 0 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 monclient: found mon.noname-g 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:15:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.905+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd700a3650 con 0x7fdd700a6950 2024-08-19T11:15:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.908+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 msgr2=0x7fdd700a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:15:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.908+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 msgr2=0x7fdd700a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.908+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0x7fdd680098a0 tx=0x7fdd6802a0e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:29.908+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.109+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.109+0000 7fdd75b65640 10 monclient: get_auth_request con 0x7fdd700a6950 auth_method 0 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.109+0000 7fdd75b65640 0 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.109+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient: ms_handle_reset current mon [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 msgr2=0x7fdd700a6d30 unknown :-1 s=STATE_CLOSED l=0).mark_down 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdd700a6950 0x7fdd700a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient: _add_conns ranks=[8,5,7,4,2,1,10,6] 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd58005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): picked mon.noname-e con 0x7fdd58003630 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdd58006340 0x7fdd580087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): picked mon.noname-h con 0x7fdd58006340 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdd58009100 0x7fdd5800b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): picked mon.noname-i con 0x7fdd58009100 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fdd5800bed0 con 0x7fdd58006340 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fdd5800c050 con 0x7fdd58009100 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fdd5800c250 con 0x7fdd58003630 2024-08-19T11:15:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd74b63640 10 monclient(hunting): ms_handle_reset stray mon [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd58005a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): get_auth_request con 0x7fdd58003630 auth_method 0 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdd58009100 0x7fdd5800b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdd58006340 0x7fdd580087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): get_auth_request con 0x7fdd58006340 auth_method 0 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): get_auth_request con 0x7fdd58009100 auth_method 0 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient(hunting): handle_auth_done global_id 44553 payload 293 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdd58009100 msgr2=0x7fdd5800b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fdd58009100 0x7fdd5800b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdd58006340 msgr2=0x7fdd580087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fdd58006340 0x7fdd580087d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 monclient: found mon.noname-e 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd76366640 1 -- 172.21.15.71:0/1482978376 reap_dead start 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.110+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5800c510 con 0x7fdd58003630 2024-08-19T11:15:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.112+0000 7fdd75b65640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 msgr2=0x7fdd58005a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.112+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd58005a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd680098a0 tx=0x7fdd68009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=ef713fe92a747c18 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.112+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd68033430 con 0x7fdd58003630 2024-08-19T11:15:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.112+0000 7fdd74b63640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.112+0000 7fdd74b63640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.112+0000 7fdd74b63640 10 monclient: dump: 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.126 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd680044a0 con 0x7fdd58003630 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 5 monclient: authenticate success, global_id 44553 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 1 -- 172.21.15.71:0/1482978376 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd68033ca0 con 0x7fdd58003630 2024-08-19T11:15:30.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 4 set_mon_vals no callback set 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd74b63640 10 monclient: dump: 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.128 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 10 monclient: shutdown 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 msgr2=0x7fdd58005a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd58005a80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd680098a0 tx=0x7fdd68009240 comp rx=0 tx=0).stop 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1482978376 shutdown_connections 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 --2- 172.21.15.71:0/1482978376 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd58005a80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1482978376 >> 172.21.15.71:0/1482978376 conn(0x7fdd700abf50 msgr2=0x7fdd700ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1482978376 shutdown_connections 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.113+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1482978376 wait complete. 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.114+0000 7fdd77dc9640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.114+0000 7fdd77dc9640 10 monclient: monmap: 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.130 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.114+0000 7fdd77dc9640 1 Processor -- start 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.114+0000 7fdd77dc9640 1 -- start start 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.114+0000 7fdd77dc9640 10 monclient: init 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient: _add_conns ranks=[8,0,6,3,2,4,7,1,5] 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd701ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): picked mon.noname-e con 0x7fdd58003630 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd701cee80 0x7fdd701cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): picked mon.noname-a con 0x7fdd701cee80 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdd70122de0 0x7fdd70123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): picked mon.noname-d con 0x7fdd70122de0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:30.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdd700a84c0 con 0x7fdd701cee80 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fdd700a7d40 con 0x7fdd70122de0 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fdd700a8700 con 0x7fdd58003630 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd77dc9640 10 monclient(hunting): authenticate will time out at 988.156211s 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75364640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd701cee80 msgr2=0x7fdd701cf2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75364640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd701cee80 0x7fdd701cf2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd701ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdd70122de0 0x7fdd70123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd701ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59516/0 (socket says 172.21.15.71:59516) 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 -- 172.21.15.71:0/1423922423 learned_addr learned my addr 172.21.15.71:0/1423922423 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): get_auth_request con 0x7fdd58003630 auth_method 0 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): get_auth_request con 0x7fdd70122de0 auth_method 0 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient(hunting): handle_auth_done global_id 64277 payload 824 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdd70122de0 msgr2=0x7fdd70123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdd70122de0 0x7fdd70123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd701cee80 msgr2=0x7fdd701cf2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd701cee80 0x7fdd701cf2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 monclient: found mon.noname-e 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd75b65640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd70126950 con 0x7fdd58003630 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.115+0000 7fdd76366640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdd70122de0 0x7fdd70123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.117+0000 7fdd75b65640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 msgr2=0x7fdd701ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.117+0000 7fdd75b65640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd701ce940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd68004650 tx=0x7fdd680046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.117+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd68003610 con 0x7fdd58003630 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: dump: 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.135 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd680037d0 con 0x7fdd58003630 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 5 monclient: authenticate success, global_id 64277 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 10 monclient: _renew_subs 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd70126c30 con 0x7fdd58003630 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd68003df0 con 0x7fdd58003630 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6e7fc640 10 monclient: dump: 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 10 monclient: _renew_subs 2024-08-19T11:15:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd6ffff640 4 set_mon_vals no callback set 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd70125dc0 con 0x7fdd58003630 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.118+0000 7fdd77dc9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd77dc9640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 0x7fdd701237a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fdd700a8700 con 0x7fdd7002e340 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fdd6804e060 con 0x7fdd58003630 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 0x7fdd701237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient: get_auth_request con 0x7fdd7002e340 auth_method 0 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 10 monclient(hunting): handle_auth_done global_id 64286 payload 824 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd75364640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd70127130 con 0x7fdd7002e340 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd6e7fc640 1 --2- 172.21.15.71:0/1423922423 >> v2:172.21.15.135:6800/726754104 conn(0x7fdd5c03eab0 0x7fdd5c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7fdd68039030 con 0x7fdd58003630 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd76366640 1 --2- 172.21.15.71:0/1423922423 >> v2:172.21.15.135:6800/726754104 conn(0x7fdd5c03eab0 0x7fdd5c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.119+0000 7fdd76366640 10 monclient: get_auth_request con 0x7fdd5c03eab0 auth_method 0 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.121+0000 7fdd75364640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 msgr2=0x7fdd701237a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.121+0000 7fdd75364640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 0x7fdd701237a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd64003d00 tx=0x7fdd6400ed80 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.121+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd6400cdf0 con 0x7fdd7002e340 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.121+0000 7fdd6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.121+0000 7fdd6e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.121+0000 7fdd6e7fc640 10 monclient: dump: 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.141 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd6400cdf0 con 0x7fdd7002e340 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 msgr2=0x7fdd701237a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 0x7fdd701237a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd64003d00 tx=0x7fdd6400ed80 comp rx=0 tx=0).stop 2024-08-19T11:15:30.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 msgr2=0x7fdd701237a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd6e7fc640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd7002e340 0x7fdd701237a0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdd64003d00 tx=0x7fdd6400ed80 comp rx=0 tx=0).stop 2024-08-19T11:15:30.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.122+0000 7fdd76366640 1 --2- 172.21.15.71:0/1423922423 >> v2:172.21.15.135:6800/726754104 conn(0x7fdd5c03eab0 0x7fdd5c040f70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdd700a5730 tx=0x7fdd60006f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd77dc9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:30.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd77dc9640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 0x7fdd70063e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd77dc9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fdd7006a590 con 0x7fdd70063a80 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 0x7fdd70063e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient: get_auth_request con 0x7fdd70063a80 auth_method 0 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 10 monclient(hunting): handle_auth_done global_id 64295 payload 824 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.128+0000 7fdd75364640 1 -- 172.21.15.71:0/1423922423 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd7002e720 con 0x7fdd70063a80 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd75364640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 msgr2=0x7fdd70063e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd75364640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 0x7fdd70063e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd64003d00 tx=0x7fdd64005e00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdd64017cd0 con 0x7fdd70063a80 2024-08-19T11:15:30.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd6e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd6e7fc640 10 monclient: dump: 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.148 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.130+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9233 (secure 0 0 0) 0x7fdd6401d040 con 0x7fdd70063a80 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd6e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd6e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 msgr2=0x7fdd70063e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd6e7fc640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 0x7fdd70063e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd64003d00 tx=0x7fdd64005e00 comp rx=0 tx=0).stop 2024-08-19T11:15:30.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd6e7fc640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 msgr2=0x7fdd70063e90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd6e7fc640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd70063a80 0x7fdd70063e90 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd64003d00 tx=0x7fdd64005e00 comp rx=0 tx=0).stop 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 96, 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 41612, 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:30.175 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 >> v2:172.21.15.135:6800/726754104 conn(0x7fdd5c03eab0 msgr2=0x7fdd5c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 --2- 172.21.15.71:0/1423922423 >> v2:172.21.15.135:6800/726754104 conn(0x7fdd5c03eab0 0x7fdd5c040f70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdd700a5730 tx=0x7fdd60006f50 comp rx=0 tx=0).stop 2024-08-19T11:15:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 10 monclient: shutdown 2024-08-19T11:15:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 msgr2=0x7fdd701ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 --2- 172.21.15.71:0/1423922423 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fdd58003630 0x7fdd701ce940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd68004650 tx=0x7fdd680046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd76366640 1 -- 172.21.15.71:0/1423922423 reap_dead start 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd76366640 1 -- 172.21.15.71:0/1423922423 reap_dead start 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 shutdown_connections 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 >> 172.21.15.71:0/1423922423 conn(0x7fdd700abf50 msgr2=0x7fdd7009c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 shutdown_connections 2024-08-19T11:15:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.131+0000 7fdd77dc9640 1 -- 172.21.15.71:0/1423922423 wait complete. 2024-08-19T11:15:30.177 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:15:30.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2024-08-19T11:15:30.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.274+0000 7f790807e640 10 monclient: get_monmap_and_config 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.274+0000 7f790807e640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.274+0000 7f790807e640 10 monclient: monmap: 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:30.275587+0000 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:30.275587+0000 2024-08-19T11:15:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.275+0000 7f790807e640 1 Processor -- start 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.275+0000 7f790807e640 1 -- start start 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.275+0000 7f790807e640 10 monclient: init 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient: _add_conns ranks=[5,9,8,3,6,7,4,0,1,10,2] 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79000a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): picked mon.noname-h con 0x7f79000a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79000a57c0 0x7f79000a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): picked mon.noname-a con 0x7f79000a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): picked mon.noname-e con 0x7f7900139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f79000a5020 con 0x7f79000a57c0 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f79000a77b0 con 0x7f79000a6950 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f79000a7d40 con 0x7f7900139710 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790807e640 10 monclient(hunting): authenticate will time out at 988.317282s 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905619640 1 -- >> v2:172.21.15.71:3300/0 conn(0x7f79000a57c0 msgr2=0x7f79000a7270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905619640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79000a57c0 0x7f79000a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59544/0 (socket says 172.21.15.71:59544) 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 -- 172.21.15.71:0/2118409175 learned_addr learned my addr 172.21.15.71:0/2118409175 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): get_auth_request con 0x7f7900139710 auth_method 0 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 1 --2- 172.21.15.71:0/2118409175 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79000a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): get_auth_request con 0x7f79000a6950 auth_method 0 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient(hunting): handle_auth_done global_id 64304 payload 274 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 -- 172.21.15.71:0/2118409175 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 msgr2=0x7f79000a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 --2- 172.21.15.71:0/2118409175 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79000a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 -- 172.21.15.71:0/2118409175 >> v2:172.21.15.71:3300/0 conn(0x7f79000a57c0 msgr2=0x7f79000a7270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 --2- 172.21.15.71:0/2118409175 >> v2:172.21.15.71:3300/0 conn(0x7f79000a57c0 0x7f79000a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 monclient: found mon.noname-e 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.276+0000 7f790661b640 1 -- 172.21.15.71:0/2118409175 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79000a6380 con 0x7f7900139710 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f790661b640 1 -- 172.21.15.71:0/2118409175 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 msgr2=0x7f7900139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f790661b640 1 --2- 172.21.15.71:0/2118409175 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900139b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78f00098a0 tx=0x7f78f002a0e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=37a27ab039c3da6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 1 -- 172.21.15.71:0/2118409175 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78f0037070 con 0x7f7900139710 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: dump: 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.292 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.293 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 1 -- 172.21.15.71:0/2118409175 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f002ae00 con 0x7f7900139710 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f790807e640 5 monclient: authenticate success, global_id 64304 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f790807e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f790807e640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 1 -- 172.21.15.71:0/2118409175 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78f0030c20 con 0x7f7900139710 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f790807e640 4 set_mon_vals no callback set 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.279+0000 7f7904e18640 10 monclient: dump: 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 10 monclient: shutdown 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 -- 172.21.15.71:0/2118409175 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 msgr2=0x7f7900139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 --2- 172.21.15.71:0/2118409175 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900139b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78f00098a0 tx=0x7f78f002a0e0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 -- 172.21.15.71:0/2118409175 shutdown_connections 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 --2- 172.21.15.71:0/2118409175 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900139b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 --2- 172.21.15.71:0/2118409175 >> v2:172.21.15.71:3300/0 conn(0x7f79000a57c0 0x7f79000a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 --2- 172.21.15.71:0/2118409175 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79000a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 -- 172.21.15.71:0/2118409175 >> 172.21.15.71:0/2118409175 conn(0x7f79000abf50 msgr2=0x7f79000ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 -- 172.21.15.71:0/2118409175 shutdown_connections 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 1 -- 172.21.15.71:0/2118409175 wait complete. 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.280+0000 7f790807e640 10 monclient: monmap: 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:30.297 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 Processor -- start 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 -- start start 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient: init 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient: _add_conns ranks=[6,5,8,2,1,0,7,3,4] 2024-08-19T11:15:30.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f79000a57c0 0x7f7900138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): picked mon.noname-d con 0x7f79000a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79001390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): picked mon.noname-h con 0x7f79000a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): picked mon.noname-e con 0x7f7900139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f79000a84c0 con 0x7f79000a6950 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f79000a3650 con 0x7f79000a57c0 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f79000a8700 con 0x7f7900139710 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790807e640 10 monclient(hunting): authenticate will time out at 988.322745s 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f79000a57c0 0x7f7900138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59554/0 (socket says 172.21.15.71:59554) 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): get_auth_request con 0x7f79000a57c0 auth_method 0 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 1 -- 172.21.15.71:0/1370771076 learned_addr learned my addr 172.21.15.71:0/1370771076 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): get_auth_request con 0x7f7900139710 auth_method 0 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f790661b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.281+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f7905619640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79001390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 10 monclient(hunting): handle_auth_done global_id 64313 payload 824 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f79000a57c0 msgr2=0x7f7900138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f79000a57c0 0x7f7900138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 msgr2=0x7f79001390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79001390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 1 monclient: found mon.noname-e 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f790661b640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79001253e0 con 0x7f7900139710 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f7905619640 10 monclient: get_auth_request con 0x7f79000a6950 auth_method 0 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f7905619640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f79000a6950 0x7f79001390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.282+0000 7f7905e1a640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f79000a57c0 0x7f7900138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790661b640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 msgr2=0x7f7900122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790661b640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900122800 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78f00090b0 tx=0x7f78f00046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78f0041020 con 0x7f7900139710 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:30.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: dump: 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.303 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f0003bd0 con 0x7f7900139710 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 5 monclient: authenticate success, global_id 64313 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 10 monclient: _renew_subs 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790013a1b0 con 0x7f7900139710 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78f0037040 con 0x7f7900139710 2024-08-19T11:15:30.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fe7fc640 10 monclient: dump: 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.305 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 10 monclient: _renew_subs 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f78fffff640 4 set_mon_vals no callback set 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.284+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7900126520 con 0x7f7900139710 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f790807e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f790807e640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 0x7f790002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f790006a590 con 0x7f79001ce4a0 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f78f0044020 con 0x7f7900139710 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 0x7f790002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient: get_auth_request con 0x7f79001ce4a0 auth_method 0 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f78fe7fc640 1 --2- 172.21.15.71:0/1370771076 >> v2:172.21.15.135:6800/726754104 conn(0x7f78ec03ea80 0x7f78ec040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.285+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(147..147 src has 1..147) ==== 3506+0+0 (secure 0 0 0) 0x7f78f0071ca0 con 0x7f7900139710 2024-08-19T11:15:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.286+0000 7f7905e1a640 10 monclient(hunting): handle_auth_done global_id 5752 payload 824 2024-08-19T11:15:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.286+0000 7f7905e1a640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79000a1f90 con 0x7f79001ce4a0 2024-08-19T11:15:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.286+0000 7f7905619640 1 --2- 172.21.15.71:0/1370771076 >> v2:172.21.15.135:6800/726754104 conn(0x7f78ec03ea80 0x7f78ec040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.286+0000 7f7905619640 10 monclient: get_auth_request con 0x7f78ec03ea80 auth_method 0 2024-08-19T11:15:30.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f7905e1a640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 msgr2=0x7f790002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f7905e1a640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 0x7f790002d1c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f78f8011d20 tx=0x7f78f800f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78f8019070 con 0x7f79001ce4a0 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 10 monclient: dump: 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.311 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f7905619640 1 --2- 172.21.15.71:0/1370771076 >> v2:172.21.15.135:6800/726754104 conn(0x7f78ec03ea80 0x7f78ec040f40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7900124830 tx=0x7f78f40073a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f78f8004240 con 0x7f79001ce4a0 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 msgr2=0x7f790002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 0x7f790002d1c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f78f8011d20 tx=0x7f78f800f610 comp rx=0 tx=0).stop 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 msgr2=0x7f790002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.288+0000 7f78fe7fc640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79001ce4a0 0x7f790002d1c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.294+0000 7f790807e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.294+0000 7f790807e640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 0x7f790002db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.294+0000 7f790807e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.294+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7900076c60 con 0x7f790002d700 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 0x7f790002db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient: get_auth_request con 0x7f790002d700 auth_method 0 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 10 monclient(hunting): handle_auth_done global_id 5761 payload 824 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.295+0000 7f7905e1a640 1 -- 172.21.15.71:0/1370771076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f79000a6d30 con 0x7f790002d700 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f7905e1a640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 msgr2=0x7f790002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f7905e1a640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 0x7f790002db10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78f801b000 tx=0x7f78f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f78f8019040 con 0x7f790002d700 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 10 monclient: dump: 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9403 (secure 0 0 0) 0x7f78f801e450 con 0x7f790002d700 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 msgr2=0x7f790002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 0x7f790002db10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78f801b000 tx=0x7f78f80046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 msgr2=0x7f790002db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.298+0000 7f78fe7fc640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790002d700 0x7f790002db10 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78f801b000 tx=0x7f78f80046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 96, 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 327138, 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:30.317 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.318 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.319 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:30.321 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.322 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:30.325 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.326 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.330 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.331 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.333 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.335 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.339 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:15:30.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.341 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.341 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:30.341 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 >> v2:172.21.15.135:6800/726754104 conn(0x7f78ec03ea80 msgr2=0x7f78ec040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 --2- 172.21.15.71:0/1370771076 >> v2:172.21.15.135:6800/726754104 conn(0x7f78ec03ea80 0x7f78ec040f40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7900124830 tx=0x7f78f40073a0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 10 monclient: shutdown 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 msgr2=0x7f7900122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790661b640 1 -- 172.21.15.71:0/1370771076 reap_dead start 2024-08-19T11:15:30.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900122800 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78f00090b0 tx=0x7f78f00046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 shutdown_connections 2024-08-19T11:15:30.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 --2- 172.21.15.71:0/1370771076 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7900139710 0x7f7900122800 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 >> 172.21.15.71:0/1370771076 conn(0x7f79000abf50 msgr2=0x7f79000aa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 shutdown_connections 2024-08-19T11:15:30.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.299+0000 7f790807e640 1 -- 172.21.15.71:0/1370771076 wait complete. 2024-08-19T11:15:30.343 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:15:30.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon g 2024-08-19T11:15:30.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.443+0000 7ff1ea798640 10 monclient: get_monmap_and_config 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.443+0000 7ff1ea798640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.443+0000 7ff1ea798640 10 monclient: monmap: 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:30.444584+0000 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:30.444584+0000 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.445 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:30.446 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.444+0000 7ff1ea798640 1 Processor -- start 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.444+0000 7ff1ea798640 1 -- start start 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.444+0000 7ff1ea798640 10 monclient: init 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient: _add_conns ranks=[1,6,0,8,9,10,5,7,2,4,3] 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff1e40a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 0x7ff1e413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient(hunting): picked mon.noname-d con 0x7ff1e40a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff1e40a7440 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e40a6380 con 0x7ff1e40a7440 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e40a3650 con 0x7ff1e40a6950 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff1e40a5020 con 0x7ff1e40a57c0 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1ea798640 10 monclient(hunting): authenticate will time out at 988.486375s 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e8d35640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7ff1e40a7440 legacy=0x7ff1e41410b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 0x7ff1e413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 0x7ff1e413eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54766/0 (socket says 172.21.15.71:54766) 2024-08-19T11:15:30.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 -- 172.21.15.71:0/1892425649 learned_addr learned my addr 172.21.15.71:0/1892425649 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): get_auth_request con 0x7ff1e40a57c0 auth_method 0 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_done global_id 25431 payload 274 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 -- 172.21.15.71:0/1892425649 >> v1:172.21.15.135:6789/0 conn(0x7ff1e40a6950 legacy=0x7ff1e40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 -- 172.21.15.71:0/1892425649 >> v1:172.21.15.71:6789/0 conn(0x7ff1e40a7440 legacy=0x7ff1e41410b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 monclient: found mon.noname-d 2024-08-19T11:15:30.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.445+0000 7ff1e37fe640 1 -- 172.21.15.71:0/1892425649 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e40a84c0 con 0x7ff1e40a57c0 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e37fe640 1 -- 172.21.15.71:0/1892425649 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 msgr2=0x7ff1e413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e37fe640 1 --2- 172.21.15.71:0/1892425649 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 0x7ff1e413eb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80098a0 tx=0x7ff1d802a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=2707cd1ac636847e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 1 -- 172.21.15.71:0/1892425649 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1d8037070 con 0x7ff1e40a57c0 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: dump: 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.460 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 1 -- 172.21.15.71:0/1892425649 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d80307b0 con 0x7ff1e40a57c0 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1ea798640 5 monclient: authenticate success, global_id 25431 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1ea798640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1ea798640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 1 -- 172.21.15.71:0/1892425649 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1d8030e50 con 0x7ff1e40a57c0 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1ea798640 4 set_mon_vals no callback set 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.448+0000 7ff1e2ffd640 10 monclient: dump: 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.463 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 10 monclient: shutdown 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 -- 172.21.15.71:0/1892425649 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 msgr2=0x7ff1e413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 --2- 172.21.15.71:0/1892425649 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 0x7ff1e413eb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80098a0 tx=0x7ff1d802a080 comp rx=0 tx=0).stop 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 -- 172.21.15.71:0/1892425649 shutdown_connections 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 --2- 172.21.15.71:0/1892425649 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a57c0 0x7ff1e413eb60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 -- 172.21.15.71:0/1892425649 >> 172.21.15.71:0/1892425649 conn(0x7ff1e40abf50 msgr2=0x7ff1e40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 -- 172.21.15.71:0/1892425649 shutdown_connections 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 1 -- 172.21.15.71:0/1892425649 wait complete. 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.449+0000 7ff1ea798640 10 monclient: monmap: 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:30.465 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.466 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.467 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.467 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.467 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 Processor -- start 2024-08-19T11:15:30.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 -- start start 2024-08-19T11:15:30.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient: init 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient: _add_conns ranks=[5,3,6,7,1,4,8,2,0] 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff1e40a57c0 0x7ff1e4128b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): picked mon.noname-h con 0x7ff1e40a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e40a6950 0x7ff1e41ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): picked mon.noname-g con 0x7ff1e40a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:30.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 0x7ff1e4126630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): picked mon.noname-d con 0x7ff1e40a7440 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e40a8700 con 0x7ff1e40a6950 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff1e40a7d40 con 0x7ff1e40a57c0 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff1e41427d0 con 0x7ff1e40a7440 2024-08-19T11:15:30.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1ea798640 10 monclient(hunting): authenticate will time out at 988.491790s 2024-08-19T11:15:30.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 0x7ff1e4126630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 0x7ff1e4126630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54770/0 (socket says 172.21.15.71:54770) 2024-08-19T11:15:30.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 1 -- 172.21.15.71:0/3065231628 learned_addr learned my addr 172.21.15.71:0/3065231628 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 10 monclient(hunting): get_auth_request con 0x7ff1e40a7440 auth_method 0 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e8d35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.450+0000 7ff1e37fe640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e40a6950 0x7ff1e41ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): get_auth_request con 0x7ff1e40a6950 auth_method 0 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff1e40a57c0 0x7ff1e4128b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): get_auth_request con 0x7ff1e40a57c0 auth_method 0 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 10 monclient(hunting): handle_auth_done global_id 25440 payload 824 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff1e40a57c0 msgr2=0x7ff1e4128b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff1e40a57c0 0x7ff1e4128b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e40a6950 msgr2=0x7ff1e41ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e40a6950 0x7ff1e41ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 1 monclient: found mon.noname-d 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.451+0000 7ff1e8d35640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e40a2550 con 0x7ff1e40a7440 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e8d35640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 msgr2=0x7ff1e4126630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e8d35640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 0x7ff1e4126630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00be90 tx=0x7ff1dc00bf80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1dc015850 con 0x7ff1e40a7440 2024-08-19T11:15:30.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: dump: 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.474 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 5 monclient: authenticate success, global_id 25440 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc010030 con 0x7ff1e40a7440 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 10 monclient: _renew_subs 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:30.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e412a060 con 0x7ff1e40a7440 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1dc0060d0 con 0x7ff1e40a7440 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e0ff9640 10 monclient: dump: 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.476 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1e27fc640 4 set_mon_vals no callback set 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 10 monclient: _renew_subs 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.453+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e40a96d0 con 0x7ff1e40a7440 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1ea798640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1ea798640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 0x7ff1e4126b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1ea798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e4076c60 con 0x7ff1e41cf280 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff1dc0153e0 con 0x7ff1e40a7440 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 0x7ff1e4126b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient: get_auth_request con 0x7ff1e41cf280 auth_method 0 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e0ff9640 1 --2- 172.21.15.71:0/3065231628 >> v2:172.21.15.135:6800/726754104 conn(0x7ff1d003ea80 0x7ff1d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(148..148 src has 1..148) ==== 3898+0+0 (secure 0 0 0) 0x7ff1dc052130 con 0x7ff1e40a7440 2024-08-19T11:15:30.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_done global_id 44571 payload 824 2024-08-19T11:15:30.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.454+0000 7ff1e3fff640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1e40a9220 con 0x7ff1e41cf280 2024-08-19T11:15:30.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.455+0000 7ff1e37fe640 1 --2- 172.21.15.71:0/3065231628 >> v2:172.21.15.135:6800/726754104 conn(0x7ff1d003ea80 0x7ff1d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.455+0000 7ff1e37fe640 10 monclient: get_auth_request con 0x7ff1d003ea80 auth_method 0 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e3fff640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 msgr2=0x7ff1e4126b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e3fff640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 0x7ff1e4126b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400f7a0 tx=0x7ff1d400fc60 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1d4018030 con 0x7ff1e41cf280 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 10 monclient: dump: 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.482 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e37fe640 1 --2- 172.21.15.71:0/3065231628 >> v2:172.21.15.135:6800/726754104 conn(0x7ff1d003ea80 0x7ff1d0040f40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff1e406c930 tx=0x7ff1d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff1d400d9b0 con 0x7ff1e41cf280 2024-08-19T11:15:30.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 msgr2=0x7ff1e4126b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 0x7ff1e4126b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400f7a0 tx=0x7ff1d400fc60 comp rx=0 tx=0).stop 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 msgr2=0x7ff1e4126b70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.457+0000 7ff1e0ff9640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41cf280 0x7ff1e4126b70 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400f7a0 tx=0x7ff1d400fc60 comp rx=0 tx=0).stop 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.463+0000 7ff1ea798640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.463+0000 7ff1ea798640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 0x7ff1e41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.463+0000 7ff1ea798640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.463+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e4127490 con 0x7ff1e41270b0 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 0x7ff1e41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient: get_auth_request con 0x7ff1e41270b0 auth_method 0 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 10 monclient(hunting): handle_auth_done global_id 44580 payload 824 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.464+0000 7ff1e3fff640 1 -- 172.21.15.71:0/3065231628 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff1e40a6d30 con 0x7ff1e41270b0 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.466+0000 7ff1e3fff640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 msgr2=0x7ff1e41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.466+0000 7ff1e3fff640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 0x7ff1e41225a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400f7a0 tx=0x7ff1d4003760 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.466+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff1d4007490 con 0x7ff1e41270b0 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.466+0000 7ff1e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.466+0000 7ff1e0ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:15:30.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.466+0000 7ff1e0ff9640 10 monclient: dump: 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.486 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9400 (secure 0 0 0) 0x7ff1d4007020 con 0x7ff1e41270b0 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 msgr2=0x7ff1e41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 0x7ff1e41225a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400f7a0 tx=0x7ff1d4003760 comp rx=0 tx=0).stop 2024-08-19T11:15:30.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 msgr2=0x7ff1e41225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e0ff9640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1e41270b0 0x7ff1e41225a0 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400f7a0 tx=0x7ff1d4003760 comp rx=0 tx=0).stop 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 96, 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 99488, 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:30.488 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.490 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.491 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:30.492 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.493 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:30.494 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.496 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.497 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.501 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:30.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.506 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:30.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.508 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.511 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.513 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:30.513 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 >> v2:172.21.15.135:6800/726754104 conn(0x7ff1d003ea80 msgr2=0x7ff1d0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 --2- 172.21.15.71:0/3065231628 >> v2:172.21.15.135:6800/726754104 conn(0x7ff1d003ea80 0x7ff1d0040f40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff1e406c930 tx=0x7ff1d802e000 comp rx=0 tx=0).stop 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 10 monclient: shutdown 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 msgr2=0x7ff1e4126630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1e8d35640 1 -- 172.21.15.71:0/3065231628 reap_dead start 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 0x7ff1e4126630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00be90 tx=0x7ff1dc00bf80 comp rx=0 tx=0).stop 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 shutdown_connections 2024-08-19T11:15:30.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 --2- 172.21.15.71:0/3065231628 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1e40a7440 0x7ff1e4126630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 >> 172.21.15.71:0/3065231628 conn(0x7ff1e40abf50 msgr2=0x7ff1e409f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 shutdown_connections 2024-08-19T11:15:30.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.467+0000 7ff1ea798640 1 -- 172.21.15.71:0/3065231628 wait complete. 2024-08-19T11:15:30.515 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:15:30.515 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon h 2024-08-19T11:15:30.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:15:30.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.611+0000 7fde5f1d9640 10 monclient: get_monmap_and_config 2024-08-19T11:15:30.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.612+0000 7fde5f1d9640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.612+0000 7fde5f1d9640 10 monclient: monmap: 2024-08-19T11:15:30.613 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.613 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.613 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:30.612651+0000 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:30.612651+0000 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.614 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.615 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.615 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.615 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.615 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:30.615 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:30.615 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.612+0000 7fde5f1d9640 1 Processor -- start 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.612+0000 7fde5f1d9640 1 -- start start 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.612+0000 7fde5f1d9640 10 monclient: init 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient: _add_conns ranks=[10,6,2,3,9,7,1,0,5,4,8] 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde580a6950 0x7fde580a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): picked mon.noname-f con 0x7fde580a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 0x7fde580a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): picked mon.noname-d con 0x7fde580a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fde58139710 0x7fde58139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): picked mon.noname-b con 0x7fde58139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fde580a5020 con 0x7fde580a6950 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fde580a77b0 con 0x7fde58139710 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fde580a7d40 con 0x7fde580a57c0 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5f1d9640 10 monclient(hunting): authenticate will time out at 988.654460s 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5d776640 1 -- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fde58139710 msgr2=0x7fde58139b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3301/0 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5d776640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fde58139710 0x7fde58139b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 0x7fde580a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 0x7fde580a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54782/0 (socket says 172.21.15.71:54782) 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 -- 172.21.15.71:0/3272471872 learned_addr learned my addr 172.21.15.71:0/3272471872 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): get_auth_request con 0x7fde580a57c0 auth_method 0 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5cf75640 1 --2- 172.21.15.71:0/3272471872 >> v2:172.21.15.135:3300/0 conn(0x7fde580a6950 0x7fde580a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5cf75640 10 monclient(hunting): get_auth_request con 0x7fde580a6950 auth_method 0 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5cf75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5cf75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde5cf75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient(hunting): handle_auth_done global_id 25449 payload 274 2024-08-19T11:15:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 -- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fde58139710 msgr2=0x7fde58139b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 --2- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fde58139710 0x7fde58139b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 -- 172.21.15.71:0/3272471872 >> v2:172.21.15.135:3300/0 conn(0x7fde580a6950 msgr2=0x7fde580a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 --2- 172.21.15.71:0/3272471872 >> v2:172.21.15.135:3300/0 conn(0x7fde580a6950 0x7fde580a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 monclient: found mon.noname-d 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.613+0000 7fde57fff640 1 -- 172.21.15.71:0/3272471872 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde580a6380 con 0x7fde580a57c0 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde57fff640 1 -- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 msgr2=0x7fde580a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde57fff640 1 --2- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 0x7fde580a7270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0098a0 tx=0x7fde4c02a0e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=d8261b1afae61502 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 1 -- 172.21.15.71:0/3272471872 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fde4c037070 con 0x7fde580a57c0 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: dump: 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.634 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde5f1d9640 5 monclient: authenticate success, global_id 25449 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde5f1d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 1 -- 172.21.15.71:0/3272471872 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c02ae00 con 0x7fde580a57c0 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 1 -- 172.21.15.71:0/3272471872 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fde4c030c20 con 0x7fde580a57c0 2024-08-19T11:15:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde5f1d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde5f1d9640 4 set_mon_vals no callback set 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.616+0000 7fde577fe640 10 monclient: dump: 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.636 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 10 monclient: shutdown 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 -- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 msgr2=0x7fde580a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 0x7fde580a7270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0098a0 tx=0x7fde4c02a0e0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 -- 172.21.15.71:0/3272471872 shutdown_connections 2024-08-19T11:15:30.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fde58139710 0x7fde58139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/3272471872 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fde580a57c0 0x7fde580a7270 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/3272471872 >> v2:172.21.15.135:3300/0 conn(0x7fde580a6950 0x7fde580a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 -- 172.21.15.71:0/3272471872 >> 172.21.15.71:0/3272471872 conn(0x7fde580abf50 msgr2=0x7fde580ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 -- 172.21.15.71:0/3272471872 shutdown_connections 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.617+0000 7fde5f1d9640 1 -- 172.21.15.71:0/3272471872 wait complete. 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.618+0000 7fde5f1d9640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.618+0000 7fde5f1d9640 10 monclient: monmap: 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.618+0000 7fde5f1d9640 1 Processor -- start 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.618+0000 7fde5f1d9640 1 -- start start 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.618+0000 7fde5f1d9640 10 monclient: init 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient: _add_conns ranks=[7,0,3,4,8,2,1,6,5] 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 0x7fde581ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): picked mon.noname-i con 0x7fde580a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde580a6950 0x7fde58138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): picked mon.noname-a con 0x7fde580a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde58139710 0x7fde58138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): picked mon.noname-g con 0x7fde58139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde580a84c0 con 0x7fde580a6950 2024-08-19T11:15:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde580a3650 con 0x7fde58139710 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fde580a8700 con 0x7fde580a57c0 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5f1d9640 10 monclient(hunting): authenticate will time out at 988.660112s 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde57fff640 1 -- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde580a6950 msgr2=0x7fde58138aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde57fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde580a6950 0x7fde58138aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 0x7fde581ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde58139710 0x7fde58138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 0x7fde581ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:48152/0 (socket says 172.21.15.71:48152) 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 -- 172.21.15.71:0/1991804568 learned_addr learned my addr 172.21.15.71:0/1991804568 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): get_auth_request con 0x7fde580a57c0 auth_method 0 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): get_auth_request con 0x7fde58139710 auth_method 0 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5d776640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient(hunting): handle_auth_done global_id 64321 payload 824 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde58139710 msgr2=0x7fde58138fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde58139710 0x7fde58138fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde580a6950 msgr2=0x7fde58138aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde580a6950 0x7fde58138aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 monclient: found mon.noname-i 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.619+0000 7fde5cf75640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde58124100 con 0x7fde580a57c0 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5cf75640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 msgr2=0x7fde581ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5cf75640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 0x7fde581ce470 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d860 tx=0x7fde4800dd20 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fde4800de50 con 0x7fde580a57c0 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: dump: 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.644 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48019070 con 0x7fde580a57c0 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 5 monclient: authenticate success, global_id 64321 2024-08-19T11:15:30.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 10 monclient: _renew_subs 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5813a2d0 con 0x7fde580a57c0 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fde480148a0 con 0x7fde580a57c0 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde557fa640 10 monclient: dump: 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.646 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 10 monclient: _renew_subs 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde56ffd640 4 set_mon_vals no callback set 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.622+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fde581ce9b0 con 0x7fde580a57c0 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde5f1d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 0x7fde581229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fde5806a590 con 0x7fde58122610 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fde48014430 con 0x7fde580a57c0 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 0x7fde581229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient: get_auth_request con 0x7fde58122610 auth_method 0 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde557fa640 1 --2- 172.21.15.71:0/1991804568 >> v2:172.21.15.135:6800/726754104 conn(0x7fde4403ea80 0x7fde44040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 10 monclient(hunting): handle_auth_done global_id 44663 payload 824 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(148..148 src has 1..148) ==== 3898+0+0 (secure 0 0 0) 0x7fde4800f040 con 0x7fde580a57c0 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde57fff640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde58139d80 con 0x7fde58122610 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde5d776640 1 --2- 172.21.15.71:0/1991804568 >> v2:172.21.15.135:6800/726754104 conn(0x7fde4403ea80 0x7fde44040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.623+0000 7fde5d776640 10 monclient: get_auth_request con 0x7fde4403ea80 auth_method 0 2024-08-19T11:15:30.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.625+0000 7fde57fff640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 msgr2=0x7fde581229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.625+0000 7fde57fff640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 0x7fde581229f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde4c034000 tx=0x7fde4c0046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fde4c037030 con 0x7fde58122610 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 10 monclient: dump: 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.650 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.651 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde5d776640 1 --2- 172.21.15.71:0/1991804568 >> v2:172.21.15.135:6800/726754104 conn(0x7fde4403ea80 0x7fde44040f40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde50003cb0 tx=0x7fde5000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fde4c038040 con 0x7fde58122610 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 msgr2=0x7fde581229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 0x7fde581229f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde4c034000 tx=0x7fde4c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 msgr2=0x7fde581229f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.626+0000 7fde557fa640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122610 0x7fde581229f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde5f1d9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:30.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 0x7fde5809da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde5f1d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fde58076c60 con 0x7fde58122f30 2024-08-19T11:15:30.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 0x7fde5809da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient: get_auth_request con 0x7fde58122f30 auth_method 0 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.632+0000 7fde57fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.633+0000 7fde57fff640 10 monclient(hunting): handle_auth_done global_id 44672 payload 824 2024-08-19T11:15:30.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.633+0000 7fde57fff640 1 -- 172.21.15.71:0/1991804568 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fde580a24d0 con 0x7fde58122f30 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.635+0000 7fde57fff640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 msgr2=0x7fde5809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.635+0000 7fde57fff640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 0x7fde5809da00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097c0 tx=0x7fde4c009240 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.635+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fde4c04b070 con 0x7fde58122f30 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.635+0000 7fde557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.635+0000 7fde557fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.635+0000 7fde557fa640 10 monclient: dump: 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.657 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.658 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9233 (secure 0 0 0) 0x7fde4c003e00 con 0x7fde58122f30 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:30.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 msgr2=0x7fde5809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 0x7fde5809da00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097c0 tx=0x7fde4c009240 comp rx=0 tx=0).stop 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 msgr2=0x7fde5809da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde557fa640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fde58122f30 0x7fde5809da00 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097c0 tx=0x7fde4c009240 comp rx=0 tx=0).stop 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:30.660 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 96, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 99657, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.661 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.662 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:30.688 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 >> v2:172.21.15.135:6800/726754104 conn(0x7fde4403ea80 msgr2=0x7fde44040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/1991804568 >> v2:172.21.15.135:6800/726754104 conn(0x7fde4403ea80 0x7fde44040f40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde50003cb0 tx=0x7fde5000d040 comp rx=0 tx=0).stop 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 10 monclient: shutdown 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 msgr2=0x7fde581ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 --2- 172.21.15.71:0/1991804568 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde580a57c0 0x7fde581ce470 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d860 tx=0x7fde4800dd20 comp rx=0 tx=0).stop 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5d776640 1 -- 172.21.15.71:0/1991804568 reap_dead start 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5d776640 1 -- 172.21.15.71:0/1991804568 reap_dead start 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 shutdown_connections 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 >> 172.21.15.71:0/1991804568 conn(0x7fde580abf50 msgr2=0x7fde581c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 shutdown_connections 2024-08-19T11:15:30.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.636+0000 7fde5f1d9640 1 -- 172.21.15.71:0/1991804568 wait complete. 2024-08-19T11:15:30.691 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:15:30.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2024-08-19T11:15:30.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:15:30.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.788+0000 7fe68599f640 10 monclient: get_monmap_and_config 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.788+0000 7fe68599f640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.788+0000 7fe68599f640 10 monclient: monmap: 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:30.789110+0000 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:30.789110+0000 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.790 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 Processor -- start 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 -- start start 2024-08-19T11:15:30.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient: init 2024-08-19T11:15:30.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient: _add_conns ranks=[0,9,10,4,8,1,7,2,6,3,5] 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe6800a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe6800a57c0 0x7fe68013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): picked mon.noname-a con 0x7fe6800a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6800a7440 0x7fe6801410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): picked mon.noname-f con 0x7fe6800a7440 addr v2:172.21.15.135:3300/0 2024-08-19T11:15:30.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6800a6380 con 0x7fe6800a6950 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe6800a5020 con 0x7fe6800a57c0 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe6800a7d40 con 0x7fe6800a7440 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe68599f640 10 monclient(hunting): authenticate will time out at 988.830593s 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67effd640 1 -- >> v1:172.21.15.71:6789/0 conn(0x7fe6800a6950 legacy=0x7fe6800a6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.71:6789/0 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67e7fc640 1 -- >> v2:172.21.15.71:3300/0 conn(0x7fe6800a57c0 msgr2=0x7fe68013eb60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3300/0 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67e7fc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe6800a57c0 0x7fe68013eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6800a7440 0x7fe6801410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6800a7440 0x7fe6801410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:34000/0 (socket says 172.21.15.71:34000) 2024-08-19T11:15:30.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1484820345 learned_addr learned my addr 172.21.15.71:0/1484820345 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): get_auth_request con 0x7fe6800a7440 auth_method 0 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.789+0000 7fe67f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 10 monclient(hunting): handle_auth_done global_id 5779 payload 274 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1484820345 >> v2:172.21.15.71:3300/0 conn(0x7fe6800a57c0 msgr2=0x7fe68013eb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:30.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 1 --2- 172.21.15.71:0/1484820345 >> v2:172.21.15.71:3300/0 conn(0x7fe6800a57c0 0x7fe68013eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1484820345 >> v1:172.21.15.71:6789/0 conn(0x7fe6800a6950 legacy=0x7fe6800a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 1 monclient: found mon.noname-f 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.790+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1484820345 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6800a3650 con 0x7fe6800a7440 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1484820345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800a7440 msgr2=0x7fe6801410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67f7fe640 1 --2- 172.21.15.71:0/1484820345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800a7440 0x7fe6801410b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe6800acf60 tx=0x7fe67802a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d491cf6e0f52417 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 1 -- 172.21.15.71:0/1484820345 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe678036070 con 0x7fe6800a7440 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: dump: 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 1 -- 172.21.15.71:0/1484820345 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe678007a70 con 0x7fe6800a7440 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 1 -- 172.21.15.71:0/1484820345 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe678007c60 con 0x7fe6800a7440 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 5 monclient: authenticate success, global_id 5779 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 4 set_mon_vals no callback set 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe67dffb640 10 monclient: dump: 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.812 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 10 monclient: shutdown 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 1 -- 172.21.15.71:0/1484820345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800a7440 msgr2=0x7fe6801410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.793+0000 7fe68599f640 1 --2- 172.21.15.71:0/1484820345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800a7440 0x7fe6801410b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe6800acf60 tx=0x7fe67802a590 comp rx=0 tx=0).stop 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 -- 172.21.15.71:0/1484820345 shutdown_connections 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 --2- 172.21.15.71:0/1484820345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6800a7440 0x7fe6801410b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 --2- 172.21.15.71:0/1484820345 >> v2:172.21.15.71:3300/0 conn(0x7fe6800a57c0 0x7fe68013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 -- 172.21.15.71:0/1484820345 >> 172.21.15.71:0/1484820345 conn(0x7fe6800abf50 msgr2=0x7fe6800ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 -- 172.21.15.71:0/1484820345 shutdown_connections 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 -- 172.21.15.71:0/1484820345 wait complete. 2024-08-19T11:15:30.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 10 monclient: build_initial_monmap 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 10 monclient: monmap: 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:30.814 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.794+0000 7fe68599f640 1 Processor -- start 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 -- start start 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient: init 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient: _add_conns ranks=[8,6,4,0,5,7,1,3,2] 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 0x7fe680128a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): picked mon.noname-e con 0x7fe6800a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe6800a6950 0x7fe6801ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): picked mon.noname-d con 0x7fe6800a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe6800a7440 0x7fe680126430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): picked mon.noname-c con 0x7fe6800a7440 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe6800a8700 con 0x7fe6800a7440 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe6800a84c0 con 0x7fe6800a6950 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe6801415f0 con 0x7fe6800a57c0 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe68599f640 10 monclient(hunting): authenticate will time out at 988.836596s 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67f7fe640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe6800a7440 msgr2=0x7fe680126430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:15:30.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe6800a7440 0x7fe680126430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 0x7fe680128a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe6800a6950 0x7fe6801ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe6800a6950 0x7fe6801ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54786/0 (socket says 172.21.15.71:54786) 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 1 -- 172.21.15.71:0/1351652359 learned_addr learned my addr 172.21.15.71:0/1351652359 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): get_auth_request con 0x7fe6800a6950 auth_method 0 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 0x7fe680128a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59560/0 (socket says 172.21.15.71:59560) 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): get_auth_request con 0x7fe6800a57c0 auth_method 0 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.795+0000 7fe67effd640 10 monclient(hunting): handle_auth_done global_id 64322 payload 824 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe6800a6950 msgr2=0x7fe6801ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe6800a6950 0x7fe6801ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe6800a7440 msgr2=0x7fe680126430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe6800a7440 0x7fe680126430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:30.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 1 monclient: found mon.noname-e 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67effd640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe680129f20 con 0x7fe6800a57c0 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.796+0000 7fe67e7fc640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe6800a6950 0x7fe6801ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe67effd640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 msgr2=0x7fe680128a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe67effd640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 0x7fe680128a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe67000b430 tx=0x7fe67000b8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe670016070 con 0x7fe6800a57c0 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:30.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: dump: 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.820 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: _finish_auth 0 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: _check_auth_tickets 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 5 monclient: authenticate success, global_id 64322 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe670003dd0 con 0x7fe6800a57c0 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 10 monclient: _renew_subs 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68012a200 con 0x7fe6800a57c0 2024-08-19T11:15:30.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe6700103a0 con 0x7fe6800a57c0 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe667fff640 10 monclient: dump: 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe67d7fa640 4 set_mon_vals no callback set 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 10 monclient: _renew_subs 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.798+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe680140d30 con 0x7fe6800a57c0 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe670005070 con 0x7fe6800a57c0 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe68599f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe68599f640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 0x7fe680126970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe6800a9410 con 0x7fe6801cf020 2024-08-19T11:15:30.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe667fff640 1 --2- 172.21.15.71:0/1351652359 >> v2:172.21.15.135:6800/726754104 conn(0x7fe66c03ea80 0x7fe66c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(148..148 src has 1..148) ==== 3898+0+0 (secure 0 0 0) 0x7fe670050ed0 con 0x7fe6800a57c0 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 0x7fe680126970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient: get_auth_request con 0x7fe6801cf020 auth_method 0 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67f7fe640 1 --2- 172.21.15.71:0/1351652359 >> v2:172.21.15.135:6800/726754104 conn(0x7fe66c03ea80 0x7fe66c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67f7fe640 10 monclient: get_auth_request con 0x7fe66c03ea80 auth_method 0 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_done global_id 64330 payload 824 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.799+0000 7fe67e7fc640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6800a6d30 con 0x7fe6801cf020 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe67e7fc640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 msgr2=0x7fe680126970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe67e7fc640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 0x7fe680126970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe674005280 tx=0x7fe674005740 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe67f7fe640 1 --2- 172.21.15.71:0/1351652359 >> v2:172.21.15.135:6800/726754104 conn(0x7fe66c03ea80 0x7fe66c040f40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe6800acf60 tx=0x7fe678009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe674016070 con 0x7fe6801cf020 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 10 monclient: dump: 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.827 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe67400ed80 con 0x7fe6801cf020 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 msgr2=0x7fe680126970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 0x7fe680126970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe674005280 tx=0x7fe674005740 comp rx=0 tx=0).stop 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 msgr2=0x7fe680126970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.802+0000 7fe667fff640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe6801cf020 0x7fe680126970 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.808+0000 7fe68599f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:15:30.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.808+0000 7fe68599f640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 0x7fe6801225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:30.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.808+0000 7fe68599f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:30.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.808+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe6801272c0 con 0x7fe680126eb0 2024-08-19T11:15:30.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 0x7fe6801225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient: get_auth_request con 0x7fe680126eb0 auth_method 0 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 10 monclient(hunting): handle_auth_done global_id 64339 payload 824 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.809+0000 7fe67e7fc640 1 -- 172.21.15.71:0/1351652359 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe680129390 con 0x7fe680126eb0 2024-08-19T11:15:30.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.811+0000 7fe67e7fc640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 msgr2=0x7fe6801225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.811+0000 7fe67e7fc640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 0x7fe6801225a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe674018000 tx=0x7fe674005970 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe674016040 con 0x7fe680126eb0 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 10 monclient: dump: 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:30.832 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:30.833 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9233 (secure 0 0 0) 0x7fe67401d270 con 0x7fe680126eb0 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 msgr2=0x7fe6801225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 0x7fe6801225a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe674018000 tx=0x7fe674005970 comp rx=0 tx=0).stop 2024-08-19T11:15:30.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 msgr2=0x7fe6801225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:15:30.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe667fff640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe680126eb0 0x7fe6801225a0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe674018000 tx=0x7fe674005970 comp rx=0 tx=0).stop 2024-08-19T11:15:30.835 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:15:30.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:30.835 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:30.835 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:15:30.835 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 96, 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 42305, 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:15:30.836 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.837 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:15:30.838 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.839 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:15:30.840 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:15:30.841 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:15:30.842 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:15:30.843 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:15:30.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:15:30.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:15:30.850 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.852 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.854 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:15:30.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.856 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:15:30.860 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:15:30.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:15:30.863 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:15:30.863 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 >> v2:172.21.15.135:6800/726754104 conn(0x7fe66c03ea80 msgr2=0x7fe66c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 --2- 172.21.15.71:0/1351652359 >> v2:172.21.15.135:6800/726754104 conn(0x7fe66c03ea80 0x7fe66c040f40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe6800acf60 tx=0x7fe678009000 comp rx=0 tx=0).stop 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 10 monclient: shutdown 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 msgr2=0x7fe680128a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 --2- 172.21.15.71:0/1351652359 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe6800a57c0 0x7fe680128a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe67000b430 tx=0x7fe67000b8f0 comp rx=0 tx=0).stop 2024-08-19T11:15:30.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1351652359 reap_dead start 2024-08-19T11:15:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe67f7fe640 1 -- 172.21.15.71:0/1351652359 reap_dead start 2024-08-19T11:15:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 shutdown_connections 2024-08-19T11:15:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 >> 172.21.15.71:0/1351652359 conn(0x7fe6800abf50 msgr2=0x7fe68009f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 shutdown_connections 2024-08-19T11:15:30.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:30.812+0000 7fe68599f640 1 -- 172.21.15.71:0/1351652359 wait complete. 2024-08-19T11:15:30.866 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:15:30.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: starting. 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26255 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: created object 0... 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: created object 25... 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: created object 49... 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: finishing. 2024-08-19T11:15:31.837 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26290]: shutting down. 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26292]: starting. 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26292]: listing objects. 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26292]: listed object 0... 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26292]: listed object 25... 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26292]: saw 50 objects 2024-08-19T11:15:31.876 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26292]: shutting down. 2024-08-19T11:15:32.748 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:32.748 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26291]: starting. 2024-08-19T11:15:32.748 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26291]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26255 2024-08-19T11:15:32.748 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26291]: shutting down. 2024-08-19T11:15:32.749 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:32.749 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:32.749 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:15:32.752 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:15:34.954 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: starting. 2024-08-19T11:15:34.954 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26360 2024-08-19T11:15:34.954 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: created object 0... 2024-08-19T11:15:34.955 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: created object 25... 2024-08-19T11:15:34.955 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: created object 49... 2024-08-19T11:15:34.955 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: finishing. 2024-08-19T11:15:34.955 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26361]: shutting down. 2024-08-19T11:15:36.281 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26362]: starting. 2024-08-19T11:15:36.281 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26362]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26360 2024-08-19T11:15:36.281 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26362]: shutting down. 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: starting. 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26360 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: created object 0... 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: created object 25... 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: created object 49... 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: finishing. 2024-08-19T11:15:38.508 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26397]: shutting down. 2024-08-19T11:15:39.380 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:39.381 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26399]: starting. 2024-08-19T11:15:39.381 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26399]: listing objects. 2024-08-19T11:15:39.381 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26399]: listed object 0... 2024-08-19T11:15:39.381 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26399]: listed object 25... 2024-08-19T11:15:39.381 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26399]: saw 50 objects 2024-08-19T11:15:39.381 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26399]: shutting down. 2024-08-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26398]: starting. 2024-08-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26398]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26360 2024-08-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26398]: shutting down. 2024-08-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:15:40.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:15:42.827 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: starting. 2024-08-19T11:15:42.828 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26467 2024-08-19T11:15:42.828 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: created object 0... 2024-08-19T11:15:42.828 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: created object 25... 2024-08-19T11:15:42.828 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: created object 49... 2024-08-19T11:15:42.828 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: finishing. 2024-08-19T11:15:42.828 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26468]: shutting down. 2024-08-19T11:15:43.742 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26469]: starting. 2024-08-19T11:15:43.742 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26469]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26467 2024-08-19T11:15:43.742 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26469]: shutting down. 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: starting. 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26467 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: created object 0... 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: created object 25... 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: created object 49... 2024-08-19T11:15:45.854 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: finishing. 2024-08-19T11:15:45.855 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26504]: shutting down. 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26506]: starting. 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26506]: listing objects. 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26506]: listed object 0... 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26506]: listed object 25... 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26506]: saw 50 objects 2024-08-19T11:15:45.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26506]: shutting down. 2024-08-19T11:15:46.837 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:46.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26505]: starting. 2024-08-19T11:15:46.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26505]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26467 2024-08-19T11:15:46.838 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26505]: shutting down. 2024-08-19T11:15:46.839 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:46.839 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:15:46.840 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:15:46.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:15:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: starting. 2024-08-19T11:15:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26574 2024-08-19T11:15:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: created object 0... 2024-08-19T11:15:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: created object 25... 2024-08-19T11:15:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: created object 49... 2024-08-19T11:15:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: finishing. 2024-08-19T11:15:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26575]: shutting down. 2024-08-19T11:15:50.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26576]: starting. 2024-08-19T11:15:50.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26576]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26574 2024-08-19T11:15:50.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26576]: shutting down. 2024-08-19T11:15:50.867 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-19T11:15:50.867 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-19T11:15:50.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-19T11:15:50.870 INFO:tasks.ceph.mon.c:Started 2024-08-19T11:15:50.870 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-08-19T11:15:50.870 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-19T11:15:50.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-19T11:15:50.873 INFO:tasks.ceph.mon.b:Started 2024-08-19T11:15:50.873 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-08-19T11:15:50.873 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-19T11:15:50.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-19T11:15:50.875 INFO:tasks.ceph.mon.a:Started 2024-08-19T11:15:50.875 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:15:50.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:50.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.988+0000 7fa2c92cc640 10 monclient: get_monmap_and_config 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.988+0000 7fa2c92cc640 10 monclient: build_initial_monmap 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.988+0000 7fa2c92cc640 10 monclient: monmap: 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:50.989542+0000 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:50.989542+0000 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:50.990 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:50.991 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.989+0000 7fa2c92cc640 1 Processor -- start 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.989+0000 7fa2c92cc640 1 -- start start 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.989+0000 7fa2c92cc640 10 monclient: init 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient: _add_conns ranks=[8,2,9,0,4,5,6,10,1,7,3] 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 0x7fa2c406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): picked mon.noname-e con 0x7fa2c406c8a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa2c406d1c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 0x7fa2c4137f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa2c4137ac0 addr v2:172.21.15.71:3300/0 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c409feb0 con 0x7fa2c4137ac0 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c4074430 con 0x7fa2c406d1c0 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa2c409cb20 con 0x7fa2c406c8a0 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c92cc640 10 monclient(hunting): authenticate will time out at 1009.031249s 2024-08-19T11:15:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:46412/0 (socket says 172.21.15.71:46412) 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 -- 172.21.15.71:0/1003206275 learned_addr learned my addr 172.21.15.71:0/1003206275 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 10 monclient(hunting): get_auth_request con 0x7fa2c406d1c0 auth_method 0 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 0x7fa2c406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 0x7fa2c4137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): get_auth_request con 0x7fa2c406c8a0 auth_method 0 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 -- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 msgr2=0x7fa2c4137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 -- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 msgr2=0x7fa2c4137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c27fc640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 10 monclient(hunting): get_auth_request con 0x7fa2c4137ac0 auth_method 0 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 1 -- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 msgr2=0x7fa2c4137f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:15:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 1 -- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 msgr2=0x7fa2c4137f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 1 --2- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 0x7fa2c4137f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c37fe640 1 --2- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 0x7fa2c4137f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_done global_id 64403 payload 274 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 msgr2=0x7fa2c4137580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 msgr2=0x7fa2c4137f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 0x7fa2c4137f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 monclient: found mon.noname-e 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.990+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/1003206275 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c40a3d60 con 0x7fa2c406c8a0 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 msgr2=0x7fa2c406cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 0x7fa2c406cc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40097a0 tx=0x7fa2b4029fd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a82caecffa61b1d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 1 -- 172.21.15.71:0/1003206275 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2b4037070 con 0x7fa2c406c8a0 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: dump: 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 1 -- 172.21.15.71:0/1003206275 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b402ad30 con 0x7fa2c406c8a0 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 1 -- 172.21.15.71:0/1003206275 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2b4030c20 con 0x7fa2c406c8a0 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.993+0000 7fa2c1ffb640 10 monclient: dump: 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 5 monclient: authenticate success, global_id 64403 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 10 monclient: get_monmap_and_config success 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 4 set_mon_vals no callback set 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 10 monclient: shutdown 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 1 -- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 msgr2=0x7fa2c406cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 0x7fa2c406cc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40097a0 tx=0x7fa2b4029fd0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 1 -- 172.21.15.71:0/1003206275 shutdown_connections 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.994+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/1003206275 >> v2:172.21.15.71:3300/0 conn(0x7fa2c4137ac0 0x7fa2c4137f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c406d1c0 0x7fa2c4137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/1003206275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2c406c8a0 0x7fa2c406cc80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 1 -- 172.21.15.71:0/1003206275 >> 172.21.15.71:0/1003206275 conn(0x7fa2c40a91d0 msgr2=0x7fa2c40a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 1 -- 172.21.15.71:0/1003206275 shutdown_connections 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 1 -- 172.21.15.71:0/1003206275 wait complete. 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 10 monclient: build_initial_monmap 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.995+0000 7fa2c92cc640 10 monclient: monmap: 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:15:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:51.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 Processor -- start 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 -- start start 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient: init 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient: _add_conns ranks=[1,6,2,3,8,0,5,7,4] 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 0x7fa2c41cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient(hunting): picked mon.noname-f con 0x7fa2c406c8a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2c406d1c0 0x7fa2c41368c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient(hunting): picked mon.noname-d con 0x7fa2c406d1c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 0x7fa2c4136e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa2c4137ac0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:51.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c406d5a0 con 0x7fa2c406c8a0 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.996+0000 7fa2c92cc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c40a27f0 con 0x7fa2c4137ac0 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c92cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 0x7fa2c41cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c92cc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa2c40a6460 con 0x7fa2c406d1c0 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 0x7fa2c41cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:40536/0 (socket says 172.21.15.71:40536) 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/821709156 learned_addr learned my addr 172.21.15.71:0/821709156 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 0x7fa2c4136e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c92cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2c406d1c0 0x7fa2c41368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c92cc640 10 monclient(hunting): authenticate will time out at 1009.038136s 2024-08-19T11:15:51.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): get_auth_request con 0x7fa2c406c8a0 auth_method 0 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 10 monclient(hunting): get_auth_request con 0x7fa2c4137ac0 auth_method 0 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): get_auth_request con 0x7fa2c406d1c0 auth_method 0 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:51.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 1 -- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 msgr2=0x7fa2c4136e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 1 -- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 msgr2=0x7fa2c4136e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 0x7fa2c4136e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c37fe640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 0x7fa2c4136e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient(hunting): handle_auth_done global_id 5860 payload 824 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2c406d1c0 msgr2=0x7fa2c41368c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2c406d1c0 0x7fa2c41368c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 msgr2=0x7fa2c4136e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 0x7fa2c4136e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:51.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 monclient: found mon.noname-f 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/821709156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c41239e0 con 0x7fa2c406c8a0 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.997+0000 7fa2c27fc640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2c406d1c0 0x7fa2c41368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.999+0000 7fa2c2ffd640 1 -- 172.21.15.71:0/821709156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 msgr2=0x7fa2c41cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:50.999+0000 7fa2c2ffd640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 0x7fa2c41cc290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4035040 tx=0x7fa2b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2b4037040 con 0x7fa2c406c8a0 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: dump: 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:51.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: _finish_auth 0 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b4042070 con 0x7fa2c406c8a0 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 5 monclient: authenticate success, global_id 5860 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 10 monclient: _renew_subs 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c4137550 con 0x7fa2c406c8a0 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2b4032d20 con 0x7fa2c406c8a0 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:15:51.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2ab7fe640 10 monclient: dump: 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:15:51.019 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 10 monclient: _renew_subs 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c17fa640 4 set_mon_vals no callback set 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.000+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c4121f20 con 0x7fa2c406c8a0 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2c92cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2c92cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa2b4003c90 con 0x7fa2c406c8a0 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2c92cc640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c41377b0 con 0x7fa2c406c8a0 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2ab7fe640 1 --2- 172.21.15.71:0/821709156 >> v2:172.21.15.135:6800/726754104 conn(0x7fa2b003ea80 0x7fa2b0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 3506+0+0 (secure 0 0 0) 0x7fa2b4071f70 con 0x7fa2c406c8a0 2024-08-19T11:15:51.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2c27fc640 1 --2- 172.21.15.71:0/821709156 >> v2:172.21.15.135:6800/726754104 conn(0x7fa2b003ea80 0x7fa2b0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.001+0000 7fa2c27fc640 10 monclient: get_auth_request con 0x7fa2b003ea80 auth_method 0 2024-08-19T11:15:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.004+0000 7fa2c27fc640 1 --2- 172.21.15.71:0/821709156 >> v2:172.21.15.135:6800/726754104 conn(0x7fa2b003ea80 0x7fa2b0040f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4122590 tx=0x7fa2b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:15:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.006+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fa2c41377b0 con 0x7fa2c406c8a0 2024-08-19T11:15:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.006+0000 7fa2ab7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:15:51.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.006+0000 7fa2ab7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:15:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.255+0000 7fa2c92cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:15:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.255+0000 7fa2c92cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.255+0000 7fa2c92cc640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:15:51.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:51.255+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa2c409d4f0 con 0x7fa2c406c8a0 2024-08-19T11:15:53.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:53.996+0000 7fa2aa7fc640 10 monclient: tick 2024-08-19T11:15:53.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:53.996+0000 7fa2aa7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:53.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:53.996+0000 7fa2aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:53.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:53.996+0000 7fa2aa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:15:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:54.997+0000 7fa2aa7fc640 10 monclient: tick 2024-08-19T11:15:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:54.997+0000 7fa2aa7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:54.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:54.997+0000 7fa2aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:55.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:55.997+0000 7fa2aa7fc640 10 monclient: tick 2024-08-19T11:15:55.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:55.997+0000 7fa2aa7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:15:55.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:55.997+0000 7fa2aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:15:56.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.205+0000 7fa2ab7fe640 1 -- 172.21.15.71:0/821709156 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3175 (secure 0 0 0) 0x7fa2c41239e0 con 0x7fa2c406c8a0 2024-08-19T11:15:56.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.205+0000 7fa2ab7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:15:56.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.205+0000 7fa2ab7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:15:56.207 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":100,"quorum":[1,3,5,6,7,8],"quorum_names":["f","g","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.208+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 >> v2:172.21.15.135:6800/726754104 conn(0x7fa2b003ea80 msgr2=0x7fa2b0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/821709156 >> v2:172.21.15.135:6800/726754104 conn(0x7fa2b003ea80 0x7fa2b0040f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4122590 tx=0x7fa2b8008040 comp rx=0 tx=0).stop 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 10 monclient: shutdown 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 msgr2=0x7fa2c41cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 0x7fa2c41cc290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4035040 tx=0x7fa2b40046c0 comp rx=0 tx=0).stop 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 shutdown_connections 2024-08-19T11:15:56.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/821709156 >> v2:172.21.15.135:6800/726754104 conn(0x7fa2b003ea80 0x7fa2b0040f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:56.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa2c4137ac0 0x7fa2c4136e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:56.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2c406d1c0 0x7fa2c41368c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:56.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 --2- 172.21.15.71:0/821709156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2c406c8a0 0x7fa2c41cc290 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:15:56.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 >> 172.21.15.71:0/821709156 conn(0x7fa2c40a91d0 msgr2=0x7fa2c4072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:15:56.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 shutdown_connections 2024-08-19T11:15:56.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:56.209+0000 7fa2c92cc640 1 -- 172.21.15.71:0/821709156 wait complete. 2024-08-19T11:15:59.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:15:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.333+0000 7f187877f640 10 monclient: get_monmap_and_config 2024-08-19T11:15:59.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.333+0000 7f187877f640 10 monclient: build_initial_monmap 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.333+0000 7f187877f640 10 monclient: monmap: 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:15:59.334420+0000 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:15:59.334420+0000 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:15:59.335 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:15:59.336 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:15:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.334+0000 7f187877f640 1 Processor -- start 2024-08-19T11:15:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.334+0000 7f187877f640 1 -- start start 2024-08-19T11:15:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.334+0000 7f187877f640 10 monclient: init 2024-08-19T11:15:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient: _reopen_session rank -1 2024-08-19T11:15:59.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient: _add_conns ranks=[1,2,3,0,10,7,8,6,9,5,4] 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f18700a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): picked mon.noname-b con 0x7f18700a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): picked mon.noname-g con 0x7f187013eb10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18700a4f90 con 0x7f18700a6a30 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f18700a3650 con 0x7f18700a6e10 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f187013eb10 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): _renew_subs 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f187877f640 10 monclient(hunting): authenticate will time out at 1017.376239s 2024-08-19T11:15:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:57926/0 (socket says 172.21.15.71:57926) 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 learned_addr learned my addr 172.21.15.71:0/3341607617 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18700a6e10 auth_method 0 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f187013eb10 auth_method 0 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:15:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:15:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.335+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:15:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.337+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v1:172.21.15.135:6789/0 conn(0x7f18700a6a30 legacy=0x7f18700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f187013eb10 auth_method 0 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:59.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18700a6e10 auth_method 0 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.536+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.537+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.537+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.537+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:59.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.537+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f187013eb10 auth_method 0 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:59.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.937+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:15:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.938+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:15:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.938+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18700a6e10 auth_method 0 2024-08-19T11:15:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.938+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:15:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.938+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:15:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.938+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:15:59.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.939+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:15:59.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.939+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:15:59.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.939+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:15:59.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:15:59.939+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f187013eb10 auth_method 0 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:00.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:00.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:00.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.739+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18700a6e10 auth_method 0 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:00.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:00.741+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:02.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.229+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115540054 0 0) 0x7f18700a4f90 con 0x7f18700a6a30 2024-08-19T11:16:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.229+0000 7f1875519640 10 monclient(hunting): _negotiate 2024-08-19T11:16:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.229+0000 7f1875519640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.229+0000 7f1875519640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.229+0000 7f1875519640 10 monclient(hunting): my global_id is 5869 2024-08-19T11:16:02.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.229+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f185c003520 con 0x7f18700a6a30 2024-08-19T11:16:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): tick 2024-08-19T11:16:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:16:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:16:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:16:02.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 msgr2=0x7f1870140f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f187013eb10 0x7f1870140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 msgr2=0x7f18700a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18700a6e10 0x7f18700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> v1:172.21.15.135:6789/0 conn(0x7f18700a6a30 legacy=0x7f18700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient: _add_conns ranks=[7,0,8,6,10,9,4,5] 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-i con 0x7f18540038b0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1854006300 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-e con 0x7f185400a020 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18700a49d0 con 0x7f1854006300 2024-08-19T11:16:02.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f18540038b0 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f185400dc90 con 0x7f185400a020 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1867fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400a020 auth_method 0 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540038b0 auth_method 0 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:02.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:02.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.334+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:02.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.336+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v1:172.21.15.71:6789/0 conn(0x7f1854006300 legacy=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400a020 auth_method 0 2024-08-19T11:16:02.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540038b0 auth_method 0 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:02.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.535+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400a020 auth_method 0 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540038b0 auth_method 0 2024-08-19T11:16:02.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:02.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:02.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:02.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:02.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:02.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:02.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:02.936+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:03.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400a020 auth_method 0 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:03.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540038b0 auth_method 0 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:03.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:03.738+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): tick 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400a020 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:05.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f18540038b0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> v1:172.21.15.71:6789/0 conn(0x7f1854006300 legacy=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 reap_dead start 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 reap_dead start 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient: _add_conns ranks=[6,10,4,5,9] 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-d con 0x7f185400cee0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-f con 0x7f185400d360 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-c con 0x7f1854008f60 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:05.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f185400d360 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f185400dc90 con 0x7f1854008f60 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f185400d8c0 con 0x7f185400cee0 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.334+0000 7f1867fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f185400cee0 auth_method 0 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:05.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400d360 auth_method 0 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f185400cee0 auth_method 0 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400d360 auth_method 0 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f185400cee0 auth_method 0 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400d360 auth_method 0 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:05.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:05.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:05.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:05.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:05.937+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:06.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f185400cee0 auth_method 0 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:06.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400d360 auth_method 0 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:06.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:06.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:06.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:06.738+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): tick 2024-08-19T11:16:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:16:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:16:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:16:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 msgr2=0x7f1854005d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185400cee0 0x7f1854005d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 msgr2=0x7f185400c4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400d360 0x7f185400c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient: _add_conns ranks=[9,5] 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-a con 0x7f18540094f0 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-h con 0x7f1854010230 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f18540094f0 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f185400dc90 con 0x7f1854010230 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1867fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f1854010230 auth_method 0 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:08.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f1854010230 auth_method 0 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:08.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.536+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:08.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.537+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:08.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:08.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f1854010230 auth_method 0 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:08.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.937+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.938+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:08.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:08.939+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f1854010230 auth_method 0 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:09.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:09.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:09.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.739+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:09.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:09.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:09.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:09.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:09.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:09.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:09.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:09.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:09.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:09.740+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): tick 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1854010230 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:11.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f1854009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f1854009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient: _add_conns ranks=[4,9,5,7,8,10,2,1,0,6,3] 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 reap_dead start 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-c con 0x7f1854008f60 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-a con 0x7f18540094f0 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-h con 0x7f185400ce80 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:11.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f18540094f0 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f185400dc90 con 0x7f1854008f60 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f185400d8c0 con 0x7f185400ce80 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1867fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f187651b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.335+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400ce80 auth_method 0 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.336+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:11.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:11.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400ce80 auth_method 0 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.537+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400ce80 auth_method 0 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:11.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:11.938+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:12.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:12.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:12.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f1854008f60 auth_method 0 2024-08-19T11:16:12.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f18540094f0 auth_method 0 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:12.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400ce80 auth_method 0 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:12.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:12.739+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): tick 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 msgr2=0x7f1854012620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185400ce80 0x7f1854012620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 msgr2=0x7f1854008770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1854008f60 0x7f1854008770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 msgr2=0x7f18540098d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.71:3300/0 conn(0x7f18540094f0 0x7f18540098d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient: _add_conns ranks=[1,10,8,7,0,6,3,2] 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f1854003cb0 addr v1:172.21.15.135:6789/0 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-f con 0x7f185400bb70 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): picked mon.noname-e con 0x7f185400c4f0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185400def0 con 0x7f1854003cb0 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f185400bb70 2024-08-19T11:16:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f185400dc90 con 0x7f185400c4f0 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1867fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400c4f0 auth_method 0 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400bb70 auth_method 0 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.336+0000 7f1875d1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.338+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> v1:172.21.15.135:6789/0 conn(0x7f1854003cb0 legacy=0x7f185400a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.338+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.338+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.338+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.338+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400c4f0 auth_method 0 2024-08-19T11:16:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:14.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.538+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:14.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400bb70 auth_method 0 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:14.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.539+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400c4f0 auth_method 0 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:14.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400bb70 auth_method 0 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:14.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:14.940+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:15.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:15.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185400c4f0 auth_method 0 2024-08-19T11:16:15.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:15.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185400bb70 auth_method 0 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:15.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:15.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:15.742+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.437+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343129284 0 0) 0x7f185400def0 con 0x7f1854003cb0 2024-08-19T11:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.437+0000 7f1875519640 10 monclient(hunting): _negotiate 2024-08-19T11:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.437+0000 7f1875519640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.437+0000 7f1875519640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.437+0000 7f1875519640 10 monclient(hunting): my global_id is 5878 2024-08-19T11:16:16.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.437+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18700a4f90 con 0x7f1854003cb0 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4039672183 0 0) 0x7f18700a4f90 con 0x7f1854003cb0 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 msgr2=0x7f1854016df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185400c4f0 0x7f1854016df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 msgr2=0x7f185400bf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 --2- 172.21.15.71:0/3341607617 >> v2:172.21.15.135:3300/0 conn(0x7f185400bb70 0x7f185400bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: _finish_hunting 0 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 monclient: found mon.noname-f-legacy 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 1 -- 172.21.15.71:0/3341607617 reap_dead start 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.135:6789/0 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18540184a0 con 0x7f1854003cb0 2024-08-19T11:16:16.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: _finish_auth 0 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: _check_auth_tickets 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f186c001d00 con 0x7f1854003cb0 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187877f640 5 monclient: authenticate success, global_id 5878 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: dump: 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.444 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] but i'm connected to v1:172.21.15.135:6789/0, reconnecting 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:16.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 >> v1:172.21.15.135:6789/0 conn(0x7f1854003cb0 legacy=0x7f185400a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient: _add_conns ranks=[6,8,7,1,3,0,2,4,5] 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 0x7f185c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): picked mon.d con 0x7f185c004390 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185c004fc0 0x7f185c0099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): picked mon.e con 0x7f185c004fc0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f185c009ef0 0x7f185c00c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): picked mon.i con 0x7f185c009ef0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f18700a6380 con 0x7f185c004390 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f185400dc90 con 0x7f185c009ef0 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f185c00cae0 con 0x7f185c004fc0 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875519640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187877f640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 0x7f185c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f185c004390 auth_method 0 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185c004fc0 0x7f185c0099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185c004fc0 auth_method 0 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f185c009ef0 0x7f185c00c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185c009ef0 auth_method 0 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1875d1a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f1876d1c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient(hunting): handle_auth_done global_id 5878 payload 293 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185c004fc0 msgr2=0x7f185c0099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185c004fc0 0x7f185c0099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f185c009ef0 msgr2=0x7f185c00c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f185c009ef0 0x7f185c00c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient: _finish_hunting 0 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 monclient: found mon.d 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18700a4f90 con 0x7f185c004390 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient: _finish_auth 0 2024-08-19T11:16:16.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 10 monclient: _check_auth_tickets 2024-08-19T11:16:16.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.438+0000 7f187651b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.441+0000 7f187651b640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 msgr2=0x7f185c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.441+0000 7f187651b640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 0x7f185c004800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1854003760 tx=0x7f185c005830 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ff18b372e0fb900b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f186c005c60 con 0x7f185c004390 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: dump: 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.456 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f187877f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186c037070 con 0x7f185c004390 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f187877f640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f187877f640 4 set_mon_vals no callback set 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 1 -- 172.21.15.71:0/3341607617 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f186c032d20 con 0x7f185c004390 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.443+0000 7f1875519640 10 monclient: dump: 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.458 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 10 monclient: shutdown 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:16.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 -- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 msgr2=0x7f185c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 0x7f185c004800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1854003760 tx=0x7f185c005830 comp rx=0 tx=0).stop 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 -- 172.21.15.71:0/3341607617 shutdown_connections 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f185c009ef0 0x7f185c00c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f185c004fc0 0x7f185c0099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 --2- 172.21.15.71:0/3341607617 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f185c004390 0x7f185c004800 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.444+0000 7f187877f640 1 -- 172.21.15.71:0/3341607617 >> 172.21.15.71:0/3341607617 conn(0x7f18700ac030 msgr2=0x7f18700ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.445+0000 7f187877f640 1 -- 172.21.15.71:0/3341607617 shutdown_connections 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.445+0000 7f187877f640 1 -- 172.21.15.71:0/3341607617 wait complete. 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.446+0000 7f187877f640 10 monclient: build_initial_monmap 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.446+0000 7f187877f640 10 monclient: monmap: 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:16.460 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 Processor -- start 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 -- start start 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient: init 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient: _add_conns ranks=[3,0,5,6,4,1,8,7,2] 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1854003cb0 0x7f18701ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): picked mon.noname-g con 0x7f1854003cb0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 0x7f1870136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): picked mon.noname-a con 0x7f185c004390 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185c004fc0 0x7f1870137210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): picked mon.noname-h con 0x7f185c004fc0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18700a5970 con 0x7f185c004390 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18700a57f0 con 0x7f1854003cb0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f18700a5af0 con 0x7f185c004fc0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187877f640 10 monclient(hunting): authenticate will time out at 1034.489786s 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 0x7f1870136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 0x7f1870136cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54544/0 (socket says 172.21.15.71:54544) 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 1 -- 172.21.15.71:0/1725341918 learned_addr learned my addr 172.21.15.71:0/1725341918 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 10 monclient(hunting): get_auth_request con 0x7f185c004390 auth_method 0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1875d1a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f1876d1c640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185c004fc0 0x7f1870137210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.447+0000 7f187651b640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1854003cb0 0x7f18701ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): get_auth_request con 0x7f185c004fc0 auth_method 0 2024-08-19T11:16:16.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): get_auth_request con 0x7f1854003cb0 auth_method 0 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1876d1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f187651b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 10 monclient(hunting): handle_auth_done global_id 74097 payload 824 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 1 -- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185c004fc0 msgr2=0x7f1870137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185c004fc0 0x7f1870137210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 1 -- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1854003cb0 msgr2=0x7f18701ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1854003cb0 0x7f18701ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 10 monclient: _finish_hunting 0 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 1 monclient: found mon.noname-a 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.448+0000 7f1875d1a640 1 -- 172.21.15.71:0/1725341918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1870122de0 con 0x7f185c004390 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.450+0000 7f1875d1a640 1 -- 172.21.15.71:0/1725341918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 msgr2=0x7f1870136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.450+0000 7f1875d1a640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 0x7f1870136cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1854003820 tx=0x7f1860024b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.450+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1860033070 con 0x7f185c004390 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.450+0000 7f1866ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: dump: 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.466 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1860024e50 con 0x7f185c004390 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 5 monclient: authenticate success, global_id 74097 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 10 monclient: _renew_subs 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:16.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18701ce640 con 0x7f185c004390 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f186000f040 con 0x7f185c004390 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1866ffd640 10 monclient: dump: 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.468 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f1874d18640 4 set_mon_vals no callback set 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 10 monclient: _renew_subs 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.451+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18700a1830 con 0x7f185c004390 2024-08-19T11:16:16.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1860018b90 con 0x7f185c004390 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f1866ffd640 1 --2- 172.21.15.71:0/1725341918 >> v2:172.21.15.135:6800/726754104 conn(0x7f1854041950 0x7f1854043e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (secure 0 0 0) 0x7f1860053ec0 con 0x7f185c004390 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f187877f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f187877f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f187877f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1870138740 con 0x7f185c004390 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f187651b640 1 --2- 172.21.15.71:0/1725341918 >> v2:172.21.15.135:6800/726754104 conn(0x7f1854041950 0x7f1854043e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.452+0000 7f187651b640 10 monclient: get_auth_request con 0x7f1854041950 auth_method 0 2024-08-19T11:16:16.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.455+0000 7f187651b640 1 --2- 172.21.15.71:0/1725341918 >> v2:172.21.15.135:6800/726754104 conn(0x7f1854041950 0x7f1854043e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f186c033000 tx=0x7f186c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.457+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f1870138740 con 0x7f185c004390 2024-08-19T11:16:16.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.457+0000 7f1866ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:16.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.457+0000 7f1866ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:16.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f187877f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:16.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f187877f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:16.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f187877f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:16.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f18700a86f0 con 0x7f185c004390 2024-08-19T11:16:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f1866ffd640 1 -- 172.21.15.71:0/1725341918 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f18700a86f0 con 0x7f185c004390 2024-08-19T11:16:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f1866ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:16.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.706+0000 7f1866ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:16.709 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":128,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 >> v2:172.21.15.135:6800/726754104 conn(0x7f1854041950 msgr2=0x7f1854043e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 --2- 172.21.15.71:0/1725341918 >> v2:172.21.15.135:6800/726754104 conn(0x7f1854041950 0x7f1854043e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f186c033000 tx=0x7f186c03d040 comp rx=0 tx=0).stop 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 10 monclient: shutdown 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 msgr2=0x7f1870136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 0x7f1870136cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1854003820 tx=0x7f1860024b10 comp rx=0 tx=0).stop 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 shutdown_connections 2024-08-19T11:16:16.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 --2- 172.21.15.71:0/1725341918 >> v2:172.21.15.135:6800/726754104 conn(0x7f1854041950 0x7f1854043e10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f185c004fc0 0x7f1870137210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f185c004390 0x7f1870136cd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 --2- 172.21.15.71:0/1725341918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1854003cb0 0x7f18701ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 >> 172.21.15.71:0/1725341918 conn(0x7f18700ac030 msgr2=0x7f1870138030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:16.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 shutdown_connections 2024-08-19T11:16:16.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.709+0000 7f187877f640 1 -- 172.21.15.71:0/1725341918 wait complete. 2024-08-19T11:16:16.722 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:16:16.722 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:16:16.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.820+0000 7fd9947c3640 10 monclient: get_monmap_and_config 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.820+0000 7fd9947c3640 10 monclient: build_initial_monmap 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.820+0000 7fd9947c3640 10 monclient: monmap: 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:16.822286+0000 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:16.822286+0000 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:16.823 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 Processor -- start 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 -- start start 2024-08-19T11:16:16.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient: init 2024-08-19T11:16:16.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:16.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient: _add_conns ranks=[7,6,2,3,1,4,0,9,10,8,5] 2024-08-19T11:16:16.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd98c0a6950 0x7fd98c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): picked mon.noname-i con 0x7fd98c0a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 0x7fd98c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): picked mon.noname-d con 0x7fd98c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 0x7fd98c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): picked mon.noname-b con 0x7fd98c139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd98c0a5020 con 0x7fd98c139710 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd98c0a77b0 con 0x7fd98c0a57c0 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fd98c0a7d40 con 0x7fd98c0a6950 2024-08-19T11:16:16.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:16.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.821+0000 7fd9947c3640 10 monclient(hunting): authenticate will time out at 1034.863953s 2024-08-19T11:16:16.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 0x7fd98c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 0x7fd98c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 0x7fd98c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41694/0 (socket says 172.21.15.71:41694) 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 0x7fd98c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60872/0 (socket says 172.21.15.71:60872) 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 -- 172.21.15.71:0/3544274780 learned_addr learned my addr 172.21.15.71:0/3544274780 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): get_auth_request con 0x7fd98c139710 auth_method 0 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): get_auth_request con 0x7fd98c0a57c0 auth_method 0 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd99255f640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd98c0a6950 0x7fd98c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd99255f640 10 monclient(hunting): get_auth_request con 0x7fd98c0a6950 auth_method 0 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd99255f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd99255f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd99255f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient(hunting): handle_auth_done global_id 74099 payload 274 2024-08-19T11:16:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 -- 172.21.15.71:0/3544274780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd98c0a6950 msgr2=0x7fd98c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd98c0a6950 0x7fd98c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 -- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 msgr2=0x7fd98c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 0x7fd98c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient: _finish_hunting 0 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 monclient: found mon.noname-b 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd992d60640 1 -- 172.21.15.71:0/3544274780 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c0a6380 con 0x7fd98c139710 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.822+0000 7fd991d5e640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 0x7fd98c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd992d60640 1 -- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 msgr2=0x7fd98c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd992d60640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 0x7fd98c139b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd984009eb0 tx=0x7fd98402a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d14293798edaccc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 1 -- 172.21.15.71:0/3544274780 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd984036070 con 0x7fd98c139710 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: dump: 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: _finish_auth 0 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: _check_auth_tickets 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 5 monclient: authenticate success, global_id 74099 2024-08-19T11:16:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 1 -- 172.21.15.71:0/3544274780 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd984007a70 con 0x7fd98c139710 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 1 -- 172.21.15.71:0/3544274780 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd984007c60 con 0x7fd98c139710 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 4 set_mon_vals no callback set 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd99155d640 10 monclient: dump: 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 10 monclient: shutdown 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 -- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 msgr2=0x7fd98c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 0x7fd98c139b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd984009eb0 tx=0x7fd98402a560 comp rx=0 tx=0).stop 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 -- 172.21.15.71:0/3544274780 shutdown_connections 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd98c139710 0x7fd98c139b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd98c0a57c0 0x7fd98c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3544274780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fd98c0a6950 0x7fd98c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.825+0000 7fd9947c3640 1 -- 172.21.15.71:0/3544274780 >> 172.21.15.71:0/3544274780 conn(0x7fd98c0abf50 msgr2=0x7fd98c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 1 -- 172.21.15.71:0/3544274780 shutdown_connections 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 1 -- 172.21.15.71:0/3544274780 wait complete. 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 10 monclient: build_initial_monmap 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 10 monclient: monmap: 2024-08-19T11:16:16.844 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:16.845 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 1 Processor -- start 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 1 -- start start 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.826+0000 7fd9947c3640 10 monclient: init 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient: _add_conns ranks=[1,3,5,0,7,6,2,8,4] 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98c0a57c0 0x7fd98c1ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): picked mon.noname-f con 0x7fd98c0a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd98c0a6950 0x7fd98c1cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): picked mon.noname-g con 0x7fd98c0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd98c139710 0x7fd98c125090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): picked mon.noname-h con 0x7fd98c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:16.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c0a84c0 con 0x7fd98c0a57c0 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd98c0a3650 con 0x7fd98c0a6950 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd98c0a8700 con 0x7fd98c139710 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd9947c3640 10 monclient(hunting): authenticate will time out at 1034.869387s 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98c0a57c0 0x7fd98c1ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98c0a57c0 0x7fd98c1ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:37684/0 (socket says 172.21.15.71:37684) 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 1 -- 172.21.15.71:0/3341481506 learned_addr learned my addr 172.21.15.71:0/3341481506 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): get_auth_request con 0x7fd98c0a57c0 auth_method 0 2024-08-19T11:16:16.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd98c0a6950 0x7fd98c1cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): get_auth_request con 0x7fd98c0a6950 auth_method 0 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd98c139710 0x7fd98c125090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): get_auth_request con 0x7fd98c139710 auth_method 0 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd992d60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient(hunting): handle_auth_done global_id 44679 payload 824 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd98c139710 msgr2=0x7fd98c125090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd98c139710 0x7fd98c125090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98c0a57c0 msgr2=0x7fd98c1ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98c0a57c0 0x7fd98c1ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient: _finish_hunting 0 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 monclient: found mon.noname-g 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd991d5e640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c1383c0 con 0x7fd98c0a6950 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.827+0000 7fd99255f640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd98c0a57c0 0x7fd98c1ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd991d5e640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd98c0a6950 msgr2=0x7fd98c1cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd991d5e640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd98c0a6950 0x7fd98c1cf260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e900 tx=0x7fd97c00edc0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd97c017070 con 0x7fd98c0a6950 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: dump: 2024-08-19T11:16:16.850 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.851 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c00cc10 con 0x7fd98c0a6950 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 5 monclient: authenticate success, global_id 44679 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 10 monclient: _renew_subs 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98c126aa0 con 0x7fd98c0a6950 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd97c00cdc0 con 0x7fd98c0a6950 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd982ffd640 10 monclient: dump: 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd990d5c640 4 set_mon_vals no callback set 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 10 monclient: _renew_subs 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.830+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98c128560 con 0x7fd98c0a6950 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd9947c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 0x7fd98c1259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c06a590 con 0x7fd98c1255d0 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 0x7fd98c1259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient: get_auth_request con 0x7fd98c1255d0 auth_method 0 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd97c01a070 con 0x7fd98c0a6950 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 10 monclient(hunting): handle_auth_done global_id 74106 payload 824 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd99255f640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd98c0a1f60 con 0x7fd98c1255d0 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd982ffd640 1 --2- 172.21.15.71:0/3341481506 >> v2:172.21.15.135:6800/726754104 conn(0x7fd97003ea80 0x7fd970040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.831+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (secure 0 0 0) 0x7fd97c00f040 con 0x7fd98c0a6950 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.832+0000 7fd992d60640 1 --2- 172.21.15.71:0/3341481506 >> v2:172.21.15.135:6800/726754104 conn(0x7fd97003ea80 0x7fd970040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.832+0000 7fd992d60640 10 monclient: get_auth_request con 0x7fd97003ea80 auth_method 0 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.833+0000 7fd99255f640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 msgr2=0x7fd98c1259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.833+0000 7fd99255f640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 0x7fd98c1259b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd988010c60 tx=0x7fd98800e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd988018070 con 0x7fd98c1255d0 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 10 monclient: dump: 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.858 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.859 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd988014640 con 0x7fd98c1255d0 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 msgr2=0x7fd98c1259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 0x7fd98c1259b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd988010c60 tx=0x7fd98800e5a0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 msgr2=0x7fd98c1259b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd982ffd640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c1255d0 0x7fd98c1259b0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd988010c60 tx=0x7fd98800e5a0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.834+0000 7fd992d60640 1 --2- 172.21.15.71:0/3341481506 >> v2:172.21.15.135:6800/726754104 conn(0x7fd97003ea80 0x7fd970040f40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd984009e80 tx=0x7fd984009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd9947c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 0x7fd98c09fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd9947c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c076c60 con 0x7fd98c125ef0 2024-08-19T11:16:16.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 0x7fd98c09fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient: get_auth_request con 0x7fd98c125ef0 auth_method 0 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 10 monclient(hunting): handle_auth_done global_id 74115 payload 824 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.840+0000 7fd99255f640 1 -- 172.21.15.71:0/3341481506 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd98c0a6d30 con 0x7fd98c125ef0 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd99255f640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 msgr2=0x7fd98c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd99255f640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 0x7fd98c09fa10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd988019000 tx=0x7fd9880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd988014e40 con 0x7fd98c125ef0 2024-08-19T11:16:16.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 10 monclient: dump: 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:16.862 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9269 (secure 0 0 0) 0x7fd988014e40 con 0x7fd98c125ef0 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 msgr2=0x7fd98c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 0x7fd98c09fa10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd988019000 tx=0x7fd9880046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 msgr2=0x7fd98c09fa10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:16.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd982ffd640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd98c125ef0 0x7fd98c09fa10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 25876, 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:16.871 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:16.873 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:16.876 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.880 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.882 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:16.885 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:16.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:16.887 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:16.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 >> v2:172.21.15.135:6800/726754104 conn(0x7fd97003ea80 msgr2=0x7fd970040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3341481506 >> v2:172.21.15.135:6800/726754104 conn(0x7fd97003ea80 0x7fd970040f40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd984009e80 tx=0x7fd984009000 comp rx=0 tx=0).stop 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 10 monclient: shutdown 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd98c0a6950 msgr2=0x7fd98c1cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 --2- 172.21.15.71:0/3341481506 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd98c0a6950 0x7fd98c1cf260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e900 tx=0x7fd97c00edc0 comp rx=0 tx=0).stop 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd992d60640 1 -- 172.21.15.71:0/3341481506 reap_dead start 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd992d60640 1 -- 172.21.15.71:0/3341481506 reap_dead start 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 shutdown_connections 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 >> 172.21.15.71:0/3341481506 conn(0x7fd98c0abf50 msgr2=0x7fd98c138f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 shutdown_connections 2024-08-19T11:16:16.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.843+0000 7fd9947c3640 1 -- 172.21.15.71:0/3341481506 wait complete. 2024-08-19T11:16:16.890 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:16.890 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:16:16.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.985+0000 7fc273eec640 10 monclient: get_monmap_and_config 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.985+0000 7fc273eec640 10 monclient: build_initial_monmap 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.985+0000 7fc273eec640 10 monclient: monmap: 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:16.987267+0000 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:16.987267+0000 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:16.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 Processor -- start 2024-08-19T11:16:16.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 -- start start 2024-08-19T11:16:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient: init 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient: _add_conns ranks=[2,10,7,1,6,4,0,8,5,3,9] 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): picked mon.noname-b con 0x7fc26c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc26c0a57c0 0x7fc26c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): picked mon.noname-f con 0x7fc26c0a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c139710 0x7fc26c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): picked mon.noname-i con 0x7fc26c139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc26c0a5020 con 0x7fc26c0a57c0 2024-08-19T11:16:16.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c0a77b0 con 0x7fc26c0a6950 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc26c0a7d40 con 0x7fc26c139710 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.986+0000 7fc273eec640 10 monclient(hunting): authenticate will time out at 1035.028946s 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41702/0 (socket says 172.21.15.71:41702) 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 -- 172.21.15.71:0/2019628180 learned_addr learned my addr 172.21.15.71:0/2019628180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): get_auth_request con 0x7fc26c0a6950 auth_method 0 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc272489640 1 --2- 172.21.15.71:0/2019628180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c139710 0x7fc26c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271487640 1 --2- 172.21.15.71:0/2019628180 >> v2:172.21.15.135:3300/0 conn(0x7fc26c0a57c0 0x7fc26c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc272489640 10 monclient(hunting): get_auth_request con 0x7fc26c139710 auth_method 0 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc272489640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc272489640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc272489640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271487640 10 monclient(hunting): get_auth_request con 0x7fc26c0a57c0 auth_method 0 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271487640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271487640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient(hunting): handle_auth_done global_id 74108 payload 274 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 -- 172.21.15.71:0/2019628180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c139710 msgr2=0x7fc26c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 --2- 172.21.15.71:0/2019628180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c139710 0x7fc26c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 -- 172.21.15.71:0/2019628180 >> v2:172.21.15.135:3300/0 conn(0x7fc26c0a57c0 msgr2=0x7fc26c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 --2- 172.21.15.71:0/2019628180 >> v2:172.21.15.135:3300/0 conn(0x7fc26c0a57c0 0x7fc26c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 monclient: found mon.noname-b 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.987+0000 7fc271c88640 1 -- 172.21.15.71:0/2019628180 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c0a6380 con 0x7fc26c0a6950 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc271c88640 1 -- 172.21.15.71:0/2019628180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 msgr2=0x7fc26c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc271c88640 1 --2- 172.21.15.71:0/2019628180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c0a6d30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2680098d0 tx=0x7fc26802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8df2a82e346c1d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 1 -- 172.21.15.71:0/2019628180 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc268037070 con 0x7fc26c0a6950 2024-08-19T11:16:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: dump: 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.003 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 5 monclient: authenticate success, global_id 74108 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 1 -- 172.21.15.71:0/2019628180 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26802ae20 con 0x7fc26c0a6950 2024-08-19T11:16:17.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 1 -- 172.21.15.71:0/2019628180 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc268030c20 con 0x7fc26c0a6950 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 4 set_mon_vals no callback set 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc270c86640 10 monclient: dump: 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 10 monclient: shutdown 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 -- 172.21.15.71:0/2019628180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 msgr2=0x7fc26c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 --2- 172.21.15.71:0/2019628180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c0a6d30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2680098d0 tx=0x7fc26802a100 comp rx=0 tx=0).stop 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 -- 172.21.15.71:0/2019628180 shutdown_connections 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 --2- 172.21.15.71:0/2019628180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c139710 0x7fc26c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 --2- 172.21.15.71:0/2019628180 >> v2:172.21.15.135:3300/0 conn(0x7fc26c0a57c0 0x7fc26c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 --2- 172.21.15.71:0/2019628180 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c0a6d30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 -- 172.21.15.71:0/2019628180 >> 172.21.15.71:0/2019628180 conn(0x7fc26c0abf50 msgr2=0x7fc26c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 -- 172.21.15.71:0/2019628180 shutdown_connections 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.990+0000 7fc273eec640 1 -- 172.21.15.71:0/2019628180 wait complete. 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.991+0000 7fc273eec640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.991+0000 7fc273eec640 10 monclient: monmap: 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.007 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.008 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.991+0000 7fc273eec640 1 Processor -- start 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.991+0000 7fc273eec640 1 -- start start 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.991+0000 7fc273eec640 10 monclient: init 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient: _add_conns ranks=[7,2,0,6,5,8,4,1,3] 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c0a57c0 0x7fc26c1ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): picked mon.noname-i con 0x7fc26c0a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c1cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): picked mon.noname-b con 0x7fc26c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 0x7fc26c1cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): picked mon.noname-a con 0x7fc26c139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:17.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc26c0a84c0 con 0x7fc26c139710 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c0a3650 con 0x7fc26c0a6950 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc26c0a8700 con 0x7fc26c0a57c0 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc273eec640 10 monclient(hunting): authenticate will time out at 1035.034367s 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c1cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 0x7fc26c1cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c1cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41708/0 (socket says 172.21.15.71:41708) 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 1 -- 172.21.15.71:0/2853981573 learned_addr learned my addr 172.21.15.71:0/2853981573 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): get_auth_request con 0x7fc26c0a6950 auth_method 0 2024-08-19T11:16:17.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): get_auth_request con 0x7fc26c139710 auth_method 0 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c0a57c0 0x7fc26c1ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): get_auth_request con 0x7fc26c0a57c0 auth_method 0 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient(hunting): handle_auth_done global_id 74124 payload 824 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c0a57c0 msgr2=0x7fc26c1ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc26c0a57c0 0x7fc26c1ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 msgr2=0x7fc26c1cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c1cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 monclient: found mon.noname-a 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc272489640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26c13a170 con 0x7fc26c139710 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.992+0000 7fc271487640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c0a6950 0x7fc26c1cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc272489640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 msgr2=0x7fc26c1cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc272489640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 0x7fc26c1cf3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc264007cf0 tx=0x7fc26400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc2640098b0 con 0x7fc26c139710 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: dump: 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.013 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.014 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264014890 con 0x7fc26c139710 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 5 monclient: authenticate success, global_id 74124 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 10 monclient: _renew_subs 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26c127d60 con 0x7fc26c139710 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc264013380 con 0x7fc26c139710 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:17.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc2627fc640 10 monclient: dump: 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc263fff640 4 set_mon_vals no callback set 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 10 monclient: _renew_subs 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.995+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26c128bd0 con 0x7fc26c139710 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc273eec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc273eec640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 0x7fc26c1252f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c128850 con 0x7fc26c124f10 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc272489640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 0x7fc26c1cf3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc264007cf0 tx=0x7fc26400e4b0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fc264019020 osd_map(169..169 src has 1..169) 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc26401b030 con 0x7fc26c139710 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 0x7fc26c1252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient: get_auth_request con 0x7fc26c124f10 auth_method 0 2024-08-19T11:16:17.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc2627fc640 1 --2- 172.21.15.71:0/2853981573 >> v2:172.21.15.135:6800/726754104 conn(0x7fc25003ea80 0x7fc250040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 10 monclient(hunting): handle_auth_done global_id 74126 payload 824 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271c88640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc26c0a1f70 con 0x7fc26c124f10 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271487640 1 --2- 172.21.15.71:0/2853981573 >> v2:172.21.15.135:6800/726754104 conn(0x7fc25003ea80 0x7fc250040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.996+0000 7fc271487640 10 monclient: get_auth_request con 0x7fc25003ea80 auth_method 0 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.998+0000 7fc271c88640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 msgr2=0x7fc26c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.998+0000 7fc271c88640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 0x7fc26c1252f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0a5730 tx=0x7fc2680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.998+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc268042070 con 0x7fc26c124f10 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.998+0000 7fc2627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.998+0000 7fc2627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.998+0000 7fc2627fc640 10 monclient: dump: 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.021 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc268003a30 con 0x7fc26c124f10 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 msgr2=0x7fc26c1252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 0x7fc26c1252f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0a5730 tx=0x7fc2680046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 msgr2=0x7fc26c1252f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc2627fc640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c124f10 0x7fc26c1252f0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0a5730 tx=0x7fc2680046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:16.999+0000 7fc271487640 1 --2- 172.21.15.71:0/2853981573 >> v2:172.21.15.135:6800/726754104 conn(0x7fc25003ea80 0x7fc250040f40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc26c126ee0 tx=0x7fc25c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc273eec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc273eec640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 0x7fc26c09fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc273eec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc26c076c60 con 0x7fc26c125830 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 0x7fc26c09fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient: get_auth_request con 0x7fc26c125830 auth_method 0 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 10 monclient(hunting): handle_auth_done global_id 74135 payload 824 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.005+0000 7fc271c88640 1 -- 172.21.15.71:0/2853981573 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc26c0a6d30 con 0x7fc26c125830 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.007+0000 7fc271c88640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 msgr2=0x7fc26c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.007+0000 7fc271c88640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 0x7fc26c09fa10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc26802a140 tx=0x7fc268009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.007+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc268037040 con 0x7fc26c125830 2024-08-19T11:16:17.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.007+0000 7fc2627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.007+0000 7fc2627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.007+0000 7fc2627fc640 10 monclient: dump: 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.025 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fc268030b60 con 0x7fc26c125830 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 msgr2=0x7fc26c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 0x7fc26c09fa10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc26802a140 tx=0x7fc268009240 comp rx=0 tx=0).stop 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 msgr2=0x7fc26c09fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc26c125830 0x7fc26c09fa10 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc26802a140 tx=0x7fc268009240 comp rx=0 tx=0).stop 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 26039, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:17.027 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.028 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:17.030 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.031 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.032 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:17.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:17.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.039 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.050 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:17.050 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:17.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 >> v2:172.21.15.135:6800/726754104 conn(0x7fc25003ea80 msgr2=0x7fc250040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 --2- 172.21.15.71:0/2853981573 >> v2:172.21.15.135:6800/726754104 conn(0x7fc25003ea80 0x7fc250040f40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc26c126ee0 tx=0x7fc25c008040 comp rx=0 tx=0).stop 2024-08-19T11:16:17.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 10 monclient: shutdown 2024-08-19T11:16:17.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 msgr2=0x7fc26c1cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc272489640 1 -- 172.21.15.71:0/2853981573 reap_dead start 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 0x7fc26c1cf3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc264007cf0 tx=0x7fc26400e4b0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc2627fc640 1 -- 172.21.15.71:0/2853981573 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (unknown 0 0 0) 0x7fc264019020 con 0x7fc26c139710 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 shutdown_connections 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 --2- 172.21.15.71:0/2853981573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc26c139710 0x7fc26c1cf3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 >> 172.21.15.71:0/2853981573 conn(0x7fc26c0abf50 msgr2=0x7fc26c138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 shutdown_connections 2024-08-19T11:16:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.008+0000 7fc273eec640 1 -- 172.21.15.71:0/2853981573 wait complete. 2024-08-19T11:16:17.052 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:17.052 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:16:17.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.149+0000 7f6eedec5640 10 monclient: get_monmap_and_config 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.149+0000 7f6eedec5640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.149+0000 7f6eedec5640 10 monclient: monmap: 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:17.150914+0000 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:17.150914+0000 2024-08-19T11:16:17.151 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:17.152 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 Processor -- start 2024-08-19T11:16:17.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 -- start start 2024-08-19T11:16:17.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient: init 2024-08-19T11:16:17.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient: _add_conns ranks=[6,0,7,3,4,9,8,10,2,1,5] 2024-08-19T11:16:17.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 0x7f6ee80a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): picked mon.noname-d con 0x7f6ee80a57d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6ee80a5bb0 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee813c9d0 0x7f6ee813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): picked mon.noname-i con 0x7f6ee813c9d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee80728a0 con 0x7f6ee80a5bb0 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f6ee80a41b0 con 0x7f6ee80a57d0 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6ee8072620 con 0x7f6ee813c9d0 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6eedec5640 10 monclient(hunting): authenticate will time out at 1035.192709s 2024-08-19T11:16:17.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 0x7f6ee80a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6edeffd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6ee80a5bb0 0x7f6ee80a5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49312/0 (socket says 172.21.15.71:49312) 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6edeffd640 1 -- 172.21.15.71:0/915993085 learned_addr learned my addr 172.21.15.71:0/915993085 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): get_auth_request con 0x7f6ee80a57d0 auth_method 0 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee7fff640 1 --2- 172.21.15.71:0/915993085 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee813c9d0 0x7f6ee813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee7fff640 10 monclient(hunting): get_auth_request con 0x7f6ee813c9d0 auth_method 0 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.150+0000 7f6ee7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_done global_id 25575 payload 274 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 1 -- 172.21.15.71:0/915993085 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee813c9d0 msgr2=0x7f6ee813edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/915993085 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee813c9d0 0x7f6ee813edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 1 -- 172.21.15.71:0/915993085 >> v1:172.21.15.71:6789/0 conn(0x7f6ee80a5bb0 legacy=0x7f6ee80a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 1 monclient: found mon.noname-d 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:17.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.151+0000 7f6ee77fe640 1 -- 172.21.15.71:0/915993085 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee8073940 con 0x7f6ee80a57d0 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.153+0000 7f6ee77fe640 1 -- 172.21.15.71:0/915993085 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 msgr2=0x7f6ee80a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.153+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/915993085 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 0x7f6ee80a1780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80097d0 tx=0x7f6ed802a030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=97059f2f0817770a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.153+0000 7f6ee6ffd640 1 -- 172.21.15.71:0/915993085 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ed8037070 con 0x7f6ee80a57d0 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.153+0000 7f6ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.153+0000 7f6ee6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.153+0000 7f6ee6ffd640 10 monclient: dump: 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.160 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 5 monclient: authenticate success, global_id 25575 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 1 -- 172.21.15.71:0/915993085 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed802ad90 con 0x7f6ee80a57d0 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 4 set_mon_vals no callback set 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 1 -- 172.21.15.71:0/915993085 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ed8030c20 con 0x7f6ee80a57d0 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6ee6ffd640 10 monclient: dump: 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.162 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 10 monclient: shutdown 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 -- 172.21.15.71:0/915993085 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 msgr2=0x7f6ee80a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 --2- 172.21.15.71:0/915993085 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 0x7f6ee80a1780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80097d0 tx=0x7f6ed802a030 comp rx=0 tx=0).stop 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 -- 172.21.15.71:0/915993085 shutdown_connections 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 --2- 172.21.15.71:0/915993085 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee813c9d0 0x7f6ee813edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 --2- 172.21.15.71:0/915993085 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6ee80a57d0 0x7f6ee80a1780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 -- 172.21.15.71:0/915993085 >> 172.21.15.71:0/915993085 conn(0x7f6ee80aa3f0 msgr2=0x7f6ee80a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 -- 172.21.15.71:0/915993085 shutdown_connections 2024-08-19T11:16:17.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.154+0000 7f6eedec5640 1 -- 172.21.15.71:0/915993085 wait complete. 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.155+0000 7f6eedec5640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.155+0000 7f6eedec5640 10 monclient: monmap: 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.155+0000 7f6eedec5640 1 Processor -- start 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.155+0000 7f6eedec5640 1 -- start start 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.155+0000 7f6eedec5640 10 monclient: init 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient: _add_conns ranks=[5,7,4,6,3,0,2,8,1] 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ee80a57d0 0x7f6ee8124150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): picked mon.noname-h con 0x7f6ee80a57d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee80a5bb0 0x7f6ee81ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): picked mon.noname-i con 0x7f6ee80a5bb0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 0x7f6ee813afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): picked mon.noname-c con 0x7f6ee813c9d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6ee806db30 con 0x7f6ee813c9d0 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6ee806d9b0 con 0x7f6ee80a57d0 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6ee806dcb0 con 0x7f6ee80a5bb0 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6eedec5640 10 monclient(hunting): authenticate will time out at 1035.198200s 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 0x7f6ee813afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 0x7f6ee813afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:51192/0 (socket says 172.21.15.71:51192) 2024-08-19T11:16:17.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 -- 172.21.15.71:0/1307037617 learned_addr learned my addr 172.21.15.71:0/1307037617 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): get_auth_request con 0x7f6ee813c9d0 auth_method 0 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ee80a57d0 0x7f6ee8124150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee80a5bb0 0x7f6ee81ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): get_auth_request con 0x7f6ee80a57d0 auth_method 0 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): get_auth_request con 0x7f6ee80a5bb0 auth_method 0 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6edeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient(hunting): handle_auth_done global_id 74101 payload 824 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee80a5bb0 msgr2=0x7f6ee81ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ee80a5bb0 0x7f6ee81ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ee80a57d0 msgr2=0x7f6ee8124150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ee80a57d0 0x7f6ee8124150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 monclient: found mon.noname-c 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.156+0000 7f6ee7fff640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee80a94b0 con 0x7f6ee813c9d0 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.158+0000 7f6ee7fff640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 msgr2=0x7f6ee813afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.158+0000 7f6ee7fff640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 0x7f6ee813afc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000efc0 tx=0x7f6ee000c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ee0018020 con 0x7f6ee813c9d0 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:17.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: dump: 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee00148f0 con 0x7f6ee813c9d0 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 5 monclient: authenticate success, global_id 74101 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ee00133e0 con 0x7f6ee813c9d0 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 10 monclient: _renew_subs 2024-08-19T11:16:17.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee81250b0 con 0x7f6ee813c9d0 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 10 monclient: dump: 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.178 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee67fc640 4 set_mon_vals no callback set 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 10 monclient: _renew_subs 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee8125670 con 0x7f6ee813c9d0 2024-08-19T11:16:17.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 0x7f6ee81c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6ee0005d10 con 0x7f6ee813c9d0 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.159+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6ee8076c60 con 0x7f6ee813b500 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 0x7f6ee81c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient: get_auth_request con 0x7f6ee813b500 auth_method 0 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee4ff9640 1 --2- 172.21.15.71:0/1307037617 >> v2:172.21.15.135:6800/726754104 conn(0x7f6ec803eab0 0x7f6ec8040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (secure 0 0 0) 0x7f6ee0052940 con 0x7f6ee813c9d0 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_done global_id 74110 payload 824 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6ee77fe640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ee80a3c30 con 0x7f6ee813b500 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6edeffd640 1 --2- 172.21.15.71:0/1307037617 >> v2:172.21.15.135:6800/726754104 conn(0x7f6ec803eab0 0x7f6ec8040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.160+0000 7f6edeffd640 10 monclient: get_auth_request con 0x7f6ec803eab0 auth_method 0 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6ee77fe640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 msgr2=0x7f6ee81c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 0x7f6ee81c6bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80a7270 tx=0x7f6ed80046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ed8042070 con 0x7f6ee813b500 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6ee4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6ee4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6ee4ff9640 10 monclient: dump: 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.181 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.162+0000 7f6edeffd640 1 --2- 172.21.15.71:0/1307037617 >> v2:172.21.15.135:6800/726754104 conn(0x7f6ec803eab0 0x7f6ec8040f70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007c90 tx=0x7f6ed0007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6ed802ad90 con 0x7f6ee813b500 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 msgr2=0x7f6ee81c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 0x7f6ee81c6bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80a7270 tx=0x7f6ed80046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 msgr2=0x7f6ee81c6bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.163+0000 7f6ee4ff9640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813b500 0x7f6ee81c6bf0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80a7270 tx=0x7f6ed80046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6eedec5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6eedec5640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 0x7f6ee81c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6eedec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6ee81cb090 con 0x7f6ee81c7130 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 0x7f6ee81c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient: get_auth_request con 0x7f6ee81c7130 auth_method 0 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 10 monclient(hunting): handle_auth_done global_id 74119 payload 824 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.169+0000 7f6ee77fe640 1 -- 172.21.15.71:0/1307037617 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ee81c7a50 con 0x7f6ee81c7130 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.171+0000 7f6ee77fe640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 msgr2=0x7f6ee81c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.171+0000 7f6ee77fe640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 0x7f6ee81c7510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802a070 tx=0x7f6ed8008030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.171+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ed8054020 con 0x7f6ee81c7130 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.171+0000 7f6ee4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.171+0000 7f6ee4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.171+0000 7f6ee4ff9640 10 monclient: dump: 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.186 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f6ed803dd50 con 0x7f6ee81c7130 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 msgr2=0x7f6ee81c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 0x7f6ee81c7510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6ed802a070 tx=0x7f6ed8008030 comp rx=0 tx=0).stop 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 msgr2=0x7f6ee81c7510 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee4ff9640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee81c7130 0x7f6ee81c7510 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.188 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 26204, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:17.189 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.190 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.191 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:17.192 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.193 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.194 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.199 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:17.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:17.211 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 >> v2:172.21.15.135:6800/726754104 conn(0x7f6ec803eab0 msgr2=0x7f6ec8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 --2- 172.21.15.71:0/1307037617 >> v2:172.21.15.135:6800/726754104 conn(0x7f6ec803eab0 0x7f6ec8040f70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007c90 tx=0x7f6ed0007be0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 10 monclient: shutdown 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 msgr2=0x7f6ee813afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 0x7f6ee813afc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000efc0 tx=0x7f6ee000c490 comp rx=0 tx=0).stop 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6ee7fff640 1 -- 172.21.15.71:0/1307037617 reap_dead start 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 shutdown_connections 2024-08-19T11:16:17.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 --2- 172.21.15.71:0/1307037617 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6ee813c9d0 0x7f6ee813afc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 >> 172.21.15.71:0/1307037617 conn(0x7f6ee80aa3f0 msgr2=0x7f6ee80a7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 shutdown_connections 2024-08-19T11:16:17.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.172+0000 7f6eedec5640 1 -- 172.21.15.71:0/1307037617 wait complete. 2024-08-19T11:16:17.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:17.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:16:17.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.310+0000 7fb36fbaa640 10 monclient: get_monmap_and_config 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.310+0000 7fb36fbaa640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.310+0000 7fb36fbaa640 10 monclient: monmap: 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:17.311937+0000 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:17.311937+0000 2024-08-19T11:16:17.312 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:17.313 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.310+0000 7fb36fbaa640 1 Processor -- start 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 1 -- start start 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient: init 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient: _add_conns ranks=[8,6,0,9,2,7,5,10,3,1,4] 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 0x7fb3680a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): picked mon.noname-e con 0x7fb3680a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3680a57c0 0x7fb3680a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): picked mon.noname-d con 0x7fb3680a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb368139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680a6380 con 0x7fb368139710 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb3680a5020 con 0x7fb3680a57c0 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fb3680a77b0 con 0x7fb3680a6950 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36fbaa640 10 monclient(hunting): authenticate will time out at 1035.353648s 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3680a57c0 0x7fb3680a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 0x7fb3680a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36e147640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb368139710 0x7fb368139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49326/0 (socket says 172.21.15.71:49326) 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36e147640 1 -- 172.21.15.71:0/706873545 learned_addr learned my addr 172.21.15.71:0/706873545 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): get_auth_request con 0x7fb3680a6950 auth_method 0 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): get_auth_request con 0x7fb3680a57c0 auth_method 0 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.311+0000 7fb36d145640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 10 monclient(hunting): handle_auth_done global_id 64412 payload 274 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 1 -- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3680a57c0 msgr2=0x7fb3680a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 1 --2- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3680a57c0 0x7fb3680a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 1 -- 172.21.15.71:0/706873545 >> v1:172.21.15.71:6789/0 conn(0x7fb368139710 legacy=0x7fb368139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 1 monclient: found mon.noname-e 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d946640 1 -- 172.21.15.71:0/706873545 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680a3650 con 0x7fb3680a6950 2024-08-19T11:16:17.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.312+0000 7fb36d145640 1 --2- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3680a57c0 0x7fb3680a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.314+0000 7fb36d946640 1 -- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 msgr2=0x7fb3680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.314+0000 7fb36d946640 1 --2- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 0x7fb3680a6d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb358009800 tx=0x7fb358029fd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c8d11dff8ecfc8d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.314+0000 7fb36c944640 1 -- 172.21.15.71:0/706873545 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb358037070 con 0x7fb3680a6950 2024-08-19T11:16:17.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:17.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: dump: 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.327 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 5 monclient: authenticate success, global_id 64412 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 1 -- 172.21.15.71:0/706873545 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35802acf0 con 0x7fb3680a6950 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 4 set_mon_vals no callback set 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 1 -- 172.21.15.71:0/706873545 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb358030c20 con 0x7fb3680a6950 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:17.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36c944640 10 monclient: dump: 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.329 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 10 monclient: shutdown 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 -- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 msgr2=0x7fb3680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 0x7fb3680a6d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb358009800 tx=0x7fb358029fd0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 -- 172.21.15.71:0/706873545 shutdown_connections 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3680a57c0 0x7fb3680a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/706873545 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb3680a6950 0x7fb3680a6d30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 -- 172.21.15.71:0/706873545 >> 172.21.15.71:0/706873545 conn(0x7fb3680abf50 msgr2=0x7fb3680ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 -- 172.21.15.71:0/706873545 shutdown_connections 2024-08-19T11:16:17.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.315+0000 7fb36fbaa640 1 -- 172.21.15.71:0/706873545 wait complete. 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.316+0000 7fb36fbaa640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.316+0000 7fb36fbaa640 10 monclient: monmap: 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.331 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.316+0000 7fb36fbaa640 1 Processor -- start 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.316+0000 7fb36fbaa640 1 -- start start 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.316+0000 7fb36fbaa640 10 monclient: init 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient: _add_conns ranks=[0,5,4,3,2,8,7,6,1] 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3680a57c0 0x7fb368124ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): picked mon.noname-a con 0x7fb3680a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3680a6950 0x7fb368125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): picked mon.noname-h con 0x7fb3680a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:17.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 0x7fb368125760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): picked mon.noname-c con 0x7fb368139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680a84c0 con 0x7fb3680a57c0 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb3680a7d40 con 0x7fb368139710 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb3680a8700 con 0x7fb3680a6950 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36fbaa640 10 monclient(hunting): authenticate will time out at 1035.359092s 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3680a57c0 0x7fb368124ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3680a57c0 0x7fb368124ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54568/0 (socket says 172.21.15.71:54568) 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 1 -- 172.21.15.71:0/4075926399 learned_addr learned my addr 172.21.15.71:0/4075926399 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): get_auth_request con 0x7fb3680a57c0 auth_method 0 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 0x7fb368125760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): get_auth_request con 0x7fb368139710 auth_method 0 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d145640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3680a6950 0x7fb368125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d145640 10 monclient(hunting): get_auth_request con 0x7fb3680a6950 auth_method 0 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d145640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d145640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d145640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient(hunting): handle_auth_done global_id 74128 payload 824 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3680a6950 msgr2=0x7fb368125220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3680a6950 0x7fb368125220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3680a57c0 msgr2=0x7fb368124ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3680a57c0 0x7fb368124ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 monclient: found mon.noname-c 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36e147640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb368128b00 con 0x7fb368139710 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.317+0000 7fb36d946640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3680a57c0 0x7fb368124ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36e147640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 msgr2=0x7fb368125760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36e147640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 0x7fb368125760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb36000be10 tx=0x7fb36000bf00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb360011b90 con 0x7fb368139710 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: dump: 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360011d70 con 0x7fb368139710 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 5 monclient: authenticate success, global_id 74128 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 10 monclient: _renew_subs 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3680a1f00 con 0x7fb368139710 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb360013870 con 0x7fb368139710 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35e7fc640 10 monclient: dump: 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.338 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.339 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 10 monclient: _renew_subs 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb35ffff640 4 set_mon_vals no callback set 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.319+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb368127c90 con 0x7fb368139710 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36fbaa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 0x7fb368063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb3680a3f10 con 0x7fb36802e340 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36e147640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 0x7fb368125760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb36000be10 tx=0x7fb36000bf00 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fb360052340 osd_map(169..169 src has 1..169) 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb360013400 con 0x7fb368139710 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 0x7fb368063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient: get_auth_request con 0x7fb36802e340 auth_method 0 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.320+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.321+0000 7fb36d946640 10 monclient(hunting): handle_auth_done global_id 25593 payload 824 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.321+0000 7fb36d946640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb36802e720 con 0x7fb36802e340 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.321+0000 7fb35e7fc640 1 --2- 172.21.15.71:0/4075926399 >> v2:172.21.15.135:6800/726754104 conn(0x7fb34c03ea80 0x7fb34c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.321+0000 7fb36d145640 1 --2- 172.21.15.71:0/4075926399 >> v2:172.21.15.135:6800/726754104 conn(0x7fb34c03ea80 0x7fb34c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.321+0000 7fb36d145640 10 monclient: get_auth_request con 0x7fb34c03ea80 auth_method 0 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb36d946640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 msgr2=0x7fb368063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb36d946640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 0x7fb368063a80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb35802bfd0 tx=0x7fb3580046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb358043070 con 0x7fb36802e340 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 10 monclient: dump: 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb358048450 con 0x7fb36802e340 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:17.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 msgr2=0x7fb368063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 0x7fb368063a80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb35802bfd0 tx=0x7fb3580046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 msgr2=0x7fb368063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb35e7fc640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb36802e340 0x7fb368063a80 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb35802bfd0 tx=0x7fb3580046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.323+0000 7fb36d145640 1 --2- 172.21.15.71:0/4075926399 >> v2:172.21.15.135:6800/726754104 conn(0x7fb34c03ea80 0x7fb34c040f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb364009560 tx=0x7fb364008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36fbaa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 0x7fb3681d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36fbaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb368076c60 con 0x7fb368063fc0 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36d946640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 0x7fb3681d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36d946640 10 monclient: get_auth_request con 0x7fb368063fc0 auth_method 0 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36d946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36d946640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.329+0000 7fb36d946640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.330+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.330+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.330+0000 7fb36d946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.330+0000 7fb36d946640 10 monclient(hunting): handle_auth_done global_id 25602 payload 824 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.330+0000 7fb36d946640 1 -- 172.21.15.71:0/4075926399 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3680a6d30 con 0x7fb368063fc0 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb36d946640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 msgr2=0x7fb3681d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb36d946640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 0x7fb3681d8990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb35802a010 tx=0x7fb358008030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb358037040 con 0x7fb368063fc0 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 10 monclient: dump: 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.347 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.348 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7fb35803c440 con 0x7fb368063fc0 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 msgr2=0x7fb3681d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 0x7fb3681d8990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb35802a010 tx=0x7fb358008030 comp rx=0 tx=0).stop 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 msgr2=0x7fb3681d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.332+0000 7fb35e7fc640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb368063fc0 0x7fb3681d8990 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb35802a010 tx=0x7fb358008030 comp rx=0 tx=0).stop 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:17.349 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 284947, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:17.350 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.351 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.352 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:17.353 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.358 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:17.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:17.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.370 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:17.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.372 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:17.373 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:17.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 >> v2:172.21.15.135:6800/726754104 conn(0x7fb34c03ea80 msgr2=0x7fb34c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/4075926399 >> v2:172.21.15.135:6800/726754104 conn(0x7fb34c03ea80 0x7fb34c040f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb364009560 tx=0x7fb364008040 comp rx=0 tx=0).stop 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 10 monclient: shutdown 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 msgr2=0x7fb368125760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 --2- 172.21.15.71:0/4075926399 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb368139710 0x7fb368125760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb36000be10 tx=0x7fb36000bf00 comp rx=0 tx=0).stop 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36e147640 1 -- 172.21.15.71:0/4075926399 reap_dead start 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36e147640 1 -- 172.21.15.71:0/4075926399 reap_dead start 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb35e7fc640 1 -- 172.21.15.71:0/4075926399 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (unknown 0 0 0) 0x7fb360052340 con 0x7fb368139710 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 shutdown_connections 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 >> 172.21.15.71:0/4075926399 conn(0x7fb3680abf50 msgr2=0x7fb368138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 shutdown_connections 2024-08-19T11:16:17.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.333+0000 7fb36fbaa640 1 -- 172.21.15.71:0/4075926399 wait complete. 2024-08-19T11:16:17.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:17.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:16:17.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:16:17.469 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:17.469 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: starting. 2024-08-19T11:16:17.469 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26574 2024-08-19T11:16:17.469 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: created object 0... 2024-08-19T11:16:17.469 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: created object 25... 2024-08-19T11:16:17.469 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: created object 49... 2024-08-19T11:16:17.470 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: finishing. 2024-08-19T11:16:17.470 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26611]: shutting down. 2024-08-19T11:16:17.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.481+0000 7f0f165e9640 10 monclient: get_monmap_and_config 2024-08-19T11:16:17.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.481+0000 7f0f165e9640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.481+0000 7f0f165e9640 10 monclient: monmap: 2024-08-19T11:16:17.483 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:17.483414+0000 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:17.483414+0000 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.484 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.485 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:17.485 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:17.485 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.482+0000 7f0f165e9640 1 Processor -- start 2024-08-19T11:16:17.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.482+0000 7f0f165e9640 1 -- start start 2024-08-19T11:16:17.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.482+0000 7f0f165e9640 10 monclient: init 2024-08-19T11:16:17.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient: _add_conns ranks=[3,7,1,0,5,2,9,4,10,6,8] 2024-08-19T11:16:17.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100a6950 0x7f0f100a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): picked mon.noname-g con 0x7f0f100a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 0x7f0f100a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): picked mon.noname-i con 0x7f0f100a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0f10139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f100a6380 con 0x7f0f10139710 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0f100a5020 con 0x7f0f100a6950 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0f100a77b0 con 0x7f0f100a57c0 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f165e9640 10 monclient(hunting): authenticate will time out at 1035.525223s 2024-08-19T11:16:17.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 0x7f0f100a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100a6950 0x7f0f100a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f14b86640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0f10139710 0x7f0f10139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:45796/0 (socket says 172.21.15.71:45796) 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f14b86640 1 -- 172.21.15.71:0/2423994379 learned_addr learned my addr 172.21.15.71:0/2423994379 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): get_auth_request con 0x7f0f100a57c0 auth_method 0 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): get_auth_request con 0x7f0f100a6950 auth_method 0 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient(hunting): handle_auth_done global_id 64474 payload 274 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 1 -- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100a6950 msgr2=0x7f0f100a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100a6950 0x7f0f100a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 1 -- 172.21.15.71:0/2423994379 >> v1:172.21.15.135:6789/0 conn(0x7f0f10139710 legacy=0x7f0f10139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 1 monclient: found mon.noname-i 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:16:17.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f07fff640 1 -- 172.21.15.71:0/2423994379 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f100a3650 con 0x7f0f100a57c0 2024-08-19T11:16:17.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.483+0000 7f0f0ffff640 1 --2- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100a6950 0x7f0f100a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f07fff640 1 -- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 msgr2=0x7f0f100a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 0x7f0f100a7270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009800 tx=0x7f0ef8029fe0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=1d1952a65e9d7721 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 1 -- 172.21.15.71:0/2423994379 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ef8037070 con 0x7f0f100a57c0 2024-08-19T11:16:17.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: dump: 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.499 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f165e9640 5 monclient: authenticate success, global_id 64474 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 1 -- 172.21.15.71:0/2423994379 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef802ad00 con 0x7f0f100a57c0 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f165e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f165e9640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f165e9640 4 set_mon_vals no callback set 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 1 -- 172.21.15.71:0/2423994379 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ef8030c20 con 0x7f0f100a57c0 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.486+0000 7f0f0f7fe640 10 monclient: dump: 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.501 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 10 monclient: shutdown 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 -- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 msgr2=0x7f0f100a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 0x7f0f100a7270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009800 tx=0x7f0ef8029fe0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 -- 172.21.15.71:0/2423994379 shutdown_connections 2024-08-19T11:16:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a57c0 0x7f0f100a7270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2423994379 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0f100a6950 0x7f0f100a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 -- 172.21.15.71:0/2423994379 >> 172.21.15.71:0/2423994379 conn(0x7f0f100abf50 msgr2=0x7f0f100ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 -- 172.21.15.71:0/2423994379 shutdown_connections 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.487+0000 7f0f165e9640 1 -- 172.21.15.71:0/2423994379 wait complete. 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient: monmap: 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.503 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 Processor -- start 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 -- start start 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient: init 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient: _add_conns ranks=[8,7,4,1,6,0,5,3,2] 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 0x7f0f101272f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): picked mon.noname-e con 0x7f0f100a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a6950 0x7f0f101ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): picked mon.noname-i con 0x7f0f100a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0f10139710 0x7f0f101cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): picked mon.noname-c con 0x7f0f10139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0f100a84c0 con 0x7f0f10139710 2024-08-19T11:16:17.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0f100a7d40 con 0x7f0f100a6950 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0f100a8700 con 0x7f0f100a57c0 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.488+0000 7f0f165e9640 10 monclient(hunting): authenticate will time out at 1035.530958s 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 0x7f0f101272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0f10139710 0x7f0f101cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 0x7f0f101272f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:44930/0 (socket says 172.21.15.71:44930) 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 -- 172.21.15.71:0/2549473836 learned_addr learned my addr 172.21.15.71:0/2549473836 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): get_auth_request con 0x7f0f100a57c0 auth_method 0 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): get_auth_request con 0x7f0f10139710 auth_method 0 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a6950 0x7f0f101ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): get_auth_request con 0x7f0f100a6950 auth_method 0 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient(hunting): handle_auth_done global_id 64421 payload 824 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a6950 msgr2=0x7f0f101ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0f100a6950 0x7f0f101ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0f10139710 msgr2=0x7f0f101cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0f10139710 0x7f0f101cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 monclient: found mon.noname-e 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f0ffff640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f10127c80 con 0x7f0f100a57c0 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.489+0000 7f0f14b86640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0f10139710 0x7f0f101cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0ffff640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 msgr2=0x7f0f101272f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0ffff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 0x7f0f101272f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000ebe0 tx=0x7f0f0000c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0f00017070 con 0x7f0f100a57c0 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: dump: 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.509 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 5 monclient: authenticate success, global_id 64421 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 10 monclient: _renew_subs 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0000ce40 con 0x7f0f100a57c0 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f10128af0 con 0x7f0f100a57c0 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0f00013d50 con 0x7f0f100a57c0 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0effd640 4 set_mon_vals no callback set 2024-08-19T11:16:17.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f0d7fa640 10 monclient: dump: 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.512 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 10 monclient: _renew_subs 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.491+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f10126790 con 0x7f0f100a57c0 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f165e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 0x7f0f10125460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0f100a20b0 con 0x7f0f101cf3c0 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0f0001a070 con 0x7f0f100a57c0 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 0x7f0f10125460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient: get_auth_request con 0x7f0f101cf3c0 auth_method 0 2024-08-19T11:16:17.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.492+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.493+0000 7f0f07fff640 10 monclient(hunting): handle_auth_done global_id 64430 payload 824 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.493+0000 7f0f07fff640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f101cf7a0 con 0x7f0f101cf3c0 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.493+0000 7f0f0d7fa640 1 --2- 172.21.15.71:0/2549473836 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ef003eab0 0x7f0ef0040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.493+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(170..170 src has 1..170) ==== 3898+0+0 (secure 0 0 0) 0x7f0f0000f040 con 0x7f0f100a57c0 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.493+0000 7f0f14b86640 1 --2- 172.21.15.71:0/2549473836 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ef003eab0 0x7f0ef0040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.493+0000 7f0f14b86640 10 monclient: get_auth_request con 0x7f0ef003eab0 auth_method 0 2024-08-19T11:16:17.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f07fff640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 msgr2=0x7f0f10125460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 0x7f0f10125460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8034000 tx=0x7f0ef80046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ef8043070 con 0x7f0f101cf3c0 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f0d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f0d7fa640 10 monclient: dump: 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.515 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.495+0000 7f0f14b86640 1 --2- 172.21.15.71:0/2549473836 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ef003eab0 0x7f0ef0040f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009400 tx=0x7f0f08009350 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0ef8038040 con 0x7f0f101cf3c0 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 msgr2=0x7f0f10125460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 0x7f0f10125460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8034000 tx=0x7f0ef80046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 msgr2=0x7f0f10125460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.496+0000 7f0f0d7fa640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f101cf3c0 0x7f0f10125460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.517 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:17.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26613]: starting. 2024-08-19T11:16:17.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26613]: listing objects. 2024-08-19T11:16:17.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26613]: listed object 0... 2024-08-19T11:16:17.518 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26613]: listed object 25... 2024-08-19T11:16:17.518 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26613]: saw 50 objects 2024-08-19T11:16:17.518 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26613]: shutting down. 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f165e9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 0x7f0f1002d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f165e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0f10076c60 con 0x7f0f1002d1c0 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 0x7f0f1002d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient: get_auth_request con 0x7f0f1002d1c0 auth_method 0 2024-08-19T11:16:17.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 10 monclient(hunting): handle_auth_done global_id 64439 payload 824 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.502+0000 7f0f07fff640 1 -- 172.21.15.71:0/2549473836 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f101385b0 con 0x7f0f1002d1c0 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.504+0000 7f0f07fff640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 msgr2=0x7f0f1002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.504+0000 7f0f07fff640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 0x7f0f1002d5d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ef802a020 tx=0x7f0ef8008030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0ef8037040 con 0x7f0f1002d1c0 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:17.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 10 monclient: dump: 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.521 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f0ef8053420 con 0x7f0f1002d1c0 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 msgr2=0x7f0f1002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 0x7f0f1002d5d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ef802a020 tx=0x7f0ef8008030 comp rx=0 tx=0).stop 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 msgr2=0x7f0f1002d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f0d7fa640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f1002d1c0 0x7f0f1002d5d0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ef802a020 tx=0x7f0ef8008030 comp rx=0 tx=0).stop 2024-08-19T11:16:17.522 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 88987, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:17.523 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.524 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.525 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:17.526 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.527 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.528 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.530 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.533 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.538 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:17.544 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.546 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:17.546 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ef003eab0 msgr2=0x7f0ef0040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2549473836 >> v2:172.21.15.135:6800/726754104 conn(0x7f0ef003eab0 0x7f0ef0040f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009400 tx=0x7f0f08009350 comp rx=0 tx=0).stop 2024-08-19T11:16:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 10 monclient: shutdown 2024-08-19T11:16:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 msgr2=0x7f0f101272f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 --2- 172.21.15.71:0/2549473836 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0f100a57c0 0x7f0f101272f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000ebe0 tx=0x7f0f0000c520 comp rx=0 tx=0).stop 2024-08-19T11:16:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f14b86640 1 -- 172.21.15.71:0/2549473836 reap_dead start 2024-08-19T11:16:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f14b86640 1 -- 172.21.15.71:0/2549473836 reap_dead start 2024-08-19T11:16:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 shutdown_connections 2024-08-19T11:16:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 >> 172.21.15.71:0/2549473836 conn(0x7f0f100abf50 msgr2=0x7f0f10138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 shutdown_connections 2024-08-19T11:16:17.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.505+0000 7f0f165e9640 1 -- 172.21.15.71:0/2549473836 wait complete. 2024-08-19T11:16:17.548 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:17.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:16:17.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:16:17.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.646+0000 7f400f504640 10 monclient: get_monmap_and_config 2024-08-19T11:16:17.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.646+0000 7f400f504640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.646+0000 7f400f504640 10 monclient: monmap: 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:17.647962+0000 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:17.647962+0000 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.649 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.650 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.650 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.650 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:17.650 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:17.650 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.646+0000 7f400f504640 1 Processor -- start 2024-08-19T11:16:17.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 1 -- start start 2024-08-19T11:16:17.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient: init 2024-08-19T11:16:17.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient: _add_conns ranks=[0,8,5,1,4,3,6,7,9,10,2] 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f40080a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 0x7f400813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): picked mon.noname-e con 0x7f40080a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a7440 0x7f40081410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): picked mon.noname-h con 0x7f40080a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40080a6380 con 0x7f40080a6950 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f40080a5020 con 0x7f40080a7440 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f40080a7d40 con 0x7f40080a57c0 2024-08-19T11:16:17.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400f504640 10 monclient(hunting): authenticate will time out at 1035.689592s 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 0x7f400813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400d2a0640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f40080a6950 0x7f40080a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49332/0 (socket says 172.21.15.71:49332) 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400d2a0640 1 -- 172.21.15.71:0/932404278 learned_addr learned my addr 172.21.15.71:0/932404278 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): get_auth_request con 0x7f40080a57c0 auth_method 0 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient(hunting): handle_auth_done global_id 64448 payload 274 2024-08-19T11:16:17.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 1 -- 172.21.15.71:0/932404278 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a7440 msgr2=0x7f40081410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 1 --2- 172.21.15.71:0/932404278 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a7440 0x7f40081410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 1 -- 172.21.15.71:0/932404278 >> v1:172.21.15.71:6789/0 conn(0x7f40080a6950 legacy=0x7f40080a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 1 monclient: found mon.noname-e 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.647+0000 7f400ca9f640 1 -- 172.21.15.71:0/932404278 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080a3650 con 0x7f40080a57c0 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f400ca9f640 1 -- 172.21.15.71:0/932404278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 msgr2=0x7f400813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f400ca9f640 1 --2- 172.21.15.71:0/932404278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 0x7f400813eb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009800 tx=0x7f3ff8029fe0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b887d7f55ac9d7f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 1 -- 172.21.15.71:0/932404278 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ff8037070 con 0x7f40080a57c0 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: dump: 2024-08-19T11:16:17.656 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.657 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f400f504640 5 monclient: authenticate success, global_id 64448 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 1 -- 172.21.15.71:0/932404278 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff802ade0 con 0x7f40080a57c0 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f400f504640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f400f504640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f400f504640 4 set_mon_vals no callback set 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 1 -- 172.21.15.71:0/932404278 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ff8030c20 con 0x7f40080a57c0 2024-08-19T11:16:17.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.650+0000 7f3ffffff640 10 monclient: dump: 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.659 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 10 monclient: shutdown 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 -- 172.21.15.71:0/932404278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 msgr2=0x7f400813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 --2- 172.21.15.71:0/932404278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 0x7f400813eb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009800 tx=0x7f3ff8029fe0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 -- 172.21.15.71:0/932404278 shutdown_connections 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 --2- 172.21.15.71:0/932404278 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a7440 0x7f40081410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 --2- 172.21.15.71:0/932404278 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f40080a57c0 0x7f400813eb60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 -- 172.21.15.71:0/932404278 >> 172.21.15.71:0/932404278 conn(0x7f40080abf50 msgr2=0x7f40080ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 -- 172.21.15.71:0/932404278 shutdown_connections 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.651+0000 7f400f504640 1 -- 172.21.15.71:0/932404278 wait complete. 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient: monmap: 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.661 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.662 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.662 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.662 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.662 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.662 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.662 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 Processor -- start 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 -- start start 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient: init 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient: _add_conns ranks=[0,5,7,6,8,3,1,2,4] 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 0x7f4008128b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): picked mon.noname-a con 0x7f40080a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a6950 0x7f40081cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): picked mon.noname-h con 0x7f40080a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f40080a7440 0x7f4008126680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): picked mon.noname-i con 0x7f40080a7440 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40080a8700 con 0x7f40080a57c0 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f40080a84c0 con 0x7f40080a6950 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f40081415f0 con 0x7f40080a7440 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400f504640 10 monclient(hunting): authenticate will time out at 1035.694870s 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 0x7f4008128b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 0x7f4008128b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54578/0 (socket says 172.21.15.71:54578) 2024-08-19T11:16:17.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 1 -- 172.21.15.71:0/4042867553 learned_addr learned my addr 172.21.15.71:0/4042867553 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 10 monclient(hunting): get_auth_request con 0x7f40080a57c0 auth_method 0 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.652+0000 7f400d2a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400ca9f640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a6950 0x7f40081cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400daa1640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f40080a7440 0x7f4008126680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400ca9f640 10 monclient(hunting): get_auth_request con 0x7f40080a6950 auth_method 0 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400ca9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400ca9f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400ca9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400daa1640 10 monclient(hunting): get_auth_request con 0x7f40080a7440 auth_method 0 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400daa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400daa1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400daa1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 10 monclient(hunting): handle_auth_done global_id 74142 payload 824 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f40080a7440 msgr2=0x7f4008126680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f40080a7440 0x7f4008126680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a6950 msgr2=0x7f40081cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f40080a6950 0x7f40081cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 1 monclient: found mon.noname-a 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.653+0000 7f400d2a0640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080a25b0 con 0x7f40080a57c0 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400d2a0640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 msgr2=0x7f4008128b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400d2a0640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 0x7f4008128b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f400400c460 tx=0x7f400400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4004017070 con 0x7f40080a57c0 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: dump: 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 5 monclient: authenticate success, global_id 74142 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4004005cf0 con 0x7f40080a57c0 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4004004b20 con 0x7f40080a57c0 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 10 monclient: _renew_subs 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4008129da0 con 0x7f40080a57c0 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3ffdffb640 10 monclient: dump: 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.674 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f3fff7fe640 4 set_mon_vals no callback set 2024-08-19T11:16:17.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 10 monclient: _renew_subs 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.655+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40081c6480 con 0x7f40080a57c0 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4004007070 con 0x7f40080a57c0 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400f504640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400f504640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 0x7f4008126bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4008140c30 con 0x7f40081cf120 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f3ffdffb640 1 --2- 172.21.15.71:0/4042867553 >> v2:172.21.15.135:6800/726754104 conn(0x7f3fec03eab0 0x7f3fec040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 3898+0+0 (secure 0 0 0) 0x7f4004051090 con 0x7f40080a57c0 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 0x7f4008126bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient: get_auth_request con 0x7f40081cf120 auth_method 0 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400daa1640 1 --2- 172.21.15.71:0/4042867553 >> v2:172.21.15.135:6800/726754104 conn(0x7f3fec03eab0 0x7f3fec040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.656+0000 7f400daa1640 10 monclient: get_auth_request con 0x7f3fec03eab0 auth_method 0 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.657+0000 7f400ca9f640 10 monclient(hunting): handle_auth_done global_id 5905 payload 824 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.657+0000 7f400ca9f640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40081294f0 con 0x7f40081cf120 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f400ca9f640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 msgr2=0x7f4008126bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f400ca9f640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 0x7f4008126bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8034000 tx=0x7f3ff80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f400daa1640 1 --2- 172.21.15.71:0/4042867553 >> v2:172.21.15.135:6800/726754104 conn(0x7f3fec03eab0 0x7f3fec040f70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4000009ea0 tx=0x7f4000009410 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ff8037040 con 0x7f40081cf120 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:16:17.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 10 monclient: dump: 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.678 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3ff8003a30 con 0x7f40081cf120 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 msgr2=0x7f4008126bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 0x7f4008126bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8034000 tx=0x7f3ff80046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 msgr2=0x7f4008126bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.659+0000 7f3ffdffb640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40081cf120 0x7f4008126bc0 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8034000 tx=0x7f3ff80046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.665+0000 7f400f504640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.665+0000 7f400f504640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 0x7f40081225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.665+0000 7f400f504640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.665+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4008076c60 con 0x7f4008127100 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 0x7f40081225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient: get_auth_request con 0x7f4008127100 auth_method 0 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 10 monclient(hunting): handle_auth_done global_id 5914 payload 824 2024-08-19T11:16:17.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.666+0000 7f400ca9f640 1 -- 172.21.15.71:0/4042867553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f40081274e0 con 0x7f4008127100 2024-08-19T11:16:17.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.668+0000 7f400ca9f640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 msgr2=0x7f40081225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.668+0000 7f400ca9f640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 0x7f40081225a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80096f0 tx=0x7f3ff8009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.668+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ff803d8b0 con 0x7f4008127100 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.668+0000 7f3ffdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.668+0000 7f3ffdffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.668+0000 7f3ffdffb640 10 monclient: dump: 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.682 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f3ff803d440 con 0x7f4008127100 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 msgr2=0x7f40081225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 0x7f40081225a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80096f0 tx=0x7f3ff8009190 comp rx=0 tx=0).stop 2024-08-19T11:16:17.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 msgr2=0x7f40081225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f3ffdffb640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4008127100 0x7f40081225a0 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80096f0 tx=0x7f3ff8009190 comp rx=0 tx=0).stop 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 374509, 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:17.684 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:17.708 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:17.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 >> v2:172.21.15.135:6800/726754104 conn(0x7f3fec03eab0 msgr2=0x7f3fec040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 --2- 172.21.15.71:0/4042867553 >> v2:172.21.15.135:6800/726754104 conn(0x7f3fec03eab0 0x7f3fec040f70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4000009ea0 tx=0x7f4000009410 comp rx=0 tx=0).stop 2024-08-19T11:16:17.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 10 monclient: shutdown 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 msgr2=0x7f4008128b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 --2- 172.21.15.71:0/4042867553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40080a57c0 0x7f4008128b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f400400c460 tx=0x7f400400c920 comp rx=0 tx=0).stop 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400daa1640 1 -- 172.21.15.71:0/4042867553 reap_dead start 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400daa1640 1 -- 172.21.15.71:0/4042867553 reap_dead start 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 shutdown_connections 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 >> 172.21.15.71:0/4042867553 conn(0x7f40080abf50 msgr2=0x7f40080aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 shutdown_connections 2024-08-19T11:16:17.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.669+0000 7f400f504640 1 -- 172.21.15.71:0/4042867553 wait complete. 2024-08-19T11:16:17.711 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:17.711 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:16:17.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.807+0000 7f34410f6640 10 monclient: get_monmap_and_config 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.807+0000 7f34410f6640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.807+0000 7f34410f6640 10 monclient: monmap: 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:17.808941+0000 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:17.808941+0000 2024-08-19T11:16:17.809 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.810 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.811 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.811 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:17.811 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:17.811 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.807+0000 7f34410f6640 1 Processor -- start 2024-08-19T11:16:17.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.807+0000 7f34410f6640 1 -- start start 2024-08-19T11:16:17.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.807+0000 7f34410f6640 10 monclient: init 2024-08-19T11:16:17.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient: _add_conns ranks=[10,4,2,8,6,9,7,1,5,0,3] 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f343c0a6a30 0x7f343c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): picked mon.noname-f con 0x7f343c0a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6e10 0x7f343c0a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): picked mon.noname-c con 0x7f343c0a6e10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 0x7f343c139c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): picked mon.noname-b con 0x7f343c1397f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f343c0a2fc0 con 0x7f343c0a6a30 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f343c0a63f0 con 0x7f343c1397f0 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f343c0a5000 con 0x7f343c0a6e10 2024-08-19T11:16:17.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f34410f6640 10 monclient(hunting): authenticate will time out at 1035.850436s 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 0x7f343c139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6e10 0x7f343c0a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 0x7f343c139c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41736/0 (socket says 172.21.15.71:41736) 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 -- 172.21.15.71:0/2757439452 learned_addr learned my addr 172.21.15.71:0/2757439452 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): get_auth_request con 0x7f343c1397f0 auth_method 0 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): get_auth_request con 0x7f343c0a6e10 auth_method 0 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 1 --2- 172.21.15.71:0/2757439452 >> v2:172.21.15.135:3300/0 conn(0x7f343c0a6a30 0x7f343c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): get_auth_request con 0x7f343c0a6a30 auth_method 0 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient(hunting): handle_auth_done global_id 74144 payload 274 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 -- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6e10 msgr2=0x7f343c0a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 --2- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6e10 0x7f343c0a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 -- 172.21.15.71:0/2757439452 >> v2:172.21.15.135:3300/0 conn(0x7f343c0a6a30 msgr2=0x7f343c0a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 --2- 172.21.15.71:0/2757439452 >> v2:172.21.15.135:3300/0 conn(0x7f343c0a6a30 0x7f343c0a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 monclient: found mon.noname-b 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343b59e640 1 -- 172.21.15.71:0/2757439452 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0a8590 con 0x7f343c1397f0 2024-08-19T11:16:17.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.808+0000 7f343a59c640 1 --2- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6e10 0x7f343c0a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f343b59e640 1 -- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 msgr2=0x7f343c139c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f343b59e640 1 --2- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 0x7f343c139c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f342c009e50 tx=0x7f342c02a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdd01e8efdcf65f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 1 -- 172.21.15.71:0/2757439452 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f342c036070 con 0x7f343c1397f0 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: dump: 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 1 -- 172.21.15.71:0/2757439452 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c007a70 con 0x7f343c1397f0 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f34410f6640 5 monclient: authenticate success, global_id 74144 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f34410f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f34410f6640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 1 -- 172.21.15.71:0/2757439452 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f342c007ca0 con 0x7f343c1397f0 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f34410f6640 4 set_mon_vals no callback set 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.811+0000 7f3439d9b640 10 monclient: dump: 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.824 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 10 monclient: shutdown 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 -- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 msgr2=0x7f343c139c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 --2- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 0x7f343c139c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f342c009e50 tx=0x7f342c02a560 comp rx=0 tx=0).stop 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 -- 172.21.15.71:0/2757439452 shutdown_connections 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 --2- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f343c1397f0 0x7f343c139c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 --2- 172.21.15.71:0/2757439452 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6e10 0x7f343c0a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 --2- 172.21.15.71:0/2757439452 >> v2:172.21.15.135:3300/0 conn(0x7f343c0a6a30 0x7f343c0a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 -- 172.21.15.71:0/2757439452 >> 172.21.15.71:0/2757439452 conn(0x7f343c0ac030 msgr2=0x7f343c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 -- 172.21.15.71:0/2757439452 shutdown_connections 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.812+0000 7f34410f6640 1 -- 172.21.15.71:0/2757439452 wait complete. 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient: monmap: 2024-08-19T11:16:17.826 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.827 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 1 Processor -- start 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 1 -- start start 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient: init 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient: _add_conns ranks=[4,3,8,6,1,5,2,7,0] 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6a30 0x7f343c138a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient(hunting): picked mon.noname-c con 0x7f343c0a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c0a6e10 0x7f343c138f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.813+0000 7f34410f6640 10 monclient(hunting): picked mon.noname-g con 0x7f343c0a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 0x7f343c1228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 10 monclient(hunting): picked mon.noname-e con 0x7f343c1397f0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:17.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f343c13a1c0 con 0x7f343c0a6e10 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f343c0a7770 con 0x7f343c0a6a30 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f343c13a340 con 0x7f343c1397f0 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f34410f6640 10 monclient(hunting): authenticate will time out at 1035.856022s 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 0x7f343c1228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6a30 0x7f343c138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 0x7f343c1228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:44954/0 (socket says 172.21.15.71:44954) 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6a30 0x7f343c138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:51250/0 (socket says 172.21.15.71:51250) 2024-08-19T11:16:17.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 -- 172.21.15.71:0/633378607 learned_addr learned my addr 172.21.15.71:0/633378607 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): get_auth_request con 0x7f343c1397f0 auth_method 0 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): get_auth_request con 0x7f343c0a6a30 auth_method 0 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c0a6e10 0x7f343c138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): get_auth_request con 0x7f343c0a6e10 auth_method 0 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient(hunting): handle_auth_done global_id 64457 payload 824 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6a30 msgr2=0x7f343c138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6a30 0x7f343c138a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c0a6e10 msgr2=0x7f343c138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c0a6e10 0x7f343c138f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 monclient: found mon.noname-e 2024-08-19T11:16:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343b59e640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0a5940 con 0x7f343c1397f0 2024-08-19T11:16:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.814+0000 7f343ad9d640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f343c0a6a30 0x7f343c138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f343b59e640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 msgr2=0x7f343c1228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f343b59e640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 0x7f343c1228b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f342c02a5a0 tx=0x7f342c004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f342c040020 con 0x7f343c1397f0 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: dump: 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c003ba0 con 0x7f343c1397f0 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 5 monclient: authenticate success, global_id 64457 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 10 monclient: _renew_subs 2024-08-19T11:16:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c1240a0 con 0x7f343c1397f0 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f342c036040 con 0x7f343c1397f0 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34337fe640 10 monclient: dump: 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f343959a640 4 set_mon_vals no callback set 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 10 monclient: _renew_subs 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.816+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c125b60 con 0x7f343c1397f0 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.817+0000 7f34410f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.817+0000 7f34410f6640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 0x7f343c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.817+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.817+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f343c076c60 con 0x7f343c1ce680 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.817+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f342c043020 con 0x7f343c1397f0 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f34337fe640 1 --2- 172.21.15.71:0/633378607 >> v2:172.21.15.135:6800/726754104 conn(0x7f341c03ea80 0x7f341c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 0x7f343c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(170..170 src has 1..170) ==== 3898+0+0 (secure 0 0 0) 0x7f342c072400 con 0x7f343c1397f0 2024-08-19T11:16:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient: get_auth_request con 0x7f343c1ce680 auth_method 0 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343a59c640 1 --2- 172.21.15.71:0/633378607 >> v2:172.21.15.135:6800/726754104 conn(0x7f341c03ea80 0x7f341c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343a59c640 10 monclient: get_auth_request con 0x7f341c03ea80 auth_method 0 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 10 monclient(hunting): handle_auth_done global_id 44706 payload 824 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.818+0000 7f343ad9d640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f343c0a7230 con 0x7f343c1ce680 2024-08-19T11:16:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.820+0000 7f343a59c640 1 --2- 172.21.15.71:0/633378607 >> v2:172.21.15.135:6800/726754104 conn(0x7f341c03ea80 0x7f341c040f40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3424009560 tx=0x7f3424009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.820+0000 7f343ad9d640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 msgr2=0x7f343c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.820+0000 7f343ad9d640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 0x7f343c02d1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3434011d20 tx=0x7f343400f610 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3434019070 con 0x7f343c1ce680 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 10 monclient: dump: 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3434004240 con 0x7f343c1ce680 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 msgr2=0x7f343c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 0x7f343c02d1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3434011d20 tx=0x7f343400f610 comp rx=0 tx=0).stop 2024-08-19T11:16:17.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 msgr2=0x7f343c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.821+0000 7f34337fe640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c1ce680 0x7f343c02d1c0 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3434011d20 tx=0x7f343400f610 comp rx=0 tx=0).stop 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f34410f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f34410f6640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 0x7f343c02db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f34410f6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f343c0a1ea0 con 0x7f343c02d700 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 0x7f343c02db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient: get_auth_request con 0x7f343c02d700 auth_method 0 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 10 monclient(hunting): handle_auth_done global_id 44715 payload 824 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.827+0000 7f343ad9d640 1 -- 172.21.15.71:0/633378607 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f343c09e100 con 0x7f343c02d700 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f343ad9d640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 msgr2=0x7f343c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f343ad9d640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 0x7f343c02db10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f343401b000 tx=0x7f34340046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3434019040 con 0x7f343c02d700 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 10 monclient: dump: 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.846 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f34340293f0 con 0x7f343c02d700 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 msgr2=0x7f343c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 0x7f343c02db10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f343401b000 tx=0x7f34340046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 msgr2=0x7f343c02db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34337fe640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f343c02d700 0x7f343c02db10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:17.848 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 146853, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:17.849 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.850 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.851 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:17.852 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:17.853 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:17.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:17.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:17.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:17.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:17.866 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:17.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.870 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:17.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:17.872 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:17.872 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 >> v2:172.21.15.135:6800/726754104 conn(0x7f341c03ea80 msgr2=0x7f341c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34410f6640 1 --2- 172.21.15.71:0/633378607 >> v2:172.21.15.135:6800/726754104 conn(0x7f341c03ea80 0x7f341c040f40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3424009560 tx=0x7f3424009190 comp rx=0 tx=0).stop 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34410f6640 10 monclient: shutdown 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34410f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 msgr2=0x7f343c1228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f343b59e640 1 -- 172.21.15.71:0/633378607 reap_dead start 2024-08-19T11:16:17.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.830+0000 7f34410f6640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 0x7f343c1228b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f342c02a5a0 tx=0x7f342c004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:17.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.831+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 shutdown_connections 2024-08-19T11:16:17.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.831+0000 7f34410f6640 1 --2- 172.21.15.71:0/633378607 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f343c1397f0 0x7f343c1228b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.831+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 >> 172.21.15.71:0/633378607 conn(0x7f343c0ac030 msgr2=0x7f343c0ab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.831+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 shutdown_connections 2024-08-19T11:16:17.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.831+0000 7f34410f6640 1 -- 172.21.15.71:0/633378607 wait complete. 2024-08-19T11:16:17.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:17.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:16:17.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.971+0000 7fa487b24640 10 monclient: get_monmap_and_config 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.971+0000 7fa487b24640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.971+0000 7fa487b24640 10 monclient: monmap: 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:17.973074+0000 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:17.973074+0000 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:17.974 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.971+0000 7fa487b24640 1 Processor -- start 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 1 -- start start 2024-08-19T11:16:17.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient: init 2024-08-19T11:16:17.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient: _add_conns ranks=[8,0,6,9,7,3,5,2,10,1,4] 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4800a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): picked mon.noname-e con 0x7fa4800a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa4800a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): picked mon.noname-d con 0x7fa4800a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800a6380 con 0x7fa4800a57c0 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa4800a5020 con 0x7fa4800a7270 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa4800a7d40 con 0x7fa4800a6950 2024-08-19T11:16:17.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa487b24640 10 monclient(hunting): authenticate will time out at 1036.014714s 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4800a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4850bf640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa4800a57c0 0x7fa480139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49346/0 (socket says 172.21.15.71:49346) 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): get_auth_request con 0x7fa4800a7270 auth_method 0 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4850bf640 1 -- 172.21.15.71:0/3039026860 learned_addr learned my addr 172.21.15.71:0/3039026860 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): get_auth_request con 0x7fa4800a6950 auth_method 0 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4860c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.972+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 10 monclient(hunting): handle_auth_done global_id 25611 payload 274 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 1 -- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 msgr2=0x7fa4800a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 1 --2- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4800a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 1 -- 172.21.15.71:0/3039026860 >> v1:172.21.15.71:6789/0 conn(0x7fa4800a57c0 legacy=0x7fa480139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 1 monclient: found mon.noname-d 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4860c1640 1 -- 172.21.15.71:0/3039026860 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4800a3650 con 0x7fa4800a7270 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.973+0000 7fa4858c0640 1 --2- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4800a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.975+0000 7fa4860c1640 1 -- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 msgr2=0x7fa480139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.975+0000 7fa4860c1640 1 --2- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480139e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa478009df0 tx=0x7fa47802a4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=31e7d1090cfabe17 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 1 -- 172.21.15.71:0/3039026860 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa478007bc0 con 0x7fa4800a7270 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: dump: 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.985 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: _finish_auth 0 2024-08-19T11:16:17.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: _check_auth_tickets 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 1 -- 172.21.15.71:0/3039026860 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478007d80 con 0x7fa4800a7270 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 5 monclient: authenticate success, global_id 25611 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 1 -- 172.21.15.71:0/3039026860 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa478031870 con 0x7fa4800a7270 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 4 set_mon_vals no callback set 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa4848be640 10 monclient: dump: 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:17.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 10 monclient: shutdown 2024-08-19T11:16:17.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 -- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 msgr2=0x7fa480139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 --2- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480139e20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa478009df0 tx=0x7fa47802a4b0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 -- 172.21.15.71:0/3039026860 shutdown_connections 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 --2- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480139e20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 --2- 172.21.15.71:0/3039026860 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4800a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 -- 172.21.15.71:0/3039026860 >> 172.21.15.71:0/3039026860 conn(0x7fa4800abf50 msgr2=0x7fa4800ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 -- 172.21.15.71:0/3039026860 shutdown_connections 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.976+0000 7fa487b24640 1 -- 172.21.15.71:0/3039026860 wait complete. 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.977+0000 7fa487b24640 10 monclient: build_initial_monmap 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.977+0000 7fa487b24640 10 monclient: monmap: 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:17.989 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:17.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.977+0000 7fa487b24640 1 Processor -- start 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.977+0000 7fa487b24640 1 -- start start 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.977+0000 7fa487b24640 10 monclient: init 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient: _add_conns ranks=[4,8,6,3,7,0,5,1,2] 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa4800a57c0 0x7fa4801cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): picked mon.noname-c con 0x7fa4800a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4801cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): picked mon.noname-e con 0x7fa4800a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480124150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): picked mon.noname-d con 0x7fa4800a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa4800a8700 con 0x7fa4800a57c0 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa4800a84c0 con 0x7fa4800a7270 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa4800a7690 con 0x7fa4800a6950 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa487b24640 10 monclient(hunting): authenticate will time out at 1036.020229s 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4801cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa4800a57c0 0x7fa4801cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4801cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:44964/0 (socket says 172.21.15.71:44964) 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 1 -- 172.21.15.71:0/1162864550 learned_addr learned my addr 172.21.15.71:0/1162864550 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480124150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): get_auth_request con 0x7fa4800a6950 auth_method 0 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): get_auth_request con 0x7fa4800a7270 auth_method 0 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): get_auth_request con 0x7fa4800a57c0 auth_method 0 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient(hunting): handle_auth_done global_id 25620 payload 824 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 msgr2=0x7fa4801cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4801cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa4800a57c0 msgr2=0x7fa4801cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa4800a57c0 0x7fa4801cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient: _finish_hunting 0 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 monclient: found mon.noname-d 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:17.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4860c1640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4800a93f0 con 0x7fa4800a7270 2024-08-19T11:16:17.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.978+0000 7fa4850bf640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa4800a6950 0x7fa4801cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:17.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.980+0000 7fa4860c1640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 msgr2=0x7fa480124150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:17.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.980+0000 7fa4860c1640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480124150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa478031000 tx=0x7fa478004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:17.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.980+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa478003e50 con 0x7fa4800a7270 2024-08-19T11:16:17.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.980+0000 7fa4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:17.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: dump: 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.000 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4780046c0 con 0x7fa4800a7270 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 5 monclient: authenticate success, global_id 25620 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa47803b880 con 0x7fa4800a7270 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 10 monclient: _renew_subs 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:18.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa480127f50 con 0x7fa4800a7270 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 10 monclient: dump: 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.002 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa477fff640 4 set_mon_vals no callback set 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 10 monclient: _renew_subs 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa480127c70 con 0x7fa4800a7270 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 0x7fa48002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa48006a590 con 0x7fa480124e50 2024-08-19T11:16:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.981+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa47803b410 con 0x7fa4800a7270 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4767fc640 1 --2- 172.21.15.71:0/1162864550 >> v2:172.21.15.135:6800/726754104 conn(0x7fa46403ec20 0x7fa4640410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 0x7fa48002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient: get_auth_request con 0x7fa480124e50 auth_method 0 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(170..170 src has 1..170) ==== 3898+0+0 (secure 0 0 0) 0x7fa478072a90 con 0x7fa4800a7270 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4850bf640 1 --2- 172.21.15.71:0/1162864550 >> v2:172.21.15.135:6800/726754104 conn(0x7fa46403ec20 0x7fa4640410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4850bf640 10 monclient: get_auth_request con 0x7fa46403ec20 auth_method 0 2024-08-19T11:16:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 10 monclient(hunting): handle_auth_done global_id 44834 payload 824 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.982+0000 7fa4858c0640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa480125bf0 con 0x7fa480124e50 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4858c0640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 msgr2=0x7fa48002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4858c0640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 0x7fa48002d1c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0118e0 tx=0x7fa47c011da0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4850bf640 1 --2- 172.21.15.71:0/1162864550 >> v2:172.21.15.135:6800/726754104 conn(0x7fa46403ec20 0x7fa4640410e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa470007d50 tx=0x7fa470007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa47c0148b0 con 0x7fa480124e50 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4767fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.984+0000 7fa4767fc640 10 monclient: dump: 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa47c014440 con 0x7fa480124e50 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 msgr2=0x7fa48002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 0x7fa48002d1c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0118e0 tx=0x7fa47c011da0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 msgr2=0x7fa48002d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.985+0000 7fa4767fc640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480124e50 0x7fa48002d1c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa487b24640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa487b24640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 0x7fa48002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa487b24640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa480076c60 con 0x7fa480125230 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 0x7fa48002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient: get_auth_request con 0x7fa480125230 auth_method 0 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 10 monclient(hunting): handle_auth_done global_id 44843 payload 824 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.991+0000 7fa4858c0640 1 -- 172.21.15.71:0/1162864550 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa480077730 con 0x7fa480125230 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.993+0000 7fa4858c0640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 msgr2=0x7fa48002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.993+0000 7fa4858c0640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 0x7fa48002d700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0118e0 tx=0x7fa47c0046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa47c022e00 con 0x7fa480125230 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 10 monclient: dump: 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.008 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7fa47c02c450 con 0x7fa480125230 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 msgr2=0x7fa48002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 0x7fa48002d700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0118e0 tx=0x7fa47c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 msgr2=0x7fa48002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4767fc640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa480125230 0x7fa48002d700 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0118e0 tx=0x7fa47c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:18.010 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 147016, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:18.011 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:18.012 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:18.013 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:18.014 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:18.015 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:18.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:18.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:18.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.024 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:18.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:18.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:18.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:18.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.033 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:18.033 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 >> v2:172.21.15.135:6800/726754104 conn(0x7fa46403ec20 msgr2=0x7fa4640410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 --2- 172.21.15.71:0/1162864550 >> v2:172.21.15.135:6800/726754104 conn(0x7fa46403ec20 0x7fa4640410e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa470007d50 tx=0x7fa470007ca0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 10 monclient: shutdown 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 msgr2=0x7fa480124150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa4860c1640 1 -- 172.21.15.71:0/1162864550 reap_dead start 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480124150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa478031000 tx=0x7fa478004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:18.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 shutdown_connections 2024-08-19T11:16:18.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 --2- 172.21.15.71:0/1162864550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa4800a7270 0x7fa480124150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 >> 172.21.15.71:0/1162864550 conn(0x7fa4800abf50 msgr2=0x7fa48009d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:18.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 shutdown_connections 2024-08-19T11:16:18.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:17.994+0000 7fa487b24640 1 -- 172.21.15.71:0/1162864550 wait complete. 2024-08-19T11:16:18.035 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:18.035 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:16:18.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:16:18.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.131+0000 7f866ffe9640 10 monclient: get_monmap_and_config 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.131+0000 7f866ffe9640 10 monclient: build_initial_monmap 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.131+0000 7f866ffe9640 10 monclient: monmap: 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:18.133426+0000 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:18.133426+0000 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:18.135 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.132+0000 7f866ffe9640 1 Processor -- start 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.132+0000 7f866ffe9640 1 -- start start 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.132+0000 7f866ffe9640 10 monclient: init 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient: _add_conns ranks=[2,4,5,6,3,7,10,8,1,0,9] 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 0x7f86680a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): picked mon.noname-b con 0x7f86680a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86680a57c0 0x7f86680a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): picked mon.noname-c con 0x7f86680a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8668139710 0x7f8668139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): picked mon.noname-h con 0x7f8668139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f86680a5020 con 0x7f86680a6950 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f86680a77b0 con 0x7f86680a57c0 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f86680a7d40 con 0x7f8668139710 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866ffe9640 10 monclient(hunting): authenticate will time out at 1036.175151s 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 0x7f86680a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86680a57c0 0x7f86680a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 0x7f86680a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41738/0 (socket says 172.21.15.71:41738) 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 -- 172.21.15.71:0/2651525095 learned_addr learned my addr 172.21.15.71:0/2651525095 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86680a57c0 0x7f86680a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:51262/0 (socket says 172.21.15.71:51262) 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): get_auth_request con 0x7f86680a6950 auth_method 0 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): get_auth_request con 0x7f86680a57c0 auth_method 0 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866e586640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8668139710 0x7f8668139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866e586640 10 monclient(hunting): get_auth_request con 0x7f8668139710 auth_method 0 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866e586640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866e586640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866e586640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient(hunting): handle_auth_done global_id 74153 payload 274 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 -- 172.21.15.71:0/2651525095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8668139710 msgr2=0x7f8668139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8668139710 0x7f8668139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 -- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86680a57c0 msgr2=0x7f86680a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86680a57c0 0x7f86680a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient: _finish_hunting 0 2024-08-19T11:16:18.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 monclient: found mon.noname-b 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.133+0000 7f866dd85640 1 -- 172.21.15.71:0/2651525095 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86680a6380 con 0x7f86680a6950 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866dd85640 1 -- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 msgr2=0x7f86680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866dd85640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 0x7f86680a6d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8658009eb0 tx=0x7f865802a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f2c30cc7fd667e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 1 -- 172.21.15.71:0/2651525095 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8658036070 con 0x7f86680a6950 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: dump: 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.144 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: _finish_auth 0 2024-08-19T11:16:18.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: _check_auth_tickets 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 5 monclient: authenticate success, global_id 74153 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 1 -- 172.21.15.71:0/2651525095 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658007a70 con 0x7f86680a6950 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 1 -- 172.21.15.71:0/2651525095 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8658007ca0 con 0x7f86680a6950 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 4 set_mon_vals no callback set 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866cd83640 10 monclient: dump: 2024-08-19T11:16:18.146 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.147 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 10 monclient: shutdown 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 1 -- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 msgr2=0x7f86680a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.136+0000 7f866ffe9640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 0x7f86680a6d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8658009eb0 tx=0x7f865802a560 comp rx=0 tx=0).stop 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 -- 172.21.15.71:0/2651525095 shutdown_connections 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8668139710 0x7f8668139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86680a57c0 0x7f86680a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 --2- 172.21.15.71:0/2651525095 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f86680a6950 0x7f86680a6d30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 -- 172.21.15.71:0/2651525095 >> 172.21.15.71:0/2651525095 conn(0x7f86680abf50 msgr2=0x7f86680ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 -- 172.21.15.71:0/2651525095 shutdown_connections 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 -- 172.21.15.71:0/2651525095 wait complete. 2024-08-19T11:16:18.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 10 monclient: build_initial_monmap 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 10 monclient: monmap: 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:18.149 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:18.150 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:18.150 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:18.150 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.137+0000 7f866ffe9640 1 Processor -- start 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 -- start start 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient: init 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient: _add_conns ranks=[0,3,7,6,2,4,8,1,5] 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 0x7f86681387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): picked mon.noname-a con 0x7f86680a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86680a6950 0x7f8668138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): picked mon.noname-g con 0x7f86680a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8668139710 0x7f86681225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): picked mon.noname-i con 0x7f8668139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86680a84c0 con 0x7f86680a57c0 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f86680a3650 con 0x7f86680a6950 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f86680a8700 con 0x7f8668139710 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866ffe9640 10 monclient(hunting): authenticate will time out at 1036.180473s 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 0x7f86681387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 0x7f86681387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54582/0 (socket says 172.21.15.71:54582) 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 -- 172.21.15.71:0/716074608 learned_addr learned my addr 172.21.15.71:0/716074608 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): get_auth_request con 0x7f86680a57c0 auth_method 0 2024-08-19T11:16:18.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866d584640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86680a6950 0x7f8668138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866d584640 10 monclient(hunting): get_auth_request con 0x7f86680a6950 auth_method 0 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866d584640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866d584640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866d584640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866e586640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8668139710 0x7f86681225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient(hunting): handle_auth_done global_id 74151 payload 824 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8668139710 msgr2=0x7f86681225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8668139710 0x7f86681225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86680a6950 msgr2=0x7f8668138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f86680a6950 0x7f8668138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient: _finish_hunting 0 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 monclient: found mon.noname-a 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.138+0000 7f866dd85640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8668126170 con 0x7f86680a57c0 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866dd85640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 msgr2=0x7f86681387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866dd85640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 0x7f86681387b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f865802a5a0 tx=0x7f8658004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8658036050 con 0x7f86680a57c0 2024-08-19T11:16:18.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: dump: 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.161 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 5 monclient: authenticate success, global_id 74151 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658037040 con 0x7f86680a57c0 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 10 monclient: _renew_subs 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:18.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8668123e10 con 0x7f86680a57c0 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8658003db0 con 0x7f86680a57c0 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f86667fc640 10 monclient: dump: 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.163 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.164 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 10 monclient: _renew_subs 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f8667fff640 4 set_mon_vals no callback set 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8668125bb0 con 0x7f86680a57c0 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 0x7f86681232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.141+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f866806a590 con 0x7f86681ce3d0 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8658044030 con 0x7f86680a57c0 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 0x7f86681232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient: get_auth_request con 0x7f86681ce3d0 auth_method 0 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f86667fc640 1 --2- 172.21.15.71:0/716074608 >> v2:172.21.15.135:6800/726754104 conn(0x7f865403ea80 0x7f8654040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 3898+0+0 (secure 0 0 0) 0x7f8658042020 con 0x7f86680a57c0 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 10 monclient(hunting): handle_auth_done global_id 64501 payload 824 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866e586640 1 --2- 172.21.15.71:0/716074608 >> v2:172.21.15.135:6800/726754104 conn(0x7f865403ea80 0x7f8654040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866d584640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86680a6d30 con 0x7f86681ce3d0 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.142+0000 7f866e586640 10 monclient: get_auth_request con 0x7f865403ea80 auth_method 0 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.144+0000 7f866d584640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 msgr2=0x7f86681232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.144+0000 7f866d584640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 0x7f86681232a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8668124480 tx=0x7f865c0119f0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.144+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f865c0044a0 con 0x7f86681ce3d0 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.144+0000 7f86667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.144+0000 7f866e586640 1 --2- 172.21.15.71:0/716074608 >> v2:172.21.15.135:6800/726754104 conn(0x7f865403ea80 0x7f8654040f40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8668139310 tx=0x7f8660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 10 monclient: dump: 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.167 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f865c004030 con 0x7f86681ce3d0 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 msgr2=0x7f86681232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 0x7f86681232a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8668124480 tx=0x7f865c0119f0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 msgr2=0x7f86681232a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.145+0000 7f86667fc640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f86681ce3d0 0x7f86681232a0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8668124480 tx=0x7f865c0119f0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866ffe9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866ffe9640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 0x7f866802d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866ffe9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f866813a390 con 0x7f866802d1c0 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 0x7f866802d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient: get_auth_request con 0x7f866802d1c0 auth_method 0 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 10 monclient(hunting): handle_auth_done global_id 64510 payload 824 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.151+0000 7f866d584640 1 -- 172.21.15.71:0/716074608 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f866809e100 con 0x7f866802d1c0 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f866d584640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 msgr2=0x7f866802d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f866d584640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 0x7f866802d5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f865c01b000 tx=0x7f865c0046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f865c003a80 con 0x7f866802d1c0 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 10 monclient: dump: 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f865c003610 con 0x7f866802d1c0 2024-08-19T11:16:18.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 msgr2=0x7f866802d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 0x7f866802d5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f865c01b000 tx=0x7f865c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 msgr2=0x7f866802d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.154+0000 7f86667fc640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f866802d1c0 0x7f866802d5d0 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f865c01b000 tx=0x7f865c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:18.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 89649, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:18.173 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:18.174 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:18.175 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:18.176 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:18.176 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:18.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:18.176 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:18.176 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:18.177 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:18.178 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.179 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:18.181 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.184 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.191 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.196 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:18.197 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 >> v2:172.21.15.135:6800/726754104 conn(0x7f865403ea80 msgr2=0x7f8654040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 --2- 172.21.15.71:0/716074608 >> v2:172.21.15.135:6800/726754104 conn(0x7f865403ea80 0x7f8654040f40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8668139310 tx=0x7f8660008040 comp rx=0 tx=0).stop 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 10 monclient: shutdown 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 msgr2=0x7f86681387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 --2- 172.21.15.71:0/716074608 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86680a57c0 0x7f86681387b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f865802a5a0 tx=0x7f8658004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866e586640 1 -- 172.21.15.71:0/716074608 reap_dead start 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866e586640 1 -- 172.21.15.71:0/716074608 reap_dead start 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 shutdown_connections 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 >> 172.21.15.71:0/716074608 conn(0x7f86680abf50 msgr2=0x7f86680aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 shutdown_connections 2024-08-19T11:16:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.155+0000 7f866ffe9640 1 -- 172.21.15.71:0/716074608 wait complete. 2024-08-19T11:16:18.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:18.201 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:16:18.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:16:18.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.296+0000 7f82d6986640 10 monclient: get_monmap_and_config 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.296+0000 7f82d6986640 10 monclient: build_initial_monmap 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.296+0000 7f82d6986640 10 monclient: monmap: 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:18.298390+0000 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:18.298390+0000 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:18.299 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:18.300 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:18.300 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:18.300 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:18.300 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:18.300 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:18.300 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.297+0000 7f82d6986640 1 Processor -- start 2024-08-19T11:16:18.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.297+0000 7f82d6986640 1 -- start start 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.297+0000 7f82d6986640 10 monclient: init 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.297+0000 7f82d6986640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.297+0000 7f82d6986640 10 monclient: _add_conns ranks=[6,3,5,0,9,4,1,2,8,7,10] 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 0x7f82d00a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): picked mon.noname-d con 0x7f82d00a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82d00a6e10 0x7f82d00a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): picked mon.noname-g con 0x7f82d00a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d0139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): picked mon.noname-h con 0x7f82d0139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82d00a4f90 con 0x7f82d00a6e10 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f82d00a6380 con 0x7f82d0139860 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f82d00a49d0 con 0x7f82d00a6a30 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d6986640 10 monclient(hunting): authenticate will time out at 1036.340072s 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 0x7f82d00a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 0x7f82d00a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60930/0 (socket says 172.21.15.71:60930) 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 -- 172.21.15.71:0/3153172178 learned_addr learned my addr 172.21.15.71:0/3153172178 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): get_auth_request con 0x7f82d00a6a30 auth_method 0 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d4f23640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d0139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cf7fe640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82d00a6e10 0x7f82d00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d4f23640 10 monclient(hunting): get_auth_request con 0x7f82d0139860 auth_method 0 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d4f23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d4f23640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d4f23640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cf7fe640 10 monclient(hunting): get_auth_request con 0x7f82d00a6e10 auth_method 0 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient(hunting): handle_auth_done global_id 25629 payload 274 2024-08-19T11:16:18.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 -- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 msgr2=0x7f82d0139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d0139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 -- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82d00a6e10 msgr2=0x7f82d00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82d00a6e10 0x7f82d00a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 monclient: found mon.noname-d 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cffff640 1 -- 172.21.15.71:0/3153172178 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d00a46f0 con 0x7f82d00a6a30 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82cf7fe640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82d00a6e10 0x7f82d00a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.298+0000 7f82d4f23640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d0139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82cffff640 1 -- 172.21.15.71:0/3153172178 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 msgr2=0x7f82d00a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82cffff640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 0x7f82d00a57f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f82c00098a0 tx=0x7f82c002a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=84137814241544cd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 1 -- 172.21.15.71:0/3153172178 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f82c0037070 con 0x7f82d00a6a30 2024-08-19T11:16:18.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: dump: 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.309 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 5 monclient: authenticate success, global_id 25629 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 1 -- 172.21.15.71:0/3153172178 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c002ade0 con 0x7f82d00a6a30 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:18.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 1 -- 172.21.15.71:0/3153172178 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f82c0030c20 con 0x7f82d00a6a30 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 4 set_mon_vals no callback set 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82ceffd640 10 monclient: dump: 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.311 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 10 monclient: shutdown 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 1 -- 172.21.15.71:0/3153172178 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 msgr2=0x7f82d00a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.301+0000 7f82d6986640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 0x7f82d00a57f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f82c00098a0 tx=0x7f82c002a080 comp rx=0 tx=0).stop 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 -- 172.21.15.71:0/3153172178 shutdown_connections 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82d00a6e10 0x7f82d00a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d0139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 --2- 172.21.15.71:0/3153172178 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f82d00a6a30 0x7f82d00a57f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 -- 172.21.15.71:0/3153172178 >> 172.21.15.71:0/3153172178 conn(0x7f82d00ac030 msgr2=0x7f82d00ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:18.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 -- 172.21.15.71:0/3153172178 shutdown_connections 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 -- 172.21.15.71:0/3153172178 wait complete. 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 10 monclient: build_initial_monmap 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 10 monclient: monmap: 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:18.313 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.302+0000 7f82d6986640 1 Processor -- start 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 -- start start 2024-08-19T11:16:18.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient: init 2024-08-19T11:16:18.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:18.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient: _add_conns ranks=[4,8,5,7,6,2,3,1,0] 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 0x7f82d01ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): picked mon.noname-c con 0x7f82d00a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): picked mon.noname-e con 0x7f82d00a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d01390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): picked mon.noname-h con 0x7f82d0139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f82d00a7730 con 0x7f82d00a6a30 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f82d013a1a0 con 0x7f82d0139860 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f82d01ce6f0 con 0x7f82d00a6e10 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:18.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d6986640 10 monclient(hunting): authenticate will time out at 1036.345552s 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 0x7f82d01ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:44980/0 (socket says 172.21.15.71:44980) 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 0x7f82d01ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:51274/0 (socket says 172.21.15.71:51274) 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 1 -- 172.21.15.71:0/3015967936 learned_addr learned my addr 172.21.15.71:0/3015967936 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): get_auth_request con 0x7f82d00a6e10 auth_method 0 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): get_auth_request con 0x7f82d00a6a30 auth_method 0 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d01390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): get_auth_request con 0x7f82d0139860 auth_method 0 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82d4f23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:18.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 10 monclient(hunting): handle_auth_done global_id 64484 payload 824 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 1 -- 172.21.15.71:0/3015967936 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 msgr2=0x7f82d01390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d01390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.303+0000 7f82cf7fe640 1 -- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 msgr2=0x7f82d01ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cf7fe640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 0x7f82d01ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cf7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cf7fe640 1 monclient: found mon.noname-e 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cf7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cf7fe640 1 -- 172.21.15.71:0/3015967936 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d0139cd0 con 0x7f82d00a6e10 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.304+0000 7f82cffff640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 0x7f82d01ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82cf7fe640 1 -- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 msgr2=0x7f82d0138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:18.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82cf7fe640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e730 tx=0x7f82c400ebf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f82c400f040 con 0x7f82d00a6e10 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: dump: 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.323 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: _finish_auth 0 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: _check_auth_tickets 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c400ee40 con 0x7f82d00a6e10 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 5 monclient: authenticate success, global_id 64484 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 10 monclient: _renew_subs 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d0126260 con 0x7f82d00a6e10 2024-08-19T11:16:18.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f82c40044a0 con 0x7f82d00a6e10 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ccff9640 10 monclient: dump: 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82ce7fc640 4 set_mon_vals no callback set 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 10 monclient: _renew_subs 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.306+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d00a21f0 con 0x7f82d00a6e10 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82d6986640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82d6986640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82d6986640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d013a500 con 0x7f82d00a6e10 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82cf7fe640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e730 tx=0x7f82c400ebf0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f82c4004030 mgrmap(e 5) 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f82c4004030 con 0x7f82d00a6e10 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.307+0000 7f82ccff9640 1 --2- 172.21.15.71:0/3015967936 >> v2:172.21.15.135:6800/726754104 conn(0x7f82bc03ea80 0x7f82bc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.308+0000 7f82cffff640 1 --2- 172.21.15.71:0/3015967936 >> v2:172.21.15.135:6800/726754104 conn(0x7f82bc03ea80 0x7f82bc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.308+0000 7f82cffff640 10 monclient: get_auth_request con 0x7f82bc03ea80 auth_method 0 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.310+0000 7f82cffff640 1 --2- 172.21.15.71:0/3015967936 >> v2:172.21.15.135:6800/726754104 conn(0x7f82bc03ea80 0x7f82bc040f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82c002afd0 tx=0x7f82c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:18.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:18.312+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(170..170 src has 1..170) ==== 3898+0+0 (secure 0 0 0) 0x7f82c4051980 con 0x7f82d00a6e10 2024-08-19T11:16:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26612]: starting. 2024-08-19T11:16:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26612]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26574 2024-08-19T11:16:18.402 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26612]: shutting down. 2024-08-19T11:16:18.403 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:18.403 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:18.403 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:16:18.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:16:19.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.136+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f82d0139cd0 con 0x7f82d00a6e10 2024-08-19T11:16:19.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.136+0000 7f82ccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:19.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.136+0000 7f82ccff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:19.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.378+0000 7f82d6986640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:16:19.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.378+0000 7f82d6986640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:16:19.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.378+0000 7f82d6986640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:19.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.378+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f82d01241c0 con 0x7f82d00a6e10 2024-08-19T11:16:19.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f82ccff9640 1 -- 172.21.15.71:0/3015967936 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f82c4017020 con 0x7f82d00a6e10 2024-08-19T11:16:19.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f82ccff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:16:19.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f82ccff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:19.386 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=660954520,config=2586702516,health=2868542272,kv=497039291,logm=3937589712}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=2122763836,config=2586702516,health=1702561233,kv=803884263,logm=1249909600}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269951169,config=2586702516,health=1702561233,kv=183716086,logm=971563230}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.387 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=306491856,config=2586702516,health=1367206252,kv=2884199049,logm=4091106021}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1621862865}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=634188254}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=306491856,config=2586702516,health=1702561233,kv=549040130,logm=3306018970}) 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.388 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=1443150905}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.380+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=306491856,config=2586702516,health=1702561233,kv=3646823213,logm=414596593}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=719870116}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3876175434}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1028779540}) 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.389 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2331854526}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=267888277}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1165437255}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1784038461}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325339322}) 2024-08-19T11:16:19.390 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.382+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1288137779}) 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 >> v2:172.21.15.135:6800/726754104 conn(0x7f82bc03ea80 msgr2=0x7f82bc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 --2- 172.21.15.71:0/3015967936 >> v2:172.21.15.135:6800/726754104 conn(0x7f82bc03ea80 0x7f82bc040f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82c002afd0 tx=0x7f82c002e000 comp rx=0 tx=0).stop 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 10 monclient: shutdown 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 msgr2=0x7f82d0138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e730 tx=0x7f82c400ebf0 comp rx=0 tx=0).stop 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 shutdown_connections 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 --2- 172.21.15.71:0/3015967936 >> v2:172.21.15.135:6800/726754104 conn(0x7f82bc03ea80 0x7f82bc040f40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82d0139860 0x7f82d01390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82d00a6e10 0x7f82d0138b60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 --2- 172.21.15.71:0/3015967936 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f82d00a6a30 0x7f82d01ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 >> 172.21.15.71:0/3015967936 conn(0x7f82d00ac030 msgr2=0x7f82d01c1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 shutdown_connections 2024-08-19T11:16:19.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:19.383+0000 7f82d6986640 1 -- 172.21.15.71:0/3015967936 wait complete. 2024-08-19T11:16:19.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1447051150}) 2024-08-19T11:16:19.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.395 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=490803104}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2339224699}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1450269392}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2774285884}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1467062233}) 2024-08-19T11:16:19.396 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.392+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3257202009}) 2024-08-19T11:16:19.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2029784853}) 2024-08-19T11:16:19.397 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=346808683}) 2024-08-19T11:16:19.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=994214340}) 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3380679338}) 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3710299508}) 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.404 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1660974776}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=94279445}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1768012665}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2309666756}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=62341208}) 2024-08-19T11:16:19.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1402820885}) 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3209525886}) 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3167599339}) 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2936755070}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1137049282}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3961352718}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=830475057}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4226437780}) 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080836112}) 2024-08-19T11:16:19.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2599419830}) 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1254992155}) 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=854482687}) 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.829 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1933345923}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2258586293}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=136466496}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4109348595}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1230597899}) 2024-08-19T11:16:19.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221948984}) 2024-08-19T11:16:19.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.826+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1675391908}) 2024-08-19T11:16:19.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2190957214}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1265938840}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=105307253}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2148234820}) 2024-08-19T11:16:19.866 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=612768791}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4127720544}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1810277425}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.827+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230919006}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1742473280}) 2024-08-19T11:16:19.867 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=640684616}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3533818571}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2560147305}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1301247088}) 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.868 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2577244324}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3888330475}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154622971}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3158344464}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.829+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=164777444}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51107285}) 2024-08-19T11:16:19.869 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=66973917}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1474123728}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=626552402}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1529129582}) 2024-08-19T11:16:19.870 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1515736370}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2692400433}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008388351}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3600134231}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.871 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2364040238}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3869364563}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=875600304}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3057380188}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3486338512}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=983106075}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3438261356}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=83032769}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3886044203}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1787193460}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3827890564}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1621000155}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=108575631}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1408522431}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3402364750}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=13722508}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658745323}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3820666446}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1841375022}) 2024-08-19T11:16:19.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2763797539}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3363855304}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=918473962}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1943701919}) 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3016444611}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603137344}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413835649}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1383303440}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=173954027}) 2024-08-19T11:16:19.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1041234946}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=335952945}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1595458322}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2450667037}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1218728013}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1550500358}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1851086983}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2242561647}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=981031738}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2254453815}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=53198089}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3483988667}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3344585941}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=396523507}) 2024-08-19T11:16:19.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=401561695}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447356962}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.837+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1223741063}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1680133002}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3628521841}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043686235}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4030751047}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1728162003}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2347855141}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1010079643}) 2024-08-19T11:16:19.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1778067052}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2212749042}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3336148102}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=616175643}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3085641096}) 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2914254265}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=826945632}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=568172432}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3512994823}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3279361318}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3544414794}) 2024-08-19T11:16:19.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2060919721}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=707896670}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2679807891}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4202243595}) 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3297674675}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2921475165}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=900456831}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693381224}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2332495195}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2051846574}) 2024-08-19T11:16:19.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1554593520}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4240861463}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2329375172}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1297095603}) 2024-08-19T11:16:19.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=448166311}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3378953333}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1558798299}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2617917199}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=951558175}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=284893053}) 2024-08-19T11:16:19.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1320498357}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2027798685}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4261060494}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3462576759}) 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2914414714}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706537161}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.844+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2919524769}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1511324650}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=317966965}) 2024-08-19T11:16:19.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4310569}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2529951540}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=989163630}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=927068360}) 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3915891388}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1871141699}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1399626633}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4258745859}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=299767561}) 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4144770055}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3869763159}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2457308433}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=755723087}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2437519561}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3082508090}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3737908831}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=217348006}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3955488299}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=756590496}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3157775265}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2342428318}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=374057622}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=326939888}) 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1100532202}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2607883110}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4194875340}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1394359250}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1170501855}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3741286234}) 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=412584031}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1766283242}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1238786988}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=716771608}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1126755755}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=153604072}) 2024-08-19T11:16:19.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1043411503}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4290841653}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=49208758}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=549031792}) 2024-08-19T11:16:19.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=914144380}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4275883591}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3357594212}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2739236037}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=465425638}) 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2100542478}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2804007493}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=384128783}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=787340734}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1121206490}) 2024-08-19T11:16:19.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=399008187}) 2024-08-19T11:16:19.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:19.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4107095234}) 2024-08-19T11:16:19.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:19.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1263675026}) 2024-08-19T11:16:20.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4066876643}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2534850029}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041623224}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3147677162}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2221623034}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1239250169}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=500077643}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=271633430}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=918569799}) 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=483215805}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2219561123}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=505013272}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3103258340}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.316 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2290295942}) 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2044496883}) 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105118948}) 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291160790}) 2024-08-19T11:16:20.317 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.310+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1380736226}) 2024-08-19T11:16:20.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4187725085}) 2024-08-19T11:16:20.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3209753295}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3260387964}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2180949277}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4011509102}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=468477277}) 2024-08-19T11:16:20.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4133835235}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2484132178}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.318+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2236741227}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1915459583}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3867862918}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2702668705}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4016236073}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4034435051}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2925795867}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1910164586}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295103905}) 2024-08-19T11:16:20.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.320+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=77410743}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2587056320}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2243387417}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1342579404}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1773970213}) 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.342 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3731367931}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2300177586}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3942978532}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566576742}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.321+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2764054718}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4255701293}) 2024-08-19T11:16:20.343 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=732668289}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=344630821}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=407776949}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2697527180}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2220428089}) 2024-08-19T11:16:20.344 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3503629388}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4061928553}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1989084940}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2000136116}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3679005160}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.345 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3821180158}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=717724181}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3682053440}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=350177985}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3762168424}) 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.346 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643072985}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.324+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3007225728}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2842434784}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3151367204}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.325+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=900387307}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.347 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1327530238}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=398566968}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1087272918}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=485708090}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732872487}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.326+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2390328957}) 2024-08-19T11:16:20.348 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.327+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=17,monmap=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3550497030,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1456159060,mon_config_key=2720761110,monmap=1080203526,osd_metadata=1076423054,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=635721820}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=34,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=16,monmap=3,osd_metadata=6,osd_snap=2,osdmap=13} crc {logm=33397204,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=700161712,mon_config_key=610406820,monmap=1080203526,osd_metadata=2544538045,osd_snap=421676469,osdmap=635721820}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=13} crc {logm=1022331032,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3361330433,mon_config_key=3399514852,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3743741452,osd_snap=2639422064,osdmap=635721820}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=32,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=14,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=16} crc {logm=745152109,mdsmap=3140514009,mgr=3044166884,mgr_command_descs=3626727126,mgrstat=3361330433,mon_config_key=2720761110,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=4175660428}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.349 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=14} crc {logm=4160746970,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1416561981,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=2481093879}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=17,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=11} crc {logm=1335696649,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3361330433,mon_config_key=2720761110,monmap=2667667542,osd_metadata=667316944,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=4236475487}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=34,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=12} crc {logm=658101889,mdsmap=3140514009,mgr=4089687023,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3361330433,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2054467476,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=110552214}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3945909397,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=1543423056,mon_config_key=2720761110,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=853325038}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.328+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=11} crc {logm=168204530,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3361330433,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3743741452,osd_snap=421676469,osdmap=4236475487}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=433457509}) 2024-08-19T11:16:20.350 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1693324117}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2072102939}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2008935191}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2163647865}) 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.351 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3402754449}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=219119527}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=587222199}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.329+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1451756830}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1100117217}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.352 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1068052033}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=443949287}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2245723422}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=317524913}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3145783725}) 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.353 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.354 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1330302796}) 2024-08-19T11:16:20.354 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.354 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=586124661}) 2024-08-19T11:16:20.354 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.331+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=10707243}) 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=47} crc {osdmap=946994208}) 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=48} crc {osdmap=2995904487}) 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.356 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=47} crc {osdmap=2095184074}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=49} crc {osdmap=664915980}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=47} crc {osdmap=941160306}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=47} crc {osdmap=3133339786}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=47} crc {osdmap=2541494133}) 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:16:20.357 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=218517225}) 2024-08-19T11:16:20.358 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:16:20.337+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=45} crc {osdmap=2904478882}) 2024-08-19T11:16:20.399 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:16:20.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:16:20.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.519+0000 7f1b88dba640 10 monclient: get_monmap_and_config 2024-08-19T11:16:20.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.519+0000 7f1b88dba640 10 monclient: build_initial_monmap 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.519+0000 7f1b88dba640 10 monclient: monmap: 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:20.521316+0000 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:20.521316+0000 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:20.522 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:20.523 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 1 Processor -- start 2024-08-19T11:16:20.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 1 -- start start 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 10 monclient: init 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 10 monclient: _add_conns ranks=[4,8,6,10,1,7,5,3,9,0,2] 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 0x7f1b84136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.520+0000 7f1b88dba640 10 monclient(hunting): picked mon.noname-c con 0x7f1b840a3d80 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1b84136ab0 0x7f1b84136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): picked mon.noname-e con 0x7f1b84136ab0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a4160 0x7f1b840a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): picked mon.noname-d con 0x7f1b840a4160 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1b840a1fa0 con 0x7f1b840a3d80 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1b8409fe70 con 0x7f1b840a4160 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f1b841373d0 con 0x7f1b84136ab0 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b88dba640 10 monclient(hunting): authenticate will time out at 1038.563199s 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 0x7f1b84136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a4160 0x7f1b840a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 0x7f1b84136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:51280/0 (socket says 172.21.15.71:51280) 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 -- 172.21.15.71:0/1540249709 learned_addr learned my addr 172.21.15.71:0/1540249709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): get_auth_request con 0x7f1b840a3d80 auth_method 0 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): get_auth_request con 0x7f1b840a4160 auth_method 0 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1b84136ab0 0x7f1b84136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): get_auth_request con 0x7f1b84136ab0 auth_method 0 2024-08-19T11:16:20.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient(hunting): handle_auth_done global_id 74191 payload 274 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 -- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1b84136ab0 msgr2=0x7f1b84136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1b84136ab0 0x7f1b84136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 -- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a4160 msgr2=0x7f1b840a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a4160 0x7f1b840a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient: _finish_hunting 0 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 monclient: found mon.noname-c 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:20.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b8259c640 1 -- 172.21.15.71:0/1540249709 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b840a0b70 con 0x7f1b840a3d80 2024-08-19T11:16:20.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.521+0000 7f1b82d9d640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a4160 0x7f1b840a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8259c640 1 -- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 msgr2=0x7f1b84136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:20.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8259c640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 0x7f1b84136570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b74013180 tx=0x7f1b74032760 comp rx=0 tx=0).ready entity=mon.4 client_cookie=57ce04c8ce019dc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 1 -- 172.21.15.71:0/1540249709 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b7403e070 con 0x7f1b840a3d80 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: dump: 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.535 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: _finish_auth 0 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: _check_auth_tickets 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 1 -- 172.21.15.71:0/1540249709 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7400fcc0 con 0x7f1b840a3d80 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b88dba640 5 monclient: authenticate success, global_id 74191 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b88dba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:20.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 1 -- 172.21.15.71:0/1540249709 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b740114f0 con 0x7f1b840a3d80 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b88dba640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b88dba640 4 set_mon_vals no callback set 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.524+0000 7f1b8159a640 10 monclient: dump: 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.537 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 10 monclient: shutdown 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 -- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 msgr2=0x7f1b84136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 0x7f1b84136570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b74013180 tx=0x7f1b74032760 comp rx=0 tx=0).stop 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 -- 172.21.15.71:0/1540249709 shutdown_connections 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a4160 0x7f1b840a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1b84136ab0 0x7f1b84136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 --2- 172.21.15.71:0/1540249709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a3d80 0x7f1b84136570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 -- 172.21.15.71:0/1540249709 >> 172.21.15.71:0/1540249709 conn(0x7f1b840a91d0 msgr2=0x7f1b840a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 -- 172.21.15.71:0/1540249709 shutdown_connections 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.525+0000 7f1b88dba640 1 -- 172.21.15.71:0/1540249709 wait complete. 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.526+0000 7f1b88dba640 10 monclient: build_initial_monmap 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.526+0000 7f1b88dba640 10 monclient: monmap: 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:20.539 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.526+0000 7f1b88dba640 1 Processor -- start 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.526+0000 7f1b88dba640 1 -- start start 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.526+0000 7f1b88dba640 10 monclient: init 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient: _add_conns ranks=[6,4,5,8,1,2,7,0,3] 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 0x7f1b841c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): picked mon.noname-d con 0x7f1b840a3d80 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 0x7f1b841359e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): picked mon.noname-c con 0x7f1b840a4160 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1b84136ab0 0x7f1b84135f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): picked mon.noname-h con 0x7f1b84136ab0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1b840a08c0 con 0x7f1b840a4160 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1b840a2520 con 0x7f1b84136ab0 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1b840a2ca0 con 0x7f1b840a3d80 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b88dba640 10 monclient(hunting): authenticate will time out at 1038.569251s 2024-08-19T11:16:20.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 0x7f1b841c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 0x7f1b841359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 0x7f1b841c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60946/0 (socket says 172.21.15.71:60946) 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 1 -- 172.21.15.71:0/3563656548 learned_addr learned my addr 172.21.15.71:0/3563656548 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): get_auth_request con 0x7f1b840a3d80 auth_method 0 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): get_auth_request con 0x7f1b840a4160 auth_method 0 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1b84136ab0 0x7f1b84135f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): get_auth_request con 0x7f1b84136ab0 auth_method 0 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b82d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient(hunting): handle_auth_done global_id 74200 payload 824 2024-08-19T11:16:20.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 -- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 msgr2=0x7f1b841c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 0x7f1b841c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 -- 172.21.15.71:0/3563656548 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1b84136ab0 msgr2=0x7f1b84135f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1b84136ab0 0x7f1b84135f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 monclient: found mon.noname-c 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b81d9b640 1 -- 172.21.15.71:0/3563656548 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84121040 con 0x7f1b840a4160 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.527+0000 7f1b8259c640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 0x7f1b841c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.529+0000 7f1b81d9b640 1 -- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 msgr2=0x7f1b841359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.529+0000 7f1b81d9b640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 0x7f1b841359e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800e870 tx=0x7f1b7800ed30 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b78017070 con 0x7f1b840a4160 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: dump: 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.546 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 5 monclient: authenticate success, global_id 74200 2024-08-19T11:16:20.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7800ee60 con 0x7f1b840a4160 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 10 monclient: _renew_subs 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b840a1410 con 0x7f1b840a4160 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1b780138e0 con 0x7f1b840a4160 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b72ffd640 10 monclient: dump: 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b80d99640 4 set_mon_vals no callback set 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 10 monclient: _renew_subs 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.530+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841233a0 con 0x7f1b840a4160 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1b7801a070 con 0x7f1b840a4160 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b88dba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b88dba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b88dba640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84121ba0 con 0x7f1b840a4160 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b72ffd640 1 --2- 172.21.15.71:0/3563656548 >> v2:172.21.15.135:6800/726754104 conn(0x7f1b6403ea80 0x7f1b64040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(173..173 src has 1..173) ==== 3898+0+0 (secure 0 0 0) 0x7f1b7800f040 con 0x7f1b840a4160 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b8259c640 1 --2- 172.21.15.71:0/3563656548 >> v2:172.21.15.135:6800/726754104 conn(0x7f1b6403ea80 0x7f1b64040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.531+0000 7f1b8259c640 10 monclient: get_auth_request con 0x7f1b6403ea80 auth_method 0 2024-08-19T11:16:20.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.534+0000 7f1b8259c640 1 --2- 172.21.15.71:0/3563656548 >> v2:172.21.15.135:6800/726754104 conn(0x7f1b6403ea80 0x7f1b64040f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1b740327a0 tx=0x7f1b74011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.535+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f1b840a1410 con 0x7f1b840a4160 2024-08-19T11:16:20.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.535+0000 7f1b72ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:20.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.535+0000 7f1b72ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:20.559 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: starting. 2024-08-19T11:16:20.560 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26684 2024-08-19T11:16:20.560 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: created object 0... 2024-08-19T11:16:20.560 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: created object 25... 2024-08-19T11:16:20.560 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: created object 49... 2024-08-19T11:16:20.560 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: finishing. 2024-08-19T11:16:20.560 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26685]: shutting down. 2024-08-19T11:16:20.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b88dba640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:20.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b88dba640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:20.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b88dba640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1b84074040 con 0x7f1b840a4160 2024-08-19T11:16:20.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b72ffd640 1 -- 172.21.15.71:0/3563656548 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f1b78050980 con 0x7f1b840a4160 2024-08-19T11:16:20.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b72ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:20.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.783+0000 7f1b72ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:20.786 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":128,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 >> v2:172.21.15.135:6800/726754104 conn(0x7f1b6403ea80 msgr2=0x7f1b64040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 --2- 172.21.15.71:0/3563656548 >> v2:172.21.15.135:6800/726754104 conn(0x7f1b6403ea80 0x7f1b64040f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1b740327a0 tx=0x7f1b74011000 comp rx=0 tx=0).stop 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 10 monclient: shutdown 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 msgr2=0x7f1b841359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 0x7f1b841359e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800e870 tx=0x7f1b7800ed30 comp rx=0 tx=0).stop 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 shutdown_connections 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 --2- 172.21.15.71:0/3563656548 >> v2:172.21.15.135:6800/726754104 conn(0x7f1b6403ea80 0x7f1b64040f40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1b840a4160 0x7f1b841359e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1b84136ab0 0x7f1b84135f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 --2- 172.21.15.71:0/3563656548 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1b840a3d80 0x7f1b841c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.785+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 >> 172.21.15.71:0/3563656548 conn(0x7f1b840a91d0 msgr2=0x7f1b8409ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.786+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 shutdown_connections 2024-08-19T11:16:20.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.786+0000 7f1b88dba640 1 -- 172.21.15.71:0/3563656548 wait complete. 2024-08-19T11:16:20.798 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:16:20.798 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:16:20.798 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:16:20.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.894+0000 7fc227f08640 10 monclient: get_monmap_and_config 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.894+0000 7fc227f08640 10 monclient: build_initial_monmap 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.894+0000 7fc227f08640 10 monclient: monmap: 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:20.896189+0000 2024-08-19T11:16:20.897 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:20.896189+0000 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:20.898 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:20.899 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 Processor -- start 2024-08-19T11:16:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 -- start start 2024-08-19T11:16:20.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient: init 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient: _add_conns ranks=[9,6,4,10,1,5,3,7,8,2,0] 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 0x7fc2200a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): picked mon.noname-a con 0x7fc2200a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc2200a57c0 0x7fc2200a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): picked mon.noname-d con 0x7fc2200a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 0x7fc220139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): picked mon.noname-c con 0x7fc220139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc2200a5020 con 0x7fc2200a6950 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc2200a77b0 con 0x7fc220139710 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc2200a7d40 con 0x7fc2200a57c0 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc227f08640 10 monclient(hunting): authenticate will time out at 1038.937816s 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 0x7fc2200a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2254a3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc2200a57c0 0x7fc2200a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2264a5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 0x7fc220139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 0x7fc2200a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54606/0 (socket says 172.21.15.71:54606) 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 1 -- 172.21.15.71:0/107826924 learned_addr learned my addr 172.21.15.71:0/107826924 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2264a5640 10 monclient(hunting): get_auth_request con 0x7fc220139710 auth_method 0 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2264a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2264a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2264a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 10 monclient(hunting): get_auth_request con 0x7fc2200a6950 auth_method 0 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc225ca4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2254a3640 10 monclient(hunting): get_auth_request con 0x7fc2200a57c0 auth_method 0 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2254a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2254a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.895+0000 7fc2254a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc225ca4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc225ca4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc225ca4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 10 monclient(hunting): handle_auth_done global_id 74209 payload 274 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 1 -- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc2200a57c0 msgr2=0x7fc2200a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 1 --2- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc2200a57c0 0x7fc2200a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 1 -- 172.21.15.71:0/107826924 >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 msgr2=0x7fc2200a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 1 --2- 172.21.15.71:0/107826924 >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 0x7fc2200a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 10 monclient: _finish_hunting 0 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 1 monclient: found mon.noname-c 2024-08-19T11:16:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2264a5640 1 -- 172.21.15.71:0/107826924 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2200a6380 con 0x7fc220139710 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc225ca4640 1 --2- 172.21.15.71:0/107826924 >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 0x7fc2200a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.896+0000 7fc2254a3640 1 --2- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc2200a57c0 0x7fc2200a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc2264a5640 1 -- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 msgr2=0x7fc220139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc2264a5640 1 --2- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 0x7fc220139b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc218009df0 tx=0x7fc21802a500 comp rx=0 tx=0).ready entity=mon.4 client_cookie=26bd7a7e287510d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 1 -- 172.21.15.71:0/107826924 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc218007bc0 con 0x7fc220139710 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:20.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: dump: 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: _finish_auth 0 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: _check_auth_tickets 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 1 -- 172.21.15.71:0/107826924 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc218007d80 con 0x7fc220139710 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 5 monclient: authenticate success, global_id 74209 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 4 set_mon_vals no callback set 2024-08-19T11:16:20.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 1 -- 172.21.15.71:0/107826924 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc218031870 con 0x7fc220139710 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc224ca2640 10 monclient: dump: 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 10 monclient: shutdown 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 -- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 msgr2=0x7fc220139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 --2- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 0x7fc220139b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc218009df0 tx=0x7fc21802a500 comp rx=0 tx=0).stop 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 -- 172.21.15.71:0/107826924 shutdown_connections 2024-08-19T11:16:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 --2- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc220139710 0x7fc220139b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 --2- 172.21.15.71:0/107826924 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc2200a57c0 0x7fc2200a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 --2- 172.21.15.71:0/107826924 >> v2:172.21.15.71:3300/0 conn(0x7fc2200a6950 0x7fc2200a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 -- 172.21.15.71:0/107826924 >> 172.21.15.71:0/107826924 conn(0x7fc2200abf50 msgr2=0x7fc2200ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 -- 172.21.15.71:0/107826924 shutdown_connections 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.899+0000 7fc227f08640 1 -- 172.21.15.71:0/107826924 wait complete. 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.900+0000 7fc227f08640 10 monclient: build_initial_monmap 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.900+0000 7fc227f08640 10 monclient: monmap: 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.900+0000 7fc227f08640 1 Processor -- start 2024-08-19T11:16:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.900+0000 7fc227f08640 1 -- start start 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.900+0000 7fc227f08640 10 monclient: init 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient: _add_conns ranks=[0,3,1,5,6,8,2,4,7] 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 0x7fc2201ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): picked mon.noname-a con 0x7fc2200a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2200a6950 0x7fc2201389e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): picked mon.noname-g con 0x7fc2200a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc220139710 0x7fc2201225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): picked mon.noname-f con 0x7fc220139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2200a84c0 con 0x7fc2200a57c0 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2200a3650 con 0x7fc220139710 2024-08-19T11:16:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200a8700 con 0x7fc2200a6950 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc227f08640 10 monclient(hunting): authenticate will time out at 1038.943290s 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 0x7fc2201ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 0x7fc2201ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54608/0 (socket says 172.21.15.71:54608) 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 -- 172.21.15.71:0/202435002 learned_addr learned my addr 172.21.15.71:0/202435002 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): get_auth_request con 0x7fc2200a57c0 auth_method 0 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient(hunting): handle_auth_done global_id 74178 payload 824 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc2254a3640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2200a6950 0x7fc2201389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc2264a5640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc220139710 0x7fc2201225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2200a6950 msgr2=0x7fc2201389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2200a6950 0x7fc2201389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc220139710 msgr2=0x7fc2201225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc220139710 0x7fc2201225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient: _finish_hunting 0 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 monclient: found mon.noname-a 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc225ca4640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22013a150 con 0x7fc2200a57c0 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc2264a5640 10 monclient: get_auth_request con 0x7fc220139710 auth_method 0 2024-08-19T11:16:20.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc2264a5640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc220139710 0x7fc2201225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc2254a3640 10 monclient: get_auth_request con 0x7fc2200a6950 auth_method 0 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.901+0000 7fc2254a3640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2200a6950 0x7fc2201389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc225ca4640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 msgr2=0x7fc2201ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc225ca4640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 0x7fc2201ce150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00e9d0 tx=0x7fc21c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc21c017070 con 0x7fc2200a57c0 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 10 monclient: dump: 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.930 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c00cc70 con 0x7fc2200a57c0 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc227f08640 5 monclient: authenticate success, global_id 74178 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc227f08640 10 monclient: _renew_subs 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc227f08640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.903+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2200a1c30 con 0x7fc2200a57c0 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2167fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc21c00ce20 con 0x7fc2200a57c0 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:20.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2167fc640 10 monclient: dump: 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.933 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 10 monclient: _renew_subs 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc217fff640 4 set_mon_vals no callback set 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc220125bb0 con 0x7fc2200a57c0 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 0x7fc2201232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc220125650 con 0x7fc220138f20 2024-08-19T11:16:20.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 0x7fc2201232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient: get_auth_request con 0x7fc220138f20 auth_method 0 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc21c01a070 con 0x7fc2200a57c0 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.904+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.905+0000 7fc2254a3640 10 monclient(hunting): handle_auth_done global_id 74187 payload 824 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.905+0000 7fc2254a3640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2200a6d30 con 0x7fc220138f20 2024-08-19T11:16:20.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.905+0000 7fc2167fc640 1 --2- 172.21.15.71:0/202435002 >> v2:172.21.15.135:6800/726754104 conn(0x7fc20403ea80 0x7fc204040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.905+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 3898+0+0 (secure 0 0 0) 0x7fc21c00f040 con 0x7fc2200a57c0 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.905+0000 7fc2264a5640 1 --2- 172.21.15.71:0/202435002 >> v2:172.21.15.135:6800/726754104 conn(0x7fc20403ea80 0x7fc204040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.905+0000 7fc2264a5640 10 monclient: get_auth_request con 0x7fc20403ea80 auth_method 0 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2254a3640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 msgr2=0x7fc2201232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2254a3640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 0x7fc2201232a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc220124480 tx=0x7fc210010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc21000f040 con 0x7fc220138f20 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 10 monclient: dump: 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.936 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc21001c400 con 0x7fc220138f20 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:20.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:20.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 msgr2=0x7fc2201232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 0x7fc2201232a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc220124480 tx=0x7fc210010bb0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 msgr2=0x7fc2201232a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:20.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2167fc640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc220138f20 0x7fc2201232a0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc220124480 tx=0x7fc210010bb0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.907+0000 7fc2264a5640 1 --2- 172.21.15.71:0/202435002 >> v2:172.21.15.135:6800/726754104 conn(0x7fc20403ea80 0x7fc204040f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc218034000 tx=0x7fc21802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc227f08640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc227f08640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 0x7fc22002d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc227f08640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc220076c60 con 0x7fc22002d1c0 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc2254a3640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 0x7fc22002d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc2254a3640 10 monclient: get_auth_request con 0x7fc22002d1c0 auth_method 0 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc2254a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc2254a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.913+0000 7fc2254a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.914+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.914+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.914+0000 7fc2254a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:20.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.914+0000 7fc2254a3640 10 monclient(hunting): handle_auth_done global_id 74196 payload 824 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.914+0000 7fc2254a3640 1 -- 172.21.15.71:0/202435002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc22009e100 con 0x7fc22002d1c0 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2254a3640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 msgr2=0x7fc22002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2254a3640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 0x7fc22002d5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc220124480 tx=0x7fc2100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc2100219e0 con 0x7fc22002d1c0 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 10 monclient: dump: 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:20.941 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9269 (secure 0 0 0) 0x7fc210025070 con 0x7fc22002d1c0 2024-08-19T11:16:20.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 msgr2=0x7fc22002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 0x7fc22002d5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc220124480 tx=0x7fc2100046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 msgr2=0x7fc22002d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.916+0000 7fc2167fc640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc22002d1c0 0x7fc22002d5d0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc220124480 tx=0x7fc2100046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:16:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 29949, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:20.967 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:20.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 >> v2:172.21.15.135:6800/726754104 conn(0x7fc20403ea80 msgr2=0x7fc204040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 --2- 172.21.15.71:0/202435002 >> v2:172.21.15.135:6800/726754104 conn(0x7fc20403ea80 0x7fc204040f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc218034000 tx=0x7fc21802f000 comp rx=0 tx=0).stop 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 10 monclient: shutdown 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 msgr2=0x7fc2201ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 --2- 172.21.15.71:0/202435002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2200a57c0 0x7fc2201ce150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00e9d0 tx=0x7fc21c00ee90 comp rx=0 tx=0).stop 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc2264a5640 1 -- 172.21.15.71:0/202435002 reap_dead start 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc2264a5640 1 -- 172.21.15.71:0/202435002 reap_dead start 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 shutdown_connections 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 >> 172.21.15.71:0/202435002 conn(0x7fc2200abf50 msgr2=0x7fc2200aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 shutdown_connections 2024-08-19T11:16:20.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:20.917+0000 7fc227f08640 1 -- 172.21.15.71:0/202435002 wait complete. 2024-08-19T11:16:20.970 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:20.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:16:20.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.066+0000 7f5fa9c2f640 10 monclient: get_monmap_and_config 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.066+0000 7f5fa9c2f640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.066+0000 7f5fa9c2f640 10 monclient: monmap: 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:21.067777+0000 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:21.067777+0000 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:21.069 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.066+0000 7f5fa9c2f640 1 Processor -- start 2024-08-19T11:16:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.066+0000 7f5fa9c2f640 1 -- start start 2024-08-19T11:16:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.066+0000 7f5fa9c2f640 10 monclient: init 2024-08-19T11:16:21.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient: _add_conns ranks=[3,10,5,4,1,2,8,0,9,7,6] 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 0x7f5fa40a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): picked mon.noname-g con 0x7f5fa40a57d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5fa40a5bb0 0x7f5fa40a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): picked mon.noname-f con 0x7f5fa40a5bb0 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa4137580 0x7f5fa4137a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): picked mon.noname-h con 0x7f5fa4137580 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa40a41b0 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa40728a0 con 0x7f5fa40a57d0 2024-08-19T11:16:21.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5fa4072620 con 0x7f5fa4137580 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa9c2f640 10 monclient(hunting): authenticate will time out at 1039.109461s 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 0x7f5fa40a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 0x7f5fa40a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:43776/0 (socket says 172.21.15.71:43776) 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 -- 172.21.15.71:0/1590325104 learned_addr learned my addr 172.21.15.71:0/1590325104 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): get_auth_request con 0x7f5fa40a57d0 auth_method 0 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 1 --2- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa4137580 0x7f5fa4137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 1 --2- 172.21.15.71:0/1590325104 >> v2:172.21.15.135:3300/0 conn(0x7f5fa40a5bb0 0x7f5fa40a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): get_auth_request con 0x7f5fa40a5bb0 auth_method 0 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): get_auth_request con 0x7f5fa4137580 auth_method 0 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_done global_id 44760 payload 274 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 -- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa4137580 msgr2=0x7f5fa4137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa4137580 0x7f5fa4137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 -- 172.21.15.71:0/1590325104 >> v2:172.21.15.135:3300/0 conn(0x7f5fa40a5bb0 msgr2=0x7f5fa40a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/1590325104 >> v2:172.21.15.135:3300/0 conn(0x7f5fa40a5bb0 0x7f5fa40a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 monclient: found mon.noname-g 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5fa37fe640 1 -- 172.21.15.71:0/1590325104 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa4073940 con 0x7f5fa40a57d0 2024-08-19T11:16:21.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.067+0000 7f5f9affd640 1 --2- 172.21.15.71:0/1590325104 >> v2:172.21.15.135:3300/0 conn(0x7f5fa40a5bb0 0x7f5fa40a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.070+0000 7f5fa37fe640 1 -- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 msgr2=0x7f5fa40a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.070+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 0x7f5fa40a1780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009870 tx=0x7f5f9402a130 comp rx=0 tx=0).ready entity=mon.3 client_cookie=acd94842a6cba936 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 1 -- 172.21.15.71:0/1590325104 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f94037070 con 0x7f5fa40a57d0 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: dump: 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.079 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 5 monclient: authenticate success, global_id 44760 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 1 -- 172.21.15.71:0/1590325104 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f940307b0 con 0x7f5fa40a57d0 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 1 -- 172.21.15.71:0/1590325104 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f94030e50 con 0x7f5fa40a57d0 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 4 set_mon_vals no callback set 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa2ffd640 10 monclient: dump: 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.081 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 10 monclient: shutdown 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 msgr2=0x7f5fa40a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 0x7f5fa40a1780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009870 tx=0x7f5f9402a130 comp rx=0 tx=0).stop 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/1590325104 shutdown_connections 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa4137580 0x7f5fa4137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/1590325104 >> v2:172.21.15.135:3300/0 conn(0x7f5fa40a5bb0 0x7f5fa40a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/1590325104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5fa40a57d0 0x7f5fa40a1780 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/1590325104 >> 172.21.15.71:0/1590325104 conn(0x7f5fa40aa3f0 msgr2=0x7f5fa40a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/1590325104 shutdown_connections 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.071+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/1590325104 wait complete. 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.072+0000 7f5fa9c2f640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.072+0000 7f5fa9c2f640 10 monclient: monmap: 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.084 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.085 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.085 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.085 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.072+0000 7f5fa9c2f640 1 Processor -- start 2024-08-19T11:16:21.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.072+0000 7f5fa9c2f640 1 -- start start 2024-08-19T11:16:21.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.072+0000 7f5fa9c2f640 10 monclient: init 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient: _add_conns ranks=[5,6,1,7,4,8,2,3,0] 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa40a57d0 0x7f5fa41ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): picked mon.noname-h con 0x7f5fa40a57d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 0x7f5fa41369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): picked mon.noname-d con 0x7f5fa40a5bb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fa4137580 0x7f5fa4136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): picked mon.noname-f con 0x7f5fa4137580 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4137f40 con 0x7f5fa4137580 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5fa40a64f0 con 0x7f5fa40a57d0 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5fa41380c0 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa9c2f640 10 monclient(hunting): authenticate will time out at 1039.115190s 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 0x7f5fa41369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 0x7f5fa41369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60958/0 (socket says 172.21.15.71:60958) 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 -- 172.21.15.71:0/148472288 learned_addr learned my addr 172.21.15.71:0/148472288 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): get_auth_request con 0x7f5fa40a5bb0 auth_method 0 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa40a57d0 0x7f5fa41ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa3fff640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fa4137580 0x7f5fa4136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa37fe640 10 monclient(hunting): get_auth_request con 0x7f5fa40a57d0 auth_method 0 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient(hunting): handle_auth_done global_id 25674 payload 824 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa40a57d0 msgr2=0x7f5fa41ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5fa40a57d0 0x7f5fa41ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fa4137580 msgr2=0x7f5fa4136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fa4137580 0x7f5fa4136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 monclient: found mon.noname-d 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5f9affd640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa4137a00 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa3fff640 10 monclient: get_auth_request con 0x7f5fa4137580 auth_method 0 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.073+0000 7f5fa3fff640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fa4137580 0x7f5fa4136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5f9affd640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 msgr2=0x7f5fa41369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5f9affd640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 0x7f5fa41369a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00ebb0 tx=0x7f5f8c00c520 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f8c017070 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 10 monclient: dump: 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.096 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00ce40 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa9c2f640 5 monclient: authenticate success, global_id 25674 2024-08-19T11:16:21.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f8c013d50 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 10 monclient: _renew_subs 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa406f3c0 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.075+0000 7f5fa27fc640 4 set_mon_vals no callback set 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa0ff9640 10 monclient: dump: 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.098 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 10 monclient: _renew_subs 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa4125ae0 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 0x7f5fa406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa4076c60 con 0x7f5fa406d9b0 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.076+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5f8c01a070 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 0x7f5fa406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient: get_auth_request con 0x7f5fa406d9b0 auth_method 0 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa0ff9640 1 --2- 172.21.15.71:0/148472288 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f8403ea80 0x7f5f84040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(173..173 src has 1..173) ==== 3898+0+0 (secure 0 0 0) 0x7f5f8c00f040 con 0x7f5fa40a5bb0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_done global_id 74162 payload 824 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa37fe640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fa40a5fb0 con 0x7f5fa406d9b0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa3fff640 1 --2- 172.21.15.71:0/148472288 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f8403ea80 0x7f5f84040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.077+0000 7f5fa3fff640 10 monclient: get_auth_request con 0x7f5f8403ea80 auth_method 0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa37fe640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 msgr2=0x7f5fa406dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 0x7f5fa406dd90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40a7270 tx=0x7f5f940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f94041070 con 0x7f5fa406d9b0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 10 monclient: dump: 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.101 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa3fff640 1 --2- 172.21.15.71:0/148472288 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f8403ea80 0x7f5f84040f40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c007440 tx=0x7f5f9c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f94003a30 con 0x7f5fa406d9b0 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 msgr2=0x7f5fa406dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 0x7f5fa406dd90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40a7270 tx=0x7f5f940046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.079+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 msgr2=0x7f5fa406dd90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.080+0000 7f5fa0ff9640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406d9b0 0x7f5fa406dd90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.085+0000 7f5fa9c2f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 0x7f5fa409c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa9c2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa4125ec0 con 0x7f5fa406e2d0 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 0x7f5fa409c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient: get_auth_request con 0x7f5fa406e2d0 auth_method 0 2024-08-19T11:16:21.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 10 monclient(hunting): handle_auth_done global_id 74171 payload 824 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.086+0000 7f5fa37fe640 1 -- 172.21.15.71:0/148472288 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5fa406fd90 con 0x7f5fa406e2d0 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa37fe640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 msgr2=0x7f5fa409c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa37fe640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 0x7f5fa409c9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097c0 tx=0x7f5f94009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f94037040 con 0x7f5fa406e2d0 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 10 monclient: dump: 2024-08-19T11:16:21.104 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.105 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f5f94032440 con 0x7f5fa406e2d0 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 msgr2=0x7f5fa409c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 0x7f5fa409c9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097c0 tx=0x7f5f94009240 comp rx=0 tx=0).stop 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 msgr2=0x7f5fa409c9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.088+0000 7f5fa0ff9640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5fa406e2d0 0x7f5fa409c9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.106 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 30120, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:21.107 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.108 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.109 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:21.110 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.111 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:21.113 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.117 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.120 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:21.124 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.127 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.129 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:21.129 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f8403ea80 msgr2=0x7f5f84040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/148472288 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f8403ea80 0x7f5f84040f40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c007440 tx=0x7f5f9c00b040 comp rx=0 tx=0).stop 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 10 monclient: shutdown 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 msgr2=0x7f5fa41369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 --2- 172.21.15.71:0/148472288 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5fa40a5bb0 0x7f5fa41369a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00ebb0 tx=0x7f5f8c00c520 comp rx=0 tx=0).stop 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa3fff640 1 -- 172.21.15.71:0/148472288 reap_dead start 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa3fff640 1 -- 172.21.15.71:0/148472288 reap_dead start 2024-08-19T11:16:21.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 shutdown_connections 2024-08-19T11:16:21.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 >> 172.21.15.71:0/148472288 conn(0x7f5fa40aa3f0 msgr2=0x7f5fa40a8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 shutdown_connections 2024-08-19T11:16:21.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.089+0000 7f5fa9c2f640 1 -- 172.21.15.71:0/148472288 wait complete. 2024-08-19T11:16:21.131 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:21.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:16:21.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:16:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.228+0000 7f6a351cc640 10 monclient: get_monmap_and_config 2024-08-19T11:16:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.228+0000 7f6a351cc640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.228+0000 7f6a351cc640 10 monclient: monmap: 2024-08-19T11:16:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.230 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:21.230103+0000 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:21.230103+0000 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:21.231 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:21.232 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 Processor -- start 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 -- start start 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient: init 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient: _add_conns ranks=[5,10,4,2,1,6,7,3,8,0,9] 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a3009b640 0x7f6a3009ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): picked mon.noname-h con 0x7f6a3009b640 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6a300a0b10 0x7f6a300a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): picked mon.noname-f con 0x7f6a300a0b10 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 0x7f6a300a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): picked mon.noname-c con 0x7f6a300a0ef0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:21.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6a3009fb50 con 0x7f6a300a0b10 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6a300a5bd0 con 0x7f6a300a0ef0 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6a3009f870 con 0x7f6a3009b640 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a351cc640 10 monclient(hunting): authenticate will time out at 1039.271564s 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 0x7f6a300a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 0x7f6a300a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:51310/0 (socket says 172.21.15.71:51310) 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 -- 172.21.15.71:0/3978772792 learned_addr learned my addr 172.21.15.71:0/3978772792 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): get_auth_request con 0x7f6a300a0ef0 auth_method 0 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 1 --2- 172.21.15.71:0/3978772792 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a3009b640 0x7f6a3009ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 1 --2- 172.21.15.71:0/3978772792 >> v2:172.21.15.135:3300/0 conn(0x7f6a300a0b10 0x7f6a300a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): get_auth_request con 0x7f6a3009b640 auth_method 0 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): get_auth_request con 0x7f6a300a0b10 auth_method 0 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_done global_id 74218 payload 274 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 -- 172.21.15.71:0/3978772792 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a3009b640 msgr2=0x7f6a3009ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 --2- 172.21.15.71:0/3978772792 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a3009b640 0x7f6a3009ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 -- 172.21.15.71:0/3978772792 >> v2:172.21.15.135:3300/0 conn(0x7f6a300a0b10 msgr2=0x7f6a300a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 --2- 172.21.15.71:0/3978772792 >> v2:172.21.15.135:3300/0 conn(0x7f6a300a0b10 0x7f6a300a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 1 monclient: found mon.noname-c 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.229+0000 7f6a2f59e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.230+0000 7f6a2f59e640 1 -- 172.21.15.71:0/3978772792 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3009bf60 con 0x7f6a300a0ef0 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2f59e640 1 -- 172.21.15.71:0/3978772792 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 msgr2=0x7f6a300a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2f59e640 1 --2- 172.21.15.71:0/3978772792 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 0x7f6a300a42c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009e50 tx=0x7f6a2802a560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=439c4d4206b86707 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 1 -- 172.21.15.71:0/3978772792 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a28036070 con 0x7f6a300a0ef0 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: dump: 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.240 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.241 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 1 -- 172.21.15.71:0/3978772792 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a28007a70 con 0x7f6a300a0ef0 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a351cc640 5 monclient: authenticate success, global_id 74218 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a351cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a351cc640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 1 -- 172.21.15.71:0/3978772792 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a28007ca0 con 0x7f6a300a0ef0 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a351cc640 4 set_mon_vals no callback set 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:21.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.232+0000 7f6a2dd9b640 10 monclient: dump: 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.243 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 10 monclient: shutdown 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 -- 172.21.15.71:0/3978772792 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 msgr2=0x7f6a300a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 --2- 172.21.15.71:0/3978772792 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 0x7f6a300a42c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009e50 tx=0x7f6a2802a560 comp rx=0 tx=0).stop 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 -- 172.21.15.71:0/3978772792 shutdown_connections 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 --2- 172.21.15.71:0/3978772792 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a300a0ef0 0x7f6a300a42c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 --2- 172.21.15.71:0/3978772792 >> v2:172.21.15.135:3300/0 conn(0x7f6a300a0b10 0x7f6a300a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 --2- 172.21.15.71:0/3978772792 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6a3009b640 0x7f6a3009ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 -- 172.21.15.71:0/3978772792 >> 172.21.15.71:0/3978772792 conn(0x7f6a300a4e70 msgr2=0x7f6a300a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 -- 172.21.15.71:0/3978772792 shutdown_connections 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.233+0000 7f6a351cc640 1 -- 172.21.15.71:0/3978772792 wait complete. 2024-08-19T11:16:21.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.234+0000 7f6a351cc640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.234+0000 7f6a351cc640 10 monclient: monmap: 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.245 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.246 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.246 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.246 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.234+0000 7f6a351cc640 1 Processor -- start 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.234+0000 7f6a351cc640 1 -- start start 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.234+0000 7f6a351cc640 10 monclient: init 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient: _add_conns ranks=[6,3,0,2,5,1,4,7,8] 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 0x7f6a301cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): picked mon.noname-d con 0x7f6a3009b640 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a300a0b10 0x7f6a301ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): picked mon.noname-g con 0x7f6a300a0b10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a300a0ef0 0x7f6a30090c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): picked mon.noname-a con 0x7f6a300a0ef0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300a4980 con 0x7f6a300a0ef0 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6a300a4800 con 0x7f6a300a0b10 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f6a300a4b00 con 0x7f6a3009b640 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a351cc640 10 monclient(hunting): authenticate will time out at 1039.277254s 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 0x7f6a301cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a300a0ef0 0x7f6a30090c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 0x7f6a301cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60974/0 (socket says 172.21.15.71:60974) 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 -- 172.21.15.71:0/227444489 learned_addr learned my addr 172.21.15.71:0/227444489 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): get_auth_request con 0x7f6a3009b640 auth_method 0 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): get_auth_request con 0x7f6a300a0ef0 auth_method 0 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a300a0b10 0x7f6a301ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): get_auth_request con 0x7f6a300a0b10 auth_method 0 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient(hunting): handle_auth_done global_id 25683 payload 824 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a300a0b10 msgr2=0x7f6a301ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6a300a0b10 0x7f6a301ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a300a0ef0 msgr2=0x7f6a30090c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a300a0ef0 0x7f6a30090c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 monclient: found mon.noname-d 2024-08-19T11:16:21.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2ed9d640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a30094970 con 0x7f6a3009b640 2024-08-19T11:16:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.235+0000 7f6a2f59e640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a300a0ef0 0x7f6a30090c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.237+0000 7f6a2ed9d640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 msgr2=0x7f6a301cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.237+0000 7f6a2ed9d640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 0x7f6a301cc630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e9b0 tx=0x7f6a2000ee70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a20017070 con 0x7f6a3009b640 2024-08-19T11:16:21.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:21.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: dump: 2024-08-19T11:16:21.259 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.259 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.259 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.260 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.260 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.260 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.260 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.260 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.260 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.261 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.261 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.261 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.261 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.261 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.261 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.262 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 5 monclient: authenticate success, global_id 25683 2024-08-19T11:16:21.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2000cbb0 con 0x7f6a3009b640 2024-08-19T11:16:21.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 10 monclient: _renew_subs 2024-08-19T11:16:21.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:21.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a30093170 con 0x7f6a3009b640 2024-08-19T11:16:21.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a2000cd60 con 0x7f6a3009b640 2024-08-19T11:16:21.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a177fe640 10 monclient: dump: 2024-08-19T11:16:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.264 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.265 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.266 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.266 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.266 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.266 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 10 monclient: _renew_subs 2024-08-19T11:16:21.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:21.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a300953a0 con 0x7f6a3009b640 2024-08-19T11:16:21.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a2d59a640 4 set_mon_vals no callback set 2024-08-19T11:16:21.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.238+0000 7f6a351cc640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 0x7f6a30091520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6a30076c60 con 0x7f6a30091140 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 0x7f6a30091520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient: get_auth_request con 0x7f6a30091140 auth_method 0 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6a2001a070 con 0x7f6a3009b640 2024-08-19T11:16:21.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_done global_id 74227 payload 824 2024-08-19T11:16:21.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2e59c640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a3009ba20 con 0x7f6a30091140 2024-08-19T11:16:21.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a177fe640 1 --2- 172.21.15.71:0/227444489 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a1c03ea80 0x7f6a1c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(173..173 src has 1..173) ==== 3898+0+0 (secure 0 0 0) 0x7f6a2000f040 con 0x7f6a3009b640 2024-08-19T11:16:21.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2f59e640 1 --2- 172.21.15.71:0/227444489 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a1c03ea80 0x7f6a1c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.239+0000 7f6a2f59e640 10 monclient: get_auth_request con 0x7f6a1c03ea80 auth_method 0 2024-08-19T11:16:21.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.241+0000 7f6a2e59c640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 msgr2=0x7f6a30091520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.241+0000 7f6a2e59c640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 0x7f6a30091520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a30092c80 tx=0x7f6a24011cf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.241+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a24019070 con 0x7f6a30091140 2024-08-19T11:16:21.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.241+0000 7f6a177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.241+0000 7f6a177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:21.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.241+0000 7f6a177fe640 10 monclient: dump: 2024-08-19T11:16:21.271 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.271 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.272 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.272 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.272 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.272 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.272 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.272 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.273 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.273 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.273 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.273 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.273 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.273 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6a2400f860 con 0x7f6a30091140 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 msgr2=0x7f6a30091520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 0x7f6a30091520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a30092c80 tx=0x7f6a24011cf0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 msgr2=0x7f6a30091520 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a177fe640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091140 0x7f6a30091520 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a30092c80 tx=0x7f6a24011cf0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.242+0000 7f6a2f59e640 1 --2- 172.21.15.71:0/227444489 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a1c03ea80 0x7f6a1c040f40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a28033000 tx=0x7f6a28009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a351cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a351cc640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 0x7f6a3008df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a351cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f6a30098e80 con 0x7f6a30091a60 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 0x7f6a3008df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient: get_auth_request con 0x7f6a30091a60 auth_method 0 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 10 monclient(hunting): handle_auth_done global_id 74236 payload 824 2024-08-19T11:16:21.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.248+0000 7f6a2e59c640 1 -- 172.21.15.71:0/227444489 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6a30092610 con 0x7f6a30091a60 2024-08-19T11:16:21.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.250+0000 7f6a2e59c640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 msgr2=0x7f6a3008df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.250+0000 7f6a2e59c640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 0x7f6a3008df80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a30092c80 tx=0x7f6a240046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6a24019040 con 0x7f6a30091a60 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 10 monclient: dump: 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.280 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.281 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.281 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.281 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.281 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.281 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.281 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.282 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.283 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f6a24003e50 con 0x7f6a30091a60 2024-08-19T11:16:21.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:21.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:21.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 msgr2=0x7f6a3008df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 0x7f6a3008df80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a30092c80 tx=0x7f6a240046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 msgr2=0x7f6a3008df80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a177fe640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f6a30091a60 0x7f6a3008df80 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a30092c80 tx=0x7f6a240046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.284 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 30284, 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:21.321 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:21.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a1c03ea80 msgr2=0x7f6a1c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 --2- 172.21.15.71:0/227444489 >> v2:172.21.15.135:6800/726754104 conn(0x7f6a1c03ea80 0x7f6a1c040f40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a28033000 tx=0x7f6a28009000 comp rx=0 tx=0).stop 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 10 monclient: shutdown 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 msgr2=0x7f6a301cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a2f59e640 1 -- 172.21.15.71:0/227444489 reap_dead start 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 0x7f6a301cc630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e9b0 tx=0x7f6a2000ee70 comp rx=0 tx=0).stop 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 shutdown_connections 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 --2- 172.21.15.71:0/227444489 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6a3009b640 0x7f6a301cc630 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 >> 172.21.15.71:0/227444489 conn(0x7f6a300a4e70 msgr2=0x7f6a300a6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 shutdown_connections 2024-08-19T11:16:21.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.251+0000 7f6a351cc640 1 -- 172.21.15.71:0/227444489 wait complete. 2024-08-19T11:16:21.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:21.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:16:21.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:16:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.431+0000 7efea216b640 10 monclient: get_monmap_and_config 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.431+0000 7efea216b640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.431+0000 7efea216b640 10 monclient: monmap: 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:21.432663+0000 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:21.432663+0000 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:21.434 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.431+0000 7efea216b640 1 Processor -- start 2024-08-19T11:16:21.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.431+0000 7efea216b640 1 -- start start 2024-08-19T11:16:21.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.431+0000 7efea216b640 10 monclient: init 2024-08-19T11:16:21.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient: _add_conns ranks=[4,2,1,3,6,0,5,7,9,8,10] 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7efe9c0a6950 0x7efe9c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): picked mon.noname-c con 0x7efe9c0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 0x7efe9c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): picked mon.noname-b con 0x7efe9c0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7efe9c139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe9c0a6380 con 0x7efe9c139710 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c0a5020 con 0x7efe9c0a57c0 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7efe9c0a77b0 con 0x7efe9c0a6950 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efea216b640 10 monclient(hunting): authenticate will time out at 1039.474416s 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 0x7efe9c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7efe9c0a6950 0x7efe9c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 0x7efe9c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41784/0 (socket says 172.21.15.71:41784) 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 -- 172.21.15.71:0/580856495 learned_addr learned my addr 172.21.15.71:0/580856495 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): get_auth_request con 0x7efe9c0a57c0 auth_method 0 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): get_auth_request con 0x7efe9c0a6950 auth_method 0 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient(hunting): handle_auth_done global_id 74180 payload 274 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 -- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7efe9c0a6950 msgr2=0x7efe9c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 --2- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7efe9c0a6950 0x7efe9c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 -- 172.21.15.71:0/580856495 >> v1:172.21.15.135:6789/0 conn(0x7efe9c139710 legacy=0x7efe9c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 monclient: found mon.noname-b 2024-08-19T11:16:21.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9affd640 1 -- 172.21.15.71:0/580856495 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c0a3650 con 0x7efe9c0a57c0 2024-08-19T11:16:21.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.432+0000 7efe9b7fe640 1 --2- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7efe9c0a6950 0x7efe9c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9affd640 1 -- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 msgr2=0x7efe9c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9affd640 1 --2- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 0x7efe9c0a7270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe900098a0 tx=0x7efe9002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900baab41bbbd354 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 1 -- 172.21.15.71:0/580856495 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe90037070 con 0x7efe9c0a57c0 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: dump: 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.444 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.445 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 1 -- 172.21.15.71:0/580856495 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9002ade0 con 0x7efe9c0a57c0 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efea216b640 5 monclient: authenticate success, global_id 74180 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efea216b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efea216b640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 1 -- 172.21.15.71:0/580856495 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe90030c20 con 0x7efe9c0a57c0 2024-08-19T11:16:21.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efe9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.435+0000 7efea216b640 4 set_mon_vals no callback set 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efe9a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efe9a7fc640 10 monclient: dump: 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.447 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 10 monclient: shutdown 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 -- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 msgr2=0x7efe9c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 --2- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 0x7efe9c0a7270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe900098a0 tx=0x7efe9002a080 comp rx=0 tx=0).stop 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 -- 172.21.15.71:0/580856495 shutdown_connections 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 --2- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a57c0 0x7efe9c0a7270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 --2- 172.21.15.71:0/580856495 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7efe9c0a6950 0x7efe9c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 -- 172.21.15.71:0/580856495 >> 172.21.15.71:0/580856495 conn(0x7efe9c0abf50 msgr2=0x7efe9c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 -- 172.21.15.71:0/580856495 shutdown_connections 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.436+0000 7efea216b640 1 -- 172.21.15.71:0/580856495 wait complete. 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.437+0000 7efea216b640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.437+0000 7efea216b640 10 monclient: monmap: 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:21.449 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.437+0000 7efea216b640 1 Processor -- start 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.437+0000 7efea216b640 1 -- start start 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.437+0000 7efea216b640 10 monclient: init 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient: _add_conns ranks=[7,2,5,3,8,6,0,1,4] 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efe9c0a57c0 0x7efe9c1ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): picked mon.noname-i con 0x7efe9c0a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 0x7efe9c138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): picked mon.noname-b con 0x7efe9c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe9c139710 0x7efe9c138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): picked mon.noname-h con 0x7efe9c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c0a84c0 con 0x7efe9c0a6950 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7efe9c0a7d40 con 0x7efe9c139710 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 0x7efe9c138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efe9c0a57c0 0x7efe9c1ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 0x7efe9c138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41798/0 (socket says 172.21.15.71:41798) 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 -- 172.21.15.71:0/2691022084 learned_addr learned my addr 172.21.15.71:0/2691022084 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7efe9c0a8700 con 0x7efe9c0a57c0 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efea216b640 10 monclient(hunting): authenticate will time out at 1039.480465s 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): get_auth_request con 0x7efe9c0a6950 auth_method 0 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): get_auth_request con 0x7efe9c0a57c0 auth_method 0 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe9c139710 0x7efe9c138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): get_auth_request con 0x7efe9c139710 auth_method 0 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient(hunting): handle_auth_done global_id 74189 payload 824 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efe9c0a57c0 msgr2=0x7efe9c1ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7efe9c0a57c0 0x7efe9c1ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe9c139710 msgr2=0x7efe9c138fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe9c139710 0x7efe9c138fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 monclient: found mon.noname-b 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.438+0000 7efe9affd640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c124100 con 0x7efe9c0a6950 2024-08-19T11:16:21.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.441+0000 7efe9affd640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 msgr2=0x7efe9c138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.441+0000 7efe9affd640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 0x7efe9c138aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe900090b0 tx=0x7efe900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.455 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26686]: starting. 2024-08-19T11:16:21.455 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26686]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26684 2024-08-19T11:16:21.455 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26686]: shutting down. 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe90037040 con 0x7efe9c0a6950 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: dump: 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.459 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe90042070 con 0x7efe9c0a6950 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efea216b640 5 monclient: authenticate success, global_id 74189 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efea216b640 10 monclient: _renew_subs 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efea216b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c0a2430 con 0x7efe9c0a6950 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe9003dd20 con 0x7efe9c0a6950 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe83fff640 10 monclient: dump: 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.461 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.462 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.443+0000 7efe99ffb640 4 set_mon_vals no callback set 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.444+0000 7efea216b640 10 monclient: _renew_subs 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.444+0000 7efea216b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.444+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c1ce760 con 0x7efe9c0a6950 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.444+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7efe90003c50 con 0x7efe9c0a6950 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe83fff640 1 --2- 172.21.15.71:0/2691022084 >> v2:172.21.15.135:6800/726754104 conn(0x7efe8803ea80 0x7efe88040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7efe90071df0 con 0x7efe9c0a6950 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efea216b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efea216b640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 0x7efe9c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7efe9c06a590 con 0x7efe9c122dd0 2024-08-19T11:16:21.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 0x7efe9c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient: get_auth_request con 0x7efe9c122dd0 auth_method 0 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 10 monclient(hunting): handle_auth_done global_id 25692 payload 824 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.445+0000 7efe9bfff640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe9c0a1ee0 con 0x7efe9c122dd0 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.446+0000 7efe9b7fe640 1 --2- 172.21.15.71:0/2691022084 >> v2:172.21.15.135:6800/726754104 conn(0x7efe8803ea80 0x7efe88040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.446+0000 7efe9b7fe640 10 monclient: get_auth_request con 0x7efe8803ea80 auth_method 0 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe9bfff640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 msgr2=0x7efe9c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe9bfff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 0x7efe9c02d1c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe9400be20 tx=0x7efe9400a7b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe94013c10 con 0x7efe9c122dd0 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 10 monclient: dump: 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.465 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efe940137a0 con 0x7efe9c122dd0 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 msgr2=0x7efe9c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 0x7efe9c02d1c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe9400be20 tx=0x7efe9400a7b0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 msgr2=0x7efe9c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.448+0000 7efe83fff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c122dd0 0x7efe9c02d1c0 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe9400be20 tx=0x7efe9400a7b0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.449+0000 7efe9b7fe640 1 --2- 172.21.15.71:0/2691022084 >> v2:172.21.15.135:6800/726754104 conn(0x7efe8803ea80 0x7efe88040f40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009560 tx=0x7efe8c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efea216b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efea216b640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 0x7efe9c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efea216b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7efe9c076c60 con 0x7efe9c1231b0 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 0x7efe9c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient: get_auth_request con 0x7efe9c1231b0 auth_method 0 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 10 monclient(hunting): handle_auth_done global_id 25701 payload 824 2024-08-19T11:16:21.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.456+0000 7efe9bfff640 1 -- 172.21.15.71:0/2691022084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe9c13a370 con 0x7efe9c1231b0 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe9bfff640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 msgr2=0x7efe9c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe9bfff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 0x7efe9c02d700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe9400be20 tx=0x7efe94004a70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe94013e30 con 0x7efe9c1231b0 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 10 monclient: dump: 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7efe94013e30 con 0x7efe9c1231b0 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:21.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 msgr2=0x7efe9c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 0x7efe9c02d700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe9400be20 tx=0x7efe94004a70 comp rx=0 tx=0).stop 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 msgr2=0x7efe9c02d700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe83fff640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe9c1231b0 0x7efe9c02d700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 289073, 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:21.471 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:21.472 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:21.473 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.474 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:21.475 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.476 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.478 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.482 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.486 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.487 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.489 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.492 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 >> v2:172.21.15.135:6800/726754104 conn(0x7efe8803ea80 msgr2=0x7efe88040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 --2- 172.21.15.71:0/2691022084 >> v2:172.21.15.135:6800/726754104 conn(0x7efe8803ea80 0x7efe88040f40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009560 tx=0x7efe8c009190 comp rx=0 tx=0).stop 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 10 monclient: shutdown 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 msgr2=0x7efe9c138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efe9bfff640 1 -- 172.21.15.71:0/2691022084 reap_dead start 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 0x7efe9c138aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe900090b0 tx=0x7efe900046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 shutdown_connections 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 --2- 172.21.15.71:0/2691022084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe9c0a6950 0x7efe9c138aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.459+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 >> 172.21.15.71:0/2691022084 conn(0x7efe9c0abf50 msgr2=0x7efe9c0aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.460+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 shutdown_connections 2024-08-19T11:16:21.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.460+0000 7efea216b640 1 -- 172.21.15.71:0/2691022084 wait complete. 2024-08-19T11:16:21.498 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:21.498 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:16:21.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:16:21.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.595+0000 7f457502e640 10 monclient: get_monmap_and_config 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.595+0000 7f457502e640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.595+0000 7f457502e640 10 monclient: monmap: 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:21.597529+0000 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:21.597529+0000 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:21.598 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:21.599 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.596+0000 7f457502e640 1 Processor -- start 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.596+0000 7f457502e640 1 -- start start 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.596+0000 7f457502e640 10 monclient: init 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient: _add_conns ranks=[2,0,9,3,6,8,5,1,10,7,4] 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 0x7f45700a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): picked mon.noname-b con 0x7f45700a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f45700a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f45700a7270 0x7f4570139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): picked mon.noname-a con 0x7f45700a7270 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45700a6380 con 0x7f45700a57c0 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f45700a5020 con 0x7f45700a7270 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f45700a7d40 con 0x7f45700a6950 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f457502e640 10 monclient(hunting): authenticate will time out at 1039.639155s 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 0x7f45700a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 0x7f45700a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41808/0 (socket says 172.21.15.71:41808) 2024-08-19T11:16:21.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 -- 172.21.15.71:0/843425234 learned_addr learned my addr 172.21.15.71:0/843425234 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 1 --2- 172.21.15.71:0/843425234 >> v2:172.21.15.71:3300/0 conn(0x7f45700a7270 0x7f4570139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): get_auth_request con 0x7f45700a6950 auth_method 0 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): get_auth_request con 0x7f45700a7270 auth_method 0 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient(hunting): handle_auth_done global_id 74216 payload 274 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 -- 172.21.15.71:0/843425234 >> v2:172.21.15.71:3300/0 conn(0x7f45700a7270 msgr2=0x7f4570139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 --2- 172.21.15.71:0/843425234 >> v2:172.21.15.71:3300/0 conn(0x7f45700a7270 0x7f4570139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 -- 172.21.15.71:0/843425234 >> v1:172.21.15.71:6789/0 conn(0x7f45700a57c0 legacy=0x7f4570139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 monclient: found mon.noname-b 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.597+0000 7f456ed9d640 1 -- 172.21.15.71:0/843425234 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45700a3650 con 0x7f45700a6950 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456ed9d640 1 -- 172.21.15.71:0/843425234 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 msgr2=0x7f45700a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456ed9d640 1 --2- 172.21.15.71:0/843425234 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 0x7f45700a6d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4568009e80 tx=0x7f456802a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e2d65f5744c7a12 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 1 -- 172.21.15.71:0/843425234 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4568036070 con 0x7f45700a6950 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: dump: 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.607 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 1 -- 172.21.15.71:0/843425234 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4568007a70 con 0x7f45700a6950 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 5 monclient: authenticate success, global_id 74216 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:21.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 1 -- 172.21.15.71:0/843425234 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4568007c60 con 0x7f45700a6950 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 4 set_mon_vals no callback set 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f456dd9b640 10 monclient: dump: 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.609 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 10 monclient: shutdown 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 1 -- 172.21.15.71:0/843425234 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 msgr2=0x7f45700a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 1 --2- 172.21.15.71:0/843425234 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 0x7f45700a6d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4568009e80 tx=0x7f456802a580 comp rx=0 tx=0).stop 2024-08-19T11:16:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 1 -- 172.21.15.71:0/843425234 shutdown_connections 2024-08-19T11:16:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 1 --2- 172.21.15.71:0/843425234 >> v2:172.21.15.71:3300/0 conn(0x7f45700a7270 0x7f4570139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 1 --2- 172.21.15.71:0/843425234 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f45700a6950 0x7f45700a6d30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.600+0000 7f457502e640 1 -- 172.21.15.71:0/843425234 >> 172.21.15.71:0/843425234 conn(0x7f45700abf50 msgr2=0x7f45700ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.601+0000 7f457502e640 1 -- 172.21.15.71:0/843425234 shutdown_connections 2024-08-19T11:16:21.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.601+0000 7f457502e640 1 -- 172.21.15.71:0/843425234 wait complete. 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.601+0000 7f457502e640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.601+0000 7f457502e640 10 monclient: monmap: 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.617 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 Processor -- start 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 -- start start 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient: init 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient: _add_conns ranks=[8,4,3,0,5,1,6,2,7] 2024-08-19T11:16:21.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f45700a57c0 0x7f45701cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): picked mon.noname-e con 0x7f45700a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f45700a6950 0x7f45701cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): picked mon.noname-c con 0x7f45700a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45700a7270 0x7f4570127050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): picked mon.noname-g con 0x7f45700a7270 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f45700a76c0 con 0x7f45700a7270 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f45700a84c0 con 0x7f45700a6950 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f45700a8700 con 0x7f45700a57c0 2024-08-19T11:16:21.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f457502e640 10 monclient(hunting): authenticate will time out at 1039.644795s 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f45700a57c0 0x7f45701cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f45700a57c0 0x7f45701cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45000/0 (socket says 172.21.15.71:45000) 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f45700a6950 0x7f45701cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 1 -- 172.21.15.71:0/274744918 learned_addr learned my addr 172.21.15.71:0/274744918 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): get_auth_request con 0x7f45700a57c0 auth_method 0 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): get_auth_request con 0x7f45700a6950 auth_method 0 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.602+0000 7f456e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456f59e640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45700a7270 0x7f4570127050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 10 monclient(hunting): handle_auth_done global_id 74263 payload 824 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f45700a57c0 msgr2=0x7f45701cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f45700a57c0 0x7f45701cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45700a7270 msgr2=0x7f4570127050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45700a7270 0x7f4570127050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 1 monclient: found mon.noname-c 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456e59c640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457013a2d0 con 0x7f45700a6950 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456f59e640 10 monclient: get_auth_request con 0x7f45700a7270 auth_method 0 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456ed9d640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f45700a57c0 0x7f45701cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.603+0000 7f456f59e640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45700a7270 0x7f4570127050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f456e59c640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f45700a6950 msgr2=0x7f45701cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f456e59c640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f45700a6950 0x7f45701cf0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f455800b3e0 tx=0x7f455800b8a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4558015030 con 0x7f45700a6950 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:16:21.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: dump: 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.623 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4558011cb0 con 0x7f45700a6950 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 5 monclient: authenticate success, global_id 74263 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f45580107f0 con 0x7f45700a6950 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 10 monclient: _renew_subs 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45700a9320 con 0x7f45700a6950 2024-08-19T11:16:21.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f456d59a640 4 set_mon_vals no callback set 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f45677fe640 10 monclient: dump: 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.625 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 10 monclient: _renew_subs 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.605+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f457012ad10 con 0x7f45700a6950 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f457502e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f457502e640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 0x7f4570127970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4570076c60 con 0x7f4570127590 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 0x7f4570127970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4558018070 con 0x7f45700a6950 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient: get_auth_request con 0x7f4570127590 auth_method 0 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 10 monclient(hunting): handle_auth_done global_id 64538 payload 824 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f456ed9d640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45700a2710 con 0x7f4570127590 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f45677fe640 1 --2- 172.21.15.71:0/274744918 >> v2:172.21.15.135:6800/726754104 conn(0x7f455003e9b0 0x7f4550040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.606+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f4558016070 con 0x7f45700a6950 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.607+0000 7f456f59e640 1 --2- 172.21.15.71:0/274744918 >> v2:172.21.15.135:6800/726754104 conn(0x7f455003e9b0 0x7f4550040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.607+0000 7f456f59e640 10 monclient: get_auth_request con 0x7f455003e9b0 auth_method 0 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.608+0000 7f456ed9d640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 msgr2=0x7f4570127970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.608+0000 7f456ed9d640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 0x7f4570127970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f456802a5c0 tx=0x7f4568004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4568040070 con 0x7f4570127590 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 10 monclient: dump: 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.628 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4568037040 con 0x7f4570127590 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:21.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 msgr2=0x7f4570127970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 0x7f4570127970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f456802a5c0 tx=0x7f4568004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:21.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 msgr2=0x7f4570127970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f45677fe640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127590 0x7f4570127970 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f456802a5c0 tx=0x7f4568004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:21.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.609+0000 7f456f59e640 1 --2- 172.21.15.71:0/274744918 >> v2:172.21.15.135:6800/726754104 conn(0x7f455003e9b0 0x7f4550040e70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f457012a310 tx=0x7f4560008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f457502e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f457502e640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 0x7f45701225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f457502e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f45700a6d30 con 0x7f4570127eb0 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 0x7f45701225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient: get_auth_request con 0x7f4570127eb0 auth_method 0 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 10 monclient(hunting): handle_auth_done global_id 64547 payload 824 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.615+0000 7f456ed9d640 1 -- 172.21.15.71:0/274744918 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4570129510 con 0x7f4570127eb0 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f456ed9d640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 msgr2=0x7f45701225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f456ed9d640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 0x7f45701225a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4568008000 tx=0x7f456802f000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4568036070 con 0x7f4570127eb0 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 10 monclient: dump: 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.633 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f4568031610 con 0x7f4570127eb0 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:21.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 msgr2=0x7f45701225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 0x7f45701225a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4568008000 tx=0x7f456802f000 comp rx=0 tx=0).stop 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 msgr2=0x7f45701225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f45677fe640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4570127eb0 0x7f45701225a0 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4568008000 tx=0x7f456802f000 comp rx=0 tx=0).stop 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:21.635 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 93100, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:16:21.636 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.637 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.638 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:21.639 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.640 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:21.641 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.644 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.647 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.648 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.649 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.651 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.653 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.655 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.656 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:21.658 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 >> v2:172.21.15.135:6800/726754104 conn(0x7f455003e9b0 msgr2=0x7f4550040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 1 --2- 172.21.15.71:0/274744918 >> v2:172.21.15.135:6800/726754104 conn(0x7f455003e9b0 0x7f4550040e70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f457012a310 tx=0x7f4560008040 comp rx=0 tx=0).stop 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 10 monclient: shutdown 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f45700a6950 msgr2=0x7f45701cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 1 --2- 172.21.15.71:0/274744918 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f45700a6950 0x7f45701cf0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f455800b3e0 tx=0x7f455800b8a0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f456f59e640 1 -- 172.21.15.71:0/274744918 reap_dead start 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f456f59e640 1 -- 172.21.15.71:0/274744918 reap_dead start 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 shutdown_connections 2024-08-19T11:16:21.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.618+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 >> 172.21.15.71:0/274744918 conn(0x7f45700abf50 msgr2=0x7f45700ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.619+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 shutdown_connections 2024-08-19T11:16:21.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.619+0000 7f457502e640 1 -- 172.21.15.71:0/274744918 wait complete. 2024-08-19T11:16:21.661 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:21.661 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:16:21.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:16:21.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.758+0000 7fb8ed2de640 10 monclient: get_monmap_and_config 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.758+0000 7fb8ed2de640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.758+0000 7fb8ed2de640 10 monclient: monmap: 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:21.760514+0000 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:21.760514+0000 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.761 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:21.762 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.759+0000 7fb8ed2de640 1 Processor -- start 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.759+0000 7fb8ed2de640 1 -- start start 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.759+0000 7fb8ed2de640 10 monclient: init 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.759+0000 7fb8ed2de640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.759+0000 7fb8ed2de640 10 monclient: _add_conns ranks=[9,10,6,8,5,7,0,1,2,4,3] 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8e80a6950 0x7fb8e80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): picked mon.noname-a con 0x7fb8e80a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:21.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8e80a57c0 0x7fb8e80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): picked mon.noname-f con 0x7fb8e80a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 0x7fb8e8139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): picked mon.noname-d con 0x7fb8e8139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e80a5020 con 0x7fb8e80a6950 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e80a77b0 con 0x7fb8e80a57c0 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb8e80a7d40 con 0x7fb8e8139710 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8ed2de640 10 monclient(hunting): authenticate will time out at 1039.802068s 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8e80a6950 0x7fb8e80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 0x7fb8e8139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 0x7fb8e8139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60990/0 (socket says 172.21.15.71:60990) 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8e80a6950 0x7fb8e80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54676/0 (socket says 172.21.15.71:54676) 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 1 -- 172.21.15.71:0/1162536632 learned_addr learned my addr 172.21.15.71:0/1162536632 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): get_auth_request con 0x7fb8e8139710 auth_method 0 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): get_auth_request con 0x7fb8e80a6950 auth_method 0 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e67fc640 1 --2- 172.21.15.71:0/1162536632 >> v2:172.21.15.135:3300/0 conn(0x7fb8e80a57c0 0x7fb8e80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e67fc640 10 monclient(hunting): get_auth_request con 0x7fb8e80a57c0 auth_method 0 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_done global_id 74232 payload 274 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 msgr2=0x7fb8e8139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 --2- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 0x7fb8e8139b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/1162536632 >> v2:172.21.15.135:3300/0 conn(0x7fb8e80a57c0 msgr2=0x7fb8e80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 --2- 172.21.15.71:0/1162536632 >> v2:172.21.15.135:3300/0 conn(0x7fb8e80a57c0 0x7fb8e80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 monclient: found mon.noname-a 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/1162536632 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e80a6380 con 0x7fb8e80a6950 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.760+0000 7fb8e77fe640 1 --2- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 0x7fb8e8139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e80a6950 msgr2=0x7fb8e80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e6ffd640 1 --2- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e80a6950 0x7fb8e80a6d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8074f90 tx=0x7fb8d802a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ded9542fa2d321 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 1 -- 172.21.15.71:0/1162536632 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8d8037070 con 0x7fb8e80a6950 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: dump: 2024-08-19T11:16:21.770 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 5 monclient: authenticate success, global_id 74232 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 1 -- 172.21.15.71:0/1162536632 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d802ad30 con 0x7fb8e80a6950 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 1 -- 172.21.15.71:0/1162536632 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8d8030c20 con 0x7fb8e80a6950 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 4 set_mon_vals no callback set 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8e5ffb640 10 monclient: dump: 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 10 monclient: shutdown 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 1 -- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e80a6950 msgr2=0x7fb8e80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.763+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e80a6950 0x7fb8e80a6d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8074f90 tx=0x7fb8d802a010 comp rx=0 tx=0).stop 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 -- 172.21.15.71:0/1162536632 shutdown_connections 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb8e8139710 0x7fb8e8139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/1162536632 >> v2:172.21.15.135:3300/0 conn(0x7fb8e80a57c0 0x7fb8e80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/1162536632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8e80a6950 0x7fb8e80a6d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 -- 172.21.15.71:0/1162536632 >> 172.21.15.71:0/1162536632 conn(0x7fb8e80abf50 msgr2=0x7fb8e80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 -- 172.21.15.71:0/1162536632 shutdown_connections 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 1 -- 172.21.15.71:0/1162536632 wait complete. 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.764+0000 7fb8ed2de640 10 monclient: monmap: 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.775 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.776 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 Processor -- start 2024-08-19T11:16:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 -- start start 2024-08-19T11:16:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient: init 2024-08-19T11:16:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient: _add_conns ranks=[8,1,5,3,7,6,0,4,2] 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 0x7fb8e81ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): picked mon.noname-e con 0x7fb8e80a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e80a6950 0x7fb8e81389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): picked mon.noname-f con 0x7fb8e80a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8e8139710 0x7fb8e8138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): picked mon.noname-h con 0x7fb8e8139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e80a84c0 con 0x7fb8e80a6950 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb8e80a3650 con 0x7fb8e8139710 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fb8e80a8700 con 0x7fb8e80a57c0 2024-08-19T11:16:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8ed2de640 10 monclient(hunting): authenticate will time out at 1039.807700s 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 0x7fb8e81ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 0x7fb8e81ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45030/0 (socket says 172.21.15.71:45030) 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/3929541939 learned_addr learned my addr 172.21.15.71:0/3929541939 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): get_auth_request con 0x7fb8e80a57c0 auth_method 0 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e67fc640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e80a6950 0x7fb8e81389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e77fe640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8e8139710 0x7fb8e8138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e67fc640 10 monclient(hunting): get_auth_request con 0x7fb8e80a6950 auth_method 0 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e77fe640 10 monclient(hunting): get_auth_request con 0x7fb8e8139710 auth_method 0 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.765+0000 7fb8e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 10 monclient(hunting): handle_auth_done global_id 64556 payload 824 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8e8139710 msgr2=0x7fb8e8138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb8e8139710 0x7fb8e8138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e80a6950 msgr2=0x7fb8e81389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e80a6950 0x7fb8e81389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 1 monclient: found mon.noname-e 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.766+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e8125af0 con 0x7fb8e80a57c0 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8e6ffd640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 msgr2=0x7fb8e81ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8e6ffd640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 0x7fb8e81ce300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb8d802bfd0 tx=0x7fb8d80046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8d8041030 con 0x7fb8e80a57c0 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: dump: 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.787 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d8003bd0 con 0x7fb8e80a57c0 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 5 monclient: authenticate success, global_id 64556 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8d8037040 con 0x7fb8e80a57c0 2024-08-19T11:16:21.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8cf7fe640 10 monclient: dump: 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8e57fa640 4 set_mon_vals no callback set 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 10 monclient: _renew_subs 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e813a3c0 con 0x7fb8e80a57c0 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 10 monclient: _renew_subs 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.768+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e8126390 con 0x7fb8e80a57c0 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8ed2de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 0x7fb8e802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e8076c60 con 0x7fb8e8122d60 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb8d8044070 con 0x7fb8e80a57c0 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 0x7fb8e802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient: get_auth_request con 0x7fb8e8122d60 auth_method 0 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3929541939 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8d403ea80 0x7fb8d4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.769+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7fb8d8042070 con 0x7fb8e80a57c0 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.770+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_done global_id 6004 payload 824 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.770+0000 7fb8e67fc640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8e80a1e90 con 0x7fb8e8122d60 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.770+0000 7fb8e77fe640 1 --2- 172.21.15.71:0/3929541939 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8d403ea80 0x7fb8d4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.770+0000 7fb8e77fe640 10 monclient: get_auth_request con 0x7fb8d403ea80 auth_method 0 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8e67fc640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 msgr2=0x7fb8e802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8e67fc640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 0x7fb8e802d1c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0107f0 tx=0x7fb8dc010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8dc010ea0 con 0x7fb8e8122d60 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 10 monclient: dump: 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.793 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8e77fe640 1 --2- 172.21.15.71:0/3929541939 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8d403ea80 0x7fb8d4040f40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009c90 tx=0x7fb8e000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb8dc00ec40 con 0x7fb8e8122d60 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 msgr2=0x7fb8e802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 0x7fb8e802d1c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0107f0 tx=0x7fb8dc010cb0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 msgr2=0x7fb8e802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.772+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8122d60 0x7fb8e802d1c0 secure :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0107f0 tx=0x7fb8dc010cb0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.778+0000 7fb8ed2de640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.778+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 0x7fb8e802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.778+0000 7fb8ed2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.778+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e80a20a0 con 0x7fb8e8123140 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 0x7fb8e802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient: get_auth_request con 0x7fb8e8123140 auth_method 0 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 10 monclient(hunting): handle_auth_done global_id 6013 payload 824 2024-08-19T11:16:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.779+0000 7fb8e67fc640 1 -- 172.21.15.71:0/3929541939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb8e80a6d30 con 0x7fb8e8123140 2024-08-19T11:16:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.781+0000 7fb8e67fc640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 msgr2=0x7fb8e802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.781+0000 7fb8e67fc640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 0x7fb8e802d700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc019000 tx=0x7fb8dc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb8dc014430 con 0x7fb8e8123140 2024-08-19T11:16:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 10 monclient: dump: 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fb8dc003b10 con 0x7fb8e8123140 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 msgr2=0x7fb8e802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 0x7fb8e802d700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc019000 tx=0x7fb8dc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 msgr2=0x7fb8e802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8cf7fe640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e8123140 0x7fb8e802d700 secure :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc019000 tx=0x7fb8dc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 378623, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:21.799 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.800 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.801 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:21.802 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.803 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.804 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.806 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:21.810 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:21.822 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:21.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8d403ea80 msgr2=0x7fb8d4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/3929541939 >> v2:172.21.15.135:6800/726754104 conn(0x7fb8d403ea80 0x7fb8d4040f40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009c90 tx=0x7fb8e000b040 comp rx=0 tx=0).stop 2024-08-19T11:16:21.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 10 monclient: shutdown 2024-08-19T11:16:21.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 msgr2=0x7fb8e81ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 --2- 172.21.15.71:0/3929541939 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb8e80a57c0 0x7fb8e81ce300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb8d802bfd0 tx=0x7fb8d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8e77fe640 1 -- 172.21.15.71:0/3929541939 reap_dead start 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8e77fe640 1 -- 172.21.15.71:0/3929541939 reap_dead start 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 shutdown_connections 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 >> 172.21.15.71:0/3929541939 conn(0x7fb8e80abf50 msgr2=0x7fb8e80aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 shutdown_connections 2024-08-19T11:16:21.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.782+0000 7fb8ed2de640 1 -- 172.21.15.71:0/3929541939 wait complete. 2024-08-19T11:16:21.824 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:21.825 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:16:21.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.920+0000 7ff2c33cf640 10 monclient: get_monmap_and_config 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.920+0000 7ff2c33cf640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.920+0000 7ff2c33cf640 10 monclient: monmap: 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:21.922548+0000 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:21.922548+0000 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:21.924 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.921+0000 7ff2c33cf640 1 Processor -- start 2024-08-19T11:16:21.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.921+0000 7ff2c33cf640 1 -- start start 2024-08-19T11:16:21.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.921+0000 7ff2c33cf640 10 monclient: init 2024-08-19T11:16:21.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient: _add_conns ranks=[8,9,10,7,4,1,0,5,2,3,6] 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 0x7ff2bc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): picked mon.noname-e con 0x7ff2bc0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2bc0a57c0 0x7ff2bc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): picked mon.noname-a con 0x7ff2bc0a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff2bc139710 0x7ff2bc139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): picked mon.noname-f con 0x7ff2bc139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc0a5020 con 0x7ff2bc0a57c0 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc0a77b0 con 0x7ff2bc139710 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff2bc0a7d40 con 0x7ff2bc0a6950 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c33cf640 10 monclient(hunting): authenticate will time out at 1039.964323s 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 0x7ff2bc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2bc0a57c0 0x7ff2bc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 0x7ff2bc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45040/0 (socket says 172.21.15.71:45040) 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 1 -- 172.21.15.71:0/2092276082 learned_addr learned my addr 172.21.15.71:0/2092276082 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): get_auth_request con 0x7ff2bc0a57c0 auth_method 0 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): get_auth_request con 0x7ff2bc0a6950 auth_method 0 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c196c640 1 --2- 172.21.15.71:0/2092276082 >> v2:172.21.15.135:3300/0 conn(0x7ff2bc139710 0x7ff2bc139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c196c640 10 monclient(hunting): get_auth_request con 0x7ff2bc139710 auth_method 0 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c196c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c196c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c196c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient(hunting): handle_auth_done global_id 74241 payload 274 2024-08-19T11:16:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 -- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 msgr2=0x7ff2bc0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 --2- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 0x7ff2bc0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 -- 172.21.15.71:0/2092276082 >> v2:172.21.15.135:3300/0 conn(0x7ff2bc139710 msgr2=0x7ff2bc139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 --2- 172.21.15.71:0/2092276082 >> v2:172.21.15.135:3300/0 conn(0x7ff2bc139710 0x7ff2bc139b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 monclient: found mon.noname-a 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c096a640 1 -- 172.21.15.71:0/2092276082 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0a6380 con 0x7ff2bc0a57c0 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c116b640 1 --2- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 0x7ff2bc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.922+0000 7ff2c196c640 1 --2- 172.21.15.71:0/2092276082 >> v2:172.21.15.135:3300/0 conn(0x7ff2bc139710 0x7ff2bc139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2c096a640 1 -- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2bc0a57c0 msgr2=0x7ff2bc0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2c096a640 1 --2- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2bc0a57c0 0x7ff2bc0a7270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc06c930 tx=0x7ff2ac02a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82a997488dac9de server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 1 -- 172.21.15.71:0/2092276082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2ac037070 con 0x7ff2bc0a57c0 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: dump: 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 1 -- 172.21.15.71:0/2092276082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac02ad30 con 0x7ff2bc0a57c0 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2c33cf640 5 monclient: authenticate success, global_id 74241 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2c33cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 1 -- 172.21.15.71:0/2092276082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2ac030c20 con 0x7ff2bc0a57c0 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2c33cf640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2c33cf640 4 set_mon_vals no callback set 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.925+0000 7ff2b3fff640 10 monclient: dump: 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 10 monclient: shutdown 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 -- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2bc0a57c0 msgr2=0x7ff2bc0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2bc0a57c0 0x7ff2bc0a7270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc06c930 tx=0x7ff2ac02a010 comp rx=0 tx=0).stop 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 -- 172.21.15.71:0/2092276082 shutdown_connections 2024-08-19T11:16:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/2092276082 >> v2:172.21.15.135:3300/0 conn(0x7ff2bc139710 0x7ff2bc139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2bc0a57c0 0x7ff2bc0a7270 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/2092276082 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff2bc0a6950 0x7ff2bc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 -- 172.21.15.71:0/2092276082 >> 172.21.15.71:0/2092276082 conn(0x7ff2bc0abf50 msgr2=0x7ff2bc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 -- 172.21.15.71:0/2092276082 shutdown_connections 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 1 -- 172.21.15.71:0/2092276082 wait complete. 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 10 monclient: build_initial_monmap 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.926+0000 7ff2c33cf640 10 monclient: monmap: 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:21.938 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 Processor -- start 2024-08-19T11:16:21.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 -- start start 2024-08-19T11:16:21.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient: init 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient: _add_conns ranks=[5,2,7,0,8,4,6,3,1] 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff2bc0a57c0 0x7ff2bc138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): picked mon.noname-h con 0x7ff2bc0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 0x7ff2bc138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): picked mon.noname-b con 0x7ff2bc0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff2bc139710 0x7ff2bc1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): picked mon.noname-i con 0x7ff2bc139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc0a84c0 con 0x7ff2bc0a6950 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff2bc0a3650 con 0x7ff2bc0a57c0 2024-08-19T11:16:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7ff2bc0a8700 con 0x7ff2bc139710 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c33cf640 10 monclient(hunting): authenticate will time out at 1039.969774s 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 0x7ff2bc138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 0x7ff2bc138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41810/0 (socket says 172.21.15.71:41810) 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 1 -- 172.21.15.71:0/1131594676 learned_addr learned my addr 172.21.15.71:0/1131594676 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 10 monclient(hunting): get_auth_request con 0x7ff2bc0a6950 auth_method 0 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.927+0000 7ff2c096a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c196c640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff2bc139710 0x7ff2bc1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c116b640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff2bc0a57c0 0x7ff2bc138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c196c640 10 monclient(hunting): get_auth_request con 0x7ff2bc139710 auth_method 0 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c196c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c196c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c196c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 10 monclient(hunting): handle_auth_done global_id 74225 payload 824 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff2bc139710 msgr2=0x7ff2bc1225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff2bc139710 0x7ff2bc1225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff2bc0a57c0 msgr2=0x7ff2bc138860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff2bc0a57c0 0x7ff2bc138860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 10 monclient: _finish_hunting 0 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 1 monclient: found mon.noname-b 2024-08-19T11:16:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c096a640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc1cefc0 con 0x7ff2bc0a6950 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c116b640 10 monclient: get_auth_request con 0x7ff2bc0a57c0 auth_method 0 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.928+0000 7ff2c116b640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff2bc0a57c0 0x7ff2bc138860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c096a640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 msgr2=0x7ff2bc138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c096a640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 0x7ff2bc138da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac02a600 tx=0x7ff2ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2ac037050 con 0x7ff2bc0a6950 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: dump: 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.949 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ac043070 con 0x7ff2bc0a6950 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 5 monclient: authenticate success, global_id 74225 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 10 monclient: _renew_subs 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc126240 con 0x7ff2bc0a6950 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2ac03ed30 con 0x7ff2bc0a6950 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b1ffb640 10 monclient: dump: 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2b37fe640 4 set_mon_vals no callback set 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 10 monclient: _renew_subs 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.930+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc13a270 con 0x7ff2bc0a6950 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.931+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff2ac003ce0 con 0x7ff2bc0a6950 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.931+0000 7ff2c33cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.931+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 0x7ff2bc02d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.931+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.931+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc06a590 con 0x7ff2bc02d1c0 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.931+0000 7ff2b1ffb640 1 --2- 172.21.15.71:0/1131594676 >> v2:172.21.15.135:6800/726754104 conn(0x7ff2a003ea80 0x7ff2a0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7ff2ac0723b0 con 0x7ff2bc0a6950 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 0x7ff2bc02d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient: get_auth_request con 0x7ff2bc02d1c0 auth_method 0 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c196c640 1 --2- 172.21.15.71:0/1131594676 >> v2:172.21.15.135:6800/726754104 conn(0x7ff2a003ea80 0x7ff2a0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c196c640 10 monclient: get_auth_request con 0x7ff2a003ea80 auth_method 0 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 10 monclient(hunting): handle_auth_done global_id 44787 payload 824 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.932+0000 7ff2c116b640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2bc0a6d30 con 0x7ff2bc02d1c0 2024-08-19T11:16:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2c196c640 1 --2- 172.21.15.71:0/1131594676 >> v2:172.21.15.135:6800/726754104 conn(0x7ff2a003ea80 0x7ff2a0040f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4006fd0 tx=0x7ff2b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2c116b640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 msgr2=0x7ff2bc02d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2c116b640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 0x7ff2bc02d5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8007cc0 tx=0x7ff2b800f520 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2b8014a50 con 0x7ff2bc02d1c0 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2b1ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.934+0000 7ff2b1ffb640 10 monclient: dump: 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff2b80145e0 con 0x7ff2bc02d1c0 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 msgr2=0x7ff2bc02d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 0x7ff2bc02d5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8007cc0 tx=0x7ff2b800f520 comp rx=0 tx=0).stop 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 msgr2=0x7ff2bc02d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.935+0000 7ff2b1ffb640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02d1c0 0x7ff2bc02d5a0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8007cc0 tx=0x7ff2b800f520 comp rx=0 tx=0).stop 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c33cf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 0x7ff2bc02dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c33cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff2bc076c60 con 0x7ff2bc02dae0 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 0x7ff2bc02dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient: get_auth_request con 0x7ff2bc02dae0 auth_method 0 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:21.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:21.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:21.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 10 monclient(hunting): handle_auth_done global_id 44796 payload 824 2024-08-19T11:16:21.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.941+0000 7ff2c116b640 1 -- 172.21.15.71:0/1131594676 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff2bc09e100 con 0x7ff2bc02dae0 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2c116b640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 msgr2=0x7ff2bc02dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2c116b640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 0x7ff2bc02dec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8007cc0 tx=0x7ff2b8004a40 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff2b8014e40 con 0x7ff2bc02dae0 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 10 monclient: dump: 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:21.958 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7ff2b8014e40 con 0x7ff2bc02dae0 2024-08-19T11:16:21.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 msgr2=0x7ff2bc02dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 0x7ff2bc02dec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8007cc0 tx=0x7ff2b8004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 msgr2=0x7ff2bc02dec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.944+0000 7ff2b1ffb640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2bc02dae0 0x7ff2bc02dec0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8007cc0 tx=0x7ff2b8004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:21.960 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 150967, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:16:21.961 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.962 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.963 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:21.964 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:21.965 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:21.968 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.969 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:21.971 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:21.974 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.976 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.978 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:21.983 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:21.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 >> v2:172.21.15.135:6800/726754104 conn(0x7ff2a003ea80 msgr2=0x7ff2a0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/1131594676 >> v2:172.21.15.135:6800/726754104 conn(0x7ff2a003ea80 0x7ff2a0040f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4006fd0 tx=0x7ff2b4008040 comp rx=0 tx=0).stop 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 10 monclient: shutdown 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 msgr2=0x7ff2bc138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 --2- 172.21.15.71:0/1131594676 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff2bc0a6950 0x7ff2bc138da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac02a600 tx=0x7ff2ac0046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c196c640 1 -- 172.21.15.71:0/1131594676 reap_dead start 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c196c640 1 -- 172.21.15.71:0/1131594676 reap_dead start 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 shutdown_connections 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 >> 172.21.15.71:0/1131594676 conn(0x7ff2bc0abf50 msgr2=0x7ff2bc0aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 shutdown_connections 2024-08-19T11:16:21.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:21.945+0000 7ff2c33cf640 1 -- 172.21.15.71:0/1131594676 wait complete. 2024-08-19T11:16:21.986 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:21.986 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:16:21.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:16:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.082+0000 7f6bd978a640 10 monclient: get_monmap_and_config 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.082+0000 7f6bd978a640 10 monclient: build_initial_monmap 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.082+0000 7f6bd978a640 10 monclient: monmap: 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:22.084477+0000 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:22.084477+0000 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:22.086 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 Processor -- start 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 -- start start 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient: init 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient: _add_conns ranks=[10,0,6,7,8,1,3,2,4,9,5] 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6bd40a6950 0x7f6bd40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): picked mon.noname-f con 0x7f6bd40a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6bd40a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 0x7f6bd4139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): picked mon.noname-d con 0x7f6bd40a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd40a6380 con 0x7f6bd40a57c0 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd40a5020 con 0x7f6bd40a6950 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f6bd40a7d40 con 0x7f6bd40a7270 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.083+0000 7f6bd978a640 10 monclient(hunting): authenticate will time out at 1040.125987s 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 0x7f6bd4139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bca7fc640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6bd40a57c0 0x7f6bd4139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49364/0 (socket says 172.21.15.71:49364) 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bca7fc640 1 -- 172.21.15.71:0/3594569925 learned_addr learned my addr 172.21.15.71:0/3594569925 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): get_auth_request con 0x7f6bd40a7270 auth_method 0 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd2ffd640 1 --2- 172.21.15.71:0/3594569925 >> v2:172.21.15.135:3300/0 conn(0x7f6bd40a6950 0x7f6bd40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd2ffd640 10 monclient(hunting): get_auth_request con 0x7f6bd40a6950 auth_method 0 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_done global_id 25728 payload 274 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 1 -- 172.21.15.71:0/3594569925 >> v2:172.21.15.135:3300/0 conn(0x7f6bd40a6950 msgr2=0x7f6bd40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 1 --2- 172.21.15.71:0/3594569925 >> v2:172.21.15.135:3300/0 conn(0x7f6bd40a6950 0x7f6bd40a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 1 -- 172.21.15.71:0/3594569925 >> v1:172.21.15.71:6789/0 conn(0x7f6bd40a57c0 legacy=0x7f6bd4139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 1 monclient: found mon.noname-d 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.084+0000 7f6bd37fe640 1 -- 172.21.15.71:0/3594569925 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd40a3650 con 0x7f6bd40a7270 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd37fe640 1 -- 172.21.15.71:0/3594569925 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 msgr2=0x7f6bd4139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd37fe640 1 --2- 172.21.15.71:0/3594569925 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 0x7f6bd4139e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc02a490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=d223d82415fa4e72 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 1 -- 172.21.15.71:0/3594569925 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bcc007bc0 con 0x7f6bd40a7270 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:22.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: dump: 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.094 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 1 -- 172.21.15.71:0/3594569925 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bcc007d80 con 0x7f6bd40a7270 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 5 monclient: authenticate success, global_id 25728 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 1 -- 172.21.15.71:0/3594569925 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bcc031870 con 0x7f6bd40a7270 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 4 set_mon_vals no callback set 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd27fc640 10 monclient: dump: 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 10 monclient: shutdown 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 -- 172.21.15.71:0/3594569925 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 msgr2=0x7f6bd4139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 --2- 172.21.15.71:0/3594569925 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 0x7f6bd4139e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc02a490 comp rx=0 tx=0).stop 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 -- 172.21.15.71:0/3594569925 shutdown_connections 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 --2- 172.21.15.71:0/3594569925 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6bd40a7270 0x7f6bd4139e20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 --2- 172.21.15.71:0/3594569925 >> v2:172.21.15.135:3300/0 conn(0x7f6bd40a6950 0x7f6bd40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 -- 172.21.15.71:0/3594569925 >> 172.21.15.71:0/3594569925 conn(0x7f6bd40abf50 msgr2=0x7f6bd40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 -- 172.21.15.71:0/3594569925 shutdown_connections 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.087+0000 7f6bd978a640 1 -- 172.21.15.71:0/3594569925 wait complete. 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.088+0000 7f6bd978a640 10 monclient: build_initial_monmap 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.088+0000 7f6bd978a640 10 monclient: monmap: 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:22.099 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:22.099 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:22.099 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:22.099 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:22.099 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.088+0000 7f6bd978a640 1 Processor -- start 2024-08-19T11:16:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.088+0000 7f6bd978a640 1 -- start start 2024-08-19T11:16:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.088+0000 7f6bd978a640 10 monclient: init 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient: _add_conns ranks=[2,1,0,6,4,5,7,3,8] 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6bd40a57c0 0x7f6bd41ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): picked mon.noname-b con 0x7f6bd40a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd40a6950 0x7f6bd41cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): picked mon.noname-f con 0x7f6bd40a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd40a7270 0x7f6bd41cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): picked mon.noname-a con 0x7f6bd40a7270 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd40a76c0 con 0x7f6bd40a7270 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd40a84c0 con 0x7f6bd40a6950 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd40a8700 con 0x7f6bd40a57c0 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd978a640 10 monclient(hunting): authenticate will time out at 1040.131422s 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd40a7270 0x7f6bd41cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6bd40a57c0 0x7f6bd41ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd40a7270 0x7f6bd41cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54690/0 (socket says 172.21.15.71:54690) 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 1 -- 172.21.15.71:0/2239748505 learned_addr learned my addr 172.21.15.71:0/2239748505 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): get_auth_request con 0x7f6bd40a7270 auth_method 0 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): get_auth_request con 0x7f6bd40a57c0 auth_method 0 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bca7fc640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd40a6950 0x7f6bd41cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bca7fc640 10 monclient(hunting): get_auth_request con 0x7f6bd40a6950 auth_method 0 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient(hunting): handle_auth_done global_id 74234 payload 824 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd40a6950 msgr2=0x7f6bd41cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd40a6950 0x7f6bd41cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd40a7270 msgr2=0x7f6bd41cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd40a7270 0x7f6bd41cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 monclient: found mon.noname-b 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd2ffd640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd4128cf0 con 0x7f6bd40a57c0 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bca7fc640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bd40a6950 0x7f6bd41cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.089+0000 7f6bd37fe640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bd40a7270 0x7f6bd41cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd2ffd640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6bd40a57c0 msgr2=0x7f6bd41ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd2ffd640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6bd40a57c0 0x7f6bd41ce940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400d5f0 tx=0x7f6bc400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bc4012c70 con 0x7f6bd40a57c0 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: dump: 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: _finish_auth 0 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc4019070 con 0x7f6bd40a57c0 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 5 monclient: authenticate success, global_id 74234 2024-08-19T11:16:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 10 monclient: _renew_subs 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bc40148a0 con 0x7f6bd40a57c0 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd4129f80 con 0x7f6bd40a57c0 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bcbfff640 10 monclient: dump: 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd1ffb640 4 set_mon_vals no callback set 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 10 monclient: _renew_subs 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd40a9660 con 0x7f6bd40a57c0 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.092+0000 7f6bd978a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bd978a640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 0x7f6bd4126230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6bd4076c60 con 0x7f6bd4125e50 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6bc4014430 con 0x7f6bd40a57c0 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 0x7f6bd4126230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient: get_auth_request con 0x7f6bd4125e50 auth_method 0 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bcbfff640 1 --2- 172.21.15.71:0/2239748505 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bb403ea80 0x7f6bb4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f6bc400f040 con 0x7f6bd40a57c0 2024-08-19T11:16:22.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bd37fe640 1 --2- 172.21.15.71:0/2239748505 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bb403ea80 0x7f6bb4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bd37fe640 10 monclient: get_auth_request con 0x7f6bb403ea80 auth_method 0 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_done global_id 44951 payload 824 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.093+0000 7f6bca7fc640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bd40a6d30 con 0x7f6bd4125e50 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.095+0000 7f6bca7fc640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 msgr2=0x7f6bd4126230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.095+0000 7f6bca7fc640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 0x7f6bd4126230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4127e70 tx=0x7f6bbc00db90 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bbc018020 con 0x7f6bd4125e50 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bd37fe640 1 --2- 172.21.15.71:0/2239748505 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bb403ea80 0x7f6bb4040f40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40a2700 tx=0x7f6bcc02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 10 monclient: dump: 2024-08-19T11:16:22.114 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.115 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6bbc009920 con 0x7f6bd4125e50 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 msgr2=0x7f6bd4126230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 0x7f6bd4126230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4127e70 tx=0x7f6bbc00db90 comp rx=0 tx=0).stop 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 msgr2=0x7f6bd4126230 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.096+0000 7f6bcbfff640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4125e50 0x7f6bd4126230 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4127e70 tx=0x7f6bbc00db90 comp rx=0 tx=0).stop 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bd978a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bd978a640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 0x7f6bd41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bd978a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6bd4127800 con 0x7f6bd4126770 2024-08-19T11:16:22.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 0x7f6bd41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient: get_auth_request con 0x7f6bd4126770 auth_method 0 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 10 monclient(hunting): handle_auth_done global_id 44960 payload 824 2024-08-19T11:16:22.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.102+0000 7f6bca7fc640 1 -- 172.21.15.71:0/2239748505 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6bd406db10 con 0x7f6bd4126770 2024-08-19T11:16:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bca7fc640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 msgr2=0x7f6bd41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bca7fc640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 0x7f6bd41225a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc019000 tx=0x7f6bbc0058d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6bbc025070 con 0x7f6bd4126770 2024-08-19T11:16:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:22.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 10 monclient: dump: 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.119 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f6bbc01f280 con 0x7f6bd4126770 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 msgr2=0x7f6bd41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 0x7f6bd41225a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc019000 tx=0x7f6bbc0058d0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 msgr2=0x7f6bd41225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bcbfff640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6bd4126770 0x7f6bd41225a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.120 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 151128, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:22.122 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:22.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:22.124 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:22.125 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.126 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:22.128 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.131 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.133 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:22.136 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:22.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.140 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.141 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:22.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:22.143 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bb403ea80 msgr2=0x7f6bb4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 --2- 172.21.15.71:0/2239748505 >> v2:172.21.15.135:6800/726754104 conn(0x7f6bb403ea80 0x7f6bb4040f40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40a2700 tx=0x7f6bcc02f000 comp rx=0 tx=0).stop 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 10 monclient: shutdown 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6bd40a57c0 msgr2=0x7f6bd41ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 --2- 172.21.15.71:0/2239748505 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6bd40a57c0 0x7f6bd41ce940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400d5f0 tx=0x7f6bc400dab0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd37fe640 1 -- 172.21.15.71:0/2239748505 reap_dead start 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd37fe640 1 -- 172.21.15.71:0/2239748505 reap_dead start 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 shutdown_connections 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 >> 172.21.15.71:0/2239748505 conn(0x7f6bd40abf50 msgr2=0x7f6bd4139fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 shutdown_connections 2024-08-19T11:16:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.106+0000 7f6bd978a640 1 -- 172.21.15.71:0/2239748505 wait complete. 2024-08-19T11:16:22.146 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:22.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:16:22.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.244+0000 7faf74277640 10 monclient: get_monmap_and_config 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.244+0000 7faf74277640 10 monclient: build_initial_monmap 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.244+0000 7faf74277640 10 monclient: monmap: 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:22.245878+0000 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:22.245878+0000 2024-08-19T11:16:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:22.247 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.244+0000 7faf74277640 1 Processor -- start 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.244+0000 7faf74277640 1 -- start start 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.244+0000 7faf74277640 10 monclient: init 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient: _add_conns ranks=[8,3,2,9,5,1,4,10,6,7,0] 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c0a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): picked mon.noname-e con 0x7faf6c0a57d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6c0a5bb0 0x7faf6c0a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): picked mon.noname-g con 0x7faf6c0a5bb0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 0x7faf6c137a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): picked mon.noname-b con 0x7faf6c137580 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0a41b0 con 0x7faf6c137580 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0728a0 con 0x7faf6c0a5bb0 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7faf6c072620 con 0x7faf6c0a57d0 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf74277640 10 monclient(hunting): authenticate will time out at 1040.287551s 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 0x7faf6c137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c0a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 0x7faf6c137a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41832/0 (socket says 172.21.15.71:41832) 2024-08-19T11:16:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 1 -- 172.21.15.71:0/1502681815 learned_addr learned my addr 172.21.15.71:0/1502681815 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): get_auth_request con 0x7faf6c137580 auth_method 0 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c0a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45052/0 (socket says 172.21.15.71:45052) 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): get_auth_request con 0x7faf6c0a57d0 auth_method 0 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf71812640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6c0a5bb0 0x7faf6c0a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf71812640 10 monclient(hunting): get_auth_request con 0x7faf6c0a5bb0 auth_method 0 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf71812640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf71812640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf71812640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient(hunting): handle_auth_done global_id 64574 payload 274 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 -- 172.21.15.71:0/1502681815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6c0a5bb0 msgr2=0x7faf6c0a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6c0a5bb0 0x7faf6c0a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 -- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 msgr2=0x7faf6c137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 0x7faf6c137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient: _finish_hunting 0 2024-08-19T11:16:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 monclient: found mon.noname-e 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72013640 1 -- 172.21.15.71:0/1502681815 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c073940 con 0x7faf6c0a57d0 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.245+0000 7faf72814640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 0x7faf6c137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf72013640 1 -- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 msgr2=0x7faf6c0a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf72013640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c0a1780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf600097d0 tx=0x7faf6002a030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b339d235e54b2aa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 1 -- 172.21.15.71:0/1502681815 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf60037070 con 0x7faf6c0a57d0 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: dump: 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: _finish_auth 0 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: _check_auth_tickets 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf74277640 5 monclient: authenticate success, global_id 64574 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 1 -- 172.21.15.71:0/1502681815 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6002ad90 con 0x7faf6c0a57d0 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf74277640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf74277640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf74277640 4 set_mon_vals no callback set 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 1 -- 172.21.15.71:0/1502681815 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf60030c20 con 0x7faf6c0a57d0 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.248+0000 7faf71011640 10 monclient: dump: 2024-08-19T11:16:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 10 monclient: shutdown 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 -- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 msgr2=0x7faf6c0a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c0a1780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf600097d0 tx=0x7faf6002a030 comp rx=0 tx=0).stop 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 -- 172.21.15.71:0/1502681815 shutdown_connections 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faf6c137580 0x7faf6c137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf6c0a5bb0 0x7faf6c0a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 --2- 172.21.15.71:0/1502681815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c0a1780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 -- 172.21.15.71:0/1502681815 >> 172.21.15.71:0/1502681815 conn(0x7faf6c0aa3f0 msgr2=0x7faf6c0a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 -- 172.21.15.71:0/1502681815 shutdown_connections 2024-08-19T11:16:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.249+0000 7faf74277640 1 -- 172.21.15.71:0/1502681815 wait complete. 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient: build_initial_monmap 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient: monmap: 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 Processor -- start 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 -- start start 2024-08-19T11:16:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient: init 2024-08-19T11:16:22.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:22.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient: _add_conns ranks=[8,6,7,0,3,5,4,2,1] 2024-08-19T11:16:22.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c1ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): picked mon.noname-e con 0x7faf6c0a57d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:22.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faf6c0a5bb0 0x7faf6c1cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): picked mon.noname-d con 0x7faf6c0a5bb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c137580 0x7faf6c125240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): picked mon.noname-i con 0x7faf6c137580 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7faf6c137f40 con 0x7faf6c0a5bb0 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7faf6c0a64f0 con 0x7faf6c137580 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7faf6c1380c0 con 0x7faf6c0a57d0 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf74277640 10 monclient(hunting): authenticate will time out at 1040.292900s 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c1ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c1ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45068/0 (socket says 172.21.15.71:45068) 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf71812640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faf6c0a5bb0 0x7faf6c1cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 1 -- 172.21.15.71:0/3630224610 learned_addr learned my addr 172.21.15.71:0/3630224610 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 10 monclient(hunting): get_auth_request con 0x7faf6c0a57d0 auth_method 0 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.250+0000 7faf72013640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): get_auth_request con 0x7faf6c0a5bb0 auth_method 0 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72814640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c137580 0x7faf6c125240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72814640 10 monclient(hunting): get_auth_request con 0x7faf6c137580 auth_method 0 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72814640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72814640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72814640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 10 monclient(hunting): handle_auth_done global_id 64583 payload 824 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c137580 msgr2=0x7faf6c125240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c137580 0x7faf6c125240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faf6c0a5bb0 msgr2=0x7faf6c1cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7faf6c0a5bb0 0x7faf6c1cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 10 monclient: _finish_hunting 0 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 1 monclient: found mon.noname-e 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72013640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c1364f0 con 0x7faf6c0a57d0 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.251+0000 7faf72814640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c137580 0x7faf6c125240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf72013640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 msgr2=0x7faf6c1ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf72013640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c1ceae0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf60035040 tx=0x7faf600046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf60037040 con 0x7faf6c0a57d0 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: dump: 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: _finish_auth 0 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf60042070 con 0x7faf6c0a57d0 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 5 monclient: authenticate success, global_id 64583 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 10 monclient: _renew_subs 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf6003dd20 con 0x7faf6c0a57d0 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c137a00 con 0x7faf6c0a57d0 2024-08-19T11:16:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf70810640 4 set_mon_vals no callback set 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf5effd640 10 monclient: dump: 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.278 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 10 monclient: _renew_subs 2024-08-19T11:16:22.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.253+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c128f50 con 0x7faf6c0a57d0 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf74277640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf74277640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 0x7faf6c063e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7faf6c06a590 con 0x7faf6c063a80 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7faf60003bd0 con 0x7faf6c0a57d0 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf5effd640 1 --2- 172.21.15.71:0/3630224610 >> v2:172.21.15.135:6800/726754104 conn(0x7faf5003ea80 0x7faf50040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf71812640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 0x7faf6c063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7faf60071ca0 con 0x7faf6c0a57d0 2024-08-19T11:16:22.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf71812640 10 monclient: get_auth_request con 0x7faf6c063a80 auth_method 0 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf71812640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.254+0000 7faf71812640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf71812640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf72814640 1 --2- 172.21.15.71:0/3630224610 >> v2:172.21.15.135:6800/726754104 conn(0x7faf5003ea80 0x7faf50040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf72814640 10 monclient: get_auth_request con 0x7faf5003ea80 auth_method 0 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf71812640 10 monclient(hunting): handle_auth_done global_id 64600 payload 824 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.255+0000 7faf71812640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf6c0a3470 con 0x7faf6c063a80 2024-08-19T11:16:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf71812640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 msgr2=0x7faf6c063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf71812640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 0x7faf6c063e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf68006fd0 tx=0x7faf68010c80 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf72814640 1 --2- 172.21.15.71:0/3630224610 >> v2:172.21.15.135:6800/726754104 conn(0x7faf5003ea80 0x7faf50040f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faf6c127690 tx=0x7faf6400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf68018070 con 0x7faf6c063a80 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf5effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.257+0000 7faf5effd640 10 monclient: dump: 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faf6800eb90 con 0x7faf6c063a80 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 msgr2=0x7faf6c063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 0x7faf6c063e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf68006fd0 tx=0x7faf68010c80 comp rx=0 tx=0).stop 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 msgr2=0x7faf6c063e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.258+0000 7faf5effd640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c063a80 0x7faf6c063e60 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf68006fd0 tx=0x7faf68010c80 comp rx=0 tx=0).stop 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf74277640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf74277640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 0x7faf6c02d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf74277640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7faf6c0a3240 con 0x7faf6c02d1c0 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 0x7faf6c02d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient: get_auth_request con 0x7faf6c02d1c0 auth_method 0 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 10 monclient(hunting): handle_auth_done global_id 64609 payload 824 2024-08-19T11:16:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.264+0000 7faf71812640 1 -- 172.21.15.71:0/3630224610 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf6c0a5fb0 con 0x7faf6c02d1c0 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.267+0000 7faf71812640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 msgr2=0x7faf6c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.267+0000 7faf71812640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 0x7faf6c02d5d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf68006fd0 tx=0x7faf680046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.267+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faf68014ab0 con 0x7faf6c02d1c0 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.267+0000 7faf5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.267+0000 7faf5effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.267+0000 7faf5effd640 10 monclient: dump: 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7faf68014640 con 0x7faf6c02d1c0 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 msgr2=0x7faf6c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 0x7faf6c02d5d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf68006fd0 tx=0x7faf680046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 msgr2=0x7faf6c02d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf5effd640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faf6c02d1c0 0x7faf6c02d5d0 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faf68006fd0 tx=0x7faf680046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 128, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 93762, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:16:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:22.317 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 >> v2:172.21.15.135:6800/726754104 conn(0x7faf5003ea80 msgr2=0x7faf50040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 --2- 172.21.15.71:0/3630224610 >> v2:172.21.15.135:6800/726754104 conn(0x7faf5003ea80 0x7faf50040f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faf6c127690 tx=0x7faf6400b040 comp rx=0 tx=0).stop 2024-08-19T11:16:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 10 monclient: shutdown 2024-08-19T11:16:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:22.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 msgr2=0x7faf6c1ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 --2- 172.21.15.71:0/3630224610 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7faf6c0a57d0 0x7faf6c1ceae0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf60035040 tx=0x7faf600046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf72814640 1 -- 172.21.15.71:0/3630224610 reap_dead start 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf72814640 1 -- 172.21.15.71:0/3630224610 reap_dead start 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 shutdown_connections 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 >> 172.21.15.71:0/3630224610 conn(0x7faf6c0aa3f0 msgr2=0x7faf6c0a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 shutdown_connections 2024-08-19T11:16:22.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.268+0000 7faf74277640 1 -- 172.21.15.71:0/3630224610 wait complete. 2024-08-19T11:16:22.320 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:16:22.321 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f', 'i', 'c'] 2024-08-19T11:16:22.321 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-19T11:16:22.321 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-08-19T11:16:22.321 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-08-19T11:16:22.321 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-19T11:16:22.321 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:16:22.335 INFO:tasks.ceph.mon.f:Stopped 2024-08-19T11:16:22.335 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-08-19T11:16:22.335 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-08-19T11:16:22.335 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-19T11:16:22.335 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:16:22.387 INFO:tasks.ceph.mon.i:Stopped 2024-08-19T11:16:22.387 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-08-19T11:16:22.387 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-08-19T11:16:22.388 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-19T11:16:22.388 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:16:22.398 INFO:tasks.ceph.mon.c:Stopped 2024-08-19T11:16:22.398 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-08-19T11:16:22.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.534+0000 7fc9c2f72640 10 monclient: get_monmap_and_config 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.534+0000 7fc9c2f72640 10 monclient: build_initial_monmap 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.534+0000 7fc9c2f72640 10 monclient: monmap: 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:22.535771+0000 2024-08-19T11:16:22.536 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:22.535771+0000 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:22.537 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:22.538 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.534+0000 7fc9c2f72640 1 Processor -- start 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.534+0000 7fc9c2f72640 1 -- start start 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.534+0000 7fc9c2f72640 10 monclient: init 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient: _add_conns ranks=[1,5,7,10,0,6,4,3,9,8,2] 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fc9bc0a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 0x7fc9bc0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): picked mon.noname-h con 0x7fc9bc0a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:22.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc13eb10 0x7fc9bc140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): picked mon.noname-i con 0x7fc9bc13eb10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc0a4f90 con 0x7fc9bc0a6a30 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc9bc0a3650 con 0x7fc9bc0a6e10 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc9bc0a6380 con 0x7fc9bc13eb10 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c2f72640 10 monclient(hunting): authenticate will time out at 1040.577471s 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c0d0e640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7fc9bc0a6a30 legacy=0x7fc9bc0a57f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c150f640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc13eb10 msgr2=0x7fc9bc140f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9c150f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc13eb10 0x7fc9bc140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 0x7fc9bc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 0x7fc9bc0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:33332/0 (socket says 172.21.15.71:33332) 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 -- 172.21.15.71:0/4119434061 learned_addr learned my addr 172.21.15.71:0/4119434061 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): get_auth_request con 0x7fc9bc0a6e10 auth_method 0 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient(hunting): handle_auth_done global_id 44969 payload 274 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 -- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc13eb10 msgr2=0x7fc9bc140f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 --2- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc13eb10 0x7fc9bc140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 -- 172.21.15.71:0/4119434061 >> v1:172.21.15.135:6789/0 conn(0x7fc9bc0a6a30 legacy=0x7fc9bc0a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:22.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:22.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 monclient: found mon.noname-h 2024-08-19T11:16:22.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:22.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:16:22.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.535+0000 7fc9bbfff640 1 -- 172.21.15.71:0/4119434061 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc0a49d0 con 0x7fc9bc0a6e10 2024-08-19T11:16:22.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bbfff640 1 -- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 msgr2=0x7fc9bc0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bbfff640 1 --2- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 0x7fc9bc0a71f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098d0 tx=0x7fc9a402a0d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=2f0ae046a9e99b6e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 1 -- 172.21.15.71:0/4119434061 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9a4037070 con 0x7fc9bc0a6e10 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: dump: 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.549 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 1 -- 172.21.15.71:0/4119434061 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a40307b0 con 0x7fc9bc0a6e10 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 5 monclient: authenticate success, global_id 44969 2024-08-19T11:16:22.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 1 -- 172.21.15.71:0/4119434061 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9a4030e50 con 0x7fc9bc0a6e10 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 4 set_mon_vals no callback set 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9bb7fe640 10 monclient: dump: 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.551 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 10 monclient: shutdown 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 -- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 msgr2=0x7fc9bc0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 0x7fc9bc0a71f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098d0 tx=0x7fc9a402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 -- 172.21.15.71:0/4119434061 shutdown_connections 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc13eb10 0x7fc9bc140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/4119434061 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9bc0a6e10 0x7fc9bc0a71f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 -- 172.21.15.71:0/4119434061 >> 172.21.15.71:0/4119434061 conn(0x7fc9bc0ac030 msgr2=0x7fc9bc0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 -- 172.21.15.71:0/4119434061 shutdown_connections 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.539+0000 7fc9c2f72640 1 -- 172.21.15.71:0/4119434061 wait complete. 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.540+0000 7fc9c2f72640 10 monclient: build_initial_monmap 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.540+0000 7fc9c2f72640 10 monclient: monmap: 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:22.553 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.540+0000 7fc9c2f72640 1 Processor -- start 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.540+0000 7fc9c2f72640 1 -- start start 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.540+0000 7fc9c2f72640 10 monclient: init 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient: _add_conns ranks=[7,3,2,6,8,4,5,0,1] 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc0a6a30 0x7fc9bc123cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): picked mon.noname-i con 0x7fc9bc0a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9bc0a6e10 0x7fc9bc125db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): picked mon.noname-g con 0x7fc9bc0a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): picked mon.noname-b con 0x7fc9bc13eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0a7730 con 0x7fc9bc13eb10 2024-08-19T11:16:22.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc141440 con 0x7fc9bc0a6e10 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc9bc0a94e0 con 0x7fc9bc0a6a30 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c2f72640 10 monclient(hunting): authenticate will time out at 1040.583444s 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c0d0e640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc0a6a30 msgr2=0x7fc9bc123cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c0d0e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc0a6a30 0x7fc9bc123cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:41834/0 (socket says 172.21.15.71:41834) 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 -- 172.21.15.71:0/1264909376 learned_addr learned my addr 172.21.15.71:0/1264909376 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): get_auth_request con 0x7fc9bc13eb10 auth_method 0 2024-08-19T11:16:22.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9bbfff640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9bc0a6e10 0x7fc9bc125db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9bbfff640 10 monclient(hunting): get_auth_request con 0x7fc9bc0a6e10 auth_method 0 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient(hunting): handle_auth_done global_id 74252 payload 824 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 -- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc0a6a30 msgr2=0x7fc9bc123cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc0a6a30 0x7fc9bc123cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 -- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9bc0a6e10 msgr2=0x7fc9bc125db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9bc0a6e10 0x7fc9bc125db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient: _finish_hunting 0 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 monclient: found mon.noname-b 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9c150f640 1 -- 172.21.15.71:0/1264909376 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc125250 con 0x7fc9bc13eb10 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.541+0000 7fc9bbfff640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9bc0a6e10 0x7fc9bc125db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c150f640 1 -- 172.21.15.71:0/1264909376 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 msgr2=0x7fc9bc13cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c150f640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400b470 tx=0x7fc9b400b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9b4016070 con 0x7fc9bc13eb10 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c150f640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400b470 tx=0x7fc9b400b930 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fc9b4003d00 config(0 keys) 2024-08-19T11:16:22.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 10 monclient: dump: 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.559 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 10 monclient: _finish_auth 0 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 10 monclient: _check_auth_tickets 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b4003d00 con 0x7fc9bc13eb10 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 5 monclient: authenticate success, global_id 74252 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 10 monclient: _renew_subs 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc126d10 con 0x7fc9bc13eb10 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9b97fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 10 monclient: _renew_subs 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9baffd640 4 set_mon_vals no callback set 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.544+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc13d8c0 con 0x7fc9bc13eb10 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c2f72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c2f72640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c2f72640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9b40054e0 con 0x7fc9bc13eb10 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc0a71f0 con 0x7fc9bc13eb10 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9b97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9b97fa640 10 monclient: dump: 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:22.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:22.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc9b4005070 con 0x7fc9bc13eb10 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9b97fa640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c0d0e640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c0d0e640 10 monclient: get_auth_request con 0x7fc99c03ead0 auth_method 0 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.545+0000 7fc9c0d0e640 1 -- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 msgr2=0x7fc99c040f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.546+0000 7fc9c0d0e640 1 -- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 msgr2=0x7fc99c040f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.546+0000 7fc9c0d0e640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.546+0000 7fc9c0d0e640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:22.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.549+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7fc9b4051160 con 0x7fc9bc13eb10 2024-08-19T11:16:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.747+0000 7fc9c0d0e640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:22.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.747+0000 7fc9c0d0e640 10 monclient: get_auth_request con 0x7fc99c03ead0 auth_method 0 2024-08-19T11:16:22.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:22.750+0000 7fc9c0d0e640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac003cb0 tx=0x7fc9ac009270 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.168+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc9b4050050 con 0x7fc9bc13eb10 2024-08-19T11:16:23.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.168+0000 7fc9b97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:23.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.168+0000 7fc9b97fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.411+0000 7fc9c2f72640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.411+0000 7fc9c2f72640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.411+0000 7fc9c2f72640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.411+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc9bc06ca70 con 0x7fc9bc13eb10 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.412+0000 7fc9b97fa640 1 -- 172.21.15.71:0/1264909376 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7fc9b401cd40 con 0x7fc9bc13eb10 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.412+0000 7fc9b97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:23.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.412+0000 7fc9b97fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:23.415 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":128,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 msgr2=0x7fc99c040f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac003cb0 tx=0x7fc9ac009270 comp rx=0 tx=0).stop 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 10 monclient: shutdown 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 msgr2=0x7fc9bc13cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400b470 tx=0x7fc9b400b930 comp rx=0 tx=0).stop 2024-08-19T11:16:23.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 shutdown_connections 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/1264909376 >> v2:172.21.15.135:6800/726754104 conn(0x7fc99c03ead0 0x7fc99c040f90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9bc13eb10 0x7fc9bc13cc20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc9bc0a6e10 0x7fc9bc125db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 --2- 172.21.15.71:0/1264909376 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9bc0a6a30 0x7fc9bc123cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 >> 172.21.15.71:0/1264909376 conn(0x7fc9bc0ac030 msgr2=0x7fc9bc1400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 shutdown_connections 2024-08-19T11:16:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:23.414+0000 7fc9c2f72640 1 -- 172.21.15.71:0/1264909376 wait complete. 2024-08-19T11:16:26.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:16:26.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.535+0000 7f9430bf7640 10 monclient: get_monmap_and_config 2024-08-19T11:16:26.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.535+0000 7f9430bf7640 10 monclient: build_initial_monmap 2024-08-19T11:16:26.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.535+0000 7f9430bf7640 10 monclient: monmap: 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:26.536277+0000 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:26.536277+0000 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:26.537 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:26.538 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:26.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 Processor -- start 2024-08-19T11:16:26.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 -- start start 2024-08-19T11:16:26.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient: init 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient: _add_conns ranks=[5,3,8,7,9,0,2,6,1,4,10] 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f942c0a3740 0x7f942c0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): picked mon.noname-h con 0x7f942c0a3740 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f942c0a1810 0x7f942c0a4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): picked mon.noname-g con 0x7f942c0a1810 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 0x7f942c137910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): picked mon.noname-e con 0x7f942c137510 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:26.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f942c09e0a0 con 0x7f942c0a1810 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f942c0a45a0 con 0x7f942c0a3740 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f942c09dba0 con 0x7f942c137510 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.536+0000 7f9430bf7640 10 monclient(hunting): authenticate will time out at 1044.577992s 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 0x7f942c137910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 0x7f942c137910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59678/0 (socket says 172.21.15.71:59678) 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 -- 172.21.15.71:0/2107463691 learned_addr learned my addr 172.21.15.71:0/2107463691 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): get_auth_request con 0x7f942c137510 auth_method 0 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f942c0a3740 0x7f942c0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f9423fff640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f942c0a1810 0x7f942c0a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): get_auth_request con 0x7f942c0a3740 auth_method 0 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f9423fff640 10 monclient(hunting): get_auth_request con 0x7f942c0a1810 auth_method 0 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f9423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f9423fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f9423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient(hunting): handle_auth_done global_id 64592 payload 274 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 -- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f942c0a3740 msgr2=0x7f942c0a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f942c0a3740 0x7f942c0a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 -- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f942c0a1810 msgr2=0x7f942c0a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f942c0a1810 0x7f942c0a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 monclient: found mon.noname-e 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f942ad9d640 1 -- 172.21.15.71:0/2107463691 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0a1c90 con 0x7f942c137510 2024-08-19T11:16:26.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.537+0000 7f9423fff640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f942c0a1810 0x7f942c0a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f942ad9d640 1 -- 172.21.15.71:0/2107463691 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 msgr2=0x7f942c137910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f942ad9d640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 0x7f942c137910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9424009e80 tx=0x7f942402a530 comp rx=0 tx=0).ready entity=mon.8 client_cookie=9ee257b34050a2e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 1 -- 172.21.15.71:0/2107463691 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9424036070 con 0x7f942c137510 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: dump: 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:26.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:26.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: _finish_auth 0 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 1 -- 172.21.15.71:0/2107463691 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424007a70 con 0x7f942c137510 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9430bf7640 5 monclient: authenticate success, global_id 64592 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9430bf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9430bf7640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9430bf7640 4 set_mon_vals no callback set 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 1 -- 172.21.15.71:0/2107463691 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9424007ca0 con 0x7f942c137510 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.540+0000 7f9429d9b640 10 monclient: dump: 2024-08-19T11:16:26.549 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:26.550 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 10 monclient: shutdown 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 -- 172.21.15.71:0/2107463691 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 msgr2=0x7f942c137910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 0x7f942c137910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9424009e80 tx=0x7f942402a530 comp rx=0 tx=0).stop 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 -- 172.21.15.71:0/2107463691 shutdown_connections 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c137510 0x7f942c137910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f942c0a1810 0x7f942c0a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 --2- 172.21.15.71:0/2107463691 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f942c0a3740 0x7f942c0a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 -- 172.21.15.71:0/2107463691 >> 172.21.15.71:0/2107463691 conn(0x7f942c06d080 msgr2=0x7f942c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:26.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 -- 172.21.15.71:0/2107463691 shutdown_connections 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 1 -- 172.21.15.71:0/2107463691 wait complete. 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.541+0000 7f9430bf7640 10 monclient: build_initial_monmap 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient: monmap: 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:26.552 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:26.553 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:26.553 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:26.553 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:26.553 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:26.553 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:26.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 Processor -- start 2024-08-19T11:16:26.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 -- start start 2024-08-19T11:16:26.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient: init 2024-08-19T11:16:26.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:26.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient: _add_conns ranks=[8,7,0,3,2,1,5,6,4] 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 0x7f942c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): picked mon.noname-e con 0x7f942c0a3740 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f942c137510 0x7f942c1231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): picked mon.noname-i con 0x7f942c137510 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 0x7f942c1cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f942c123730 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f942c09c9f0 con 0x7f942c123730 2024-08-19T11:16:26.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f942c137e50 con 0x7f942c137510 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f942c1267f0 con 0x7f942c0a3740 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9430bf7640 10 monclient(hunting): authenticate will time out at 1044.583938s 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9423fff640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f942c137510 msgr2=0x7f942c1231f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.542+0000 7f9423fff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f942c137510 0x7f942c1231f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 0x7f942c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 0x7f942c122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59680/0 (socket says 172.21.15.71:59680) 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 0x7f942c1cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 1 -- 172.21.15.71:0/3691002584 learned_addr learned my addr 172.21.15.71:0/3691002584 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:26.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): get_auth_request con 0x7f942c0a3740 auth_method 0 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): get_auth_request con 0x7f942c123730 auth_method 0 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:26.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient(hunting): handle_auth_done global_id 74259 payload 824 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 -- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 msgr2=0x7f942c122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 0x7f942c122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 -- 172.21.15.71:0/3691002584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f942c137510 msgr2=0x7f942c1231f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f942c137510 0x7f942c1231f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 monclient: found mon.noname-a 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942ad9d640 1 -- 172.21.15.71:0/3691002584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c126f80 con 0x7f942c123730 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.543+0000 7f942a59c640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 0x7f942c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.545+0000 7f942ad9d640 1 -- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 msgr2=0x7f942c1cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:26.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.545+0000 7f942ad9d640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 0x7f942c1cc740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f942c09d660 tx=0x7f9424004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.547+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9424040030 con 0x7f942c123730 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.547+0000 7f9422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: dump: 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:26.562 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424003ba0 con 0x7f942c123730 2024-08-19T11:16:26.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 5 monclient: authenticate success, global_id 74259 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 10 monclient: _renew_subs 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c126ad0 con 0x7f942c123730 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9424036040 con 0x7f942c123730 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f942959a640 4 set_mon_vals no callback set 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 10 monclient: dump: 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.564 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:26.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 10 monclient: _renew_subs 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c073620 con 0x7f942c123730 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.548+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9424043070 con 0x7f942c123730 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f9422ffd640 1 --2- 172.21.15.71:0/3691002584 >> v2:172.21.15.135:6800/726754104 conn(0x7f940c03eab0 0x7f940c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f9430bf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f9430bf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f9430bf7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942c137a80 con 0x7f942c123730 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f9424041070 con 0x7f942c123730 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f942a59c640 1 --2- 172.21.15.71:0/3691002584 >> v2:172.21.15.135:6800/726754104 conn(0x7f940c03eab0 0x7f940c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.549+0000 7f942a59c640 10 monclient: get_auth_request con 0x7f940c03eab0 auth_method 0 2024-08-19T11:16:26.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.552+0000 7f942a59c640 1 --2- 172.21.15.71:0/3691002584 >> v2:172.21.15.135:6800/726754104 conn(0x7f940c03eab0 0x7f940c040f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f941c009f70 tx=0x7f941c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:26.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.554+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9424044da0 con 0x7f942c123730 2024-08-19T11:16:26.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.554+0000 7f9422ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:26.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.554+0000 7f9422ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:26.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9430bf7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:26.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9430bf7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:26.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9430bf7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:26.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f942c1381b0 con 0x7f942c123730 2024-08-19T11:16:26.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9422ffd640 1 -- 172.21.15.71:0/3691002584 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3194 (secure 0 0 0) 0x7f9424003d50 con 0x7f942c123730 2024-08-19T11:16:26.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9422ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:26.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.795+0000 7f9422ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:26.797 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":128,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.797+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 >> v2:172.21.15.135:6800/726754104 conn(0x7f940c03eab0 msgr2=0x7f940c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.797+0000 7f9430bf7640 1 --2- 172.21.15.71:0/3691002584 >> v2:172.21.15.135:6800/726754104 conn(0x7f940c03eab0 0x7f940c040f70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f941c009f70 tx=0x7f941c009190 comp rx=0 tx=0).stop 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.797+0000 7f9430bf7640 10 monclient: shutdown 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.797+0000 7f9430bf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.797+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 msgr2=0x7f942c1cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.797+0000 7f9430bf7640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 0x7f942c1cc740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f942c09d660 tx=0x7f9424004a40 comp rx=0 tx=0).stop 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 shutdown_connections 2024-08-19T11:16:26.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 --2- 172.21.15.71:0/3691002584 >> v2:172.21.15.135:6800/726754104 conn(0x7f940c03eab0 0x7f940c040f70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f942c123730 0x7f942c1cc740 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f942c137510 0x7f942c1231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 --2- 172.21.15.71:0/3691002584 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f942c0a3740 0x7f942c122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 >> 172.21.15.71:0/3691002584 conn(0x7f942c06d080 msgr2=0x7f942c0a6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 shutdown_connections 2024-08-19T11:16:26.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:26.798+0000 7f9430bf7640 1 -- 172.21.15.71:0/3691002584 wait complete. 2024-08-19T11:16:29.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.919+0000 7f28d03d9640 10 monclient: get_monmap_and_config 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.919+0000 7f28d03d9640 10 monclient: build_initial_monmap 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.919+0000 7f28d03d9640 10 monclient: monmap: 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:29.919927+0000 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:29.919927+0000 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:29.920 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:29.921 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.919+0000 7f28d03d9640 1 Processor -- start 2024-08-19T11:16:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.919+0000 7f28d03d9640 1 -- start start 2024-08-19T11:16:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.919+0000 7f28d03d9640 10 monclient: init 2024-08-19T11:16:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient: _add_conns ranks=[4,10,5,2,3,1,9,6,8,7,0] 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f28c80a3d80 0x7f28c8136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): picked mon.noname-c con 0x7f28c80a3d80 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28c8136ab0 0x7f28c8136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): picked mon.noname-f con 0x7f28c8136ab0 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 0x7f28c80a4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): picked mon.noname-h con 0x7f28c80a4160 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f28c80a1fa0 con 0x7f28c8136ab0 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f28c809fe70 con 0x7f28c80a3d80 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f28c81373d0 con 0x7f28c80a4160 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28d03d9640 10 monclient(hunting): authenticate will time out at 1047.961714s 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28ce175640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f28c80a3d80 msgr2=0x7f28c8136570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28ce175640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f28c80a3d80 0x7f28c8136570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28cd974640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f28c8136ab0 msgr2=0x7f28c8136e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.920+0000 7f28cd974640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28c8136ab0 0x7f28c8136e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 0x7f28c80a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 0x7f28c80a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:58960/0 (socket says 172.21.15.71:58960) 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 -- 172.21.15.71:0/2132386375 learned_addr learned my addr 172.21.15.71:0/2132386375 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): get_auth_request con 0x7f28c80a4160 auth_method 0 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:29.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient(hunting): handle_auth_done global_id 44987 payload 274 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 -- 172.21.15.71:0/2132386375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f28c80a3d80 msgr2=0x7f28c8136570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 --2- 172.21.15.71:0/2132386375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f28c80a3d80 0x7f28c8136570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 -- 172.21.15.71:0/2132386375 >> v2:172.21.15.135:3300/0 conn(0x7f28c8136ab0 msgr2=0x7f28c8136e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 --2- 172.21.15.71:0/2132386375 >> v2:172.21.15.135:3300/0 conn(0x7f28c8136ab0 0x7f28c8136e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient: _finish_hunting 0 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 monclient: found mon.noname-h 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:29.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:16:29.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.921+0000 7f28ce976640 1 -- 172.21.15.71:0/2132386375 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c80a24d0 con 0x7f28c80a4160 2024-08-19T11:16:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28ce976640 1 -- 172.21.15.71:0/2132386375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 msgr2=0x7f28c80a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28ce976640 1 --2- 172.21.15.71:0/2132386375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 0x7f28c80a4610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c002a0d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=bcb3c3df8934cbdb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 1 -- 172.21.15.71:0/2132386375 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28c0037070 con 0x7f28c80a4160 2024-08-19T11:16:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: dump: 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: _finish_auth 0 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: _check_auth_tickets 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 1 -- 172.21.15.71:0/2132386375 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c00307b0 con 0x7f28c80a4160 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28d03d9640 5 monclient: authenticate success, global_id 44987 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28d03d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28d03d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 1 -- 172.21.15.71:0/2132386375 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28c0030e10 con 0x7f28c80a4160 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28d03d9640 4 set_mon_vals no callback set 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.924+0000 7f28cd173640 10 monclient: dump: 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 10 monclient: shutdown 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 -- 172.21.15.71:0/2132386375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 msgr2=0x7f28c80a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 --2- 172.21.15.71:0/2132386375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 0x7f28c80a4610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 -- 172.21.15.71:0/2132386375 shutdown_connections 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 --2- 172.21.15.71:0/2132386375 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f28c80a4160 0x7f28c80a4610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 --2- 172.21.15.71:0/2132386375 >> v2:172.21.15.135:3300/0 conn(0x7f28c8136ab0 0x7f28c8136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 --2- 172.21.15.71:0/2132386375 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f28c80a3d80 0x7f28c8136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 -- 172.21.15.71:0/2132386375 >> 172.21.15.71:0/2132386375 conn(0x7f28c80a91d0 msgr2=0x7f28c80a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 -- 172.21.15.71:0/2132386375 shutdown_connections 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.925+0000 7f28d03d9640 1 -- 172.21.15.71:0/2132386375 wait complete. 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.926+0000 7f28d03d9640 10 monclient: build_initial_monmap 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.926+0000 7f28d03d9640 10 monclient: monmap: 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.926+0000 7f28d03d9640 1 Processor -- start 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.926+0000 7f28d03d9640 1 -- start start 2024-08-19T11:16:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.926+0000 7f28d03d9640 10 monclient: init 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient: _add_conns ranks=[6,2,7,3,8,1,0,5,4] 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 0x7f28c8124c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): picked mon.noname-d con 0x7f28c80a3d80 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28c80a4160 0x7f28c8125180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): picked mon.noname-b con 0x7f28c80a4160 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f28c8136ab0 0x7f28c81256c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): picked mon.noname-i con 0x7f28c8136ab0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f28c80a08c0 con 0x7f28c80a4160 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f28c80a1c10 con 0x7f28c80a3d80 2024-08-19T11:16:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f28c80a2ca0 con 0x7f28c8136ab0 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28d03d9640 10 monclient(hunting): authenticate will time out at 1047.968136s 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 0x7f28c8124c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28c80a4160 0x7f28c8125180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 0x7f28c8124c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:41242/0 (socket says 172.21.15.71:41242) 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 -- 172.21.15.71:0/241788084 learned_addr learned my addr 172.21.15.71:0/241788084 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): get_auth_request con 0x7f28c80a3d80 auth_method 0 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce976640 1 -- 172.21.15.71:0/241788084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f28c8136ab0 msgr2=0x7f28c81256c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): get_auth_request con 0x7f28c80a4160 auth_method 0 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce976640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f28c8136ab0 0x7f28c81256c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient(hunting): handle_auth_done global_id 25746 payload 824 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 -- 172.21.15.71:0/241788084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f28c8136ab0 msgr2=0x7f28c81256c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f28c8136ab0 0x7f28c81256c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 -- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28c80a4160 msgr2=0x7f28c8125180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28c80a4160 0x7f28c8125180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient: _finish_hunting 0 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 monclient: found mon.noname-d 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28ce175640 1 -- 172.21.15.71:0/241788084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c806d290 con 0x7f28c80a3d80 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.927+0000 7f28cd974640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28c80a4160 0x7f28c8125180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28ce175640 1 -- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 msgr2=0x7f28c8124c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28ce175640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 0x7f28c8124c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28b800b580 tx=0x7f28b800ba40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28b80092c0 con 0x7f28c80a3d80 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 10 monclient: dump: 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b8015070 con 0x7f28c80a3d80 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f28b8003dd0 con 0x7f28c80a3d80 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28d03d9640 5 monclient: authenticate success, global_id 25746 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 monclient: _renew_subs 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.929+0000 7f28cc972640 4 set_mon_vals no callback set 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c80a1410 con 0x7f28c80a3d80 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28beffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28beffd640 10 monclient: dump: 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 monclient: _renew_subs 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c8127890 con 0x7f28c80a3d80 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f28b80050f0 con 0x7f28c80a3d80 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:29.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.930+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c8136570 con 0x7f28c80a3d80 2024-08-19T11:16:29.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.931+0000 7f28beffd640 1 --2- 172.21.15.71:0/241788084 >> v2:172.21.15.135:6800/726754104 conn(0x7f28ac03ea80 0x7f28ac040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:29.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.931+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f28b8051870 con 0x7f28c80a3d80 2024-08-19T11:16:29.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.931+0000 7f28cd974640 1 --2- 172.21.15.71:0/241788084 >> v2:172.21.15.135:6800/726754104 conn(0x7f28ac03ea80 0x7f28ac040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:29.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.931+0000 7f28cd974640 10 monclient: get_auth_request con 0x7f28ac03ea80 auth_method 0 2024-08-19T11:16:29.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.934+0000 7f28cd974640 1 --2- 172.21.15.71:0/241788084 >> v2:172.21.15.135:6800/726754104 conn(0x7f28ac03ea80 0x7f28ac040f40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009420 tx=0x7f28c4009370 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.935+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f28c80a1410 con 0x7f28c80a3d80 2024-08-19T11:16:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.935+0000 7f28beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:29.935+0000 7f28beffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28d03d9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28d03d9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28d03d9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f28c8126c60 con 0x7f28c80a3d80 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28beffd640 1 -- 172.21.15.71:0/241788084 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3194 (secure 0 0 0) 0x7f28b8050760 con 0x7f28c80a3d80 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.176+0000 7f28beffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:30.178 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":128,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:16:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 >> v2:172.21.15.135:6800/726754104 conn(0x7f28ac03ea80 msgr2=0x7f28ac040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 --2- 172.21.15.71:0/241788084 >> v2:172.21.15.135:6800/726754104 conn(0x7f28ac03ea80 0x7f28ac040f40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009420 tx=0x7f28c4009370 comp rx=0 tx=0).stop 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 10 monclient: shutdown 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 msgr2=0x7f28c8124c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 0x7f28c8124c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28b800b580 tx=0x7f28b800ba40 comp rx=0 tx=0).stop 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 shutdown_connections 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 --2- 172.21.15.71:0/241788084 >> v2:172.21.15.135:6800/726754104 conn(0x7f28ac03ea80 0x7f28ac040f40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f28c8136ab0 0x7f28c81256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f28c80a4160 0x7f28c8125180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 --2- 172.21.15.71:0/241788084 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f28c80a3d80 0x7f28c8124c40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 >> 172.21.15.71:0/241788084 conn(0x7f28c80a91d0 msgr2=0x7f28c809e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:30.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 shutdown_connections 2024-08-19T11:16:30.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:30.178+0000 7f28d03d9640 1 -- 172.21.15.71:0/241788084 wait complete. 2024-08-19T11:16:33.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.300+0000 7f80977bc640 10 monclient: get_monmap_and_config 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.300+0000 7f80977bc640 10 monclient: build_initial_monmap 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.300+0000 7f80977bc640 10 monclient: monmap: 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:33.300858+0000 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:33.300858+0000 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:33.301 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:33.302 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.300+0000 7f80977bc640 1 Processor -- start 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 -- start start 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient: init 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient: _add_conns ranks=[4,10,7,1,8,2,5,0,9,3,6] 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 0x7f80900a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): picked mon.noname-c con 0x7f80900a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 0x7f80900a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): picked mon.noname-f con 0x7f80900a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 0x7f8090139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): picked mon.noname-i con 0x7f8090139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:33.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f80900a4f90 con 0x7f80900a6e10 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f80900a6380 con 0x7f80900a6a30 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f80900a49d0 con 0x7f8090139860 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f80977bc640 10 monclient(hunting): authenticate will time out at 1051.342603s 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f8095558640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 msgr2=0x7f80900a57f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f8095558640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 0x7f80900a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f8095d59640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 msgr2=0x7f8090139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f8094d57640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 msgr2=0x7f80900a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f8095d59640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 0x7f8090139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:33.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.301+0000 7f8094d57640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 0x7f80900a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:33.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.502+0000 7f8095558640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 msgr2=0x7f80900a57f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:33.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.502+0000 7f8095558640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 0x7f80900a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:33.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.502+0000 7f8094d57640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 msgr2=0x7f80900a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:33.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.502+0000 7f8095d59640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 msgr2=0x7f8090139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:33.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.502+0000 7f8094d57640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 0x7f80900a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:33.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.502+0000 7f8095d59640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 0x7f8090139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:16:33.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.903+0000 7f8095558640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 msgr2=0x7f80900a57f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:33.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.903+0000 7f8095558640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 0x7f80900a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:33.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.903+0000 7f8095d59640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 msgr2=0x7f8090139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:33.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.903+0000 7f8094d57640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 msgr2=0x7f80900a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:33.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.903+0000 7f8095d59640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 0x7f8090139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:33.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:33.903+0000 7f8094d57640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 0x7f80900a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:16:34.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.704+0000 7f8095558640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 msgr2=0x7f80900a57f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.704+0000 7f8095558640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 0x7f80900a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.705+0000 7f8094d57640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 msgr2=0x7f80900a71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.705+0000 7f8095d59640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 msgr2=0x7f8090139cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.705+0000 7f8094d57640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 0x7f80900a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.705+0000 7f8095d59640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 0x7f8090139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:16:34.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:34.705+0000 7f8087fff640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): tick 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 msgr2=0x7f8090139cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8090139860 0x7f8090139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 msgr2=0x7f80900a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f80900a6a30 0x7f80900a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 msgr2=0x7f80900a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f80900a6e10 0x7f80900a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient: _add_conns ranks=[6,8,9,5,3,2,1,0] 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): picked mon.noname-d con 0x7f8074003840 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f8074006290 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f8074008df0 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f80900a4f90 con 0x7f8074008df0 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f80900a6380 con 0x7f8074003840 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f80900a49d0 con 0x7f8074006290 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.301+0000 7f8086ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45392/0 (socket says 172.21.15.71:45392) 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53018/0 (socket says 172.21.15.71:53018) 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:45820/0 (socket says 172.21.15.71:45820) 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 -- 172.21.15.71:0/557146906 learned_addr learned my addr 172.21.15.71:0/557146906 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 10 monclient(hunting): get_auth_request con 0x7f8074006290 auth_method 0 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 10 monclient(hunting): get_auth_request con 0x7f8074008df0 auth_method 0 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 10 monclient(hunting): get_auth_request con 0x7f8074003840 auth_method 0 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 msgr2=0x7f8074008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 msgr2=0x7f8074008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 msgr2=0x7f8074005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:16:36.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 1 -- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 msgr2=0x7f807400b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 msgr2=0x7f8074005c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8094d57640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 1 -- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 msgr2=0x7f807400b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 1 --2- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095d59640 1 --2- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:36.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.302+0000 7f8095558640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095d59640 1 --2- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095558640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095d59640 10 monclient(hunting): get_auth_request con 0x7f8074008df0 auth_method 0 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095d59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095d59640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095d59640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095558640 10 monclient(hunting): get_auth_request con 0x7f8074003840 auth_method 0 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095558640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095558640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8095558640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.503+0000 7f8094d57640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): get_auth_request con 0x7f8074006290 auth_method 0 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095d59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095d59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095d59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8094d57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 10 monclient(hunting): handle_auth_done global_id 25755 payload 274 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 msgr2=0x7f8074008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8074006290 0x7f8074008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 1 -- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 msgr2=0x7f807400b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 1 --2- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 10 monclient: _finish_hunting 0 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 1 monclient: found mon.noname-d 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095558640 1 -- 172.21.15.71:0/557146906 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80900a46f0 con 0x7f8074003840 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095d59640 1 --2- 172.21.15.71:0/557146906 >> v2:172.21.15.71:3300/0 conn(0x7f8074008df0 0x7f807400b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:36.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.504+0000 7f8095d59640 1 -- 172.21.15.71:0/557146906 reap_dead start 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8095558640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 msgr2=0x7f8074005c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8095558640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8080003980 tx=0x7f808002afa0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=7a4aac368fb770f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 1 -- 172.21.15.71:0/557146906 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8080038070 con 0x7f8074003840 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: dump: 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.513 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.514 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: _finish_auth 0 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f80977bc640 5 monclient: authenticate success, global_id 25755 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 1 -- 172.21.15.71:0/557146906 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808002bcc0 con 0x7f8074003840 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f80977bc640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f80977bc640 4 set_mon_vals no callback set 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 1 -- 172.21.15.71:0/557146906 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8080031c20 con 0x7f8074003840 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.507+0000 7f8087fff640 10 monclient: dump: 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.516 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 10 monclient: shutdown 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 -- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 msgr2=0x7f8074005c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8080003980 tx=0x7f808002afa0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 -- 172.21.15.71:0/557146906 shutdown_connections 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 --2- 172.21.15.71:0/557146906 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8074003840 0x7f8074005c90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 -- 172.21.15.71:0/557146906 >> 172.21.15.71:0/557146906 conn(0x7f80900ac030 msgr2=0x7f80900ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 -- 172.21.15.71:0/557146906 shutdown_connections 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.508+0000 7f80977bc640 1 -- 172.21.15.71:0/557146906 wait complete. 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient: build_initial_monmap 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient: monmap: 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:36.518 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 Processor -- start 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 -- start start 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient: init 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient: _add_conns ranks=[1,5,3,6,7,4,8,0,2] 2024-08-19T11:16:36.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8074003840 0x7f8090127290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient(hunting): picked mon.noname-f con 0x7f8074003840 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 0x7f80901251a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient(hunting): picked mon.noname-h con 0x7f8090124d60 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 0x7f8090125b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient(hunting): picked mon.noname-g con 0x7f80901256e0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80900a5b80 con 0x7f8074003840 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f80900a5a00 con 0x7f80901256e0 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.509+0000 7f80977bc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f80900a5d00 con 0x7f8090124d60 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f80977bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f80977bc640 10 monclient(hunting): authenticate will time out at 1054.551012s 2024-08-19T11:16:36.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095558640 1 -- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8074003840 msgr2=0x7f8090127290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095558640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8074003840 0x7f8090127290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 0x7f8090125b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 0x7f80901251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 0x7f80901251a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:49148/0 (socket says 172.21.15.71:49148) 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 0x7f8090125b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:51756/0 (socket says 172.21.15.71:51756) 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 -- 172.21.15.71:0/3950556846 learned_addr learned my addr 172.21.15.71:0/3950556846 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): get_auth_request con 0x7f8090124d60 auth_method 0 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): get_auth_request con 0x7f80901256e0 auth_method 0 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient(hunting): handle_auth_done global_id 44996 payload 824 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 -- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 msgr2=0x7f8090125b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 0x7f8090125b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 -- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8074003840 msgr2=0x7f8090127290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8074003840 0x7f8090127290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient: _finish_hunting 0 2024-08-19T11:16:36.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 monclient: found mon.noname-h 2024-08-19T11:16:36.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:36.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:16:36.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8094d57640 1 -- 172.21.15.71:0/3950556846 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8090126060 con 0x7f8090124d60 2024-08-19T11:16:36.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.510+0000 7f8095d59640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 0x7f8090125b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:36.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8094d57640 1 -- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 msgr2=0x7f80901251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:36.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8094d57640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 0x7f80901251a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f808c0056a0 tx=0x7f808c005aa0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f808c019020 con 0x7f8090124d60 2024-08-19T11:16:36.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: dump: 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.526 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: _finish_auth 0 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c015870 con 0x7f8090124d60 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 5 monclient: authenticate success, global_id 44996 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 10 monclient: _renew_subs 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80901287b0 con 0x7f8090124d60 2024-08-19T11:16:36.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f808c014360 con 0x7f8090124d60 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f8085ffb640 10 monclient: dump: 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.528 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80877fe640 4 set_mon_vals no callback set 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 10 monclient: _renew_subs 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.513+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f809013a3e0 con 0x7f8090124d60 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.514+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f808c01c020 con 0x7f8090124d60 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f80977bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f80977bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:36.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f80977bc640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80900a71f0 con 0x7f8090124d60 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f8085ffb640 1 --2- 172.21.15.71:0/3950556846 >> v2:172.21.15.135:6800/726754104 conn(0x7f807403fd70 0x7f8074042230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f808c052400 con 0x7f8090124d60 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f8095558640 1 --2- 172.21.15.71:0/3950556846 >> v2:172.21.15.135:6800/726754104 conn(0x7f807403fd70 0x7f8074042230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.515+0000 7f8095558640 10 monclient: get_auth_request con 0x7f807403fd70 auth_method 0 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.518+0000 7f8095558640 1 --2- 172.21.15.71:0/3950556846 >> v2:172.21.15.135:6800/726754104 conn(0x7f807403fd70 0x7f8074042230 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8080032000 tx=0x7f808002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.520+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f808c023030 con 0x7f8090124d60 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.520+0000 7f8085ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:36.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.520+0000 7f8085ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.762+0000 7f80977bc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.763+0000 7f80977bc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.763+0000 7f80977bc640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:16:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.763+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8090126730 con 0x7f8090124d60 2024-08-19T11:16:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.763+0000 7f8085ffb640 1 -- 172.21.15.71:0/3950556846 <== mon.5 v2:172.21.15.135:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3175 (secure 0 0 0) 0x7f808c012040 con 0x7f8090124d60 2024-08-19T11:16:36.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.763+0000 7f8085ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:36.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.763+0000 7f8085ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:36.765 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":132,"quorum":[0,2,3,5,6,8],"quorum_names":["a","b","g","h","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 >> v2:172.21.15.135:6800/726754104 conn(0x7f807403fd70 msgr2=0x7f8074042230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 --2- 172.21.15.71:0/3950556846 >> v2:172.21.15.135:6800/726754104 conn(0x7f807403fd70 0x7f8074042230 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8080032000 tx=0x7f808002f000 comp rx=0 tx=0).stop 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 10 monclient: shutdown 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 msgr2=0x7f80901251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 0x7f80901251a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f808c0056a0 tx=0x7f808c005aa0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 shutdown_connections 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 --2- 172.21.15.71:0/3950556846 >> v2:172.21.15.135:6800/726754104 conn(0x7f807403fd70 0x7f8074042230 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f80901256e0 0x7f8090125b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8090124d60 0x7f80901251a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 --2- 172.21.15.71:0/3950556846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8074003840 0x7f8090127290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 >> 172.21.15.71:0/3950556846 conn(0x7f80900ac030 msgr2=0x7f8090139040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:36.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 shutdown_connections 2024-08-19T11:16:36.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.766+0000 7f80977bc640 1 -- 172.21.15.71:0/3950556846 wait complete. 2024-08-19T11:16:36.778 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-08-19T11:16:36.778 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon a 2024-08-19T11:16:36.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:16:36.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.874+0000 7fc3b514c640 10 monclient: get_monmap_and_config 2024-08-19T11:16:36.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.874+0000 7fc3b514c640 10 monclient: build_initial_monmap 2024-08-19T11:16:36.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.874+0000 7fc3b514c640 10 monclient: monmap: 2024-08-19T11:16:36.875 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:36.875238+0000 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:36.875238+0000 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:36.876 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:36.877 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:36.877 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:36.877 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:36.877 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 Processor -- start 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 -- start start 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient: init 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient: _add_conns ranks=[6,10,3,1,2,9,4,8,7,0,5] 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 0x7fc3b00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): picked mon.noname-d con 0x7fc3b00a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:36.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc3b00a57c0 0x7fc3b00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): picked mon.noname-f con 0x7fc3b00a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b0139710 0x7fc3b0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): picked mon.noname-g con 0x7fc3b0139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b00a5020 con 0x7fc3b00a57c0 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b00a77b0 con 0x7fc3b0139710 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc3b00a7d40 con 0x7fc3b00a6950 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.875+0000 7fc3b514c640 10 monclient(hunting): authenticate will time out at 1054.916932s 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3a659c640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7fc3b00a57c0 msgr2=0x7fc3b00a7270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:36.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 0x7fc3b00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3a659c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc3b00a57c0 0x7fc3b00a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 0x7fc3b00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:45834/0 (socket says 172.21.15.71:45834) 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 -- 172.21.15.71:0/3579352297 learned_addr learned my addr 172.21.15.71:0/3579352297 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): get_auth_request con 0x7fc3b00a6950 auth_method 0 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3af59e640 1 --2- 172.21.15.71:0/3579352297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b0139710 0x7fc3b0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3af59e640 10 monclient(hunting): get_auth_request con 0x7fc3b0139710 auth_method 0 2024-08-19T11:16:36.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3af59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3af59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3af59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_done global_id 25764 payload 274 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 -- 172.21.15.71:0/3579352297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b0139710 msgr2=0x7fc3b0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 --2- 172.21.15.71:0/3579352297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b0139710 0x7fc3b0139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 -- 172.21.15.71:0/3579352297 >> v2:172.21.15.135:3300/0 conn(0x7fc3b00a57c0 msgr2=0x7fc3b00a7270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 --2- 172.21.15.71:0/3579352297 >> v2:172.21.15.135:3300/0 conn(0x7fc3b00a57c0 0x7fc3b00a7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 monclient: found mon.noname-d 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:36.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.876+0000 7fc3aed9d640 1 -- 172.21.15.71:0/3579352297 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b00a6380 con 0x7fc3b00a6950 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3aed9d640 1 -- 172.21.15.71:0/3579352297 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 msgr2=0x7fc3b00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3aed9d640 1 --2- 172.21.15.71:0/3579352297 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 0x7fc3b00a6d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3980098a0 tx=0x7fc39802a0e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=29df22dcc957977c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 1 -- 172.21.15.71:0/3579352297 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc398037070 con 0x7fc3b00a6950 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: dump: 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.890 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: _finish_auth 0 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: _check_auth_tickets 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:36.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 1 -- 172.21.15.71:0/3579352297 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39802ae00 con 0x7fc3b00a6950 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 1 -- 172.21.15.71:0/3579352297 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc398030c20 con 0x7fc3b00a6950 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3ae59c640 10 monclient: dump: 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.892 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 5 monclient: authenticate success, global_id 25764 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 4 set_mon_vals no callback set 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 10 monclient: shutdown 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:36.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 -- 172.21.15.71:0/3579352297 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 msgr2=0x7fc3b00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 --2- 172.21.15.71:0/3579352297 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 0x7fc3b00a6d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3980098a0 tx=0x7fc39802a0e0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 -- 172.21.15.71:0/3579352297 shutdown_connections 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 --2- 172.21.15.71:0/3579352297 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b0139710 0x7fc3b0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 --2- 172.21.15.71:0/3579352297 >> v2:172.21.15.135:3300/0 conn(0x7fc3b00a57c0 0x7fc3b00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 --2- 172.21.15.71:0/3579352297 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3b00a6950 0x7fc3b00a6d30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 -- 172.21.15.71:0/3579352297 >> 172.21.15.71:0/3579352297 conn(0x7fc3b00abf50 msgr2=0x7fc3b00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 -- 172.21.15.71:0/3579352297 shutdown_connections 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.879+0000 7fc3b514c640 1 -- 172.21.15.71:0/3579352297 wait complete. 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.880+0000 7fc3b514c640 10 monclient: build_initial_monmap 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.880+0000 7fc3b514c640 10 monclient: monmap: 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:36.894 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.880+0000 7fc3b514c640 1 Processor -- start 2024-08-19T11:16:36.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 -- start start 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient: init 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient: _add_conns ranks=[8,3,5,7,1,0,4,6,2] 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 0x7fc3b01ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): picked mon.noname-e con 0x7fc3b00a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b00a6950 0x7fc3b0138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): picked mon.noname-g con 0x7fc3b00a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3b0139710 0x7fc3b0138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): picked mon.noname-h con 0x7fc3b0139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b00a84c0 con 0x7fc3b00a6950 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc3b00a3650 con 0x7fc3b0139710 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc3b00a8700 con 0x7fc3b00a57c0 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3b514c640 10 monclient(hunting): authenticate will time out at 1054.922559s 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 0x7fc3b01ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 0x7fc3b01ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45400/0 (socket says 172.21.15.71:45400) 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 -- 172.21.15.71:0/2770549050 learned_addr learned my addr 172.21.15.71:0/2770549050 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): get_auth_request con 0x7fc3b00a57c0 auth_method 0 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3b0139710 0x7fc3b0138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): get_auth_request con 0x7fc3b0139710 auth_method 0 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3a659c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b00a6950 0x7fc3b0138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3a659c640 10 monclient(hunting): get_auth_request con 0x7fc3b00a6950 auth_method 0 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3a659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3a659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3a659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3af59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient(hunting): handle_auth_done global_id 64619 payload 824 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3b0139710 msgr2=0x7fc3b0138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3b0139710 0x7fc3b0138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b00a6950 msgr2=0x7fc3b0138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b00a6950 0x7fc3b0138870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 monclient: found mon.noname-e 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.881+0000 7fc3aed9d640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b0123ed0 con 0x7fc3b00a57c0 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.882+0000 7fc3a659c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b00a6950 0x7fc3b0138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3aed9d640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 msgr2=0x7fc3b01ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3aed9d640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 0x7fc3b01ce1f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3980090b0 tx=0x7fc3980046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc398041030 con 0x7fc3b00a57c0 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: dump: 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.900 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: _finish_auth 0 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc398003c50 con 0x7fc3b00a57c0 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 5 monclient: authenticate success, global_id 64619 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc398037040 con 0x7fc3b00a57c0 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3a7fff640 10 monclient: dump: 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.902 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.903 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 10 monclient: _renew_subs 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3add9b640 4 set_mon_vals no callback set 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b013a1b0 con 0x7fc3b00a57c0 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 10 monclient: _renew_subs 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.884+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b0125990 con 0x7fc3b00a57c0 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3b514c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3b514c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 0x7fc3b002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b006a590 con 0x7fc3b0122d60 2024-08-19T11:16:36.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc398044070 con 0x7fc3b00a57c0 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 0x7fc3b002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient: get_auth_request con 0x7fc3b0122d60 auth_method 0 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a7fff640 1 --2- 172.21.15.71:0/2770549050 >> v2:172.21.15.135:6800/726754104 conn(0x7fc39403ea80 0x7fc394040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 10 monclient(hunting): handle_auth_done global_id 74277 payload 824 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a659c640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3b00a1d50 con 0x7fc3b0122d60 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.885+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7fc398042070 con 0x7fc3b00a57c0 2024-08-19T11:16:36.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.886+0000 7fc3af59e640 1 --2- 172.21.15.71:0/2770549050 >> v2:172.21.15.135:6800/726754104 conn(0x7fc39403ea80 0x7fc394040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.886+0000 7fc3af59e640 10 monclient: get_auth_request con 0x7fc39403ea80 auth_method 0 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a659c640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 msgr2=0x7fc3b002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a659c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 0x7fc3b002d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00a1a80 tx=0x7fc3a000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3a0003bc0 con 0x7fc3b0122d60 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 10 monclient: dump: 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.906 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc3a0017070 con 0x7fc3b0122d60 2024-08-19T11:16:36.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:36.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:36.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 msgr2=0x7fc3b002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 0x7fc3b002d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00a1a80 tx=0x7fc3a000db90 comp rx=0 tx=0).stop 2024-08-19T11:16:36.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 msgr2=0x7fc3b002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:36.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3a7fff640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0122d60 0x7fc3b002d1c0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00a1a80 tx=0x7fc3a000db90 comp rx=0 tx=0).stop 2024-08-19T11:16:36.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.888+0000 7fc3af59e640 1 --2- 172.21.15.71:0/2770549050 >> v2:172.21.15.135:6800/726754104 conn(0x7fc39403ea80 0x7fc394040f40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8003aa0 tx=0x7fc3a8009780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3b514c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3b514c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 0x7fc3b002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3b514c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b0076c60 con 0x7fc3b0123140 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 0x7fc3b002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient: get_auth_request con 0x7fc3b0123140 auth_method 0 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:36.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 10 monclient(hunting): handle_auth_done global_id 74286 payload 824 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.894+0000 7fc3a659c640 1 -- 172.21.15.71:0/2770549050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3b00a4260 con 0x7fc3b0123140 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a659c640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 msgr2=0x7fc3b002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a659c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 0x7fc3b002d700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0016000 tx=0x7fc3a00059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3a001cd80 con 0x7fc3b0123140 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 10 monclient: dump: 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:36.911 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:36.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9403 (secure 0 0 0) 0x7fc3a00050d0 con 0x7fc3b0123140 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 msgr2=0x7fc3b002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 0x7fc3b002d700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0016000 tx=0x7fc3a00059d0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 msgr2=0x7fc3b002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3a7fff640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3b0123140 0x7fc3b002d700 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0016000 tx=0x7fc3a00059d0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:36.913 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 132, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 45930, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:36.914 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:36.915 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:36.916 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:36.917 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:36.919 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.924 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.925 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:36.930 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:36.932 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:36.933 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:36.934 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.935 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:36.936 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:36.937 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:36.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 >> v2:172.21.15.135:6800/726754104 conn(0x7fc39403ea80 msgr2=0x7fc394040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 --2- 172.21.15.71:0/2770549050 >> v2:172.21.15.135:6800/726754104 conn(0x7fc39403ea80 0x7fc394040f40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8003aa0 tx=0x7fc3a8009780 comp rx=0 tx=0).stop 2024-08-19T11:16:36.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 10 monclient: shutdown 2024-08-19T11:16:36.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:36.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 msgr2=0x7fc3b01ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 --2- 172.21.15.71:0/2770549050 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc3b00a57c0 0x7fc3b01ce1f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3980090b0 tx=0x7fc3980046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3af59e640 1 -- 172.21.15.71:0/2770549050 reap_dead start 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3af59e640 1 -- 172.21.15.71:0/2770549050 reap_dead start 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 shutdown_connections 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 >> 172.21.15.71:0/2770549050 conn(0x7fc3b00abf50 msgr2=0x7fc3b00aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 shutdown_connections 2024-08-19T11:16:36.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:36.897+0000 7fc3b514c640 1 -- 172.21.15.71:0/2770549050 wait complete. 2024-08-19T11:16:36.939 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:16:36.939 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2024-08-19T11:16:36.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.037+0000 7f4c2ad12640 10 monclient: get_monmap_and_config 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.037+0000 7f4c2ad12640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.037+0000 7f4c2ad12640 10 monclient: monmap: 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:37.038421+0000 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:37.038421+0000 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:37.039 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:37.040 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 1 Processor -- start 2024-08-19T11:16:37.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 1 -- start start 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 10 monclient: init 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 10 monclient: _add_conns ranks=[3,8,10,9,0,4,7,6,5,1,2] 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c240a6950 0x7f4c240a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 10 monclient(hunting): picked mon.noname-g con 0x7f4c240a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 0x7f4c240a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.038+0000 7f4c2ad12640 10 monclient(hunting): picked mon.noname-e con 0x7f4c240a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c24139710 0x7f4c24139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 10 monclient(hunting): picked mon.noname-f con 0x7f4c24139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4c240a5020 con 0x7f4c24139710 2024-08-19T11:16:37.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4c240a77b0 con 0x7f4c240a6950 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4c240a7d40 con 0x7f4c240a57c0 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c2ad12640 10 monclient(hunting): authenticate will time out at 1055.080034s 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 0x7f4c240a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c292af640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f4c24139710 msgr2=0x7f4c24139b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c292af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4c24139710 0x7f4c24139b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 0x7f4c240a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45408/0 (socket says 172.21.15.71:45408) 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 -- 172.21.15.71:0/151698569 learned_addr learned my addr 172.21.15.71:0/151698569 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): get_auth_request con 0x7f4c240a57c0 auth_method 0 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c28aae640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c240a6950 0x7f4c240a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_done global_id 64628 payload 274 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 -- 172.21.15.71:0/151698569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c240a6950 msgr2=0x7f4c240a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c240a6950 0x7f4c240a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 -- 172.21.15.71:0/151698569 >> v2:172.21.15.135:3300/0 conn(0x7f4c24139710 msgr2=0x7f4c24139b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/151698569 >> v2:172.21.15.135:3300/0 conn(0x7f4c24139710 0x7f4c24139b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 monclient: found mon.noname-e 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c1bfff640 1 -- 172.21.15.71:0/151698569 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c240a6380 con 0x7f4c240a57c0 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c28aae640 10 monclient: get_auth_request con 0x7f4c240a6950 auth_method 0 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.039+0000 7f4c28aae640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c240a6950 0x7f4c240a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1bfff640 1 -- 172.21.15.71:0/151698569 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 msgr2=0x7f4c240a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 0x7f4c240a7270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009870 tx=0x7f4c1402a0d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=99fe0f79855f9a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 1 -- 172.21.15.71:0/151698569 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c14037070 con 0x7f4c240a57c0 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: dump: 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.048 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.049 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 5 monclient: authenticate success, global_id 64628 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 1 -- 172.21.15.71:0/151698569 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c140307b0 con 0x7f4c240a57c0 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 4 set_mon_vals no callback set 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 1 -- 172.21.15.71:0/151698569 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c14030e10 con 0x7f4c240a57c0 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c1b7fe640 10 monclient: dump: 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.051 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 10 monclient: shutdown 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 -- 172.21.15.71:0/151698569 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 msgr2=0x7f4c240a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 0x7f4c240a7270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009870 tx=0x7f4c1402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 -- 172.21.15.71:0/151698569 shutdown_connections 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/151698569 >> v2:172.21.15.135:3300/0 conn(0x7f4c24139710 0x7f4c24139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4c240a57c0 0x7f4c240a7270 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/151698569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4c240a6950 0x7f4c240a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.042+0000 7f4c2ad12640 1 -- 172.21.15.71:0/151698569 >> 172.21.15.71:0/151698569 conn(0x7f4c240abf50 msgr2=0x7f4c240ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 1 -- 172.21.15.71:0/151698569 shutdown_connections 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 1 -- 172.21.15.71:0/151698569 wait complete. 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 10 monclient: monmap: 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:37.053 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 1 Processor -- start 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 1 -- start start 2024-08-19T11:16:37.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.043+0000 7f4c2ad12640 10 monclient: init 2024-08-19T11:16:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient: _add_conns ranks=[0,2,4,1,5,7,8,6,3] 2024-08-19T11:16:37.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c240a57c0 0x7f4c24138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): picked mon.noname-a con 0x7f4c240a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c240a6950 0x7f4c241cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): picked mon.noname-b con 0x7f4c240a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c24139710 0x7f4c241cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): picked mon.noname-c con 0x7f4c24139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c240a84c0 con 0x7f4c240a57c0 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4c240a3650 con 0x7f4c240a6950 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4c240a8700 con 0x7f4c24139710 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c2ad12640 10 monclient(hunting): authenticate will time out at 1055.085535s 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c292af640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c24139710 msgr2=0x7f4c241cb2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c292af640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c24139710 0x7f4c241cb2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c240a6950 0x7f4c241cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c240a57c0 0x7f4c24138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c240a6950 0x7f4c241cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:50382/0 (socket says 172.21.15.71:50382) 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 1 -- 172.21.15.71:0/2899457611 learned_addr learned my addr 172.21.15.71:0/2899457611 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): get_auth_request con 0x7f4c240a6950 auth_method 0 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): get_auth_request con 0x7f4c240a57c0 auth_method 0 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient(hunting): handle_auth_done global_id 74295 payload 824 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c24139710 msgr2=0x7f4c241cb2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4c24139710 0x7f4c241cb2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c240a6950 msgr2=0x7f4c241cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c240a6950 0x7f4c241cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 monclient: found mon.noname-a 2024-08-19T11:16:37.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c28aae640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c241266c0 con 0x7f4c240a57c0 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.044+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c240a6950 0x7f4c241cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c28aae640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c240a57c0 msgr2=0x7f4c24138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c28aae640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c240a57c0 0x7f4c24138d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c7f0 tx=0x7f4c2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c20015070 con 0x7f4c240a57c0 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: dump: 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.065 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c20007c40 con 0x7f4c240a57c0 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 5 monclient: authenticate success, global_id 74295 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 10 monclient: _renew_subs 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c24125730 con 0x7f4c240a57c0 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c20007e30 con 0x7f4c240a57c0 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c197fa640 10 monclient: dump: 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.067 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 10 monclient: _renew_subs 2024-08-19T11:16:37.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c24125e20 con 0x7f4c240a57c0 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.047+0000 7f4c1affd640 4 set_mon_vals no callback set 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c2ad12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 0x7f4c241ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4c24076c60 con 0x7f4c24139240 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 0x7f4c241ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4c200077d0 con 0x7f4c240a57c0 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient: get_auth_request con 0x7f4c24139240 auth_method 0 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c197fa640 1 --2- 172.21.15.71:0/2899457611 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c1003ea80 0x7f4c10040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_done global_id 74279 payload 824 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f4c200518b0 con 0x7f4c240a57c0 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c1bfff640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c240779c0 con 0x7f4c24139240 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c292af640 1 --2- 172.21.15.71:0/2899457611 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c1003ea80 0x7f4c10040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.048+0000 7f4c292af640 10 monclient: get_auth_request con 0x7f4c1003ea80 auth_method 0 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.050+0000 7f4c1bfff640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 msgr2=0x7f4c241ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.050+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 0x7f4c241ceab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c14035040 tx=0x7f4c140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.050+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c14037040 con 0x7f4c24139240 2024-08-19T11:16:37.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.050+0000 7f4c197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.050+0000 7f4c197fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.050+0000 7f4c197fa640 10 monclient: dump: 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.071 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4c14030b10 con 0x7f4c24139240 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 msgr2=0x7f4c241ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 0x7f4c241ceab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c14035040 tx=0x7f4c140046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 msgr2=0x7f4c241ceab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c197fa640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c24139240 0x7f4c241ceab0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c14035040 tx=0x7f4c140046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.051+0000 7f4c292af640 1 --2- 172.21.15.71:0/2899457611 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c1003ea80 0x7f4c10040f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c003c60 tx=0x7f4c1c0091f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c2ad12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 0x7f4c2402d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c2ad12640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2413a060 con 0x7f4c2402d1c0 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 0x7f4c2402d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient: get_auth_request con 0x7f4c2402d1c0 auth_method 0 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 10 monclient(hunting): handle_auth_done global_id 74288 payload 824 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.057+0000 7f4c1bfff640 1 -- 172.21.15.71:0/2899457611 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4c240a6d30 con 0x7f4c2402d1c0 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.059+0000 7f4c1bfff640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 msgr2=0x7f4c2402d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.059+0000 7f4c1bfff640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 0x7f4c2402d5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4c24077730 tx=0x7f4c14009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.059+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4c1403c8b0 con 0x7f4c2402d1c0 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.059+0000 7f4c197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.059+0000 7f4c197fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.059+0000 7f4c197fa640 10 monclient: dump: 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.074 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9234 (secure 0 0 0) 0x7f4c1403c440 con 0x7f4c2402d1c0 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 msgr2=0x7f4c2402d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 0x7f4c2402d5d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4c24077730 tx=0x7f4c14009240 comp rx=0 tx=0).stop 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 msgr2=0x7f4c2402d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c197fa640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2402d1c0 0x7f4c2402d5d0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4c24077730 tx=0x7f4c14009240 comp rx=0 tx=0).stop 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 132, 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 46091, 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:37.098 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c1003ea80 msgr2=0x7f4c10040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/2899457611 >> v2:172.21.15.135:6800/726754104 conn(0x7f4c1003ea80 0x7f4c10040f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c003c60 tx=0x7f4c1c0091f0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 10 monclient: shutdown 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c240a57c0 msgr2=0x7f4c24138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 --2- 172.21.15.71:0/2899457611 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c240a57c0 0x7f4c24138d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c7f0 tx=0x7f4c2000ccb0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c292af640 1 -- 172.21.15.71:0/2899457611 reap_dead start 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c292af640 1 -- 172.21.15.71:0/2899457611 reap_dead start 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 shutdown_connections 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 >> 172.21.15.71:0/2899457611 conn(0x7f4c240abf50 msgr2=0x7f4c240aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 shutdown_connections 2024-08-19T11:16:37.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.060+0000 7f4c2ad12640 1 -- 172.21.15.71:0/2899457611 wait complete. 2024-08-19T11:16:37.101 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:16:37.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2024-08-19T11:16:37.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.199+0000 7f7f333a0640 10 monclient: get_monmap_and_config 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.199+0000 7f7f333a0640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.199+0000 7f7f333a0640 10 monclient: monmap: 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:37.199879+0000 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:37.199879+0000 2024-08-19T11:16:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:37.201 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.199+0000 7f7f333a0640 1 Processor -- start 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.199+0000 7f7f333a0640 1 -- start start 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.199+0000 7f7f333a0640 10 monclient: init 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient: _add_conns ranks=[2,1,10,4,3,5,0,8,6,9,7] 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 0x7f7f2c0a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): picked mon.noname-b con 0x7f7f2c0a54e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7f2c072370 addr v1:172.21.15.135:6789/0 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f2c072f80 0x7f7f2c0a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): picked mon.noname-f con 0x7f7f2c072f80 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2c074130 con 0x7f7f2c072370 2024-08-19T11:16:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c073c00 con 0x7f7f2c072f80 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0a6340 con 0x7f7f2c0a54e0 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f333a0640 10 monclient(hunting): authenticate will time out at 1055.241642s 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f32b9f640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f7f2c072f80 msgr2=0x7f7f2c0a5e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f31b9d640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f7f2c072370 legacy=0x7f7f2c137290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 0x7f7f2c0a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f32b9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f2c072f80 0x7f7f2c0a5e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 0x7f7f2c0a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:50400/0 (socket says 172.21.15.71:50400) 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 -- 172.21.15.71:0/2531799151 learned_addr learned my addr 172.21.15.71:0/2531799151 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): get_auth_request con 0x7f7f2c0a54e0 auth_method 0 2024-08-19T11:16:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient(hunting): handle_auth_done global_id 74297 payload 274 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 -- 172.21.15.71:0/2531799151 >> v2:172.21.15.135:3300/0 conn(0x7f7f2c072f80 msgr2=0x7f7f2c0a5e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 --2- 172.21.15.71:0/2531799151 >> v2:172.21.15.135:3300/0 conn(0x7f7f2c072f80 0x7f7f2c0a5e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 -- 172.21.15.71:0/2531799151 >> v1:172.21.15.135:6789/0 conn(0x7f7f2c072370 legacy=0x7f7f2c137290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.200+0000 7f7f3239e640 1 monclient: found mon.noname-b 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.201+0000 7f7f3239e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.201+0000 7f7f3239e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.201+0000 7f7f3239e640 1 -- 172.21.15.71:0/2531799151 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c073890 con 0x7f7f2c0a54e0 2024-08-19T11:16:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.203+0000 7f7f3239e640 1 -- 172.21.15.71:0/2531799151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 msgr2=0x7f7f2c0a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.203+0000 7f7f3239e640 1 --2- 172.21.15.71:0/2531799151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 0x7f7f2c0a58c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009870 tx=0x7f7f2402a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b32acc6cb26f6d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.203+0000 7f7f3139c640 1 -- 172.21.15.71:0/2531799151 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f24037070 con 0x7f7f2c0a54e0 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.203+0000 7f7f3139c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.203+0000 7f7f3139c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.203+0000 7f7f3139c640 10 monclient: dump: 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.215 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 5 monclient: authenticate success, global_id 74297 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 1 -- 172.21.15.71:0/2531799151 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f240307b0 con 0x7f7f2c0a54e0 2024-08-19T11:16:37.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 4 set_mon_vals no callback set 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 1 -- 172.21.15.71:0/2531799151 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f24030e50 con 0x7f7f2c0a54e0 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f3139c640 10 monclient: dump: 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 10 monclient: shutdown 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 -- 172.21.15.71:0/2531799151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 msgr2=0x7f7f2c0a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 --2- 172.21.15.71:0/2531799151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 0x7f7f2c0a58c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009870 tx=0x7f7f2402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 -- 172.21.15.71:0/2531799151 shutdown_connections 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 --2- 172.21.15.71:0/2531799151 >> v2:172.21.15.135:3300/0 conn(0x7f7f2c072f80 0x7f7f2c0a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 --2- 172.21.15.71:0/2531799151 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c0a54e0 0x7f7f2c0a58c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 -- 172.21.15.71:0/2531799151 >> 172.21.15.71:0/2531799151 conn(0x7f7f2c0aa350 msgr2=0x7f7f2c0a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 -- 172.21.15.71:0/2531799151 shutdown_connections 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.204+0000 7f7f333a0640 1 -- 172.21.15.71:0/2531799151 wait complete. 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.205+0000 7f7f333a0640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.205+0000 7f7f333a0640 10 monclient: monmap: 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.219 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.205+0000 7f7f333a0640 1 Processor -- start 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.205+0000 7f7f333a0640 1 -- start start 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.205+0000 7f7f333a0640 10 monclient: init 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.205+0000 7f7f333a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient: _add_conns ranks=[8,2,1,4,6,0,5,3,7] 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f2c072370 0x7f7f2c1ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): picked mon.noname-e con 0x7f7f2c072370 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 0x7f7f2c1cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): picked mon.noname-b con 0x7f7f2c072f80 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f2c0a54e0 0x7f7f2c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): picked mon.noname-f con 0x7f7f2c0a54e0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c1379a0 con 0x7f7f2c0a54e0 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0a70d0 con 0x7f7f2c072f80 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7f2c137b20 con 0x7f7f2c072370 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f333a0640 10 monclient(hunting): authenticate will time out at 1055.247070s 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 0x7f7f2c1cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f2c072370 0x7f7f2c1ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 0x7f7f2c1cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:50406/0 (socket says 172.21.15.71:50406) 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f2c072370 0x7f7f2c1ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45416/0 (socket says 172.21.15.71:45416) 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 -- 172.21.15.71:0/4059574636 learned_addr learned my addr 172.21.15.71:0/4059574636 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): get_auth_request con 0x7f7f2c072f80 auth_method 0 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): get_auth_request con 0x7f7f2c072370 auth_method 0 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f32b9f640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f2c0a54e0 msgr2=0x7f7f2c06d9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f32b9f640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f2c0a54e0 0x7f7f2c06d9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient(hunting): handle_auth_done global_id 74306 payload 824 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f2c072370 msgr2=0x7f7f2c1ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7f2c072370 0x7f7f2c1ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f2c0a54e0 msgr2=0x7f7f2c06d9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:37.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f2c0a54e0 0x7f7f2c06d9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 monclient: found mon.noname-b 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.206+0000 7f7f31b9d640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c1274b0 con 0x7f7f2c072f80 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f31b9d640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 msgr2=0x7f7f2c1cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f31b9d640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 0x7f7f2c1cecf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000b9e0 tx=0x7f7f2000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f2000cbb0 con 0x7f7f2c072f80 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: dump: 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.224 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.225 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f20010070 con 0x7f7f2c072f80 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 5 monclient: authenticate success, global_id 74306 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 10 monclient: _renew_subs 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f2000cdd0 con 0x7f7f2c072f80 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c127790 con 0x7f7f2c072f80 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f2affd640 10 monclient: dump: 2024-08-19T11:16:37.226 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.227 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f30b9b640 4 set_mon_vals no callback set 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 10 monclient: _renew_subs 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.208+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c0a8f10 con 0x7f7f2c072f80 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f333a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f333a0640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 0x7f7f2c063e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7f2c135060 con 0x7f7f2c063a80 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7f20005070 con 0x7f7f2c072f80 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 0x7f7f2c063e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient: get_auth_request con 0x7f7f2c063a80 auth_method 0 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.209+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.210+0000 7f7f2affd640 1 --2- 172.21.15.71:0/4059574636 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f1803ea80 0x7f7f18040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.210+0000 7f7f3239e640 10 monclient(hunting): handle_auth_done global_id 25773 payload 824 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.210+0000 7f7f3239e640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f2c0a89e0 con 0x7f7f2c063a80 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.210+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f7f20051d90 con 0x7f7f2c072f80 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.210+0000 7f7f32b9f640 1 --2- 172.21.15.71:0/4059574636 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f1803ea80 0x7f7f18040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.210+0000 7f7f32b9f640 10 monclient: get_auth_request con 0x7f7f1803ea80 auth_method 0 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f3239e640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 msgr2=0x7f7f2c063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f3239e640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 0x7f7f2c063e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0a3280 tx=0x7f7f240046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f24041070 con 0x7f7f2c063a80 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 10 monclient: dump: 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.230 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7f24038040 con 0x7f7f2c063a80 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 msgr2=0x7f7f2c063e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 0x7f7f2c063e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0a3280 tx=0x7f7f240046c0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.212+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 msgr2=0x7f7f2c063e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.213+0000 7f7f2affd640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c063a80 0x7f7f2c063e60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.213+0000 7f7f32b9f640 1 --2- 172.21.15.71:0/4059574636 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f1803ea80 0x7f7f18040f40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c1262f0 tx=0x7f7f1c006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f333a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f333a0640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 0x7f7f2c02d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f333a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7f2c076c60 con 0x7f7f2c02d1c0 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 0x7f7f2c02d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient: get_auth_request con 0x7f7f2c02d1c0 auth_method 0 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 10 monclient(hunting): handle_auth_done global_id 25782 payload 824 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.219+0000 7f7f3239e640 1 -- 172.21.15.71:0/4059574636 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f2c137f00 con 0x7f7f2c02d1c0 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.221+0000 7f7f3239e640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 msgr2=0x7f7f2c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.221+0000 7f7f3239e640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 0x7f7f2c02d5d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f24035040 tx=0x7f7f24008030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.221+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7f24037070 con 0x7f7f2c02d1c0 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.221+0000 7f7f2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.221+0000 7f7f2affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.221+0000 7f7f2affd640 10 monclient: dump: 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.235 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.236 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9569 (secure 0 0 0) 0x7f7f24045610 con 0x7f7f2c02d1c0 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 msgr2=0x7f7f2c02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 0x7f7f2c02d5d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f24035040 tx=0x7f7f24008030 comp rx=0 tx=0).stop 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 msgr2=0x7f7f2c02d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f2affd640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7f2c02d1c0 0x7f7f2c02d5d0 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7f24035040 tx=0x7f7f24008030 comp rx=0 tx=0).stop 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:37.237 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 132, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 304835, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:37.238 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.239 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.240 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:37.241 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.242 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.244 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.246 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:37.247 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.251 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:37.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.256 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.258 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:37.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.260 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:37.261 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f1803ea80 msgr2=0x7f7f18040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 --2- 172.21.15.71:0/4059574636 >> v2:172.21.15.135:6800/726754104 conn(0x7f7f1803ea80 0x7f7f18040f40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c1262f0 tx=0x7f7f1c006c60 comp rx=0 tx=0).stop 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 10 monclient: shutdown 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 msgr2=0x7f7f2c1cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 --2- 172.21.15.71:0/4059574636 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7f2c072f80 0x7f7f2c1cecf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000b9e0 tx=0x7f7f2000bea0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f32b9f640 1 -- 172.21.15.71:0/4059574636 reap_dead start 2024-08-19T11:16:37.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f32b9f640 1 -- 172.21.15.71:0/4059574636 reap_dead start 2024-08-19T11:16:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 shutdown_connections 2024-08-19T11:16:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 >> 172.21.15.71:0/4059574636 conn(0x7f7f2c0aa350 msgr2=0x7f7f2c135b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 shutdown_connections 2024-08-19T11:16:37.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.222+0000 7f7f333a0640 1 -- 172.21.15.71:0/4059574636 wait complete. 2024-08-19T11:16:37.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:16:37.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2024-08-19T11:16:37.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.360+0000 7f064089f640 10 monclient: get_monmap_and_config 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.360+0000 7f064089f640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.360+0000 7f064089f640 10 monclient: monmap: 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:37.360882+0000 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:37.360882+0000 2024-08-19T11:16:37.361 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:37.362 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.360+0000 7f064089f640 1 Processor -- start 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 -- start start 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient: init 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient: _add_conns ranks=[7,10,5,2,9,4,1,6,0,3,8] 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f063c0a3c30 0x7f063c0a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): picked mon.noname-i con 0x7f063c0a3c30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f063c0a4550 0x7f063c139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): picked mon.noname-f con 0x7f063c0a4550 addr v2:172.21.15.135:3300/0 2024-08-19T11:16:37.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 0x7f063c13a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): picked mon.noname-h con 0x7f063c139eb0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f063c0a5000 con 0x7f063c0a4550 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f063c0a13b0 con 0x7f063c139eb0 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f063c0a0b10 con 0x7f063c0a3c30 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f064089f640 10 monclient(hunting): authenticate will time out at 1055.402524s 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f0633fff640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f063c0a4550 msgr2=0x7f063c139970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063a59c640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f063c0a3c30 msgr2=0x7f063c0a4010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:37.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063a59c640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f063c0a3c30 0x7f063c0a4010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f0633fff640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f063c0a4550 0x7f063c139970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 0x7f063c13a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 0x7f063c13a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:49164/0 (socket says 172.21.15.71:49164) 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 1 -- 172.21.15.71:0/3446025809 learned_addr learned my addr 172.21.15.71:0/3446025809 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): get_auth_request con 0x7f063c139eb0 auth_method 0 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.361+0000 7f063ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 10 monclient(hunting): handle_auth_done global_id 45014 payload 274 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 1 -- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f063c0a3c30 msgr2=0x7f063c0a4010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:37.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 1 --2- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f063c0a3c30 0x7f063c0a4010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 1 -- 172.21.15.71:0/3446025809 >> v2:172.21.15.135:3300/0 conn(0x7f063c0a4550 msgr2=0x7f063c139970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 1 --2- 172.21.15.71:0/3446025809 >> v2:172.21.15.135:3300/0 conn(0x7f063c0a4550 0x7f063c139970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 1 monclient: found mon.noname-h 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:16:37.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.362+0000 7f063ad9d640 1 -- 172.21.15.71:0/3446025809 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c0a0df0 con 0x7f063c139eb0 2024-08-19T11:16:37.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f063ad9d640 1 -- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 msgr2=0x7f063c13a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f063ad9d640 1 --2- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 0x7f063c13a330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0634009e80 tx=0x7f063402a5d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=f6dc68b3254dedbe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 1 -- 172.21.15.71:0/3446025809 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0634036070 con 0x7f063c139eb0 2024-08-19T11:16:37.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:16:37.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: dump: 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.376 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 1 -- 172.21.15.71:0/3446025809 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0634007a70 con 0x7f063c139eb0 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 5 monclient: authenticate success, global_id 45014 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 1 -- 172.21.15.71:0/3446025809 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0634007ca0 con 0x7f063c139eb0 2024-08-19T11:16:37.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 4 set_mon_vals no callback set 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f0639d9b640 10 monclient: dump: 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.378 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 10 monclient: shutdown 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 -- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 msgr2=0x7f063c13a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 --2- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 0x7f063c13a330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0634009e80 tx=0x7f063402a5d0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 -- 172.21.15.71:0/3446025809 shutdown_connections 2024-08-19T11:16:37.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 --2- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f063c139eb0 0x7f063c13a330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 --2- 172.21.15.71:0/3446025809 >> v2:172.21.15.135:3300/0 conn(0x7f063c0a4550 0x7f063c139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 --2- 172.21.15.71:0/3446025809 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f063c0a3c30 0x7f063c0a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 -- 172.21.15.71:0/3446025809 >> 172.21.15.71:0/3446025809 conn(0x7f063c0a91d0 msgr2=0x7f063c0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 -- 172.21.15.71:0/3446025809 shutdown_connections 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.365+0000 7f064089f640 1 -- 172.21.15.71:0/3446025809 wait complete. 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.366+0000 7f064089f640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.366+0000 7f064089f640 10 monclient: monmap: 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.380 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.366+0000 7f064089f640 1 Processor -- start 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 -- start start 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient: init 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient: _add_conns ranks=[0,4,3,1,5,7,8,6,2] 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 0x7f063c128400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): picked mon.noname-a con 0x7f063c0a3c30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f063c0a4550 0x7f063c125ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): picked mon.noname-c con 0x7f063c0a4550 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c139eb0 0x7f063c126530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): picked mon.noname-g con 0x7f063c139eb0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f063c0a5570 con 0x7f063c0a3c30 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f063c06cbd0 con 0x7f063c139eb0 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f063c0a4930 con 0x7f063c0a4550 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f064089f640 10 monclient(hunting): authenticate will time out at 1055.408448s 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f0633fff640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f063c0a4550 msgr2=0x7f063c125ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f0633fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f063c0a4550 0x7f063c125ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 0x7f063c128400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 0x7f063c128400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53068/0 (socket says 172.21.15.71:53068) 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 -- 172.21.15.71:0/837919117 learned_addr learned my addr 172.21.15.71:0/837919117 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): get_auth_request con 0x7f063c0a3c30 auth_method 0 2024-08-19T11:16:37.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063ad9d640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c139eb0 0x7f063c126530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063ad9d640 10 monclient(hunting): get_auth_request con 0x7f063c139eb0 auth_method 0 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient(hunting): handle_auth_done global_id 74304 payload 824 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f063c0a4550 msgr2=0x7f063c125ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:37.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f063c0a4550 0x7f063c125ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c139eb0 msgr2=0x7f063c126530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c139eb0 0x7f063c126530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 monclient: found mon.noname-a 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063a59c640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c129920 con 0x7f063c0a3c30 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.367+0000 7f063ad9d640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f063c139eb0 0x7f063c126530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f063a59c640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 msgr2=0x7f063c128400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f063a59c640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 0x7f063c128400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f062c00b550 tx=0x7f062c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f062c0092c0 con 0x7f063c0a3c30 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: dump: 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c015070 con 0x7f063c0a3c30 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 5 monclient: authenticate success, global_id 74304 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f062c003d40 con 0x7f063c0a3c30 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 10 monclient: _renew_subs 2024-08-19T11:16:37.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c129c00 con 0x7f063c0a3c30 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f063959a640 4 set_mon_vals no callback set 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f0632ffd640 10 monclient: dump: 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.388 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 10 monclient: _renew_subs 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.370+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c128d90 con 0x7f063c0a3c30 2024-08-19T11:16:37.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f064089f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f064089f640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 0x7f063c071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f063c0a88f0 con 0x7f063c126a70 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 0x7f063c071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient: get_auth_request con 0x7f063c126a70 auth_method 0 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f062c005070 con 0x7f063c0a3c30 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 10 monclient(hunting): handle_auth_done global_id 64646 payload 824 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0633fff640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f063c1295a0 con 0x7f063c126a70 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0632ffd640 1 --2- 172.21.15.71:0/837919117 >> v2:172.21.15.135:6800/726754104 conn(0x7f061c03ea80 0x7f061c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 3506+0+0 (secure 0 0 0) 0x7f062c051850 con 0x7f063c0a3c30 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f063ad9d640 1 --2- 172.21.15.71:0/837919117 >> v2:172.21.15.135:6800/726754104 conn(0x7f061c03ea80 0x7f061c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.371+0000 7f063ad9d640 10 monclient: get_auth_request con 0x7f061c03ea80 auth_method 0 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.373+0000 7f0633fff640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 msgr2=0x7f063c071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.373+0000 7f0633fff640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 0x7f063c071590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f063c1276d0 tx=0x7f062400b8e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.373+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0624016070 con 0x7f063c126a70 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.373+0000 7f0632ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 10 monclient: dump: 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.391 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.392 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0624005070 con 0x7f063c126a70 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 msgr2=0x7f063c071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 0x7f063c071590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f063c1276d0 tx=0x7f062400b8e0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 msgr2=0x7f063c071590 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f0632ffd640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c126a70 0x7f063c071590 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f063c1276d0 tx=0x7f062400b8e0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.374+0000 7f063ad9d640 1 --2- 172.21.15.71:0/837919117 >> v2:172.21.15.135:6800/726754104 conn(0x7f061c03ea80 0x7f061c040f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0634033000 tx=0x7f0634009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f064089f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f064089f640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 0x7f063c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f064089f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f063c076c60 con 0x7f063c071ad0 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 0x7f063c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient: get_auth_request con 0x7f063c071ad0 auth_method 0 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 10 monclient(hunting): handle_auth_done global_id 64655 payload 824 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.380+0000 7f0633fff640 1 -- 172.21.15.71:0/837919117 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f063c126e50 con 0x7f063c071ad0 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.382+0000 7f0633fff640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 msgr2=0x7f063c071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.382+0000 7f0633fff640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 0x7f063c071ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0624013000 tx=0x7f06240059c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.382+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0624016040 con 0x7f063c071ad0 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.382+0000 7f0632ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 10 monclient: dump: 2024-08-19T11:16:37.396 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.397 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9235 (secure 0 0 0) 0x7f0624011400 con 0x7f063c071ad0 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 msgr2=0x7f063c071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 0x7f063c071ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0624013000 tx=0x7f06240059c0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 msgr2=0x7f063c071ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f0632ffd640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f063c071ad0 0x7f063c071ee0 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0624013000 tx=0x7f06240059c0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.398 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 132, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 108865, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:37.399 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.400 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.401 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.402 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.403 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.404 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.407 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:37.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.409 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.412 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.414 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:37.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.419 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.422 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.423 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:37.423 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:37.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 >> v2:172.21.15.135:6800/726754104 conn(0x7f061c03ea80 msgr2=0x7f061c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 --2- 172.21.15.71:0/837919117 >> v2:172.21.15.135:6800/726754104 conn(0x7f061c03ea80 0x7f061c040f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0634033000 tx=0x7f0634009000 comp rx=0 tx=0).stop 2024-08-19T11:16:37.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 10 monclient: shutdown 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 msgr2=0x7f063c128400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 0x7f063c128400 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f062c00b550 tx=0x7f062c00ba10 comp rx=0 tx=0).stop 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f063ad9d640 1 -- 172.21.15.71:0/837919117 reap_dead start 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 shutdown_connections 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 --2- 172.21.15.71:0/837919117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f063c0a3c30 0x7f063c128400 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 >> 172.21.15.71:0/837919117 conn(0x7f063c0a91d0 msgr2=0x7f063c0a6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 shutdown_connections 2024-08-19T11:16:37.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.383+0000 7f064089f640 1 -- 172.21.15.71:0/837919117 wait complete. 2024-08-19T11:16:37.425 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:16:37.426 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon g 2024-08-19T11:16:37.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.528+0000 7f7b05ac7640 10 monclient: get_monmap_and_config 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.528+0000 7f7b05ac7640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.529+0000 7f7b05ac7640 10 monclient: monmap: 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:37.529640+0000 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:37.529640+0000 2024-08-19T11:16:37.530 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:37.531 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.529+0000 7f7b05ac7640 1 Processor -- start 2024-08-19T11:16:37.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.529+0000 7f7b05ac7640 1 -- start start 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.529+0000 7f7b05ac7640 10 monclient: init 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient: _add_conns ranks=[9,6,0,8,2,4,5,1,7,10,3] 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7b000a6950 0x7f7b000a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): picked mon.noname-a con 0x7f7b000a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 0x7f7b000a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): picked mon.noname-d con 0x7f7b000a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7b00139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b000a6380 con 0x7f7b00139710 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f7b000a5020 con 0x7f7b000a6950 2024-08-19T11:16:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7b000a77b0 con 0x7f7b000a57c0 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7b05ac7640 10 monclient(hunting): authenticate will time out at 1055.571384s 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 0x7f7b000a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7b000a6950 0x7f7b000a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 0x7f7b000a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:45864/0 (socket says 172.21.15.71:45864) 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 -- 172.21.15.71:0/3860945861 learned_addr learned my addr 172.21.15.71:0/3860945861 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): get_auth_request con 0x7f7b000a57c0 auth_method 0 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): get_auth_request con 0x7f7b000a6950 auth_method 0 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient(hunting): handle_auth_done global_id 25791 payload 274 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 -- 172.21.15.71:0/3860945861 >> v2:172.21.15.71:3300/0 conn(0x7f7b000a6950 msgr2=0x7f7b000a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 --2- 172.21.15.71:0/3860945861 >> v2:172.21.15.71:3300/0 conn(0x7f7b000a6950 0x7f7b000a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 -- 172.21.15.71:0/3860945861 >> v1:172.21.15.71:6789/0 conn(0x7f7b00139710 legacy=0x7f7b00139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 monclient: found mon.noname-d 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7afeffd640 1 -- 172.21.15.71:0/3860945861 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b000a3650 con 0x7f7b000a57c0 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.530+0000 7f7aff7fe640 1 --2- 172.21.15.71:0/3860945861 >> v2:172.21.15.71:3300/0 conn(0x7f7b000a6950 0x7f7b000a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afeffd640 1 -- 172.21.15.71:0/3860945861 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 msgr2=0x7f7b000a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afeffd640 1 --2- 172.21.15.71:0/3860945861 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 0x7f7b000a7270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7af40098a0 tx=0x7f7af402a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=8d2b78de0d6ce685 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 1 -- 172.21.15.71:0/3860945861 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7af4037070 con 0x7f7b000a57c0 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: dump: 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 1 -- 172.21.15.71:0/3860945861 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af402adf0 con 0x7f7b000a57c0 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7b05ac7640 5 monclient: authenticate success, global_id 25791 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7b05ac7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7b05ac7640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 1 -- 172.21.15.71:0/3860945861 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7af4030c20 con 0x7f7b000a57c0 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7b05ac7640 4 set_mon_vals no callback set 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.533+0000 7f7afe7fc640 10 monclient: dump: 2024-08-19T11:16:37.541 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.542 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 10 monclient: shutdown 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 -- 172.21.15.71:0/3860945861 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 msgr2=0x7f7b000a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/3860945861 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 0x7f7b000a7270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7af40098a0 tx=0x7f7af402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 -- 172.21.15.71:0/3860945861 shutdown_connections 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/3860945861 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b000a57c0 0x7f7b000a7270 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/3860945861 >> v2:172.21.15.71:3300/0 conn(0x7f7b000a6950 0x7f7b000a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 -- 172.21.15.71:0/3860945861 >> 172.21.15.71:0/3860945861 conn(0x7f7b000abf50 msgr2=0x7f7b000ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 -- 172.21.15.71:0/3860945861 shutdown_connections 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 1 -- 172.21.15.71:0/3860945861 wait complete. 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.534+0000 7f7b05ac7640 10 monclient: monmap: 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.545 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 Processor -- start 2024-08-19T11:16:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 -- start start 2024-08-19T11:16:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient: init 2024-08-19T11:16:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient: _add_conns ranks=[7,8,6,3,2,4,1,5,0] 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7b000a57c0 0x7f7b001ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): picked mon.noname-i con 0x7f7b000a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b000a6950 0x7f7b001388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): picked mon.noname-e con 0x7f7b000a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 0x7f7b00138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): picked mon.noname-d con 0x7f7b00139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7b000a84c0 con 0x7f7b00139710 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7b000a7d40 con 0x7f7b000a57c0 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7b000a8700 con 0x7f7b000a6950 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7b05ac7640 10 monclient(hunting): authenticate will time out at 1055.576900s 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7afffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 0x7f7b00138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.535+0000 7f7aff7fe640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7b000a57c0 msgr2=0x7f7b001ce180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:3303/0 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b000a6950 0x7f7b001388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 0x7f7b00138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:45874/0 (socket says 172.21.15.71:45874) 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 -- 172.21.15.71:0/501743229 learned_addr learned my addr 172.21.15.71:0/501743229 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7aff7fe640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7b000a57c0 0x7f7b001ce180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): get_auth_request con 0x7f7b00139710 auth_method 0 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): get_auth_request con 0x7f7b000a6950 auth_method 0 2024-08-19T11:16:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient(hunting): handle_auth_done global_id 25800 payload 824 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b000a6950 msgr2=0x7f7b001388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b000a6950 0x7f7b001388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7b000a57c0 msgr2=0x7f7b001ce180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7b000a57c0 0x7f7b001ce180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 monclient: found mon.noname-d 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afffff640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b00123f10 con 0x7f7b00139710 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.536+0000 7f7afeffd640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b000a6950 0x7f7b001388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7afffff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 msgr2=0x7f7b00138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7afffff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 0x7f7b00138df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c410 tx=0x7f7af800c8d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7af8011c10 con 0x7f7b00139710 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: dump: 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.556 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 5 monclient: authenticate success, global_id 25800 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af8017070 con 0x7f7b00139710 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 10 monclient: _renew_subs 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b000a1f90 con 0x7f7b00139710 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7af8011df0 con 0x7f7b00139710 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7ae7fff640 10 monclient: dump: 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 10 monclient: _renew_subs 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7afdffb640 4 set_mon_vals no callback set 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.538+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b00126270 con 0x7f7b00139710 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7b05ac7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 0x7f7b00122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0006a590 con 0x7f7b001225a0 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7af80117a0 con 0x7f7b00139710 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/501743229 >> v2:172.21.15.135:6800/726754104 conn(0x7f7aec03eab0 0x7f7aec040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7aff7fe640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 0x7f7b00122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (secure 0 0 0) 0x7f7af8051720 con 0x7f7b00139710 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7aff7fe640 10 monclient: get_auth_request con 0x7f7b001225a0 auth_method 0 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7aff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7aff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.539+0000 7f7aff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7afeffd640 1 --2- 172.21.15.71:0/501743229 >> v2:172.21.15.135:6800/726754104 conn(0x7f7aec03eab0 0x7f7aec040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7afeffd640 10 monclient: get_auth_request con 0x7f7aec03eab0 auth_method 0 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_done global_id 44868 payload 824 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.540+0000 7f7aff7fe640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b000a6d30 con 0x7f7b001225a0 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7aff7fe640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 msgr2=0x7f7b00122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7aff7fe640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 0x7f7b00122980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009ca0 tx=0x7f7af000c490 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7afeffd640 1 --2- 172.21.15.71:0/501743229 >> v2:172.21.15.135:6800/726754104 conn(0x7f7aec03eab0 0x7f7aec040f70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7b0006c930 tx=0x7f7af402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7af0003e00 con 0x7f7b001225a0 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7ae7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.542+0000 7f7ae7fff640 10 monclient: dump: 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7af0003990 con 0x7f7b001225a0 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 msgr2=0x7f7b00122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 0x7f7b00122980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009ca0 tx=0x7f7af000c490 comp rx=0 tx=0).stop 2024-08-19T11:16:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 msgr2=0x7f7b00122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.543+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b001225a0 0x7f7b00122980 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009ca0 tx=0x7f7af000c490 comp rx=0 tx=0).stop 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7b05ac7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 0x7f7b0009da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7b05ac7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b00076c60 con 0x7f7b00122ec0 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 0x7f7b0009da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient: get_auth_request con 0x7f7b00122ec0 auth_method 0 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.549+0000 7f7aff7fe640 10 monclient(hunting): handle_auth_done global_id 44877 payload 824 2024-08-19T11:16:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.550+0000 7f7aff7fe640 1 -- 172.21.15.71:0/501743229 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b001ce6c0 con 0x7f7b00122ec0 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7aff7fe640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 msgr2=0x7f7b0009da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7aff7fe640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 0x7f7b0009da00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7af0018000 tx=0x7f7af0004ab0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7af00046b0 con 0x7f7b00122ec0 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 10 monclient: dump: 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9235 (secure 0 0 0) 0x7f7af0004240 con 0x7f7b00122ec0 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 msgr2=0x7f7b0009da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 0x7f7b0009da00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7af0018000 tx=0x7f7af0004ab0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 msgr2=0x7f7b0009da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.552+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b00122ec0 0x7f7b0009da00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:37.567 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 132, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 166575, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.568 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.569 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:37.571 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.572 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.573 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.574 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.576 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:37.578 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.579 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.581 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.583 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.584 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.586 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.589 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.590 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:37.590 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:37.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 >> v2:172.21.15.135:6800/726754104 conn(0x7f7aec03eab0 msgr2=0x7f7aec040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/501743229 >> v2:172.21.15.135:6800/726754104 conn(0x7f7aec03eab0 0x7f7aec040f70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7b0006c930 tx=0x7f7af402e000 comp rx=0 tx=0).stop 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 10 monclient: shutdown 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 msgr2=0x7f7b00138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7afffff640 1 -- 172.21.15.71:0/501743229 reap_dead start 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 0x7f7b00138df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c410 tx=0x7f7af800c8d0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 shutdown_connections 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 --2- 172.21.15.71:0/501743229 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7b00139710 0x7f7b00138df0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 >> 172.21.15.71:0/501743229 conn(0x7f7b000abf50 msgr2=0x7f7b001c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 shutdown_connections 2024-08-19T11:16:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.553+0000 7f7b05ac7640 1 -- 172.21.15.71:0/501743229 wait complete. 2024-08-19T11:16:37.593 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:16:37.593 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon h 2024-08-19T11:16:37.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.692+0000 7f2a3b981640 10 monclient: get_monmap_and_config 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.692+0000 7f2a3b981640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.692+0000 7f2a3b981640 10 monclient: monmap: 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:37.692751+0000 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:37.692751+0000 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:37.694 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.692+0000 7f2a3b981640 1 Processor -- start 2024-08-19T11:16:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.692+0000 7f2a3b981640 1 -- start start 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.692+0000 7f2a3b981640 10 monclient: init 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient: _add_conns ranks=[3,0,6,7,9,1,2,10,8,5,4] 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a340a4640 0x7f2a340a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): picked mon.noname-g con 0x7f2a340a4640 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2a3406d500 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34139f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): picked mon.noname-d con 0x7f2a340a4f60 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a340a1400 con 0x7f2a3406d500 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a340a31a0 con 0x7f2a340a4640 2024-08-19T11:16:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2a3409fab0 con 0x7f2a340a4f60 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3b981640 10 monclient(hunting): authenticate will time out at 1055.734517s 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a38f1c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2a3406d500 0x7f2a341397f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33028/0 (socket says 172.21.15.71:33028) 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a38f1c640 1 -- 172.21.15.71:0/3369268793 learned_addr learned my addr 172.21.15.71:0/3369268793 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): get_auth_request con 0x7f2a340a4f60 auth_method 0 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3971d640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a340a4640 0x7f2a340a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_done global_id 25809 payload 274 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 1 -- 172.21.15.71:0/3369268793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a340a4640 msgr2=0x7f2a340a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a340a4640 0x7f2a340a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 1 -- 172.21.15.71:0/3369268793 >> v1:172.21.15.71:6789/0 conn(0x7f2a3406d500 legacy=0x7f2a341397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 1 monclient: found mon.noname-d 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a39f1e640 1 -- 172.21.15.71:0/3369268793 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3406d040 con 0x7f2a340a4f60 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3971d640 10 monclient: get_auth_request con 0x7f2a340a4640 auth_method 0 2024-08-19T11:16:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.693+0000 7f2a3971d640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a340a4640 0x7f2a340a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:16:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a39f1e640 1 -- 172.21.15.71:0/3369268793 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 msgr2=0x7f2a34139f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a39f1e640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34139f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009dc0 tx=0x7f2a2402a480 comp rx=0 tx=0).ready entity=mon.6 client_cookie=a1312f30435fe668 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 1 -- 172.21.15.71:0/3369268793 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2a24007ca0 con 0x7f2a340a4f60 2024-08-19T11:16:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:16:37.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: dump: 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.708 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 1 -- 172.21.15.71:0/3369268793 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a24031400 con 0x7f2a340a4f60 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a3b981640 5 monclient: authenticate success, global_id 25809 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a3b981640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a3b981640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 1 -- 172.21.15.71:0/3369268793 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2a24007e60 con 0x7f2a340a4f60 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a3b981640 4 set_mon_vals no callback set 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.696+0000 7f2a33fff640 10 monclient: dump: 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.710 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 10 monclient: shutdown 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 -- 172.21.15.71:0/3369268793 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 msgr2=0x7f2a34139f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34139f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009dc0 tx=0x7f2a2402a480 comp rx=0 tx=0).stop 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 -- 172.21.15.71:0/3369268793 shutdown_connections 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34139f00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 --2- 172.21.15.71:0/3369268793 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a340a4640 0x7f2a340a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 -- 172.21.15.71:0/3369268793 >> 172.21.15.71:0/3369268793 conn(0x7f2a3406dfe0 msgr2=0x7f2a340a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 -- 172.21.15.71:0/3369268793 shutdown_connections 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.697+0000 7f2a3b981640 1 -- 172.21.15.71:0/3369268793 wait complete. 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 10 monclient: build_initial_monmap 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 10 monclient: monmap: 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:37.712 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 1 Processor -- start 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 1 -- start start 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 10 monclient: init 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 10 monclient: _add_conns ranks=[2,4,6,7,5,0,1,3,8] 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 0x7f2a34126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 10 monclient(hunting): picked mon.noname-b con 0x7f2a3406d500 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:37.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.698+0000 7f2a3b981640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2a340a4640 0x7f2a34127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): picked mon.noname-c con 0x7f2a340a4640 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): picked mon.noname-d con 0x7f2a340a4f60 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2a340a53f0 con 0x7f2a3406d500 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f2a340a6170 con 0x7f2a340a4640 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2a3409f4a0 con 0x7f2a340a4f60 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a38f1c640 1 -- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2a340a4640 msgr2=0x7f2a34127340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3302/0 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3b981640 10 monclient(hunting): authenticate will time out at 1055.740061s 2024-08-19T11:16:37.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a38f1c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2a340a4640 0x7f2a34127340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 0x7f2a34126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 0x7f2a34126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:50420/0 (socket says 172.21.15.71:50420) 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 -- 172.21.15.71:0/4024415331 learned_addr learned my addr 172.21.15.71:0/4024415331 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): get_auth_request con 0x7f2a3406d500 auth_method 0 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): get_auth_request con 0x7f2a340a4f60 auth_method 0 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient(hunting): handle_auth_done global_id 74315 payload 824 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 msgr2=0x7f2a34127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2a340a4640 msgr2=0x7f2a34127340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2a340a4640 0x7f2a34127340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient: _finish_hunting 0 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 monclient: found mon.noname-b 2024-08-19T11:16:37.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a3971d640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3412ab60 con 0x7f2a3406d500 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.699+0000 7f2a39f1e640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2a340a4f60 0x7f2a34127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a3971d640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 msgr2=0x7f2a34126e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a3971d640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 0x7f2a34126e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00c820 tx=0x7f2a2c00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2a2c015070 con 0x7f2a3406d500 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: dump: 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.717 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: _finish_auth 0 2024-08-19T11:16:37.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a3b981640 5 monclient: authenticate success, global_id 74315 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0113f0 con 0x7f2a3406d500 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2a2c011a10 con 0x7f2a3406d500 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a3b981640 10 monclient: _renew_subs 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a3b981640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a340a7a40 con 0x7f2a3406d500 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a337fe640 4 set_mon_vals no callback set 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.701+0000 7f2a31ffb640 10 monclient: dump: 2024-08-19T11:16:37.719 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.720 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 10 monclient: _renew_subs 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a34128800 con 0x7f2a3406d500 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2a2c018070 con 0x7f2a3406d500 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 0x7f2a34123a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f2a3406d2c0 con 0x7f2a34123690 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.702+0000 7f2a31ffb640 1 --2- 172.21.15.71:0/4024415331 >> v2:172.21.15.135:6800/726754104 conn(0x7f2a2003ea80 0x7f2a20040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (secure 0 0 0) 0x7f2a2c051b90 con 0x7f2a3406d500 2024-08-19T11:16:37.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 0x7f2a34123a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient: get_auth_request con 0x7f2a34123690 auth_method 0 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a39f1e640 1 --2- 172.21.15.71:0/4024415331 >> v2:172.21.15.135:6800/726754104 conn(0x7f2a2003ea80 0x7f2a20040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a39f1e640 10 monclient: get_auth_request con 0x7f2a2003ea80 auth_method 0 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_done global_id 45023 payload 824 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.703+0000 7f2a38f1c640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a340a4a20 con 0x7f2a34123690 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.705+0000 7f2a39f1e640 1 --2- 172.21.15.71:0/4024415331 >> v2:172.21.15.135:6800/726754104 conn(0x7f2a2003ea80 0x7f2a20040f40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a24034000 tx=0x7f2a2402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.705+0000 7f2a38f1c640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 msgr2=0x7f2a34123a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.705+0000 7f2a38f1c640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 0x7f2a34123a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a34128560 tx=0x7f2a2800c7f0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2a28017070 con 0x7f2a34123690 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 10 monclient: dump: 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.723 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2a28005db0 con 0x7f2a34123690 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 msgr2=0x7f2a34123a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 0x7f2a34123a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2a34128560 tx=0x7f2a2800c7f0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 msgr2=0x7f2a34123a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.706+0000 7f2a31ffb640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123690 0x7f2a34123a70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a3b981640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a3b981640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 0x7f2a341d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a3b981640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f2a3406cc70 con 0x7f2a34123fb0 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 0x7f2a341d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient: get_auth_request con 0x7f2a34123fb0 auth_method 0 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 10 monclient(hunting): handle_auth_done global_id 45032 payload 824 2024-08-19T11:16:37.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.712+0000 7f2a38f1c640 1 -- 172.21.15.71:0/4024415331 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2a3406ec60 con 0x7f2a34123fb0 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a38f1c640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 msgr2=0x7f2a341d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a38f1c640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 0x7f2a341d8a70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a28011000 tx=0x7f2a280047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2a28017030 con 0x7f2a34123fb0 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 10 monclient: dump: 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:37.728 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9402 (secure 0 0 0) 0x7f2a28022430 con 0x7f2a34123fb0 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:16:37.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 msgr2=0x7f2a341d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 0x7f2a341d8a70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a28011000 tx=0x7f2a280047e0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 msgr2=0x7f2a341d8a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.715+0000 7f2a31ffb640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2a34123fb0 0x7f2a341d8a70 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a28011000 tx=0x7f2a280047e0 comp rx=0 tx=0).stop 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 132, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 166738, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:16:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:16:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:16:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:16:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:16:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:16:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:16:37.753 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 >> v2:172.21.15.135:6800/726754104 conn(0x7f2a2003ea80 msgr2=0x7f2a20040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 --2- 172.21.15.71:0/4024415331 >> v2:172.21.15.135:6800/726754104 conn(0x7f2a2003ea80 0x7f2a20040f40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a24034000 tx=0x7f2a2402f000 comp rx=0 tx=0).stop 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 10 monclient: shutdown 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 msgr2=0x7f2a34126e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 --2- 172.21.15.71:0/4024415331 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2a3406d500 0x7f2a34126e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c00c820 tx=0x7f2a2c00cc20 comp rx=0 tx=0).stop 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a39f1e640 1 -- 172.21.15.71:0/4024415331 reap_dead start 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a39f1e640 1 -- 172.21.15.71:0/4024415331 reap_dead start 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 shutdown_connections 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 >> 172.21.15.71:0/4024415331 conn(0x7f2a3406dfe0 msgr2=0x7f2a3409ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 shutdown_connections 2024-08-19T11:16:37.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:37.716+0000 7f2a3b981640 1 -- 172.21.15.71:0/4024415331 wait complete. 2024-08-19T11:16:37.756 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-08-19T11:16:37.756 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:16:38.605 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:38.605 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: starting. 2024-08-19T11:16:38.605 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26684 2024-08-19T11:16:38.605 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: created object 0... 2024-08-19T11:16:38.605 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: created object 25... 2024-08-19T11:16:38.605 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: created object 49... 2024-08-19T11:16:38.606 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: finishing. 2024-08-19T11:16:38.606 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26719]: shutting down. 2024-08-19T11:16:38.642 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:38.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26721]: starting. 2024-08-19T11:16:38.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26721]: listing objects. 2024-08-19T11:16:38.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26721]: listed object 0... 2024-08-19T11:16:38.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26721]: listed object 25... 2024-08-19T11:16:38.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26721]: saw 50 objects 2024-08-19T11:16:38.643 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26721]: shutting down. 2024-08-19T11:16:39.513 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:39.513 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26720]: starting. 2024-08-19T11:16:39.513 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26720]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26684 2024-08-19T11:16:39.513 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26720]: shutting down. 2024-08-19T11:16:39.515 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:39.515 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:39.515 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:16:39.517 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:16:41.107 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: starting. 2024-08-19T11:16:41.108 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26787 2024-08-19T11:16:41.108 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: created object 0... 2024-08-19T11:16:41.108 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: created object 25... 2024-08-19T11:16:41.108 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: created object 49... 2024-08-19T11:16:41.108 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: finishing. 2024-08-19T11:16:41.108 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26788]: shutting down. 2024-08-19T11:16:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26789]: starting. 2024-08-19T11:16:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26789]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26787 2024-08-19T11:16:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26789]: shutting down. 2024-08-19T11:16:44.120 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: starting. 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26787 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: created object 0... 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: created object 25... 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: created object 49... 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: finishing. 2024-08-19T11:16:44.121 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26822]: shutting down. 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26824]: starting. 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26824]: listing objects. 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26824]: listed object 0... 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26824]: listed object 25... 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26824]: saw 50 objects 2024-08-19T11:16:44.159 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26824]: shutting down. 2024-08-19T11:16:45.031 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:45.031 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26823]: starting. 2024-08-19T11:16:45.032 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26823]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26787 2024-08-19T11:16:45.032 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26823]: shutting down. 2024-08-19T11:16:45.034 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:45.034 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:45.034 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:16:45.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:16:47.160 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: starting. 2024-08-19T11:16:47.161 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26890 2024-08-19T11:16:47.161 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: created object 0... 2024-08-19T11:16:47.161 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: created object 25... 2024-08-19T11:16:47.161 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: created object 49... 2024-08-19T11:16:47.161 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: finishing. 2024-08-19T11:16:47.161 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26891]: shutting down. 2024-08-19T11:16:48.055 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26892]: starting. 2024-08-19T11:16:48.055 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26892]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26890 2024-08-19T11:16:48.055 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26892]: shutting down. 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: starting. 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26890 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: created object 0... 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: created object 25... 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: created object 49... 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: finishing. 2024-08-19T11:16:50.181 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[26925]: shutting down. 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26927]: starting. 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26927]: listing objects. 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26927]: listed object 0... 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26927]: listed object 25... 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26927]: saw 50 objects 2024-08-19T11:16:50.219 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[26927]: shutting down. 2024-08-19T11:16:51.088 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:51.088 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26926]: starting. 2024-08-19T11:16:51.088 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26926]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26890 2024-08-19T11:16:51.088 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[26926]: shutting down. 2024-08-19T11:16:51.089 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:51.089 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:51.090 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:16:51.092 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:16:53.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: starting. 2024-08-19T11:16:53.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26993 2024-08-19T11:16:53.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: created object 0... 2024-08-19T11:16:53.220 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: created object 25... 2024-08-19T11:16:53.221 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: created object 49... 2024-08-19T11:16:53.221 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: finishing. 2024-08-19T11:16:53.221 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[26994]: shutting down. 2024-08-19T11:16:54.588 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26995]: starting. 2024-08-19T11:16:54.588 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26995]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26993 2024-08-19T11:16:54.588 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[26995]: shutting down. 2024-08-19T11:16:56.602 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: starting. 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-26993 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: created object 0... 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: created object 25... 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: created object 49... 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: finishing. 2024-08-19T11:16:56.603 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27028]: shutting down. 2024-08-19T11:16:56.640 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:56.640 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27030]: starting. 2024-08-19T11:16:56.640 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27030]: listing objects. 2024-08-19T11:16:56.640 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27030]: listed object 0... 2024-08-19T11:16:56.641 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27030]: listed object 25... 2024-08-19T11:16:56.641 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27030]: saw 50 objects 2024-08-19T11:16:56.641 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27030]: shutting down. 2024-08-19T11:16:57.479 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:57.479 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27029]: starting. 2024-08-19T11:16:57.479 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27029]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-26993 2024-08-19T11:16:57.479 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27029]: shutting down. 2024-08-19T11:16:57.480 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:57.480 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:16:57.481 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:16:57.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:16:57.757 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-08-19T11:16:57.757 INFO:tasks.ceph.mon.f:Restarting daemon 2024-08-19T11:16:57.757 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-08-19T11:16:57.760 INFO:tasks.ceph.mon.f:Started 2024-08-19T11:16:57.760 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-08-19T11:16:57.760 INFO:tasks.ceph.mon.i:Restarting daemon 2024-08-19T11:16:57.760 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-08-19T11:16:57.762 INFO:tasks.ceph.mon.i:Started 2024-08-19T11:16:57.762 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-08-19T11:16:57.762 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-19T11:16:57.762 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-19T11:16:57.765 INFO:tasks.ceph.mon.c:Started 2024-08-19T11:16:57.766 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:16:57.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:16:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.874+0000 7f813ed14640 10 monclient: get_monmap_and_config 2024-08-19T11:16:57.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.874+0000 7f813ed14640 10 monclient: build_initial_monmap 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.874+0000 7f813ed14640 10 monclient: monmap: 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:16:57.875586+0000 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:16:57.875586+0000 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:57.877 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:57.877 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:57.877 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:57.877 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:16:57.877 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:16:57.877 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.875+0000 7f813ed14640 1 Processor -- start 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.875+0000 7f813ed14640 1 -- start start 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.875+0000 7f813ed14640 10 monclient: init 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient: _add_conns ranks=[9,2,0,1,7,5,8,10,6,3,4] 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81380a4750 0x7f81380a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): picked mon.noname-a con 0x7f81380a4750 addr v2:172.21.15.71:3300/0 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 0x7f81380a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): picked mon.noname-b con 0x7f81380a29b0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8138137510 addr v1:172.21.15.71:6789/0 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813809cc20 con 0x7f8138137510 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f813809fa00 con 0x7f81380a4750 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f81380a2e30 con 0x7f81380a29b0 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813ed14640 10 monclient(hunting): authenticate will time out at 1075.917368s 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 0x7f81380a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81380a4750 0x7f81380a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:57.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 0x7f81380a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44758/0 (socket says 172.21.15.71:44758) 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 -- 172.21.15.71:0/519103961 learned_addr learned my addr 172.21.15.71:0/519103961 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): get_auth_request con 0x7f81380a29b0 auth_method 0 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): get_auth_request con 0x7f81380a4750 auth_method 0 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:57.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f813cab0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient(hunting): handle_auth_done global_id 74414 payload 274 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 -- 172.21.15.71:0/519103961 >> v2:172.21.15.71:3300/0 conn(0x7f81380a4750 msgr2=0x7f81380a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 --2- 172.21.15.71:0/519103961 >> v2:172.21.15.71:3300/0 conn(0x7f81380a4750 0x7f81380a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 -- 172.21.15.71:0/519103961 >> v1:172.21.15.71:6789/0 conn(0x7f8138137510 legacy=0x7f8138137910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 monclient: found mon.noname-b 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.876+0000 7f8137fff640 1 -- 172.21.15.71:0/519103961 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81380a62b0 con 0x7f81380a29b0 2024-08-19T11:16:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f8137fff640 1 -- 172.21.15.71:0/519103961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 msgr2=0x7f81380a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f8137fff640 1 --2- 172.21.15.71:0/519103961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 0x7f81380a5070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8124009870 tx=0x7f812402a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4e3d7b0e167376 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 1 -- 172.21.15.71:0/519103961 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8124037070 con 0x7f81380a29b0 2024-08-19T11:16:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: dump: 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: _finish_auth 0 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: _check_auth_tickets 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 1 -- 172.21.15.71:0/519103961 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812402ae00 con 0x7f81380a29b0 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f813ed14640 5 monclient: authenticate success, global_id 74414 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f813ed14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:16:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f813ed14640 10 monclient: get_monmap_and_config success 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 1 -- 172.21.15.71:0/519103961 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8124030c20 con 0x7f81380a29b0 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f813ed14640 4 set_mon_vals no callback set 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.879+0000 7f81377fe640 10 monclient: dump: 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 10 monclient: shutdown 2024-08-19T11:16:57.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 -- 172.21.15.71:0/519103961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 msgr2=0x7f81380a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 --2- 172.21.15.71:0/519103961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 0x7f81380a5070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8124009870 tx=0x7f812402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 -- 172.21.15.71:0/519103961 shutdown_connections 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 --2- 172.21.15.71:0/519103961 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a29b0 0x7f81380a5070 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 --2- 172.21.15.71:0/519103961 >> v2:172.21.15.71:3300/0 conn(0x7f81380a4750 0x7f81380a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 -- 172.21.15.71:0/519103961 >> 172.21.15.71:0/519103961 conn(0x7f813806dfe0 msgr2=0x7f81380a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 -- 172.21.15.71:0/519103961 shutdown_connections 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 1 -- 172.21.15.71:0/519103961 wait complete. 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 10 monclient: build_initial_monmap 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.880+0000 7f813ed14640 10 monclient: monmap: 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:16:57.893 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:16:57.894 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.881+0000 7f813ed14640 1 Processor -- start 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.881+0000 7f813ed14640 1 -- start start 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.881+0000 7f813ed14640 10 monclient: init 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.881+0000 7f813ed14640 10 monclient: _reopen_session rank -1 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient: _add_conns ranks=[7,2,1,6,3,8,0,5,4] 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 0x7f8138136b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): picked mon.noname-i con 0x7f81380a29b0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 0x7f81381c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:57.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): picked mon.noname-b con 0x7f81380a4750 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 0x7f81381c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): picked mon.noname-f con 0x7f8138137510 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81380a24c0 con 0x7f8138137510 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f81380a55b0 con 0x7f81380a4750 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f813809fbd0 con 0x7f81380a29b0 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): _renew_subs 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813ed14640 10 monclient(hunting): authenticate will time out at 1075.923098s 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 0x7f81381c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 0x7f81381c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:44760/0 (socket says 172.21.15.71:44760) 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 -- 172.21.15.71:0/1500913252 learned_addr learned my addr 172.21.15.71:0/1500913252 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): get_auth_request con 0x7f81380a4750 auth_method 0 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 0x7f81381c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:57.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 0x7f8138136b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 10 monclient(hunting): get_auth_request con 0x7f8138137510 auth_method 0 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 10 monclient(hunting): get_auth_request con 0x7f81380a29b0 auth_method 0 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient(hunting): handle_auth_done global_id 74423 payload 824 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 msgr2=0x7f81381c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:16:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 msgr2=0x7f81381c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 0x7f81381c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 msgr2=0x7f8138136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 msgr2=0x7f8138136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813d2b1640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 0x7f81381c9290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 msgr2=0x7f8138136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 0x7f8138136b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f813cab0640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 0x7f8138136b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 0x7f8138136b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 msgr2=0x7f81381c9290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 0x7f81381c9290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient: _finish_hunting 0 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 monclient: found mon.noname-b 2024-08-19T11:16:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.882+0000 7f8137fff640 1 -- 172.21.15.71:0/1500913252 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8138121b50 con 0x7f81380a4750 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f8137fff640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 msgr2=0x7f81381c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f8137fff640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 0x7f81381c8d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f81240097c0 tx=0x7f81240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8124041030 con 0x7f81380a4750 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 10 monclient: dump: 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.900 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 10 monclient: _finish_auth 0 2024-08-19T11:16:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 10 monclient: _check_auth_tickets 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8124003c50 con 0x7f81380a4750 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f813ed14640 5 monclient: authenticate success, global_id 74423 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f813ed14640 10 monclient: _renew_subs 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f813ed14640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.884+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81381244c0 con 0x7f81380a4750 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f81357fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8124037040 con 0x7f81380a4750 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f813ed14640 10 monclient: _renew_subs 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f8136ffd640 4 set_mon_vals no callback set 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f813ed14640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8138122160 con 0x7f81380a4750 2024-08-19T11:16:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f81357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f81357fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f81357fa640 10 monclient: dump: 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:16:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.885+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8124044070 con 0x7f81380a4750 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f81357fa640 1 --2- 172.21.15.71:0/1500913252 >> v2:172.21.15.135:6800/726754104 conn(0x7f811c03ea80 0x7f811c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f813ed14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f813ed14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f813ed14640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81380a8400 con 0x7f81380a4750 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(195..195 src has 1..195) ==== 3506+0+0 (secure 0 0 0) 0x7f8124042070 con 0x7f81380a4750 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f813cab0640 1 --2- 172.21.15.71:0/1500913252 >> v2:172.21.15.135:6800/726754104 conn(0x7f811c03ea80 0x7f811c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:16:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.886+0000 7f813cab0640 10 monclient: get_auth_request con 0x7f811c03ea80 auth_method 0 2024-08-19T11:16:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.888+0000 7f813cab0640 1 --2- 172.21.15.71:0/1500913252 >> v2:172.21.15.135:6800/726754104 conn(0x7f811c03ea80 0x7f811c040f40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f812c009500 tx=0x7f812c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:16:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.891+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f81380a8400 con 0x7f81380a4750 2024-08-19T11:16:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.891+0000 7f81357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:16:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:57.891+0000 7f81357fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:16:58.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:58.140+0000 7f813ed14640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:16:58.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:58.140+0000 7f813ed14640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:16:58.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:58.140+0000 7f813ed14640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:16:58.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:16:58.140+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f81380a4b30 con 0x7f81380a4750 2024-08-19T11:17:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:00.881+0000 7f8123fff640 10 monclient: tick 2024-08-19T11:17:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:00.881+0000 7f8123fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:00.881+0000 7f8123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:00.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:00.881+0000 7f8123fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:01.881+0000 7f8123fff640 10 monclient: tick 2024-08-19T11:17:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:01.881+0000 7f8123fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:01.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:01.881+0000 7f8123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:02.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:02.881+0000 7f8123fff640 10 monclient: tick 2024-08-19T11:17:02.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:02.881+0000 7f8123fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:02.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:02.881+0000 7f8123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:03.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.072+0000 7f81357fa640 1 -- 172.21.15.71:0/1500913252 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3175 (secure 0 0 0) 0x7f8124032440 con 0x7f81380a4750 2024-08-19T11:17:03.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.072+0000 7f81357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:03.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.072+0000 7f81357fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:03.075 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":136,"quorum":[0,2,3,5,6,8],"quorum_names":["a","b","g","h","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.075+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 >> v2:172.21.15.135:6800/726754104 conn(0x7f811c03ea80 msgr2=0x7f811c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.075+0000 7f813ed14640 1 --2- 172.21.15.71:0/1500913252 >> v2:172.21.15.135:6800/726754104 conn(0x7f811c03ea80 0x7f811c040f40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f812c009500 tx=0x7f812c008040 comp rx=0 tx=0).stop 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.075+0000 7f813ed14640 10 monclient: shutdown 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.075+0000 7f813ed14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.075+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 msgr2=0x7f81381c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.075+0000 7f813ed14640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 0x7f81381c8d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f81240097c0 tx=0x7f81240046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 shutdown_connections 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 --2- 172.21.15.71:0/1500913252 >> v2:172.21.15.135:6800/726754104 conn(0x7f811c03ea80 0x7f811c040f40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8138137510 0x7f81381c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81380a4750 0x7f81381c8d50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 --2- 172.21.15.71:0/1500913252 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f81380a29b0 0x7f8138136b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 >> 172.21.15.71:0/1500913252 conn(0x7f813806dfe0 msgr2=0x7f81380a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 shutdown_connections 2024-08-19T11:17:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:03.076+0000 7f813ed14640 1 -- 172.21.15.71:0/1500913252 wait complete. 2024-08-19T11:17:06.094 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:17:06.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.200+0000 7f2db0cda640 10 monclient: get_monmap_and_config 2024-08-19T11:17:06.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.200+0000 7f2db0cda640 10 monclient: build_initial_monmap 2024-08-19T11:17:06.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.201+0000 7f2db0cda640 10 monclient: monmap: 2024-08-19T11:17:06.203 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:06.203 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:06.202634+0000 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:06.202634+0000 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:06.204 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:06.205 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:06.205 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.201+0000 7f2db0cda640 1 Processor -- start 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.201+0000 7f2db0cda640 1 -- start start 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.201+0000 7f2db0cda640 10 monclient: init 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient: _add_conns ranks=[10,9,5,1,3,8,6,7,2,4,0] 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:06.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): picked mon.noname-f con 0x7f2dac0a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): picked mon.noname-a con 0x7f2dac0a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): picked mon.noname-h con 0x7f2dac139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:06.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2dac0a6e10 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac0a6380 con 0x7f2dac0a6a30 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f2dac0a49d0 con 0x7f2dac139860 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2db0cda640 10 monclient(hunting): authenticate will time out at 1084.244409s 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43200/0 (socket says 172.21.15.71:43200) 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 learned_addr learned my addr 172.21.15.71:0/3841644063 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6e10 auth_method 0 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:06.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2dac139860 auth_method 0 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6a30 auth_method 0 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:06.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:06.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.202+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2dac139860 auth_method 0 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6a30 auth_method 0 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.403+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6e10 auth_method 0 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:06.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:06.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2dac139860 auth_method 0 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6a30 auth_method 0 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.804+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6e10 auth_method 0 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:06.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:06.806+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:07.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:07.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:07.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6a30 auth_method 0 2024-08-19T11:17:07.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:07.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2dac139860 auth_method 0 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:07.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.606+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:07.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:07.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2dac0a6e10 auth_method 0 2024-08-19T11:17:07.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:07.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:07.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:07.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:07.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:07.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:07.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:07.608+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:09.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): tick 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 msgr2=0x7f2dac139d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2dac139860 0x7f2dac139d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 msgr2=0x7f2dac0a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.135:3300/0 conn(0x7f2dac0a6a30 0x7f2dac0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 msgr2=0x7f2dac0a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> v2:172.21.15.71:3300/0 conn(0x7f2dac0a6e10 0x7f2dac0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient: _add_conns ranks=[8,3,0,1,4,6,7,2] 2024-08-19T11:17:09.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-e con 0x7f2d980037f0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-g con 0x7f2d98006250 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d98008db0 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dac0a46f0 con 0x7f2d98008db0 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2d98006250 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f2dac0a6380 con 0x7f2d980037f0 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:09.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d980037f0 auth_method 0 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98006250 auth_method 0 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:09.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:09.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.205+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.71:6789/0 conn(0x7f2d98008db0 legacy=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d980037f0 auth_method 0 2024-08-19T11:17:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:09.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98006250 auth_method 0 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:09.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:09.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:09.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d980037f0 auth_method 0 2024-08-19T11:17:09.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:09.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:09.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:09.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:09.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:09.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:09.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:09.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:09.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98006250 auth_method 0 2024-08-19T11:17:09.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:09.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:09.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:09.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:09.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:09.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:09.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:09.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d980037f0 auth_method 0 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:10.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98006250 auth_method 0 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:10.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:10.606+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): tick 2024-08-19T11:17:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:17:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:17:12.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 msgr2=0x7f2d98005c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d980037f0 0x7f2d98005c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 msgr2=0x7f2d980086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d98006250 0x7f2d980086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.71:6789/0 conn(0x7f2d98008db0 legacy=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient: _add_conns ranks=[1,7,2,4,6] 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 reap_dead start 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2d9800ce20 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:12.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 reap_dead start 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-i con 0x7f2d98003bf0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-b con 0x7f2d98006c10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d9800dc90 con 0x7f2d9800ce20 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2d98006c10 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:12.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f2dac0a6380 con 0x7f2d98003bf0 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98006c10 auth_method 0 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:12.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:12.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.205+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d9800ce20 legacy=0x7f2d9800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98006c10 auth_method 0 2024-08-19T11:17:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98006c10 auth_method 0 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.806+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.846+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d9800ce20 legacy=0x7f2d9800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-19T11:17:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.846+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d9800ce20 legacy=0x7f2d9800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:17:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.846+0000 7f2daa59c640 1 --1- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d9800ce20 0x7f2d9800d200 :-1 s=OPENED pgs=75 cs=1 l=1).handle_message read tag failed 2024-08-19T11:17:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.846+0000 7f2daa59c640 1 --1- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d9800ce20 0x7f2d9800d200 :-1 s=OPENED pgs=75 cs=1 l=1).fault on lossy channel, failing 2024-08-19T11:17:12.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:12.846+0000 7f2da959a640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.135:6789/0 2024-08-19T11:17:13.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:13.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:13.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98006c10 auth_method 0 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:13.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:13.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:13.607+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): tick 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d980066d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d980066d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 msgr2=0x7f2d98007090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d98006c10 0x7f2d98007090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:15.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d9800ce20 legacy=0x7f2d9800d200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient: _add_conns ranks=[4,6] 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-c con 0x7f2d98007620 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-d con 0x7f2d98007a00 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2d98007620 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2dac0a6380 con 0x7f2d98007a00 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:15.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98007a00 auth_method 0 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:15.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.203+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:15.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:15.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98007a00 auth_method 0 2024-08-19T11:17:15.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:15.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:15.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:15.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:15.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.404+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98007a00 auth_method 0 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:15.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:15.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:15.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:15.805+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:16.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98007a00 auth_method 0 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:16.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:16.607+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): tick 2024-08-19T11:17:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 msgr2=0x7f2d98007de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007a00 0x7f2d98007de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient: _add_conns ranks=[8,7,4,2,0,5,3,6,1,10,9] 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-e con 0x7f2d9800ba20 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 reap_dead start 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-i con 0x7f2d98003bf0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-c con 0x7f2d98007620 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2d98007620 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f2dac0a6380 con 0x7f2d98003bf0 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f2dac0a49d0 con 0x7f2d9800ba20 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d9800ba20 auth_method 0 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.204+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d9800ba20 auth_method 0 2024-08-19T11:17:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.405+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.406+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:18.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d9800ba20 auth_method 0 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:18.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:18.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:18.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:18.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:18.807+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d9800ba20 auth_method 0 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d98007620 auth_method 0 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:19.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98003bf0 auth_method 0 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:19.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:19.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:19.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:19.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:19.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:19.608+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: starting. 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27096 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: created object 0... 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: created object 25... 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: created object 49... 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: finishing. 2024-08-19T11:17:20.271 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27097]: shutting down. 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 10 monclient(hunting): tick 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 msgr2=0x7f2d9800be00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d9800ba20 0x7f2d9800be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 msgr2=0x7f2d98006690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d98003bf0 0x7f2d98006690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 msgr2=0x7f2d9800b270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.204+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f2d98007620 0x7f2d9800b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 10 monclient: _add_conns ranks=[1,6,0,9,5,2,10,3] 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2d98006bd0 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 0x7f2d9800c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-d con 0x7f2d98007090 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d98007a00 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d98008720 con 0x7f2d98007a00 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d9800c880 con 0x7f2d98006bd0 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2d98007090 2024-08-19T11:17:21.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da3fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 0x7f2d9800c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d98007090 auth_method 0 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 msgr2=0x7f2d9800c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 msgr2=0x7f2d9800c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 0x7f2d9800c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:21.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.205+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 0x7f2d9800c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:21.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.207+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.71:6789/0 conn(0x7f2d98007a00 legacy=0x7f2d98017010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.207+0000 7f2daa59c640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d98006bd0 legacy=0x7f2d9800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.332+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693847697 0 0) 0x7f2d98008720 con 0x7f2d98007a00 2024-08-19T11:17:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.332+0000 7f2da959a640 10 monclient(hunting): _negotiate 2024-08-19T11:17:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.332+0000 7f2da959a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.332+0000 7f2da959a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.332+0000 7f2da959a640 10 monclient(hunting): my global_id is 74421 2024-08-19T11:17:21.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.332+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d8c003520 con 0x7f2d98007a00 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1548534288 0 0) 0x7f2d8c003520 con 0x7f2d98007a00 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 msgr2=0x7f2d9800c340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f2d98007090 0x7f2d9800c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.135:6789/0 conn(0x7f2d98006bd0 legacy=0x7f2d9800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 reap_dead start 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d98007e10 con 0x7f2d98007a00 2024-08-19T11:17:21.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f2da4009c30 con 0x7f2d98007a00 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.334+0000 7f2da959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient: dump: 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.339 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 >> v1:172.21.15.71:6789/0 conn(0x7f2d98007a00 legacy=0x7f2d98017010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient: _add_conns ranks=[3,2,8,4,5,0,7,6,1] 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d8c004200 0x7f2d8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): picked mon.g con 0x7f2d8c004200 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c004e10 0x7f2d8c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): picked mon.b con 0x7f2d8c004e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 0x7f2d8c00c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): picked mon.e con 0x7f2d8c009cd0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac0a4f90 con 0x7f2d8c004e10 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8c00ca40 con 0x7f2d8c004200 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f2d8c00cbf0 con 0x7f2d8c009cd0 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da959a640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c004e10 0x7f2d8c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 0x7f2d8c00c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d8c004e10 auth_method 0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d8c009cd0 auth_method 0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d8c004200 0x7f2d8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d8c004200 auth_method 0 2024-08-19T11:17:21.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2da9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daa59c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:17:21.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient(hunting): handle_auth_done global_id 74421 payload 293 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d8c004200 msgr2=0x7f2d8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d8c004200 0x7f2d8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c004e10 msgr2=0x7f2d8c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c004e10 0x7f2d8c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 monclient: found mon.e 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8c003520 con 0x7f2d8c009cd0 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2daad9d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2db0cda640 5 monclient: authenticate success, global_id 74421 2024-08-19T11:17:21.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.335+0000 7f2db0cda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:21.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.338+0000 7f2daad9d640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 msgr2=0x7f2d8c00c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.338+0000 7f2daad9d640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 0x7f2d8c00c160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2dac09ca80 tx=0x7f2d8c005830 comp rx=0 tx=0).ready entity=mon.8 client_cookie=6f4dc843f9f86a12 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2da4003990 con 0x7f2d8c009cd0 2024-08-19T11:17:21.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: dump: 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.351 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2db0cda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da4038070 con 0x7f2d8c009cd0 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2db0cda640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2db0cda640 4 set_mon_vals no callback set 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 1 -- 172.21.15.71:0/3841644063 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2da4032cf0 con 0x7f2d8c009cd0 2024-08-19T11:17:21.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.339+0000 7f2da959a640 10 monclient: dump: 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.353 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 10 monclient: shutdown 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 -- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 msgr2=0x7f2d8c00c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 0x7f2d8c00c160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2dac09ca80 tx=0x7f2d8c005830 comp rx=0 tx=0).stop 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 -- 172.21.15.71:0/3841644063 shutdown_connections 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c004e10 0x7f2d8c005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d8c004200 0x7f2d8c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 --2- 172.21.15.71:0/3841644063 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2d8c009cd0 0x7f2d8c00c160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 -- 172.21.15.71:0/3841644063 >> 172.21.15.71:0/3841644063 conn(0x7f2dac0ac030 msgr2=0x7f2dac0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 -- 172.21.15.71:0/3841644063 shutdown_connections 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.340+0000 7f2db0cda640 1 -- 172.21.15.71:0/3841644063 wait complete. 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.341+0000 7f2db0cda640 10 monclient: build_initial_monmap 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.341+0000 7f2db0cda640 10 monclient: monmap: 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:21.355 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 Processor -- start 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 -- start start 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient: init 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient: _add_conns ranks=[7,5,2,4,3,6,0,8,1] 2024-08-19T11:17:21.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 0x7f2dac136190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): picked mon.noname-i con 0x7f2d8c004200 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2d8c004e10 0x7f2dac1366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): picked mon.noname-h con 0x7f2d8c004e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 0x7f2dac0a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): picked mon.noname-b con 0x7f2d8c009cd0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac0a5b80 con 0x7f2d8c009cd0 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f2dac0a5a00 con 0x7f2d8c004e10 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f2dac0a5d00 con 0x7f2d8c004200 2024-08-19T11:17:21.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2db0cda640 10 monclient(hunting): authenticate will time out at 1099.383780s 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 0x7f2dac0a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 0x7f2dac0a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48444/0 (socket says 172.21.15.71:48444) 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 1 -- 172.21.15.71:0/1963847295 learned_addr learned my addr 172.21.15.71:0/1963847295 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 10 monclient(hunting): get_auth_request con 0x7f2d8c009cd0 auth_method 0 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2da9d9b640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2d8c004e10 0x7f2dac1366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.342+0000 7f2daa59c640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 0x7f2dac136190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request con 0x7f2d8c004e10 auth_method 0 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 10 monclient(hunting): get_auth_request con 0x7f2d8c004200 auth_method 0 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 1 -- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 msgr2=0x7f2dac136190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:17:21.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 1 -- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 msgr2=0x7f2dac136190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 0x7f2dac136190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2da9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daa59c640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 0x7f2dac136190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 10 monclient(hunting): handle_auth_done global_id 74432 payload 824 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 1 -- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 msgr2=0x7f2dac136190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 0x7f2dac136190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 1 -- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2d8c004e10 msgr2=0x7f2dac1366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2d8c004e10 0x7f2dac1366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 1 monclient: found mon.noname-b 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.343+0000 7f2daad9d640 1 -- 172.21.15.71:0/1963847295 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac139e20 con 0x7f2d8c009cd0 2024-08-19T11:17:21.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2daad9d640 1 -- 172.21.15.71:0/1963847295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 msgr2=0x7f2dac0a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2daad9d640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 0x7f2dac0a0980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2da402bf70 tx=0x7f2da4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2da4009c30 con 0x7f2d8c009cd0 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: dump: 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.361 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da402e070 con 0x7f2d8c009cd0 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 5 monclient: authenticate success, global_id 74432 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 10 monclient: _renew_subs 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dac0a2350 con 0x7f2d8c009cd0 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2da4007160 con 0x7f2d8c009cd0 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da2ffd640 10 monclient: dump: 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.363 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2da8d99640 4 set_mon_vals no callback set 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 10 monclient: _renew_subs 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.345+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dac137790 con 0x7f2d8c009cd0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.346+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2da4044020 con 0x7f2d8c009cd0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.346+0000 7f2da2ffd640 1 --2- 172.21.15.71:0/1963847295 >> v2:172.21.15.135:6800/726754104 conn(0x7f2d98040d20 0x7f2d980431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (secure 0 0 0) 0x7f2da4072ec0 con 0x7f2d8c009cd0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2db0cda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2db0cda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2db0cda640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2daa59c640 1 --2- 172.21.15.71:0/1963847295 >> v2:172.21.15.135:6800/726754104 conn(0x7f2d98040d20 0x7f2d980431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dac0a71f0 con 0x7f2d8c009cd0 2024-08-19T11:17:21.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.347+0000 7f2daa59c640 10 monclient: get_auth_request con 0x7f2d98040d20 auth_method 0 2024-08-19T11:17:21.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.349+0000 7f2daa59c640 1 --2- 172.21.15.71:0/1963847295 >> v2:172.21.15.135:6800/726754104 conn(0x7f2d98040d20 0x7f2d980431e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2d94000c00 tx=0x7f2d94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.352+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f2da403c3f0 con 0x7f2d8c009cd0 2024-08-19T11:17:21.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.352+0000 7f2da2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.352+0000 7f2da2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2db0cda640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2db0cda640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2db0cda640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2dac1229c0 con 0x7f2d8c009cd0 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2da2ffd640 1 -- 172.21.15.71:0/1963847295 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f2da4055020 con 0x7f2d8c009cd0 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2da2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:21.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.598+0000 7f2da2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:21.600 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":154,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:17:21.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 >> v2:172.21.15.135:6800/726754104 conn(0x7f2d98040d20 msgr2=0x7f2d980431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 --2- 172.21.15.71:0/1963847295 >> v2:172.21.15.135:6800/726754104 conn(0x7f2d98040d20 0x7f2d980431e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2d94000c00 tx=0x7f2d94008040 comp rx=0 tx=0).stop 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 10 monclient: shutdown 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 msgr2=0x7f2dac0a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 0x7f2dac0a0980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2da402bf70 tx=0x7f2da4004a40 comp rx=0 tx=0).stop 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 shutdown_connections 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 --2- 172.21.15.71:0/1963847295 >> v2:172.21.15.135:6800/726754104 conn(0x7f2d98040d20 0x7f2d980431e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2d8c009cd0 0x7f2dac0a0980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2d8c004e10 0x7f2dac1366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 --2- 172.21.15.71:0/1963847295 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f2d8c004200 0x7f2dac136190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 >> 172.21.15.71:0/1963847295 conn(0x7f2dac0ac030 msgr2=0x7f2dac138eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 shutdown_connections 2024-08-19T11:17:21.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.600+0000 7f2db0cda640 1 -- 172.21.15.71:0/1963847295 wait complete. 2024-08-19T11:17:21.612 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:17:21.612 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:17:21.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:17:21.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.710+0000 7f98227ba640 10 monclient: get_monmap_and_config 2024-08-19T11:17:21.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.710+0000 7f98227ba640 10 monclient: build_initial_monmap 2024-08-19T11:17:21.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.710+0000 7f98227ba640 10 monclient: monmap: 2024-08-19T11:17:21.711 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:21.711 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.711 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:21.711270+0000 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:21.711270+0000 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:21.712 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 1 Processor -- start 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 1 -- start start 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 10 monclient: init 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 10 monclient: _add_conns ranks=[9,6,2,10,7,4,8,3,1,5,0] 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f981c0a6950 0x7f981c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 10 monclient(hunting): picked mon.noname-a con 0x7f981c0a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 0x7f981c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.711+0000 7f98227ba640 10 monclient(hunting): picked mon.noname-d con 0x7f981c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f981c139710 0x7f981c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 10 monclient(hunting): picked mon.noname-b con 0x7f981c139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f981c0a5020 con 0x7f981c0a6950 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f981c0a77b0 con 0x7f981c139710 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f981c0a7d40 con 0x7f981c0a57c0 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f98227ba640 10 monclient(hunting): authenticate will time out at 1099.753045s 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f981c0a6950 0x7f981c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 0x7f981c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f981c0a6950 0x7f981c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36994/0 (socket says 172.21.15.71:36994) 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 0x7f981c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58508/0 (socket says 172.21.15.71:58508) 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 -- 172.21.15.71:0/4091965150 learned_addr learned my addr 172.21.15.71:0/4091965150 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f981c139710 0x7f981c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): get_auth_request con 0x7f981c0a6950 auth_method 0 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): get_auth_request con 0x7f981c0a57c0 auth_method 0 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): get_auth_request con 0x7f981c139710 auth_method 0 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient(hunting): handle_auth_done global_id 74430 payload 274 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 -- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 msgr2=0x7f981c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 0x7f981c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 -- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f981c139710 msgr2=0x7f981c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f981c139710 0x7f981c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 monclient: found mon.noname-a 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981bfff640 1 -- 172.21.15.71:0/4091965150 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0a6380 con 0x7f981c0a6950 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f981b7fe640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 0x7f981c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:21.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.712+0000 7f9820d57640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f981c139710 0x7f981c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981bfff640 1 -- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c0a6950 msgr2=0x7f981c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981bfff640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c0a6950 0x7f981c0a6d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f980c0098a0 tx=0x7f980c02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef65f3ec5f4e4f90 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 1 -- 172.21.15.71:0/4091965150 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f980c037070 con 0x7f981c0a6950 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: dump: 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.725 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.726 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 1 -- 172.21.15.71:0/4091965150 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c02adf0 con 0x7f981c0a6950 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 5 monclient: authenticate success, global_id 74430 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 1 -- 172.21.15.71:0/4091965150 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f980c030c20 con 0x7f981c0a6950 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 4 set_mon_vals no callback set 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f981affd640 10 monclient: dump: 2024-08-19T11:17:21.727 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.728 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 10 monclient: shutdown 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 -- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c0a6950 msgr2=0x7f981c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c0a6950 0x7f981c0a6d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f980c0098a0 tx=0x7f980c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 -- 172.21.15.71:0/4091965150 shutdown_connections 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f981c139710 0x7f981c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f981c0a57c0 0x7f981c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 --2- 172.21.15.71:0/4091965150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c0a6950 0x7f981c0a6d30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.715+0000 7f98227ba640 1 -- 172.21.15.71:0/4091965150 >> 172.21.15.71:0/4091965150 conn(0x7f981c0abf50 msgr2=0x7f981c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.716+0000 7f98227ba640 1 -- 172.21.15.71:0/4091965150 shutdown_connections 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.716+0000 7f98227ba640 1 -- 172.21.15.71:0/4091965150 wait complete. 2024-08-19T11:17:21.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.716+0000 7f98227ba640 10 monclient: build_initial_monmap 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.716+0000 7f98227ba640 10 monclient: monmap: 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:21.730 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.716+0000 7f98227ba640 1 Processor -- start 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 -- start start 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient: init 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient: _add_conns ranks=[8,5,1,2,3,4,0,6,7] 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 0x7f981c138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): picked mon.noname-e con 0x7f981c0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f981c0a6950 0x7f981c138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): picked mon.noname-h con 0x7f981c0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f981c139710 0x7f981c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): picked mon.noname-f con 0x7f981c139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0a84c0 con 0x7f981c139710 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f981c0a3650 con 0x7f981c0a6950 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f981c0a8700 con 0x7f981c0a57c0 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f98227ba640 10 monclient(hunting): authenticate will time out at 1099.758617s 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 0x7f981c138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 0x7f981c138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35612/0 (socket says 172.21.15.71:35612) 2024-08-19T11:17:21.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 -- 172.21.15.71:0/2716435666 learned_addr learned my addr 172.21.15.71:0/2716435666 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): get_auth_request con 0x7f981c0a57c0 auth_method 0 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient(hunting): handle_auth_done global_id 64772 payload 824 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f981c0a6950 msgr2=0x7f981c138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f981c0a6950 0x7f981c138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f981c139710 msgr2=0x7f981c1225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f981c139710 0x7f981c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 monclient: found mon.noname-e 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.717+0000 7f981bfff640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0a1e00 con 0x7f981c0a57c0 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f981bfff640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 msgr2=0x7f981c138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f981bfff640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 0x7f981c138550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f980c035040 tx=0x7f980c0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f980c041030 con 0x7f981c0a57c0 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: dump: 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.734 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 5 monclient: authenticate success, global_id 64772 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c003dd0 con 0x7f981c0a57c0 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 10 monclient: _renew_subs 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c125e20 con 0x7f981c0a57c0 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f980c037040 con 0x7f981c0a57c0 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f9818ff9640 10 monclient: dump: 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.736 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 10 monclient: _renew_subs 2024-08-19T11:17:21.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c124900 con 0x7f981c0a57c0 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.720+0000 7f981a7fc640 4 set_mon_vals no callback set 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f98227ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f98227ba640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 0x7f981c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f981c06a590 con 0x7f981c1232a0 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f980c044070 con 0x7f981c0a57c0 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 0x7f981c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient: get_auth_request con 0x7f981c1232a0 auth_method 0 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f9818ff9640 1 --2- 172.21.15.71:0/2716435666 >> v2:172.21.15.135:6800/726754104 conn(0x7f980803ea80 0x7f9808040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 10 monclient(hunting): handle_auth_done global_id 74439 payload 824 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f981b7fe640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f981c0a6d30 con 0x7f981c1232a0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (secure 0 0 0) 0x7f980c042070 con 0x7f981c0a57c0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f9820d57640 1 --2- 172.21.15.71:0/2716435666 >> v2:172.21.15.135:6800/726754104 conn(0x7f980803ea80 0x7f9808040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.721+0000 7f9820d57640 10 monclient: get_auth_request con 0x7f980803ea80 auth_method 0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.723+0000 7f981b7fe640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 msgr2=0x7f981c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.723+0000 7f981b7fe640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 0x7f981c02d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f981c125710 tx=0x7f981000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.723+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9810017070 con 0x7f981c1232a0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.723+0000 7f9818ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.723+0000 7f9818ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.723+0000 7f9818ff9640 10 monclient: dump: 2024-08-19T11:17:21.739 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.740 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f981000cac0 con 0x7f981c1232a0 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 msgr2=0x7f981c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 0x7f981c02d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f981c125710 tx=0x7f981000ec00 comp rx=0 tx=0).stop 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 msgr2=0x7f981c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9818ff9640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c1232a0 0x7f981c02d1c0 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f981c125710 tx=0x7f981000ec00 comp rx=0 tx=0).stop 2024-08-19T11:17:21.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.724+0000 7f9820d57640 1 --2- 172.21.15.71:0/2716435666 >> v2:172.21.15.135:6800/726754104 conn(0x7f980803ea80 0x7f9808040f40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9814009fa0 tx=0x7f981400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f98227ba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f98227ba640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 0x7f981c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f98227ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f981c076c60 con 0x7f981c123680 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 0x7f981c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient: get_auth_request con 0x7f981c123680 auth_method 0 2024-08-19T11:17:21.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 10 monclient(hunting): handle_auth_done global_id 74448 payload 824 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.730+0000 7f981b7fe640 1 -- 172.21.15.71:0/2716435666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f981c09e100 con 0x7f981c123680 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.732+0000 7f981b7fe640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 msgr2=0x7f981c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.732+0000 7f981b7fe640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 0x7f981c02d700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9810019000 tx=0x7f98100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9810017070 con 0x7f981c123680 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 10 monclient: dump: 2024-08-19T11:17:21.744 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.745 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9436 (secure 0 0 0) 0x7f9810006600 con 0x7f981c123680 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 msgr2=0x7f981c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 0x7f981c02d700 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9810019000 tx=0x7f98100046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 msgr2=0x7f981c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9818ff9640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f981c123680 0x7f981c02d700 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9810019000 tx=0x7f98100046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.746 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 90766, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:21.747 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:21.748 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:21.749 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:21.750 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:21.751 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:21.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:21.754 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.757 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.759 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.760 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.762 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:21.764 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:21.767 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.768 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.770 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:21.770 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 >> v2:172.21.15.135:6800/726754104 conn(0x7f980803ea80 msgr2=0x7f9808040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 --2- 172.21.15.71:0/2716435666 >> v2:172.21.15.135:6800/726754104 conn(0x7f980803ea80 0x7f9808040f40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9814009fa0 tx=0x7f981400d040 comp rx=0 tx=0).stop 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 10 monclient: shutdown 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 msgr2=0x7f981c138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 --2- 172.21.15.71:0/2716435666 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f981c0a57c0 0x7f981c138550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f980c035040 tx=0x7f980c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9820d57640 1 -- 172.21.15.71:0/2716435666 reap_dead start 2024-08-19T11:17:21.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f9820d57640 1 -- 172.21.15.71:0/2716435666 reap_dead start 2024-08-19T11:17:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 shutdown_connections 2024-08-19T11:17:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 >> 172.21.15.71:0/2716435666 conn(0x7f981c0abf50 msgr2=0x7f981c0aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 shutdown_connections 2024-08-19T11:17:21.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.733+0000 7f98227ba640 1 -- 172.21.15.71:0/2716435666 wait complete. 2024-08-19T11:17:21.772 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:21.772 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:17:21.772 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:17:21.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.869+0000 7fba9e7b8640 10 monclient: get_monmap_and_config 2024-08-19T11:17:21.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.869+0000 7fba9e7b8640 10 monclient: build_initial_monmap 2024-08-19T11:17:21.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.869+0000 7fba9e7b8640 10 monclient: monmap: 2024-08-19T11:17:21.870 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:21.869994+0000 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:21.869994+0000 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:21.871 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:21.872 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:21.872 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:21.872 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:21.872 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:21.872 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 Processor -- start 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 -- start start 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient: init 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient: _add_conns ranks=[0,6,2,4,1,7,9,5,8,10,3] 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fba980a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fba980a57c0 0x7fba9813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): picked mon.noname-d con 0x7fba980a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 0x7fba981410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): picked mon.noname-b con 0x7fba980a7440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba980a6380 con 0x7fba980a6950 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba980a5020 con 0x7fba980a7440 2024-08-19T11:17:21.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fba980a7d40 con 0x7fba980a57c0 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9e7b8640 10 monclient(hunting): authenticate will time out at 1099.911657s 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 0x7fba981410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fba980a57c0 0x7fba9813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba97fff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fba980a6950 0x7fba980a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58550/0 (socket says 172.21.15.71:58550) 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba97fff640 1 -- 172.21.15.71:0/561639091 learned_addr learned my addr 172.21.15.71:0/561639091 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): get_auth_request con 0x7fba980a7440 auth_method 0 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): get_auth_request con 0x7fba980a57c0 auth_method 0 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba9cd55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.870+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 10 monclient(hunting): handle_auth_done global_id 74450 payload 274 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 1 -- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fba980a57c0 msgr2=0x7fba9813eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 1 --2- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fba980a57c0 0x7fba9813eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 1 -- 172.21.15.71:0/561639091 >> v1:172.21.15.71:6789/0 conn(0x7fba980a6950 legacy=0x7fba980a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 1 monclient: found mon.noname-b 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba9cd55640 1 -- 172.21.15.71:0/561639091 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980a3650 con 0x7fba980a7440 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.871+0000 7fba977fe640 1 --2- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fba980a57c0 0x7fba9813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.873+0000 7fba9cd55640 1 -- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 msgr2=0x7fba981410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.873+0000 7fba9cd55640 1 --2- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 0x7fba981410b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba90009df0 tx=0x7fba9002a4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4824e27bbab83da server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 1 -- 172.21.15.71:0/561639091 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba90007bc0 con 0x7fba980a7440 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: dump: 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.887 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 1 -- 172.21.15.71:0/561639091 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba90007d80 con 0x7fba980a7440 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba9e7b8640 5 monclient: authenticate success, global_id 74450 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba9e7b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba9e7b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 1 -- 172.21.15.71:0/561639091 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba90031870 con 0x7fba980a7440 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba9e7b8640 4 set_mon_vals no callback set 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.875+0000 7fba96ffd640 10 monclient: dump: 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.889 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.890 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 10 monclient: shutdown 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 -- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 msgr2=0x7fba981410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 0x7fba981410b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fba90009df0 tx=0x7fba9002a4b0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 -- 172.21.15.71:0/561639091 shutdown_connections 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba980a7440 0x7fba981410b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/561639091 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fba980a57c0 0x7fba9813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 -- 172.21.15.71:0/561639091 >> 172.21.15.71:0/561639091 conn(0x7fba980abf50 msgr2=0x7fba980ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 -- 172.21.15.71:0/561639091 shutdown_connections 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.876+0000 7fba9e7b8640 1 -- 172.21.15.71:0/561639091 wait complete. 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.877+0000 7fba9e7b8640 10 monclient: build_initial_monmap 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.877+0000 7fba9e7b8640 10 monclient: monmap: 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:21.892 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:21.893 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.893 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:21.893 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:21.893 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:21.893 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:21.893 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:21.894 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:21.894 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:21.894 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:21.894 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:21.894 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.877+0000 7fba9e7b8640 1 Processor -- start 2024-08-19T11:17:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.877+0000 7fba9e7b8640 1 -- start start 2024-08-19T11:17:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.877+0000 7fba9e7b8640 10 monclient: init 2024-08-19T11:17:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient: _add_conns ranks=[3,1,8,5,2,4,0,7,6] 2024-08-19T11:17:21.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 0x7fba98128a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): picked mon.noname-g con 0x7fba980a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:21.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980a6950 0x7fba981ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): picked mon.noname-f con 0x7fba980a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:21.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba980a7440 0x7fba98126440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): picked mon.noname-e con 0x7fba980a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:21.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba980a8700 con 0x7fba980a6950 2024-08-19T11:17:21.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fba980a84c0 con 0x7fba980a57c0 2024-08-19T11:17:21.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fba981415f0 con 0x7fba980a7440 2024-08-19T11:17:21.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:21.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9e7b8640 10 monclient(hunting): authenticate will time out at 1099.919422s 2024-08-19T11:17:21.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980a6950 0x7fba981ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba980a7440 0x7fba98126440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 0x7fba98128a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 0x7fba98128a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:47708/0 (socket says 172.21.15.71:47708) 2024-08-19T11:17:21.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 1 -- 172.21.15.71:0/4173083332 learned_addr learned my addr 172.21.15.71:0/4173083332 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:21.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba980a7440 0x7fba98126440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35616/0 (socket says 172.21.15.71:35616) 2024-08-19T11:17:21.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): get_auth_request con 0x7fba980a57c0 auth_method 0 2024-08-19T11:17:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): get_auth_request con 0x7fba980a7440 auth_method 0 2024-08-19T11:17:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba9cd55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba977fe640 10 monclient(hunting): get_auth_request con 0x7fba980a6950 auth_method 0 2024-08-19T11:17:21.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba977fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.878+0000 7fba977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 10 monclient(hunting): handle_auth_done global_id 44985 payload 824 2024-08-19T11:17:21.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba980a7440 msgr2=0x7fba98126440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba980a7440 0x7fba98126440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980a6950 msgr2=0x7fba981ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980a6950 0x7fba981ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:21.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 1 monclient: found mon.noname-g 2024-08-19T11:17:21.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:21.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:17:21.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba97fff640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba98129f70 con 0x7fba980a57c0 2024-08-19T11:17:21.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.879+0000 7fba9cd55640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba980a7440 0x7fba98126440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:21.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba97fff640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 msgr2=0x7fba98128a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba97fff640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 0x7fba98128a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c460 tx=0x7fba8800c920 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba88005cf0 con 0x7fba980a57c0 2024-08-19T11:17:21.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:17:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: dump: 2024-08-19T11:17:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.907 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.907 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.907 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.907 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.907 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.907 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.908 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.908 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.908 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.908 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.908 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.909 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.909 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: _finish_auth 0 2024-08-19T11:17:21.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:17:21.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:21.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba880074e0 con 0x7fba980a57c0 2024-08-19T11:17:21.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 5 monclient: authenticate success, global_id 44985 2024-08-19T11:17:21.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 10 monclient: _renew_subs 2024-08-19T11:17:21.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:17:21.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9812a250 con 0x7fba980a57c0 2024-08-19T11:17:21.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba88007690 con 0x7fba980a57c0 2024-08-19T11:17:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba94ff9640 10 monclient: dump: 2024-08-19T11:17:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.911 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.912 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.913 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.913 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.913 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.913 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.913 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.914 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.914 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.914 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.914 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba967fc640 4 set_mon_vals no callback set 2024-08-19T11:17:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 10 monclient: _renew_subs 2024-08-19T11:17:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:17:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.881+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba980a9280 con 0x7fba980a57c0 2024-08-19T11:17:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba9e7b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 0x7fba98126980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba98076c60 con 0x7fba981cf020 2024-08-19T11:17:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 0x7fba98126980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient: get_auth_request con 0x7fba981cf020 auth_method 0 2024-08-19T11:17:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 10 monclient(hunting): handle_auth_done global_id 74459 payload 824 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba977fe640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba98141110 con 0x7fba981cf020 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.882+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fba88007070 con 0x7fba980a57c0 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.883+0000 7fba94ff9640 1 --2- 172.21.15.71:0/4173083332 >> v2:172.21.15.135:6800/726754104 conn(0x7fba7803ea80 0x7fba78040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.883+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (secure 0 0 0) 0x7fba88051840 con 0x7fba980a57c0 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.883+0000 7fba9cd55640 1 --2- 172.21.15.71:0/4173083332 >> v2:172.21.15.135:6800/726754104 conn(0x7fba7803ea80 0x7fba78040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.883+0000 7fba9cd55640 10 monclient: get_auth_request con 0x7fba7803ea80 auth_method 0 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba977fe640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 msgr2=0x7fba98126980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba977fe640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 0x7fba98126980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba98128560 tx=0x7fba800119f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba8000fe20 con 0x7fba981cf020 2024-08-19T11:17:21.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 10 monclient: dump: 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.919 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fba8000f9b0 con 0x7fba981cf020 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:21.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 msgr2=0x7fba98126980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 0x7fba98126980 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fba98128560 tx=0x7fba800119f0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 msgr2=0x7fba98126980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.885+0000 7fba94ff9640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba981cf020 0x7fba98126980 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.886+0000 7fba9cd55640 1 --2- 172.21.15.71:0/4173083332 >> v2:172.21.15.135:6800/726754104 conn(0x7fba7803ea80 0x7fba78040f40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fba90009df0 tx=0x7fba9002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba9e7b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 0x7fba981225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba9e7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:21.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba981272d0 con 0x7fba98126ec0 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 0x7fba981225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient: get_auth_request con 0x7fba98126ec0 auth_method 0 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 10 monclient(hunting): handle_auth_done global_id 74468 payload 824 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.891+0000 7fba977fe640 1 -- 172.21.15.71:0/4173083332 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba980a6d30 con 0x7fba98126ec0 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba977fe640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 msgr2=0x7fba981225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba977fe640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 0x7fba981225a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba98128560 tx=0x7fba800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba80004470 con 0x7fba98126ec0 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 10 monclient: dump: 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fba80026070 con 0x7fba98126ec0 2024-08-19T11:17:21.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 msgr2=0x7fba981225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 0x7fba981225a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba98128560 tx=0x7fba800046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 msgr2=0x7fba981225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba94ff9640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba98126ec0 0x7fba981225a0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fba98128560 tx=0x7fba800046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 90926, 2024-08-19T11:17:21.927 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:21.928 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:21.929 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:21.930 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:21.931 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:21.932 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.933 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.936 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:21.937 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.939 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.940 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:21.941 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.942 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.943 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:21.944 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:21.945 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.948 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:21.949 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:21.950 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:21.951 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 >> v2:172.21.15.135:6800/726754104 conn(0x7fba7803ea80 msgr2=0x7fba78040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/4173083332 >> v2:172.21.15.135:6800/726754104 conn(0x7fba7803ea80 0x7fba78040f40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fba90009df0 tx=0x7fba9002f000 comp rx=0 tx=0).stop 2024-08-19T11:17:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 10 monclient: shutdown 2024-08-19T11:17:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 msgr2=0x7fba98128a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 1 --2- 172.21.15.71:0/4173083332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba980a57c0 0x7fba98128a50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c460 tx=0x7fba8800c920 comp rx=0 tx=0).stop 2024-08-19T11:17:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9cd55640 1 -- 172.21.15.71:0/4173083332 reap_dead start 2024-08-19T11:17:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9cd55640 1 -- 172.21.15.71:0/4173083332 reap_dead start 2024-08-19T11:17:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 shutdown_connections 2024-08-19T11:17:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.894+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 >> 172.21.15.71:0/4173083332 conn(0x7fba980abf50 msgr2=0x7fba9809f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.895+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 shutdown_connections 2024-08-19T11:17:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:21.895+0000 7fba9e7b8640 1 -- 172.21.15.71:0/4173083332 wait complete. 2024-08-19T11:17:21.954 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:21.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:17:21.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:17:22.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.052+0000 7f1cb6bf7640 10 monclient: get_monmap_and_config 2024-08-19T11:17:22.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.052+0000 7f1cb6bf7640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.052+0000 7f1cb6bf7640 10 monclient: monmap: 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:22.053286+0000 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:22.053286+0000 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.054 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:22.055 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 Processor -- start 2024-08-19T11:17:22.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 -- start start 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient: init 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient: _add_conns ranks=[6,0,5,4,1,7,3,8,9,10,2] 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 0x7f1cb00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): picked mon.noname-d con 0x7f1cb00a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1cb00a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1cb00a7270 0x7f1cb0139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): picked mon.noname-h con 0x7f1cb00a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb00a6380 con 0x7f1cb00a57c0 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1cb00a5020 con 0x7f1cb00a7270 2024-08-19T11:17:22.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1cb00a7d40 con 0x7f1cb00a6950 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.053+0000 7f1cb6bf7640 10 monclient(hunting): authenticate will time out at 1100.094906s 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 0x7f1cb00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1caffff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1cb00a57c0 0x7f1cb0139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58558/0 (socket says 172.21.15.71:58558) 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1caffff640 1 -- 172.21.15.71:0/4139320671 learned_addr learned my addr 172.21.15.71:0/4139320671 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): get_auth_request con 0x7f1cb00a6950 auth_method 0 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient(hunting): handle_auth_done global_id 25971 payload 274 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 1 -- 172.21.15.71:0/4139320671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1cb00a7270 msgr2=0x7f1cb0139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb5194640 1 --2- 172.21.15.71:0/4139320671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1cb00a7270 0x7f1cb0139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 1 --2- 172.21.15.71:0/4139320671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1cb00a7270 0x7f1cb0139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 1 -- 172.21.15.71:0/4139320671 >> v1:172.21.15.71:6789/0 conn(0x7f1cb00a57c0 legacy=0x7f1cb0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 1 monclient: found mon.noname-d 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.054+0000 7f1cb4993640 1 -- 172.21.15.71:0/4139320671 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb00a3650 con 0x7f1cb00a6950 2024-08-19T11:17:22.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1cb4993640 1 -- 172.21.15.71:0/4139320671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 msgr2=0x7f1cb00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1cb4993640 1 --2- 172.21.15.71:0/4139320671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 0x7f1cb00a6d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009800 tx=0x7f1ca4029fe0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fac27077fbc5be0a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 1 -- 172.21.15.71:0/4139320671 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ca4037070 con 0x7f1cb00a6950 2024-08-19T11:17:22.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:22.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: dump: 2024-08-19T11:17:22.068 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1cb6bf7640 5 monclient: authenticate success, global_id 25971 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1cb6bf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 1 -- 172.21.15.71:0/4139320671 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca402ade0 con 0x7f1cb00a6950 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1cb6bf7640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1cb6bf7640 4 set_mon_vals no callback set 2024-08-19T11:17:22.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 1 -- 172.21.15.71:0/4139320671 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ca4030c20 con 0x7f1cb00a6950 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.057+0000 7f1caf7fe640 10 monclient: dump: 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.071 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 10 monclient: shutdown 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/4139320671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 msgr2=0x7f1cb00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/4139320671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 0x7f1cb00a6d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009800 tx=0x7f1ca4029fe0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/4139320671 shutdown_connections 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/4139320671 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1cb00a7270 0x7f1cb0139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/4139320671 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1cb00a6950 0x7f1cb00a6d30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/4139320671 >> 172.21.15.71:0/4139320671 conn(0x7f1cb00abf50 msgr2=0x7f1cb00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/4139320671 shutdown_connections 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/4139320671 wait complete. 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.058+0000 7f1cb6bf7640 10 monclient: monmap: 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:22.073 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.074 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 Processor -- start 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 -- start start 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient: init 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient: _add_conns ranks=[8,3,4,7,0,6,2,5,1] 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): picked mon.noname-e con 0x7f1cb00a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cb00a6950 0x7f1cb0139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): picked mon.noname-g con 0x7f1cb00a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb00a7270 0x7f1cb013a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f1cb00a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb00a8700 con 0x7f1cb00a6950 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1cb00a84c0 con 0x7f1cb00a7270 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f1cb00a7690 con 0x7f1cb00a57c0 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb6bf7640 10 monclient(hunting): authenticate will time out at 1100.100784s 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb5194640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb00a7270 0x7f1cb013a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35618/0 (socket says 172.21.15.71:35618) 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 1 -- 172.21.15.71:0/2555142578 learned_addr learned my addr 172.21.15.71:0/2555142578 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): get_auth_request con 0x7f1cb00a57c0 auth_method 0 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb5194640 10 monclient(hunting): get_auth_request con 0x7f1cb00a7270 auth_method 0 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb5194640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb5194640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb5194640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb4993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.059+0000 7f1cb5194640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb5194640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb5194640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1caffff640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cb00a6950 0x7f1cb0139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 10 monclient(hunting): handle_auth_done global_id 64790 payload 824 2024-08-19T11:17:22.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb00a7270 msgr2=0x7f1cb013a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb00a7270 0x7f1cb013a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cb00a6950 msgr2=0x7f1cb0139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cb00a6950 0x7f1cb0139ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 1 monclient: found mon.noname-e 2024-08-19T11:17:22.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb4993640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb00a9590 con 0x7f1cb00a57c0 2024-08-19T11:17:22.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1caffff640 10 monclient: get_auth_request con 0x7f1cb00a6950 auth_method 0 2024-08-19T11:17:22.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1caffff640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cb00a6950 0x7f1cb0139ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:22.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.060+0000 7f1cb5194640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb00a7270 0x7f1cb013a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb4993640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 msgr2=0x7f1cb01ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb4993640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4035040 tx=0x7f1ca40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ca4040020 con 0x7f1cb00a57c0 2024-08-19T11:17:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:22.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: dump: 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.083 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 5 monclient: authenticate success, global_id 64790 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca4038040 con 0x7f1cb00a57c0 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1ca4037070 con 0x7f1cb00a57c0 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 10 monclient: _renew_subs 2024-08-19T11:17:22.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb0126260 con 0x7f1cb00a57c0 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1caeffd640 4 set_mon_vals no callback set 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cad7fa640 10 monclient: dump: 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.085 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.086 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 10 monclient: _renew_subs 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.062+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb01274a0 con 0x7f1cb00a57c0 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cb6bf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 0x7f1cb0123de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1cb0076c60 con 0x7f1cb0123a00 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 0x7f1cb0123de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient: get_auth_request con 0x7f1cb0123a00 auth_method 0 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cb4993640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4035040 tx=0x7f1ca40046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f1ca4071850 osd_map(197..197 src has 1..197) 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1ca4043020 con 0x7f1cb00a57c0 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 10 monclient(hunting): handle_auth_done global_id 84118 payload 824 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1caffff640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cb00a6d30 con 0x7f1cb0123a00 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.063+0000 7f1cad7fa640 1 --2- 172.21.15.71:0/2555142578 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c9403ea80 0x7f1c94040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.064+0000 7f1cb5194640 1 --2- 172.21.15.71:0/2555142578 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c9403ea80 0x7f1c94040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.064+0000 7f1cb5194640 10 monclient: get_auth_request con 0x7f1c9403ea80 auth_method 0 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.065+0000 7f1caffff640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 msgr2=0x7f1cb0123de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.065+0000 7f1caffff640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 0x7f1cb0123de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01257b0 tx=0x7f1c9c00d950 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c9c005cf0 con 0x7f1cb0123a00 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 10 monclient: dump: 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.089 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.090 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.091 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1c9c017070 con 0x7f1cb0123a00 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 msgr2=0x7f1cb0123de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 0x7f1cb0123de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01257b0 tx=0x7f1c9c00d950 comp rx=0 tx=0).stop 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 msgr2=0x7f1cb0123de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cad7fa640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0123a00 0x7f1cb0123de0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01257b0 tx=0x7f1c9c00d950 comp rx=0 tx=0).stop 2024-08-19T11:17:22.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.066+0000 7f1cb5194640 1 --2- 172.21.15.71:0/2555142578 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c9403ea80 0x7f1c94040f40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800f6b0 tx=0x7f1ca8007650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1cb6bf7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 0x7f1cb009e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1cb6bf7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1cb006ca70 con 0x7f1cb0124320 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 0x7f1cb009e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient: get_auth_request con 0x7f1cb0124320 auth_method 0 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 10 monclient(hunting): handle_auth_done global_id 84127 payload 824 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.072+0000 7f1caffff640 1 -- 172.21.15.71:0/2555142578 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1cb0124730 con 0x7f1cb0124320 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.074+0000 7f1caffff640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 msgr2=0x7f1cb009e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.074+0000 7f1caffff640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 0x7f1cb009e6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01257b0 tx=0x7f1c9c004940 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1c9c007510 con 0x7f1cb0124320 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:22.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 10 monclient: dump: 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.097 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f1c9c007510 con 0x7f1cb0124320 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 msgr2=0x7f1cb009e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 0x7f1cb009e6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01257b0 tx=0x7f1c9c004940 comp rx=0 tx=0).stop 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 msgr2=0x7f1cb009e6d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1cb0124320 0x7f1cb009e6d0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cb01257b0 tx=0x7f1c9c004940 comp rx=0 tx=0).stop 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 24222, 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:22.099 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.100 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.101 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:22.102 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:22.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.106 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.107 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.109 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.111 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.112 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.113 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.115 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.119 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:22.121 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c9403ea80 msgr2=0x7f1c94040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/2555142578 >> v2:172.21.15.135:6800/726754104 conn(0x7f1c9403ea80 0x7f1c94040f40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800f6b0 tx=0x7f1ca8007650 comp rx=0 tx=0).stop 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 10 monclient: shutdown 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 msgr2=0x7f1cb01ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4035040 tx=0x7f1ca40046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb5194640 1 -- 172.21.15.71:0/2555142578 reap_dead start 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cad7fa640 1 -- 172.21.15.71:0/2555142578 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (unknown 0 0 0) 0x7f1ca4071850 con 0x7f1cb00a57c0 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 shutdown_connections 2024-08-19T11:17:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 --2- 172.21.15.71:0/2555142578 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1cb00a57c0 0x7f1cb01ce390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 >> 172.21.15.71:0/2555142578 conn(0x7f1cb00abf50 msgr2=0x7f1cb01c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 shutdown_connections 2024-08-19T11:17:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.075+0000 7f1cb6bf7640 1 -- 172.21.15.71:0/2555142578 wait complete. 2024-08-19T11:17:22.124 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:22.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:17:22.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:17:22.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27098]: starting. 2024-08-19T11:17:22.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27098]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27096 2024-08-19T11:17:22.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27098]: shutting down. 2024-08-19T11:17:22.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.223+0000 7fadf05c3640 10 monclient: get_monmap_and_config 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.223+0000 7fadf05c3640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.223+0000 7fadf05c3640 10 monclient: monmap: 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:22.224218+0000 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:22.224218+0000 2024-08-19T11:17:22.225 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.226 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:22.227 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 Processor -- start 2024-08-19T11:17:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 -- start start 2024-08-19T11:17:22.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient: init 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient: _add_conns ranks=[6,1,4,0,7,10,2,9,5,8,3] 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade80a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): picked mon.noname-d con 0x7fade80a3cd0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fade80a40b0 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 0x7fade81410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): picked mon.noname-c con 0x7fade813ed00 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade80a0ae0 con 0x7fade80a40b0 2024-08-19T11:17:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fade80a1410 con 0x7fade813ed00 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fade80a0dc0 con 0x7fade80a3cd0 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadf05c3640 10 monclient(hunting): authenticate will time out at 1100.265858s 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadee35f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade80a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadeeb60640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 0x7fade81410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadee35f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade80a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58534/0 (socket says 172.21.15.71:58534) 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.224+0000 7fadeeb60640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 0x7fade81410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:56570/0 (socket says 172.21.15.71:56570) 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 1 -- 172.21.15.71:0/2410263455 learned_addr learned my addr 172.21.15.71:0/2410263455 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): get_auth_request con 0x7fade80a3cd0 auth_method 0 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): get_auth_request con 0x7fade813ed00 auth_method 0 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient(hunting): handle_auth_done global_id 84154 payload 274 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 1 -- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 msgr2=0x7fade80a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 1 --2- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade80a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 1 -- 172.21.15.71:0/2410263455 >> v1:172.21.15.135:6789/0 conn(0x7fade80a40b0 legacy=0x7fade80a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 1 monclient: found mon.noname-c 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadeeb60640 1 -- 172.21.15.71:0/2410263455 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade80a10a0 con 0x7fade813ed00 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.225+0000 7fadee35f640 1 --2- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade80a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadeeb60640 1 -- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 msgr2=0x7fade81410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadeeb60640 1 --2- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 0x7fade81410f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fade0009dc0 tx=0x7fade002a470 comp rx=0 tx=0).ready entity=mon.4 client_cookie=206b8c8fe804b488 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 1 -- 172.21.15.71:0/2410263455 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fade0007bc0 con 0x7fade813ed00 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: dump: 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 1 -- 172.21.15.71:0/2410263455 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade0007d80 con 0x7fade813ed00 2024-08-19T11:17:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 5 monclient: authenticate success, global_id 84154 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 1 -- 172.21.15.71:0/2410263455 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fade0031870 con 0x7fade813ed00 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 4 set_mon_vals no callback set 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7faded35d640 10 monclient: dump: 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.250 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 10 monclient: shutdown 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 -- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 msgr2=0x7fade81410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 --2- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 0x7fade81410f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fade0009dc0 tx=0x7fade002a470 comp rx=0 tx=0).stop 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 -- 172.21.15.71:0/2410263455 shutdown_connections 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 --2- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fade813ed00 0x7fade81410f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 --2- 172.21.15.71:0/2410263455 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade80a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 -- 172.21.15.71:0/2410263455 >> 172.21.15.71:0/2410263455 conn(0x7fade80a91d0 msgr2=0x7fade80a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 -- 172.21.15.71:0/2410263455 shutdown_connections 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.228+0000 7fadf05c3640 1 -- 172.21.15.71:0/2410263455 wait complete. 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.229+0000 7fadf05c3640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.229+0000 7fadf05c3640 10 monclient: monmap: 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.229+0000 7fadf05c3640 1 Processor -- start 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.229+0000 7fadf05c3640 1 -- start start 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.229+0000 7fadf05c3640 10 monclient: init 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient: _add_conns ranks=[6,5,1,0,4,3,7,8,2] 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade81ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): picked mon.noname-d con 0x7fade80a3cd0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fade80a40b0 0x7fade81cee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): picked mon.noname-h con 0x7fade80a40b0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade813ed00 0x7fade813b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): picked mon.noname-f con 0x7fade813ed00 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fade80a1f40 con 0x7fade813ed00 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fade80a1dc0 con 0x7fade80a40b0 2024-08-19T11:17:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fade8141630 con 0x7fade80a3cd0 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadf05c3640 10 monclient(hunting): authenticate will time out at 1100.271271s 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade81ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade81ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58538/0 (socket says 172.21.15.71:58538) 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 -- 172.21.15.71:0/4105375543 learned_addr learned my addr 172.21.15.71:0/4105375543 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): get_auth_request con 0x7fade80a3cd0 auth_method 0 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadeeb60640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade813ed00 0x7fade813b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient(hunting): handle_auth_done global_id 25989 payload 824 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fade80a40b0 0x7fade81cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fade80a40b0 msgr2=0x7fade81cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fade80a40b0 0x7fade81cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade813ed00 msgr2=0x7fade813b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade813ed00 0x7fade813b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 monclient: found mon.noname-d 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadee35f640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade8124020 con 0x7fade80a3cd0 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadeeb60640 10 monclient: get_auth_request con 0x7fade813ed00 auth_method 0 2024-08-19T11:17:22.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadedb5e640 10 monclient: get_auth_request con 0x7fade80a40b0 auth_method 0 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadeeb60640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade813ed00 0x7fade813b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.230+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fade80a40b0 0x7fade81cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.232+0000 7fadee35f640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 msgr2=0x7fade81ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.232+0000 7fadee35f640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade81ce930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fade400e9d0 tx=0x7fade400ee90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fade4017070 con 0x7fade80a3cd0 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: dump: 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.258 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.259 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade400cc70 con 0x7fade80a3cd0 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 5 monclient: authenticate success, global_id 25989 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 10 monclient: _renew_subs 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fade400ce20 con 0x7fade80a3cd0 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade813dce0 con 0x7fade80a3cd0 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 10 monclient: dump: 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.261 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadecb5c640 4 set_mon_vals no callback set 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 10 monclient: _renew_subs 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fade813d200 con 0x7fade80a3cd0 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fade806a590 con 0x7fade813bee0 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.233+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fade401a070 con 0x7fade80a3cd0 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient: get_auth_request con 0x7fade813bee0 auth_method 0 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> v2:172.21.15.135:6800/726754104 conn(0x7fadcc03ea80 0x7fadcc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 10 monclient(hunting): handle_auth_done global_id 25998 payload 824 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fade813e120 con 0x7fade813bee0 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(198..198 src has 1..198) ==== 3506+0+0 (secure 0 0 0) 0x7fade400f040 con 0x7fade80a3cd0 2024-08-19T11:17:22.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadeeb60640 1 --2- 172.21.15.71:0/4105375543 >> v2:172.21.15.135:6800/726754104 conn(0x7fadcc03ea80 0x7fadcc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.234+0000 7fadeeb60640 10 monclient: get_auth_request con 0x7fadcc03ea80 auth_method 0 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 msgr2=0x7fade813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fade80a4d40 tx=0x7fadd800d950 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fadd8012c80 con 0x7fade813bee0 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 10 monclient: dump: 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.264 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 msgr2=0x7fade813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 msgr2=0x7fade813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fade80a4d40 tx=0x7fadd800d950 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fade80a4d40 tx=0x7fadd800d950 comp rx=0 tx=0).stop 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 msgr2=0x7fade813c2c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 0x7fadcc046bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 msgr2=0x7fade813c2c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813bee0 0x7fade813c2c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.236+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fadcc044330 con 0x7fadcc0447d0 2024-08-19T11:17:22.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 0x7fadcc046bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient: get_auth_request con 0x7fadcc0447d0 auth_method 0 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadeeb60640 1 --2- 172.21.15.71:0/4105375543 >> v2:172.21.15.135:6800/726754104 conn(0x7fadcc03ea80 0x7fadcc040f40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fade0034000 tx=0x7fade002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 10 monclient(hunting): handle_auth_done global_id 26007 payload 824 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.237+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fade4020e80 con 0x7fadcc0447d0 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 msgr2=0x7fadcc046bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 0x7fadcc046bc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd8003760 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fadd802a070 con 0x7fadcc0447d0 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 10 monclient: dump: 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.268 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fadd8006bf0 con 0x7fadcc0447d0 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 msgr2=0x7fadcc046bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 0x7fadcc046bc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd8003760 comp rx=0 tx=0).stop 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 msgr2=0x7fadcc046bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.239+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fadcc0447d0 0x7fadcc046bc0 secure :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd8003760 comp rx=0 tx=0).stop 2024-08-19T11:17:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.245+0000 7fadf05c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.245+0000 7fadf05c3640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 0x7fade8070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.245+0000 7fadf05c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.245+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fade8076c60 con 0x7fade813c800 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.245+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 0x7fade8070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient: get_auth_request con 0x7fade813c800 auth_method 0 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 10 monclient(hunting): handle_auth_done global_id 26016 payload 824 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.246+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fade8123ca0 con 0x7fade813c800 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7fadedb5e640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 msgr2=0x7fade8070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7fadedb5e640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 0x7fade8070e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0444b0 tx=0x7fadd8018000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fadd8033070 con 0x7fade813c800 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 10 monclient: dump: 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.273 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7fadd802c620 con 0x7fade813c800 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 msgr2=0x7fade8070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 0x7fade8070e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0444b0 tx=0x7fadd8018000 comp rx=0 tx=0).stop 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 msgr2=0x7fade8070e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7faddeffd640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade813c800 0x7fade8070e10 secure :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0444b0 tx=0x7fadd8018000 comp rx=0 tx=0).stop 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.248+0000 7fadeeb60640 1 -- 172.21.15.71:0/4105375543 reap_dead start 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 349862, 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:22.302 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 >> v2:172.21.15.135:6800/726754104 conn(0x7fadcc03ea80 msgr2=0x7fadcc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 --2- 172.21.15.71:0/4105375543 >> v2:172.21.15.135:6800/726754104 conn(0x7fadcc03ea80 0x7fadcc040f40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fade0034000 tx=0x7fade002f000 comp rx=0 tx=0).stop 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 10 monclient: shutdown 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 msgr2=0x7fade81ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade81ce930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fade400e9d0 tx=0x7fade400ee90 comp rx=0 tx=0).stop 2024-08-19T11:17:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 shutdown_connections 2024-08-19T11:17:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 --2- 172.21.15.71:0/4105375543 >> v2:172.21.15.135:6800/726754104 conn(0x7fadcc03ea80 0x7fadcc040f40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 --2- 172.21.15.71:0/4105375543 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fade80a3cd0 0x7fade81ce930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 >> 172.21.15.71:0/4105375543 conn(0x7fade80a91d0 msgr2=0x7fade813f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 shutdown_connections 2024-08-19T11:17:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.249+0000 7fadf05c3640 1 -- 172.21.15.71:0/4105375543 wait complete. 2024-08-19T11:17:22.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:22.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:17:22.306 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:17:22.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.403+0000 7f97ac174640 10 monclient: get_monmap_and_config 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.403+0000 7f97ac174640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.403+0000 7f97ac174640 10 monclient: monmap: 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:22.404519+0000 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:22.404519+0000 2024-08-19T11:17:22.405 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.406 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.407 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:22.407 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:22.407 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.404+0000 7f97ac174640 1 Processor -- start 2024-08-19T11:17:22.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.404+0000 7f97ac174640 1 -- start start 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.404+0000 7f97ac174640 10 monclient: init 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient: _add_conns ranks=[5,4,0,8,10,9,3,6,2,1,7] 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f97a40a6950 0x7f97a40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): picked mon.noname-h con 0x7f97a40a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 0x7f97a40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): picked mon.noname-c con 0x7f97a40a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f97a4139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a40a6380 con 0x7f97a4139710 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f97a40a5020 con 0x7f97a40a57c0 2024-08-19T11:17:22.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f97a40a77b0 con 0x7f97a40a6950 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97ac174640 10 monclient(hunting): authenticate will time out at 1100.446280s 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 0x7f97a40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97aa711640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f97a4139710 0x7f97a4139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58568/0 (socket says 172.21.15.71:58568) 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 0x7f97a40a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:56582/0 (socket says 172.21.15.71:56582) 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97aa711640 1 -- 172.21.15.71:0/3385110599 learned_addr learned my addr 172.21.15.71:0/3385110599 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): get_auth_request con 0x7f97a40a57c0 auth_method 0 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient(hunting): handle_auth_done global_id 84163 payload 274 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a9f10640 1 --2- 172.21.15.71:0/3385110599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f97a40a6950 0x7f97a40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 -- 172.21.15.71:0/3385110599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f97a40a6950 msgr2=0x7f97a40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 --2- 172.21.15.71:0/3385110599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f97a40a6950 0x7f97a40a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 -- 172.21.15.71:0/3385110599 >> v1:172.21.15.71:6789/0 conn(0x7f97a4139710 legacy=0x7f97a4139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 monclient: found mon.noname-c 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.405+0000 7f97a970f640 1 -- 172.21.15.71:0/3385110599 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a40a3650 con 0x7f97a40a57c0 2024-08-19T11:17:22.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a970f640 1 -- 172.21.15.71:0/3385110599 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 msgr2=0x7f97a40a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a970f640 1 --2- 172.21.15.71:0/3385110599 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 0x7f97a40a7270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f97940097d0 tx=0x7f9794029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=80112f7dd046be7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 1 -- 172.21.15.71:0/3385110599 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9794037070 con 0x7f97a40a57c0 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: dump: 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.420 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97ac174640 5 monclient: authenticate success, global_id 84163 2024-08-19T11:17:22.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 1 -- 172.21.15.71:0/3385110599 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979402adf0 con 0x7f97a40a57c0 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97ac174640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 1 -- 172.21.15.71:0/3385110599 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9794030c20 con 0x7f97a40a57c0 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97ac174640 4 set_mon_vals no callback set 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.408+0000 7f97a8f0e640 10 monclient: dump: 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.422 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 10 monclient: shutdown 2024-08-19T11:17:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 -- 172.21.15.71:0/3385110599 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 msgr2=0x7f97a40a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 --2- 172.21.15.71:0/3385110599 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 0x7f97a40a7270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f97940097d0 tx=0x7f9794029fb0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 -- 172.21.15.71:0/3385110599 shutdown_connections 2024-08-19T11:17:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 --2- 172.21.15.71:0/3385110599 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f97a40a57c0 0x7f97a40a7270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 --2- 172.21.15.71:0/3385110599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f97a40a6950 0x7f97a40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 -- 172.21.15.71:0/3385110599 >> 172.21.15.71:0/3385110599 conn(0x7f97a40abf50 msgr2=0x7f97a40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 -- 172.21.15.71:0/3385110599 shutdown_connections 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 1 -- 172.21.15.71:0/3385110599 wait complete. 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.409+0000 7f97ac174640 10 monclient: monmap: 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.425 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.426 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 Processor -- start 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 -- start start 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient: init 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient: _add_conns ranks=[0,3,6,4,2,7,8,5,1] 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97a40a57c0 0x7f97a4138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): picked mon.noname-a con 0x7f97a40a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97a40a6950 0x7f97a4138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): picked mon.noname-g con 0x7f97a40a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:22.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 0x7f97a41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): picked mon.noname-d con 0x7f97a4139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f97a40a84c0 con 0x7f97a40a57c0 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f97a40a7d40 con 0x7f97a40a6950 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f97a40a8700 con 0x7f97a4139710 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97ac174640 10 monclient(hunting): authenticate will time out at 1100.451726s 2024-08-19T11:17:22.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97a40a57c0 0x7f97a4138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97a40a57c0 0x7f97a4138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37020/0 (socket says 172.21.15.71:37020) 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 1 -- 172.21.15.71:0/1514280994 learned_addr learned my addr 172.21.15.71:0/1514280994 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): get_auth_request con 0x7f97a40a57c0 auth_method 0 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 0x7f97a41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): get_auth_request con 0x7f97a4139710 auth_method 0 2024-08-19T11:17:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97aa711640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a970f640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97a40a6950 0x7f97a4138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a970f640 10 monclient(hunting): get_auth_request con 0x7f97a40a6950 auth_method 0 2024-08-19T11:17:22.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.410+0000 7f97a970f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97a970f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97a970f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97a970f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97a970f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97a970f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 10 monclient(hunting): handle_auth_done global_id 26025 payload 824 2024-08-19T11:17:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97a40a6950 msgr2=0x7f97a4138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f97a40a6950 0x7f97a4138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97a40a57c0 msgr2=0x7f97a4138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97a40a57c0 0x7f97a4138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 1 monclient: found mon.noname-d 2024-08-19T11:17:22.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97aa711640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a4123f80 con 0x7f97a4139710 2024-08-19T11:17:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.411+0000 7f97a9f10640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97a40a57c0 0x7f97a4138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97aa711640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 msgr2=0x7f97a41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97aa711640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 0x7f97a41225a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f979c00bde0 tx=0x7f979c009ed0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f979c011b90 con 0x7f97a4139710 2024-08-19T11:17:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: dump: 2024-08-19T11:17:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.436 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.437 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.438 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.439 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.439 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.439 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 5 monclient: authenticate success, global_id 26025 2024-08-19T11:17:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979c011d70 con 0x7f97a4139710 2024-08-19T11:17:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f979c013870 con 0x7f97a4139710 2024-08-19T11:17:22.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 10 monclient: _renew_subs 2024-08-19T11:17:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a413a2d0 con 0x7f97a4139710 2024-08-19T11:17:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979bfff640 4 set_mon_vals no callback set 2024-08-19T11:17:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:22.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f979a7fc640 10 monclient: dump: 2024-08-19T11:17:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.444 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.444 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.444 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.444 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.444 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.445 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 10 monclient: _renew_subs 2024-08-19T11:17:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.413+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41262e0 con 0x7f97a4139710 2024-08-19T11:17:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97ac174640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97ac174640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 0x7f97a402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f97a4076c60 con 0x7f97a41ce5a0 2024-08-19T11:17:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 0x7f97a402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f979c013400 con 0x7f97a4139710 2024-08-19T11:17:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient: get_auth_request con 0x7f97a41ce5a0 auth_method 0 2024-08-19T11:17:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 10 monclient(hunting): handle_auth_done global_id 64826 payload 824 2024-08-19T11:17:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f97a9f10640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97a40a20a0 con 0x7f97a41ce5a0 2024-08-19T11:17:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f979a7fc640 1 --2- 172.21.15.71:0/1514280994 >> v2:172.21.15.135:6800/726754104 conn(0x7f978803ea80 0x7f9788040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.414+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(198..198 src has 1..198) ==== 3506+0+0 (secure 0 0 0) 0x7f979c052860 con 0x7f97a4139710 2024-08-19T11:17:22.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.415+0000 7f97a970f640 1 --2- 172.21.15.71:0/1514280994 >> v2:172.21.15.135:6800/726754104 conn(0x7f978803ea80 0x7f9788040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.415+0000 7f97a970f640 10 monclient: get_auth_request con 0x7f978803ea80 auth_method 0 2024-08-19T11:17:22.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f97a9f10640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 msgr2=0x7f97a402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f97a9f10640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 0x7f97a402d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f97a000fc90 tx=0x7f97a000d590 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97a000fea0 con 0x7f97a41ce5a0 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 10 monclient: dump: 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.454 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.455 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f97a0013650 con 0x7f97a41ce5a0 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 msgr2=0x7f97a402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 0x7f97a402d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f97a000fc90 tx=0x7f97a000d590 comp rx=0 tx=0).stop 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 msgr2=0x7f97a402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f979a7fc640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a41ce5a0 0x7f97a402d1c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.417+0000 7f97a970f640 1 --2- 172.21.15.71:0/1514280994 >> v2:172.21.15.135:6800/726754104 conn(0x7f978803ea80 0x7f9788040f40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f97940097d0 tx=0x7f979402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97ac174640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97ac174640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 0x7f97a402db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97ac174640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f97a40a23a0 con 0x7f97a402d700 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 0x7f97a402db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient: get_auth_request con 0x7f97a402d700 auth_method 0 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 10 monclient(hunting): handle_auth_done global_id 64835 payload 824 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.423+0000 7f97a9f10640 1 -- 172.21.15.71:0/1514280994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97a40a1e70 con 0x7f97a402d700 2024-08-19T11:17:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97a9f10640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 msgr2=0x7f97a402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97a9f10640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 0x7f97a402db10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f97a000fc90 tx=0x7f97a00046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f97a000fea0 con 0x7f97a402d700 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 10 monclient: dump: 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f97a0013cc0 con 0x7f97a402d700 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 msgr2=0x7f97a402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 0x7f97a402db10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f97a000fc90 tx=0x7f97a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 msgr2=0x7f97a402db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f979a7fc640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f97a402d700 0x7f97a402db10 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f97a000fc90 tx=0x7f97a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 153908, 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:22.460 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:22.461 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.462 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.463 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:22.464 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.465 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.466 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.468 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.470 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.471 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.472 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.473 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.475 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.477 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.479 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.480 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:22.484 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 >> v2:172.21.15.135:6800/726754104 conn(0x7f978803ea80 msgr2=0x7f9788040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 --2- 172.21.15.71:0/1514280994 >> v2:172.21.15.135:6800/726754104 conn(0x7f978803ea80 0x7f9788040f40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f97940097d0 tx=0x7f979402e000 comp rx=0 tx=0).stop 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 10 monclient: shutdown 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 msgr2=0x7f97a41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97aa711640 1 -- 172.21.15.71:0/1514280994 reap_dead start 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 0x7f97a41225a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f979c00bde0 tx=0x7f979c009ed0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 shutdown_connections 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 --2- 172.21.15.71:0/1514280994 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f97a4139710 0x7f97a41225a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 >> 172.21.15.71:0/1514280994 conn(0x7f97a40abf50 msgr2=0x7f97a40aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 shutdown_connections 2024-08-19T11:17:22.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.426+0000 7f97ac174640 1 -- 172.21.15.71:0/1514280994 wait complete. 2024-08-19T11:17:22.487 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:22.487 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:17:22.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:17:22.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.584+0000 7f4a81830640 10 monclient: get_monmap_and_config 2024-08-19T11:17:22.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.584+0000 7f4a81830640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.584+0000 7f4a81830640 10 monclient: monmap: 2024-08-19T11:17:22.585 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.585 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:22.585097+0000 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:22.585097+0000 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.586 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.587 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.587 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.587 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:22.587 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:22.587 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 Processor -- start 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 -- start start 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient: init 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient: _add_conns ranks=[6,8,4,5,2,9,10,1,3,7,0] 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 0x7f4a7c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): picked mon.noname-d con 0x7f4a7c0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 0x7f4a7c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): picked mon.noname-e con 0x7f4a7c0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4a7c139710 0x7f4a7c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): picked mon.noname-c con 0x7f4a7c139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:22.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4a7c0a5020 con 0x7f4a7c139710 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4a7c0a77b0 con 0x7f4a7c0a6950 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4a7c0a7d40 con 0x7f4a7c0a57c0 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a81830640 10 monclient(hunting): authenticate will time out at 1100.626703s 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 0x7f4a7c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 0x7f4a7c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 0x7f4a7c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35632/0 (socket says 172.21.15.71:35632) 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 0x7f4a7c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58592/0 (socket says 172.21.15.71:58592) 2024-08-19T11:17:22.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/2028903014 learned_addr learned my addr 172.21.15.71:0/2028903014 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): get_auth_request con 0x7f4a7c0a57c0 auth_method 0 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): get_auth_request con 0x7f4a7c0a6950 auth_method 0 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4a7c139710 0x7f4a7c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): get_auth_request con 0x7f4a7c139710 auth_method 0 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.585+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_done global_id 64844 payload 274 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 msgr2=0x7f4a7c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 0x7f4a7c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4a7c139710 msgr2=0x7f4a7c139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4a7c139710 0x7f4a7c139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 1 monclient: found mon.noname-e 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/2028903014 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c0a6380 con 0x7f4a7c0a57c0 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7b7fe640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4a7c139710 0x7f4a7c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.586+0000 7f4a7affd640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 0x7f4a7c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.588+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 msgr2=0x7f4a7c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.588+0000 7f4a7a7fc640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 0x7f4a7c0a7270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a640098a0 tx=0x7f4a6402a080 comp rx=0 tx=0).ready entity=mon.8 client_cookie=35258b41931d7f3f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.588+0000 7f4a79ffb640 1 -- 172.21.15.71:0/2028903014 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a64037070 con 0x7f4a7c0a57c0 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.588+0000 7f4a79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: dump: 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.596 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 5 monclient: authenticate success, global_id 64844 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 1 -- 172.21.15.71:0/2028903014 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6402ade0 con 0x7f4a7c0a57c0 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 4 set_mon_vals no callback set 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 1 -- 172.21.15.71:0/2028903014 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a64030c20 con 0x7f4a7c0a57c0 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a79ffb640 10 monclient: dump: 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.598 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 10 monclient: shutdown 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 -- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 msgr2=0x7f4a7c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 0x7f4a7c0a7270 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a640098a0 tx=0x7f4a6402a080 comp rx=0 tx=0).stop 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 -- 172.21.15.71:0/2028903014 shutdown_connections 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4a7c139710 0x7f4a7c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a57c0 0x7f4a7c0a7270 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 --2- 172.21.15.71:0/2028903014 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a7c0a6950 0x7f4a7c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 -- 172.21.15.71:0/2028903014 >> 172.21.15.71:0/2028903014 conn(0x7f4a7c0abf50 msgr2=0x7f4a7c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 -- 172.21.15.71:0/2028903014 shutdown_connections 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.589+0000 7f4a81830640 1 -- 172.21.15.71:0/2028903014 wait complete. 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.590+0000 7f4a81830640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.590+0000 7f4a81830640 10 monclient: monmap: 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.590+0000 7f4a81830640 1 Processor -- start 2024-08-19T11:17:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.590+0000 7f4a81830640 1 -- start start 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.590+0000 7f4a81830640 10 monclient: init 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient: _add_conns ranks=[1,8,5,0,2,4,6,7,3] 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c0a57c0 0x7f4a7c1ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): picked mon.noname-f con 0x7f4a7c0a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 0x7f4a7c138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): picked mon.noname-e con 0x7f4a7c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a7c139710 0x7f4a7c1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): picked mon.noname-h con 0x7f4a7c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0a84c0 con 0x7f4a7c0a57c0 2024-08-19T11:17:22.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4a7c0a3650 con 0x7f4a7c139710 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4a7c0a8700 con 0x7f4a7c0a6950 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a81830640 10 monclient(hunting): authenticate will time out at 1100.632205s 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 0x7f4a7c138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 0x7f4a7c138b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35642/0 (socket says 172.21.15.71:35642) 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/37515466 learned_addr learned my addr 172.21.15.71:0/37515466 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): get_auth_request con 0x7f4a7c0a6950 auth_method 0 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient(hunting): handle_auth_done global_id 64853 payload 824 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a7c139710 msgr2=0x7f4a7c1229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a7c139710 0x7f4a7c1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c0a57c0 msgr2=0x7f4a7c1ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c0a57c0 0x7f4a7c1ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 monclient: found mon.noname-e 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.591+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c1cf400 con 0x7f4a7c0a6950 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a7a7fc640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 msgr2=0x7f4a7c138b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a7a7fc640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 0x7f4a7c138b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a640097c0 tx=0x7f4a640046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a64037040 con 0x7f4a7c0a6950 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: dump: 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.612 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 5 monclient: authenticate success, global_id 64853 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a64042070 con 0x7f4a7c0a6950 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a6403d8b0 con 0x7f4a7c0a6950 2024-08-19T11:17:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 10 monclient: _renew_subs 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c1241f0 con 0x7f4a7c0a6950 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a797fa640 4 set_mon_vals no callback set 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a73fff640 10 monclient: dump: 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 10 monclient: _renew_subs 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.593+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c126550 con 0x7f4a7c0a6950 2024-08-19T11:17:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.594+0000 7f4a81830640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.594+0000 7f4a81830640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 0x7f4a7c122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.594+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.594+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c076c60 con 0x7f4a7c1390d0 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.594+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4a6403d440 con 0x7f4a7c0a6950 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a73fff640 1 --2- 172.21.15.71:0/37515466 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03ea80 0x7f4a5c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 0x7f4a7c122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(198..198 src has 1..198) ==== 3506+0+0 (secure 0 0 0) 0x7f4a64071e50 con 0x7f4a7c0a6950 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient: get_auth_request con 0x7f4a7c1390d0 auth_method 0 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7b7fe640 1 --2- 172.21.15.71:0/37515466 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03ea80 0x7f4a5c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7b7fe640 10 monclient: get_auth_request con 0x7f4a5c03ea80 auth_method 0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 10 monclient(hunting): handle_auth_done global_id 84124 payload 824 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.595+0000 7f4a7affd640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a7c0a1e50 con 0x7f4a7c1390d0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.597+0000 7f4a7affd640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 msgr2=0x7f4a7c122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.597+0000 7f4a7affd640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 0x7f4a7c122f30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00e7a0 tx=0x7f4a6c00ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.597+0000 7f4a7b7fe640 1 --2- 172.21.15.71:0/37515466 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03ea80 0x7f4a5c040f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c074f90 tx=0x7f4a7400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a6c017070 con 0x7f4a7c1390d0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 10 monclient: dump: 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.617 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4a6c00cac0 con 0x7f4a7c1390d0 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 msgr2=0x7f4a7c122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 0x7f4a7c122f30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00e7a0 tx=0x7f4a6c00ec60 comp rx=0 tx=0).stop 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 msgr2=0x7f4a7c122f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.598+0000 7f4a73fff640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c1390d0 0x7f4a7c122f30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a81830640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a81830640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 0x7f4a7c09da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a81830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c123880 con 0x7f4a7c123470 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 0x7f4a7c09da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient: get_auth_request con 0x7f4a7c123470 auth_method 0 2024-08-19T11:17:22.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 10 monclient(hunting): handle_auth_done global_id 84133 payload 824 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.604+0000 7f4a7affd640 1 -- 172.21.15.71:0/37515466 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4a7c0a2080 con 0x7f4a7c123470 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a7affd640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 msgr2=0x7f4a7c09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a7affd640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 0x7f4a7c09da00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c019000 tx=0x7f4a6c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a6c017070 con 0x7f4a7c123470 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a73fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a73fff640 10 monclient: dump: 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.607+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f4a6c0067c0 con 0x7f4a7c123470 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a73fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a73fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 msgr2=0x7f4a7c09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a73fff640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 0x7f4a7c09da00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c019000 tx=0x7f4a6c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a73fff640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 msgr2=0x7f4a7c09da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a73fff640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a7c123470 0x7f4a7c09da00 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c019000 tx=0x7f4a6c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.622 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 24768, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:22.623 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.624 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.625 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:22.626 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:22.627 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.628 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:22.631 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:22.632 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.634 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.635 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.637 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.638 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.640 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.644 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:22.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.646 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.646 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:22.646 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03ea80 msgr2=0x7f4a5c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 --2- 172.21.15.71:0/37515466 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03ea80 0x7f4a5c040f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c074f90 tx=0x7f4a7400d040 comp rx=0 tx=0).stop 2024-08-19T11:17:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 10 monclient: shutdown 2024-08-19T11:17:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 msgr2=0x7f4a7c138b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 --2- 172.21.15.71:0/37515466 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4a7c0a6950 0x7f4a7c138b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a640097c0 tx=0x7f4a640046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a7b7fe640 1 -- 172.21.15.71:0/37515466 reap_dead start 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a7b7fe640 1 -- 172.21.15.71:0/37515466 reap_dead start 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 shutdown_connections 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 >> 172.21.15.71:0/37515466 conn(0x7f4a7c0abf50 msgr2=0x7f4a7c1c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 shutdown_connections 2024-08-19T11:17:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.608+0000 7f4a81830640 1 -- 172.21.15.71:0/37515466 wait complete. 2024-08-19T11:17:22.648 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:22.648 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:17:22.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.746+0000 7f8a4a1cc640 10 monclient: get_monmap_and_config 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.746+0000 7f8a4a1cc640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.746+0000 7f8a4a1cc640 10 monclient: monmap: 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:22.746888+0000 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:22.746888+0000 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.747 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:22.748 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 Processor -- start 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 -- start start 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient: init 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient: _add_conns ranks=[7,9,4,8,3,10,2,6,5,0,1] 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8a440a6950 0x7f8a440a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): picked mon.noname-i con 0x7f8a440a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a440a57c0 0x7f8a440a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): picked mon.noname-a con 0x7f8a440a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:22.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a44139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): picked mon.noname-c con 0x7f8a44139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8a440a5020 con 0x7f8a440a57c0 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f8a440a77b0 con 0x7f8a44139710 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8a440a7d40 con 0x7f8a440a6950 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a4a1cc640 10 monclient(hunting): authenticate will time out at 1100.788655s 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a440a57c0 0x7f8a440a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a440a57c0 0x7f8a440a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37024/0 (socket says 172.21.15.71:37024) 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 1 -- 172.21.15.71:0/664156097 learned_addr learned my addr 172.21.15.71:0/664156097 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): get_auth_request con 0x7f8a440a57c0 auth_method 0 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a44139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): get_auth_request con 0x7f8a44139710 auth_method 0 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a437fe640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8a440a6950 0x7f8a440a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a437fe640 10 monclient(hunting): get_auth_request con 0x7f8a440a6950 auth_method 0 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a437fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.747+0000 7f8a437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 10 monclient(hunting): handle_auth_done global_id 74493 payload 274 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 1 -- 172.21.15.71:0/664156097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8a440a6950 msgr2=0x7f8a440a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8a440a6950 0x7f8a440a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 1 -- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 msgr2=0x7f8a44139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a44139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 1 monclient: found mon.noname-a 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a3affd640 1 -- 172.21.15.71:0/664156097 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a440a6380 con 0x7f8a440a57c0 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.748+0000 7f8a43fff640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a44139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.750+0000 7f8a3affd640 1 -- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a440a57c0 msgr2=0x7f8a440a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.750+0000 7f8a3affd640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a440a57c0 0x7f8a440a7270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0098a0 tx=0x7f8a2c02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0840b351804886 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 1 -- 172.21.15.71:0/664156097 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a2c037070 con 0x7f8a440a57c0 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: dump: 2024-08-19T11:17:22.760 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.761 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 1 -- 172.21.15.71:0/664156097 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c02adf0 con 0x7f8a440a57c0 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 5 monclient: authenticate success, global_id 74493 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 1 -- 172.21.15.71:0/664156097 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a2c030c20 con 0x7f8a440a57c0 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 4 set_mon_vals no callback set 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a42ffd640 10 monclient: dump: 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.763 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 10 monclient: shutdown 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a440a57c0 msgr2=0x7f8a440a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a440a57c0 0x7f8a440a7270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0098a0 tx=0x7f8a2c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/664156097 shutdown_connections 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a44139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a440a57c0 0x7f8a440a7270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/664156097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8a440a6950 0x7f8a440a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/664156097 >> 172.21.15.71:0/664156097 conn(0x7f8a440abf50 msgr2=0x7f8a440ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/664156097 shutdown_connections 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.751+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/664156097 wait complete. 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.752+0000 7f8a4a1cc640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.752+0000 7f8a4a1cc640 10 monclient: monmap: 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:22.765 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.752+0000 7f8a4a1cc640 1 Processor -- start 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.752+0000 7f8a4a1cc640 1 -- start start 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.752+0000 7f8a4a1cc640 10 monclient: init 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient: _add_conns ranks=[8,1,4,6,7,5,3,2,0] 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 0x7f8a44124d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): picked mon.noname-e con 0x7f8a440a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a440a6950 0x7f8a44125280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): picked mon.noname-f con 0x7f8a440a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a441257c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): picked mon.noname-c con 0x7f8a44139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440a84c0 con 0x7f8a440a6950 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f8a440a3650 con 0x7f8a44139710 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8a440a8700 con 0x7f8a440a57c0 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a4a1cc640 10 monclient(hunting): authenticate will time out at 1100.794243s 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 0x7f8a44124d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a441257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 0x7f8a44124d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35644/0 (socket says 172.21.15.71:35644) 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 -- 172.21.15.71:0/4044686950 learned_addr learned my addr 172.21.15.71:0/4044686950 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): get_auth_request con 0x7f8a440a57c0 auth_method 0 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): get_auth_request con 0x7f8a44139710 auth_method 0 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient(hunting): handle_auth_done global_id 64862 payload 824 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a3affd640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a440a6950 0x7f8a44125280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 msgr2=0x7f8a441257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a441257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a440a6950 msgr2=0x7f8a44125280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a440a6950 0x7f8a44125280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 monclient: found mon.noname-e 2024-08-19T11:17:22.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a437fe640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a441376f0 con 0x7f8a440a57c0 2024-08-19T11:17:22.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a3affd640 10 monclient: get_auth_request con 0x7f8a440a6950 auth_method 0 2024-08-19T11:17:22.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a43fff640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8a44139710 0x7f8a441257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.753+0000 7f8a3affd640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a440a6950 0x7f8a44125280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a437fe640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 msgr2=0x7f8a44124d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a437fe640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 0x7f8a44124d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d800 tx=0x7f8a3400dc00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a3400bd40 con 0x7f8a440a57c0 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 10 monclient: dump: 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a4a1cc640 5 monclient: authenticate success, global_id 64862 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a34019070 con 0x7f8a440a57c0 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a340148a0 con 0x7f8a440a57c0 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a40ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a40ff9640 10 monclient: dump: 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.778 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 10 monclient: _renew_subs 2024-08-19T11:17:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.755+0000 7f8a427fc640 4 set_mon_vals no callback set 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a44127b70 con 0x7f8a440a57c0 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 10 monclient: _renew_subs 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4413a1d0 con 0x7f8a440a57c0 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 0x7f8a4409fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.756+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a44076c60 con 0x7f8a4409fa10 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a437fe640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 0x7f8a44124d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d800 tx=0x7f8a3400dc00 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f8a3400f040 osd_map(198..198 src has 1..198) 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8a34014430 con 0x7f8a440a57c0 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 0x7f8a4409fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a40ff9640 1 --2- 172.21.15.71:0/4044686950 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a2803ea80 0x7f8a28040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient: get_auth_request con 0x7f8a4409fa10 auth_method 0 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a43fff640 1 --2- 172.21.15.71:0/4044686950 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a2803ea80 0x7f8a28040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a43fff640 10 monclient: get_auth_request con 0x7f8a2803ea80 auth_method 0 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 10 monclient(hunting): handle_auth_done global_id 45030 payload 824 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.757+0000 7f8a3affd640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a440a1d60 con 0x7f8a4409fa10 2024-08-19T11:17:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a3affd640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 msgr2=0x7f8a4409fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a3affd640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 0x7f8a4409fdf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c034000 tx=0x7f8a2c0046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a43fff640 1 --2- 172.21.15.71:0/4044686950 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a2803ea80 0x7f8a28040f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c003b80 tx=0x7f8a3c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a2c041070 con 0x7f8a4409fa10 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 10 monclient: dump: 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8a2c003820 con 0x7f8a4409fa10 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 msgr2=0x7f8a4409fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 0x7f8a4409fdf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c034000 tx=0x7f8a2c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 msgr2=0x7f8a4409fdf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.760+0000 7f8a40ff9640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4409fa10 0x7f8a4409fdf0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c034000 tx=0x7f8a2c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a4a1cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 0x7f8a441d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a4a1cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a440a6d30 con 0x7f8a440a0330 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 0x7f8a441d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient: get_auth_request con 0x7f8a440a0330 auth_method 0 2024-08-19T11:17:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.766+0000 7f8a3affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.767+0000 7f8a3affd640 10 monclient(hunting): handle_auth_done global_id 45039 payload 824 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.767+0000 7f8a3affd640 1 -- 172.21.15.71:0/4044686950 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a4406ca70 con 0x7f8a440a0330 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a3affd640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 msgr2=0x7f8a441d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a3affd640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 0x7f8a441d8990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c035040 tx=0x7f8a2c009240 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8a2c04c070 con 0x7f8a440a0330 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 10 monclient: dump: 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f8a2c0467b0 con 0x7f8a440a0330 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 msgr2=0x7f8a441d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 0x7f8a441d8990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c035040 tx=0x7f8a2c009240 comp rx=0 tx=0).stop 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 msgr2=0x7f8a441d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.769+0000 7f8a40ff9640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a440a0330 0x7f8a441d8990 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c035040 tx=0x7f8a2c009240 comp rx=0 tx=0).stop 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 211792, 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.789 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:22.790 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:22.791 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:22.792 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.793 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.794 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.795 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.802 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.804 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.808 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.810 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:22.811 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a2803ea80 msgr2=0x7f8a28040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/4044686950 >> v2:172.21.15.135:6800/726754104 conn(0x7f8a2803ea80 0x7f8a28040f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c003b80 tx=0x7f8a3c00b040 comp rx=0 tx=0).stop 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 10 monclient: shutdown 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 msgr2=0x7f8a44124d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 --2- 172.21.15.71:0/4044686950 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8a440a57c0 0x7f8a44124d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400d800 tx=0x7f8a3400dc00 comp rx=0 tx=0).stop 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a43fff640 1 -- 172.21.15.71:0/4044686950 reap_dead start 2024-08-19T11:17:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a40ff9640 1 -- 172.21.15.71:0/4044686950 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(198..198 src has 1..198) ==== 3506+0+0 (unknown 0 0 0) 0x7f8a3400f040 con 0x7f8a440a57c0 2024-08-19T11:17:22.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a43fff640 1 -- 172.21.15.71:0/4044686950 reap_dead start 2024-08-19T11:17:22.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 shutdown_connections 2024-08-19T11:17:22.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 >> 172.21.15.71:0/4044686950 conn(0x7f8a440abf50 msgr2=0x7f8a44138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 shutdown_connections 2024-08-19T11:17:22.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.770+0000 7f8a4a1cc640 1 -- 172.21.15.71:0/4044686950 wait complete. 2024-08-19T11:17:22.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:22.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:17:22.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.912+0000 7fba812e5640 10 monclient: get_monmap_and_config 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.912+0000 7fba812e5640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.912+0000 7fba812e5640 10 monclient: monmap: 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:22.912873+0000 2024-08-19T11:17:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:22.912873+0000 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:22.915 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.912+0000 7fba812e5640 1 Processor -- start 2024-08-19T11:17:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.912+0000 7fba812e5640 1 -- start start 2024-08-19T11:17:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.912+0000 7fba812e5640 10 monclient: init 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient: _add_conns ranks=[2,8,5,0,9,1,10,3,7,4,6] 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 0x7fba7c0a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): picked mon.noname-b con 0x7fba7c0a47c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 0x7fba7c139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): picked mon.noname-e con 0x7fba7c0a50e0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c139eb0 0x7fba7c13a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): picked mon.noname-h con 0x7fba7c139eb0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba7c0a1540 con 0x7fba7c0a47c0 2024-08-19T11:17:22.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fba7c0a32a0 con 0x7fba7c139eb0 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fba7c06cc40 con 0x7fba7c0a50e0 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba812e5640 10 monclient(hunting): authenticate will time out at 1100.954443s 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 0x7fba7c139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 0x7fba7c0a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 0x7fba7c139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35650/0 (socket says 172.21.15.71:35650) 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 0x7fba7c0a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48494/0 (socket says 172.21.15.71:48494) 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1663495532 learned_addr learned my addr 172.21.15.71:0/1663495532 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): get_auth_request con 0x7fba7c0a50e0 auth_method 0 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): get_auth_request con 0x7fba7c0a47c0 auth_method 0 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7b7fe640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c139eb0 0x7fba7c13a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7b7fe640 10 monclient(hunting): get_auth_request con 0x7fba7c139eb0 auth_method 0 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_done global_id 64871 payload 274 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1663495532 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c139eb0 msgr2=0x7fba7c13a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c139eb0 0x7fba7c13a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 msgr2=0x7fba7c0a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 0x7fba7c0a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 monclient: found mon.noname-e 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1663495532 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c0a6380 con 0x7fba7c0a50e0 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.913+0000 7fba7affd640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 0x7fba7c0a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 msgr2=0x7fba7c139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 0x7fba7c139970 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba700098d0 tx=0x7fba7002a0a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=863c664935cf4156 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 1 -- 172.21.15.71:0/1663495532 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba70037070 con 0x7fba7c0a50e0 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: dump: 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 1 -- 172.21.15.71:0/1663495532 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7002adc0 con 0x7fba7c0a50e0 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba812e5640 5 monclient: authenticate success, global_id 64871 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba812e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba812e5640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 1 -- 172.21.15.71:0/1663495532 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba70030c20 con 0x7fba7c0a50e0 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba812e5640 4 set_mon_vals no callback set 2024-08-19T11:17:22.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.916+0000 7fba79ffb640 10 monclient: dump: 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.929 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 10 monclient: shutdown 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 -- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 msgr2=0x7fba7c139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 0x7fba7c139970 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba700098d0 tx=0x7fba7002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 -- 172.21.15.71:0/1663495532 shutdown_connections 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c139eb0 0x7fba7c13a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fba7c0a50e0 0x7fba7c139970 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 --2- 172.21.15.71:0/1663495532 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a47c0 0x7fba7c0a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 -- 172.21.15.71:0/1663495532 >> 172.21.15.71:0/1663495532 conn(0x7fba7c0a9470 msgr2=0x7fba7c0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 -- 172.21.15.71:0/1663495532 shutdown_connections 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 1 -- 172.21.15.71:0/1663495532 wait complete. 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.917+0000 7fba812e5640 10 monclient: build_initial_monmap 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient: monmap: 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:22.931 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 Processor -- start 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 -- start start 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient: init 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:22.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient: _add_conns ranks=[0,2,1,7,4,6,3,8,5] 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba7c0a47c0 0x7fba7c126160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): picked mon.noname-a con 0x7fba7c0a47c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a50e0 0x7fba7c1266a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): picked mon.noname-b con 0x7fba7c0a50e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c139eb0 0x7fba7c126be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): picked mon.noname-f con 0x7fba7c139eb0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c0a5500 con 0x7fba7c0a47c0 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c06cfd0 con 0x7fba7c139eb0 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fba7c06d300 con 0x7fba7c0a50e0 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.918+0000 7fba812e5640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba812e5640 10 monclient(hunting): authenticate will time out at 1100.960008s 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a50e0 0x7fba7c1266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba7c0a47c0 0x7fba7c126160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a50e0 0x7fba7c1266a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48502/0 (socket says 172.21.15.71:48502) 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1918188829 learned_addr learned my addr 172.21.15.71:0/1918188829 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): get_auth_request con 0x7fba7c0a50e0 auth_method 0 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): get_auth_request con 0x7fba7c0a47c0 auth_method 0 2024-08-19T11:17:22.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7b7fe640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c139eb0 0x7fba7c126be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7b7fe640 10 monclient(hunting): get_auth_request con 0x7fba7c139eb0 auth_method 0 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient(hunting): handle_auth_done global_id 74502 payload 824 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a50e0 msgr2=0x7fba7c1266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a50e0 0x7fba7c1266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c139eb0 msgr2=0x7fba7c126be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba7c139eb0 0x7fba7c126be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient: _finish_hunting 0 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 monclient: found mon.noname-a 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7affd640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c128f30 con 0x7fba7c0a47c0 2024-08-19T11:17:22.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.919+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fba7c0a50e0 0x7fba7c1266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba7affd640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba7c0a47c0 msgr2=0x7fba7c126160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba7affd640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba7c0a47c0 0x7fba7c126160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00efc0 tx=0x7fba6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba6c018020 con 0x7fba7c0a47c0 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: dump: 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.942 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 5 monclient: authenticate success, global_id 74502 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6c014b00 con 0x7fba7c0a47c0 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 10 monclient: _renew_subs 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7c12a1c0 con 0x7fba7c0a47c0 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba6c014cb0 con 0x7fba7c0a47c0 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba637fe640 10 monclient: dump: 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba797fa640 4 set_mon_vals no callback set 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 10 monclient: _renew_subs 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.921+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba7c0a3e00 con 0x7fba7c0a47c0 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba812e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba812e5640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 0x7fba7c09d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fba7c076c60 con 0x7fba7c09d2f0 2024-08-19T11:17:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 0x7fba7c09d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba7a7fc640 10 monclient: get_auth_request con 0x7fba7c09d2f0 auth_method 0 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.922+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fba6c005d10 con 0x7fba7c0a47c0 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_done global_id 45149 payload 824 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba637fe640 1 --2- 172.21.15.71:0/1918188829 >> v2:172.21.15.135:6800/726754104 conn(0x7fba6803ea80 0x7fba68040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba7c09fab0 con 0x7fba7c09d2f0 2024-08-19T11:17:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 3506+0+0 (secure 0 0 0) 0x7fba6c052300 con 0x7fba7c0a47c0 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7b7fe640 1 --2- 172.21.15.71:0/1918188829 >> v2:172.21.15.135:6800/726754104 conn(0x7fba6803ea80 0x7fba68040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.923+0000 7fba7b7fe640 10 monclient: get_auth_request con 0x7fba6803ea80 auth_method 0 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 msgr2=0x7fba7c09d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 0x7fba7c09d6d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba700097c0 tx=0x7fba700046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba70037040 con 0x7fba7c09d2f0 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba637fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba637fe640 10 monclient: dump: 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.947 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.925+0000 7fba7b7fe640 1 --2- 172.21.15.71:0/1918188829 >> v2:172.21.15.135:6800/726754104 conn(0x7fba6803ea80 0x7fba68040f40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fba7400d850 tx=0x7fba74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fba7002adc0 con 0x7fba7c09d2f0 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 msgr2=0x7fba7c09d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 0x7fba7c09d6d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba700097c0 tx=0x7fba700046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 msgr2=0x7fba7c09d6d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.926+0000 7fba637fe640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09d2f0 0x7fba7c09d6d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba812e5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba812e5640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 0x7fba7c1d87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba812e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fba7c069ed0 con 0x7fba7c09dc10 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 0x7fba7c1d87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient: get_auth_request con 0x7fba7c09dc10 auth_method 0 2024-08-19T11:17:22.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 10 monclient(hunting): handle_auth_done global_id 45158 payload 824 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.932+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1918188829 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba7c129670 con 0x7fba7c09dc10 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.935+0000 7fba7a7fc640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 msgr2=0x7fba7c1d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.935+0000 7fba7a7fc640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 0x7fba7c1d87d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba70000c00 tx=0x7fba70009240 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.935+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fba70037040 con 0x7fba7c09dc10 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.935+0000 7fba637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.935+0000 7fba637fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:22.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.935+0000 7fba637fe640 10 monclient: dump: 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:22.951 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fba70009490 con 0x7fba7c09dc10 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 msgr2=0x7fba7c1d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 0x7fba7c1d87d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba70000c00 tx=0x7fba70009240 comp rx=0 tx=0).stop 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 msgr2=0x7fba7c1d87d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba637fe640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fba7c09dc10 0x7fba7c1d87d0 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba70000c00 tx=0x7fba70009240 comp rx=0 tx=0).stop 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 211958, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:17:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:22.976 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 >> v2:172.21.15.135:6800/726754104 conn(0x7fba6803ea80 msgr2=0x7fba68040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 --2- 172.21.15.71:0/1918188829 >> v2:172.21.15.135:6800/726754104 conn(0x7fba6803ea80 0x7fba68040f40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fba7400d850 tx=0x7fba74008040 comp rx=0 tx=0).stop 2024-08-19T11:17:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 10 monclient: shutdown 2024-08-19T11:17:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba7c0a47c0 msgr2=0x7fba7c126160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 --2- 172.21.15.71:0/1918188829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba7c0a47c0 0x7fba7c126160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00efc0 tx=0x7fba6c00c490 comp rx=0 tx=0).stop 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba7b7fe640 1 -- 172.21.15.71:0/1918188829 reap_dead start 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba7b7fe640 1 -- 172.21.15.71:0/1918188829 reap_dead start 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 shutdown_connections 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 >> 172.21.15.71:0/1918188829 conn(0x7fba7c0a9470 msgr2=0x7fba7c09f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 shutdown_connections 2024-08-19T11:17:22.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:22.936+0000 7fba812e5640 1 -- 172.21.15.71:0/1918188829 wait complete. 2024-08-19T11:17:22.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:22.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:17:22.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:17:23.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.077+0000 7faa9edd9640 10 monclient: get_monmap_and_config 2024-08-19T11:17:23.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.077+0000 7faa9edd9640 10 monclient: build_initial_monmap 2024-08-19T11:17:23.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.077+0000 7faa9edd9640 10 monclient: monmap: 2024-08-19T11:17:23.078 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:23.078 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:23.077841+0000 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:23.077841+0000 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:23.079 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:23.080 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:23.080 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:23.080 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:23.080 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:23.080 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:23.080 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.077+0000 7faa9edd9640 1 Processor -- start 2024-08-19T11:17:23.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.077+0000 7faa9edd9640 1 -- start start 2024-08-19T11:17:23.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient: init 2024-08-19T11:17:23.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:23.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient: _add_conns ranks=[4,9,10,1,2,6,8,3,0,5,7] 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 0x7faa980a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): picked mon.noname-c con 0x7faa980a3cd0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa980a40b0 0x7faa980a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): picked mon.noname-a con 0x7faa980a40b0 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faa98139a50 0x7faa98139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): picked mon.noname-f con 0x7faa98139a50 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7faa980a1410 con 0x7faa980a40b0 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7faa980a0ae0 con 0x7faa98139a50 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7faa980a0dc0 con 0x7faa980a3cd0 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9edd9640 10 monclient(hunting): authenticate will time out at 1101.119502s 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa980a40b0 0x7faa980a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 0x7faa980a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa980a40b0 0x7faa980a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37048/0 (socket says 172.21.15.71:37048) 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 0x7faa980a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:56616/0 (socket says 172.21.15.71:56616) 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 1 -- 172.21.15.71:0/3274487367 learned_addr learned my addr 172.21.15.71:0/3274487367 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): get_auth_request con 0x7faa980a40b0 auth_method 0 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 1 --2- 172.21.15.71:0/3274487367 >> v2:172.21.15.135:3300/0 conn(0x7faa98139a50 0x7faa98139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): get_auth_request con 0x7faa980a3cd0 auth_method 0 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): get_auth_request con 0x7faa98139a50 auth_method 0 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.078+0000 7faa9d376640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 10 monclient(hunting): handle_auth_done global_id 74511 payload 274 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 1 -- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 msgr2=0x7faa980a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 1 --2- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 0x7faa980a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 1 -- 172.21.15.71:0/3274487367 >> v2:172.21.15.135:3300/0 conn(0x7faa98139a50 msgr2=0x7faa98139ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 1 --2- 172.21.15.71:0/3274487367 >> v2:172.21.15.135:3300/0 conn(0x7faa98139a50 0x7faa98139ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 1 monclient: found mon.noname-a 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:23.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa97fff640 1 -- 172.21.15.71:0/3274487367 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa980a10a0 con 0x7faa980a40b0 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.079+0000 7faa9cb75640 1 --2- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 0x7faa980a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.081+0000 7faa97fff640 1 -- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa980a40b0 msgr2=0x7faa980a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.081+0000 7faa97fff640 1 --2- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa980a40b0 0x7faa980a44d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa980a6970 tx=0x7faa8402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49937cd73d856d37 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.081+0000 7faa977fe640 1 -- 172.21.15.71:0/3274487367 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faa84037070 con 0x7faa980a40b0 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.081+0000 7faa977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.081+0000 7faa977fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.081+0000 7faa977fe640 10 monclient: dump: 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.095 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:23.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 1 -- 172.21.15.71:0/3274487367 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8402ae10 con 0x7faa980a40b0 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 5 monclient: authenticate success, global_id 74511 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 1 -- 172.21.15.71:0/3274487367 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faa84030c20 con 0x7faa980a40b0 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 4 set_mon_vals no callback set 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa977fe640 10 monclient: dump: 2024-08-19T11:17:23.097 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.098 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 10 monclient: shutdown 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 -- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa980a40b0 msgr2=0x7faa980a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 --2- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa980a40b0 0x7faa980a44d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa980a6970 tx=0x7faa8402a0b0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 -- 172.21.15.71:0/3274487367 shutdown_connections 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 --2- 172.21.15.71:0/3274487367 >> v2:172.21.15.135:3300/0 conn(0x7faa98139a50 0x7faa98139ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 --2- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa980a40b0 0x7faa980a44d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 --2- 172.21.15.71:0/3274487367 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa980a3cd0 0x7faa980a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 -- 172.21.15.71:0/3274487367 >> 172.21.15.71:0/3274487367 conn(0x7faa980a91d0 msgr2=0x7faa980a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:23.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 -- 172.21.15.71:0/3274487367 shutdown_connections 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.082+0000 7faa9edd9640 1 -- 172.21.15.71:0/3274487367 wait complete. 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.083+0000 7faa9edd9640 10 monclient: build_initial_monmap 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.083+0000 7faa9edd9640 10 monclient: monmap: 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:23.100 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.083+0000 7faa9edd9640 1 Processor -- start 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.083+0000 7faa9edd9640 1 -- start start 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.083+0000 7faa9edd9640 10 monclient: init 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient: _add_conns ranks=[7,5,4,6,8,3,2,0,1] 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa980a3cd0 0x7faa98138950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): picked mon.noname-i con 0x7faa980a3cd0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa980a40b0 0x7faa98138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): picked mon.noname-h con 0x7faa980a40b0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:23.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 0x7faa981ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): picked mon.noname-c con 0x7faa98139a50 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7faa980a1dc0 con 0x7faa98139a50 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7faa980a4a10 con 0x7faa980a40b0 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7faa980a1f40 con 0x7faa980a3cd0 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9edd9640 10 monclient(hunting): authenticate will time out at 1101.125164s 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 0x7faa981ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 0x7faa981ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:56618/0 (socket says 172.21.15.71:56618) 2024-08-19T11:17:23.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 learned_addr learned my addr 172.21.15.71:0/927646547 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): get_auth_request con 0x7faa98139a50 auth_method 0 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9cb75640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa980a3cd0 0x7faa98138950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9cb75640 10 monclient(hunting): get_auth_request con 0x7faa980a3cd0 auth_method 0 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9cb75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9cb75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9cb75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa97fff640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa980a40b0 0x7faa98138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa97fff640 10 monclient(hunting): get_auth_request con 0x7faa980a40b0 auth_method 0 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa97fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa97fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient(hunting): handle_auth_done global_id 84208 payload 824 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa980a3cd0 msgr2=0x7faa98138950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa980a3cd0 0x7faa98138950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa980a40b0 msgr2=0x7faa98138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7faa980a40b0 0x7faa98138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient: _finish_hunting 0 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 monclient: found mon.noname-c 2024-08-19T11:17:23.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.084+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa98124a20 con 0x7faa98139a50 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.086+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 msgr2=0x7faa981ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.086+0000 7faa9d376640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 0x7faa981ce2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa9000efc0 tx=0x7faa9000c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faa90018020 con 0x7faa98139a50 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: dump: 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.105 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: _finish_auth 0 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: _check_auth_tickets 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa900148f0 con 0x7faa98139a50 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 5 monclient: authenticate success, global_id 84208 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 10 monclient: _renew_subs 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa98125480 con 0x7faa98139a50 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faa900133e0 con 0x7faa98139a50 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa957fa640 10 monclient: dump: 2024-08-19T11:17:23.107 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa96ffd640 4 set_mon_vals no callback set 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 10 monclient: _renew_subs 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7faa981263e0 con 0x7faa98139a50 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.087+0000 7faa9edd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9edd9640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 0x7faa981cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7faa9806a590 con 0x7faa981ce7f0 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7faa90005d10 con 0x7faa98139a50 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 0x7faa981cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa957fa640 1 --2- 172.21.15.71:0/927646547 >> v2:172.21.15.135:6800/726754104 conn(0x7faa7c03ea80 0x7faa7c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient: get_auth_request con 0x7faa981ce7f0 auth_method 0 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(198..198 src has 1..198) ==== 3506+0+0 (secure 0 0 0) 0x7faa900524e0 con 0x7faa98139a50 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa97fff640 1 --2- 172.21.15.71:0/927646547 >> v2:172.21.15.135:6800/726754104 conn(0x7faa7c03ea80 0x7faa7c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa97fff640 10 monclient: get_auth_request con 0x7faa7c03ea80 auth_method 0 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 10 monclient(hunting): handle_auth_done global_id 84139 payload 824 2024-08-19T11:17:23.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.088+0000 7faa9cb75640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa981cf110 con 0x7faa981ce7f0 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.090+0000 7faa9cb75640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 msgr2=0x7faa981cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.090+0000 7faa9cb75640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 0x7faa981cebd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa8c011590 tx=0x7faa8c011a50 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa97fff640 1 --2- 172.21.15.71:0/927646547 >> v2:172.21.15.135:6800/726754104 conn(0x7faa7c03ea80 0x7faa7c040f40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faa84034000 tx=0x7faa8402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faa8c00fe70 con 0x7faa981ce7f0 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 10 monclient: dump: 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.114 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faa8c00fa00 con 0x7faa981ce7f0 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 msgr2=0x7faa981cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 0x7faa981cebd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa8c011590 tx=0x7faa8c011a50 comp rx=0 tx=0).stop 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 msgr2=0x7faa981cebd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.091+0000 7faa957fa640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa981ce7f0 0x7faa981cebd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.097+0000 7faa9edd9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.097+0000 7faa9edd9640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 0x7faa9809d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9edd9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7faa98076c60 con 0x7faa9809cd30 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 0x7faa9809d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient: get_auth_request con 0x7faa9809cd30 auth_method 0 2024-08-19T11:17:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 10 monclient(hunting): handle_auth_done global_id 84148 payload 824 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.098+0000 7faa9cb75640 1 -- 172.21.15.71:0/927646547 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa9806cff0 con 0x7faa9809cd30 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9cb75640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 msgr2=0x7faa9809d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9cb75640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 0x7faa9809d110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa8c008010 tx=0x7faa8c0046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7faa8c004470 con 0x7faa9809cd30 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 10 monclient: dump: 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7faa8c026070 con 0x7faa9809cd30 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 msgr2=0x7faa9809d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 0x7faa9809d110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa8c008010 tx=0x7faa8c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 msgr2=0x7faa9809d110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa957fa640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7faa9809cd30 0x7faa9809d110 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa8c008010 tx=0x7faa8c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.118 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 25262, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:23.119 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:23.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:23.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:23.123 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:23.140 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:23.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 >> v2:172.21.15.135:6800/726754104 conn(0x7faa7c03ea80 msgr2=0x7faa7c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9edd9640 1 --2- 172.21.15.71:0/927646547 >> v2:172.21.15.135:6800/726754104 conn(0x7faa7c03ea80 0x7faa7c040f40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faa84034000 tx=0x7faa8402e000 comp rx=0 tx=0).stop 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9edd9640 10 monclient: shutdown 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9edd9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 msgr2=0x7faa981ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9edd9640 1 --2- 172.21.15.71:0/927646547 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7faa98139a50 0x7faa981ce2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa9000efc0 tx=0x7faa9000c490 comp rx=0 tx=0).stop 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.101+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 reap_dead start 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.102+0000 7faa9d376640 1 -- 172.21.15.71:0/927646547 reap_dead start 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.102+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 shutdown_connections 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.102+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 >> 172.21.15.71:0/927646547 conn(0x7faa980a91d0 msgr2=0x7faa980a5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.102+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 shutdown_connections 2024-08-19T11:17:23.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.102+0000 7faa9edd9640 1 -- 172.21.15.71:0/927646547 wait complete. 2024-08-19T11:17:23.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:23.144 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:17:23.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.241+0000 7f4a7678a640 10 monclient: get_monmap_and_config 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.241+0000 7f4a7678a640 10 monclient: build_initial_monmap 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.241+0000 7f4a7678a640 10 monclient: monmap: 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:23.241669+0000 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:23.241669+0000 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.242 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:23.243 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.241+0000 7f4a7678a640 1 Processor -- start 2024-08-19T11:17:23.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.241+0000 7f4a7678a640 1 -- start start 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.241+0000 7f4a7678a640 10 monclient: init 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient: _add_conns ranks=[6,9,7,1,0,4,3,2,5,10,8] 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 0x7f4a700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): picked mon.noname-d con 0x7f4a700a69c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a700a6da0 0x7f4a700a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): picked mon.noname-a con 0x7f4a700a6da0 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a70139780 0x7f4a70139c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): picked mon.noname-i con 0x7f4a70139780 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4a700a3650 con 0x7f4a700a6da0 2024-08-19T11:17:23.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4a700a8760 con 0x7f4a700a69c0 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4a700a4f90 con 0x7f4a70139780 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a7678a640 10 monclient(hunting): authenticate will time out at 1101.283444s 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 0x7f4a700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a700a6da0 0x7f4a700a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 0x7f4a700a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58608/0 (socket says 172.21.15.71:58608) 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 -- 172.21.15.71:0/501759138 learned_addr learned my addr 172.21.15.71:0/501759138 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): get_auth_request con 0x7f4a700a69c0 auth_method 0 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): get_auth_request con 0x7f4a700a6da0 auth_method 0 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a74d27640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a70139780 0x7f4a70139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient(hunting): handle_auth_done global_id 26043 payload 274 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 -- 172.21.15.71:0/501759138 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a70139780 msgr2=0x7f4a70139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:23.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a70139780 0x7f4a70139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 -- 172.21.15.71:0/501759138 >> v2:172.21.15.71:3300/0 conn(0x7f4a700a6da0 msgr2=0x7f4a700a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/501759138 >> v2:172.21.15.71:3300/0 conn(0x7f4a700a6da0 0x7f4a700a71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 monclient: found mon.noname-d 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6ffff640 1 -- 172.21.15.71:0/501759138 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a700a6380 con 0x7f4a700a69c0 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a74d27640 10 monclient: get_auth_request con 0x7f4a70139780 auth_method 0 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a6f7fe640 1 --2- 172.21.15.71:0/501759138 >> v2:172.21.15.71:3300/0 conn(0x7f4a700a6da0 0x7f4a700a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.242+0000 7f4a74d27640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a70139780 0x7f4a70139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6ffff640 1 -- 172.21.15.71:0/501759138 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 msgr2=0x7f4a700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 0x7f4a700a5810 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a600098a0 tx=0x7f4a6002a150 comp rx=0 tx=0).ready entity=mon.6 client_cookie=58cd712acc4ea31 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 1 -- 172.21.15.71:0/501759138 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a60037070 con 0x7f4a700a69c0 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: dump: 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.252 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: _finish_auth 0 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 1 -- 172.21.15.71:0/501759138 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a600307b0 con 0x7f4a700a69c0 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a7678a640 5 monclient: authenticate success, global_id 26043 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a7678a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:23.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a7678a640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 1 -- 172.21.15.71:0/501759138 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a60030e10 con 0x7f4a700a69c0 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a7678a640 4 set_mon_vals no callback set 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.245+0000 7f4a6effd640 10 monclient: dump: 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.254 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 10 monclient: shutdown 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 -- 172.21.15.71:0/501759138 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 msgr2=0x7f4a700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 0x7f4a700a5810 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a600098a0 tx=0x7f4a6002a150 comp rx=0 tx=0).stop 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 -- 172.21.15.71:0/501759138 shutdown_connections 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a70139780 0x7f4a70139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 --2- 172.21.15.71:0/501759138 >> v2:172.21.15.71:3300/0 conn(0x7f4a700a6da0 0x7f4a700a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 --2- 172.21.15.71:0/501759138 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4a700a69c0 0x7f4a700a5810 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 -- 172.21.15.71:0/501759138 >> 172.21.15.71:0/501759138 conn(0x7f4a700abfc0 msgr2=0x7f4a700ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 -- 172.21.15.71:0/501759138 shutdown_connections 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.246+0000 7f4a7678a640 1 -- 172.21.15.71:0/501759138 wait complete. 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.247+0000 7f4a7678a640 10 monclient: build_initial_monmap 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.247+0000 7f4a7678a640 10 monclient: monmap: 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:23.256 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:23.257 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.247+0000 7f4a7678a640 1 Processor -- start 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.247+0000 7f4a7678a640 1 -- start start 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.247+0000 7f4a7678a640 10 monclient: init 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient: _add_conns ranks=[5,7,0,2,1,4,8,6,3] 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a700a69c0 0x7f4a701ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): picked mon.noname-h con 0x7f4a700a69c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a700a6da0 0x7f4a701387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): picked mon.noname-i con 0x7f4a700a6da0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 0x7f4a70138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): picked mon.noname-a con 0x7f4a70139780 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4a700a7700 con 0x7f4a70139780 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4a700a84c0 con 0x7f4a700a69c0 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4a7013a140 con 0x7f4a700a6da0 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a7678a640 10 monclient(hunting): authenticate will time out at 1101.289160s 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 0x7f4a70138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 0x7f4a70138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37068/0 (socket says 172.21.15.71:37068) 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 -- 172.21.15.71:0/729779488 learned_addr learned my addr 172.21.15.71:0/729779488 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): get_auth_request con 0x7f4a70139780 auth_method 0 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:23.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient(hunting): handle_auth_done global_id 74529 payload 824 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 -- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a700a6da0 msgr2=0x7f4a701387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a6f7fe640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a700a6da0 0x7f4a701387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a700a69c0 0x7f4a701ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a700a6da0 0x7f4a701387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 -- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a700a69c0 msgr2=0x7f4a701ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a700a69c0 0x7f4a701ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient: _finish_hunting 0 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 monclient: found mon.noname-a 2024-08-19T11:17:23.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a74d27640 1 -- 172.21.15.71:0/729779488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a700a1ec0 con 0x7f4a70139780 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a6f7fe640 10 monclient: get_auth_request con 0x7f4a700a6da0 auth_method 0 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a6f7fe640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a700a6da0 0x7f4a701387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a6ffff640 10 monclient: get_auth_request con 0x7f4a700a69c0 auth_method 0 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.248+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a700a69c0 0x7f4a701ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a74d27640 1 -- 172.21.15.71:0/729779488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 msgr2=0x7f4a70138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a74d27640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 0x7f4a70138d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800cd50 tx=0x7f4a6800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a6800fb00 con 0x7f4a70139780 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: dump: 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.265 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.266 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: _finish_auth 0 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6800fce0 con 0x7f4a70139780 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a7678a640 5 monclient: authenticate success, global_id 74529 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4a68018870 con 0x7f4a70139780 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a7678a640 10 monclient: _renew_subs 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a7678a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a70139c00 con 0x7f4a70139780 2024-08-19T11:17:23.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6cff9640 10 monclient: dump: 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:23.268 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.250+0000 7f4a6e7fc640 4 set_mon_vals no callback set 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 10 monclient: _renew_subs 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:23.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a70125bd0 con 0x7f4a70139780 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4a68018400 con 0x7f4a70139780 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.251+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a700008d0 con 0x7f4a70139780 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.252+0000 7f4a6cff9640 1 --2- 172.21.15.71:0/729779488 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03eab0 0x7f4a5c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.252+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 3898+0+0 (secure 0 0 0) 0x7f4a680529f0 con 0x7f4a70139780 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.252+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/729779488 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03eab0 0x7f4a5c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.252+0000 7f4a6ffff640 10 monclient: get_auth_request con 0x7f4a5c03eab0 auth_method 0 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.255+0000 7f4a6ffff640 1 --2- 172.21.15.71:0/729779488 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03eab0 0x7f4a5c040f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4a600098a0 tx=0x7f4a6002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:23.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.257+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f4a68014030 con 0x7f4a70139780 2024-08-19T11:17:23.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.257+0000 7f4a6cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:23.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.257+0000 7f4a6cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.499+0000 7f4a7678a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:17:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.499+0000 7f4a7678a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:17:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.499+0000 7f4a7678a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:23.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.499+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4a7013a4d0 con 0x7f4a70139780 2024-08-19T11:17:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.500+0000 7f4a6cff9640 1 -- 172.21.15.71:0/729779488 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f4a6800d370 con 0x7f4a70139780 2024-08-19T11:17:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.500+0000 7f4a6cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:17:23.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.500+0000 7f4a6cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03eab0 msgr2=0x7f4a5c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 --2- 172.21.15.71:0/729779488 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03eab0 0x7f4a5c040f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4a600098a0 tx=0x7f4a6002e000 comp rx=0 tx=0).stop 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 10 monclient: shutdown 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 msgr2=0x7f4a70138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 0x7f4a70138d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800cd50 tx=0x7f4a6800a650 comp rx=0 tx=0).stop 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 shutdown_connections 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 --2- 172.21.15.71:0/729779488 >> v2:172.21.15.135:6800/726754104 conn(0x7f4a5c03eab0 0x7f4a5c040f70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a70139780 0x7f4a70138d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4a700a6da0 0x7f4a701387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 --2- 172.21.15.71:0/729779488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4a700a69c0 0x7f4a701ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.502+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 >> 172.21.15.71:0/729779488 conn(0x7f4a700abfc0 msgr2=0x7f4a700ab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.503+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 shutdown_connections 2024-08-19T11:17:23.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:23.503+0000 7f4a7678a640 1 -- 172.21.15.71:0/729779488 wait complete. 2024-08-19T11:17:23.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:17:23.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=1698077578,config=2586702516,health=3334251417,kv=3646823213,logm=1195543373}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=2695103296,config=2586702516,health=2619282021,kv=3646823213,logm=2052231163}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=1783044288,config=2586702516,health=2234713017,kv=3646823213,logm=556882055}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=15,config=2,health=11,kv=10,logm=62} crc {auth=3847977715,config=2586702516,health=3160483489,kv=3561258669,logm=1308800196}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=14,config=1,health=9,kv=12,logm=64} crc {auth=2811622232,config=1228700967,health=1841081331,kv=3646823213,logm=328369395}) 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=14,config=2,health=12,kv=11,logm=61} crc {auth=4116337391,config=2586702516,health=3334251417,kv=1566686170,logm=2901747504}) 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1169473669,config=2586702516,health=1688807597,kv=1111774046,logm=2423003536}) 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=10,kv=12,logm=61} crc {auth=3847977715,config=2586702516,health=1704015717,kv=3646823213,logm=2850206448}) 2024-08-19T11:17:23.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:23.806+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=3847977715,config=2586702516,health=3334251417,kv=3646823213,logm=2318351741}) 2024-08-19T11:17:24.269 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.269 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.269 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2937673174}) 2024-08-19T11:17:24.269 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.270 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.270 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3230163288}) 2024-08-19T11:17:24.270 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.270 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.270 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462199844}) 2024-08-19T11:17:24.270 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.271 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.271 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3656828078}) 2024-08-19T11:17:24.271 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.271 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.271 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=870172826}) 2024-08-19T11:17:24.272 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.272 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.272 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1582595990}) 2024-08-19T11:17:24.272 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.272 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.272 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3374640659}) 2024-08-19T11:17:24.273 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.273 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632752927}) 2024-08-19T11:17:24.273 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.265+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3019086597}) 2024-08-19T11:17:24.275 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.276 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.276 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2704312959}) 2024-08-19T11:17:24.276 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.276 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.277 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1768397325}) 2024-08-19T11:17:24.277 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.277 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.277 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2677401699}) 2024-08-19T11:17:24.277 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.277 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.278 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2507565973}) 2024-08-19T11:17:24.278 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.278 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.278 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=577393279}) 2024-08-19T11:17:24.278 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=883999625}) 2024-08-19T11:17:24.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1421902676}) 2024-08-19T11:17:24.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=335283810}) 2024-08-19T11:17:24.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.273+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1601115142}) 2024-08-19T11:17:24.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942433056}) 2024-08-19T11:17:24.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=225901052}) 2024-08-19T11:17:24.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1016609136}) 2024-08-19T11:17:24.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2488429615}) 2024-08-19T11:17:24.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=696641752}) 2024-08-19T11:17:24.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3852859235}) 2024-08-19T11:17:24.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=500405708}) 2024-08-19T11:17:24.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856854883}) 2024-08-19T11:17:24.326 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=842253952}) 2024-08-19T11:17:24.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3759777163}) 2024-08-19T11:17:24.329 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3593467915}) 2024-08-19T11:17:24.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.330 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3927063861}) 2024-08-19T11:17:24.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.332 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=843084250}) 2024-08-19T11:17:24.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1102696423}) 2024-08-19T11:17:24.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.333 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=851068732}) 2024-08-19T11:17:24.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1882988547}) 2024-08-19T11:17:24.334 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202109409}) 2024-08-19T11:17:24.335 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.323+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3586072361}) 2024-08-19T11:17:24.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.337 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2187288285}) 2024-08-19T11:17:24.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1481230106}) 2024-08-19T11:17:24.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.338 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2465259541}) 2024-08-19T11:17:24.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1888777315}) 2024-08-19T11:17:24.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.339 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1324434073}) 2024-08-19T11:17:24.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3968712623}) 2024-08-19T11:17:24.340 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=164822109}) 2024-08-19T11:17:24.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3632845764}) 2024-08-19T11:17:24.341 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.333+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1394311846}) 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: starting. 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27096 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: created object 0... 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: created object 25... 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: created object 49... 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: finishing. 2024-08-19T11:17:24.423 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27249]: shutting down. 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27251]: starting. 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27251]: listing objects. 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27251]: listed object 0... 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27251]: listed object 25... 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27251]: saw 50 objects 2024-08-19T11:17:24.460 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27251]: shutting down. 2024-08-19T11:17:24.515 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:17:24.516 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:17:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.611+0000 7f250f29f640 10 monclient: get_monmap_and_config 2024-08-19T11:17:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.611+0000 7f250f29f640 10 monclient: build_initial_monmap 2024-08-19T11:17:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.611+0000 7f250f29f640 10 monclient: monmap: 2024-08-19T11:17:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:24.612073+0000 2024-08-19T11:17:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:24.612073+0000 2024-08-19T11:17:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.614 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:24.615 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:24.616 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:24.616 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:24.616 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:24.616 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:24.616 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 Processor -- start 2024-08-19T11:17:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 -- start start 2024-08-19T11:17:24.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient: init 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient: _add_conns ranks=[3,10,5,6,2,1,0,9,8,7,4] 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25080a6a30 0x7f25080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): picked mon.noname-g con 0x7f25080a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25080a6e10 0x7f25080a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): picked mon.noname-f con 0x7f25080a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 0x7f2508139c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): picked mon.noname-h con 0x7f25081397f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:24.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f25080a3650 con 0x7f25080a6e10 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f25080a5d50 con 0x7f25080a6a30 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f25080a4cb0 con 0x7f25081397f0 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.612+0000 7f250f29f640 10 monclient(hunting): authenticate will time out at 1102.653747s 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25080a6a30 0x7f25080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 0x7f2508139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25080a6e10 0x7f25080a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 0x7f2508139c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:58950/0 (socket says 172.21.15.71:58950) 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 -- 172.21.15.71:0/963103852 learned_addr learned my addr 172.21.15.71:0/963103852 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:24.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): get_auth_request con 0x7f25080a6e10 auth_method 0 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 1 --2- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25080a6a30 0x7f25080a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:47764/0 (socket says 172.21.15.71:47764) 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): get_auth_request con 0x7f25081397f0 auth_method 0 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): get_auth_request con 0x7f25080a6a30 auth_method 0 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:24.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d03b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient(hunting): handle_auth_done global_id 45176 payload 274 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 -- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25080a6a30 msgr2=0x7f25080a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 --2- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25080a6a30 0x7f25080a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 -- 172.21.15.71:0/963103852 >> v2:172.21.15.135:3300/0 conn(0x7f25080a6e10 msgr2=0x7f25080a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:24.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 --2- 172.21.15.71:0/963103852 >> v2:172.21.15.135:3300/0 conn(0x7f25080a6e10 0x7f25080a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 monclient: found mon.noname-h 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250d83c640 1 -- 172.21.15.71:0/963103852 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25080a4f90 con 0x7f25081397f0 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.613+0000 7f250c83a640 1 --2- 172.21.15.71:0/963103852 >> v2:172.21.15.135:3300/0 conn(0x7f25080a6e10 0x7f25080a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f250d83c640 1 -- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 msgr2=0x7f2508139c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f250d83c640 1 --2- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 0x7f2508139c70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f24f80098a0 tx=0x7f24f802a0d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=63edd2f295b2c058 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 1 -- 172.21.15.71:0/963103852 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24f8037070 con 0x7f25081397f0 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: dump: 2024-08-19T11:17:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:24.636 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: _finish_auth 0 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 1 -- 172.21.15.71:0/963103852 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f802adf0 con 0x7f25081397f0 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 1 -- 172.21.15.71:0/963103852 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24f8030c20 con 0x7f25081397f0 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f250f29f640 5 monclient: authenticate success, global_id 45176 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f250f29f640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f250f29f640 4 set_mon_vals no callback set 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:24.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.616+0000 7f2507fff640 10 monclient: dump: 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:24.638 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 10 monclient: shutdown 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 -- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 msgr2=0x7f2508139c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 --2- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 0x7f2508139c70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f24f80098a0 tx=0x7f24f802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 -- 172.21.15.71:0/963103852 shutdown_connections 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 --2- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25081397f0 0x7f2508139c70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 --2- 172.21.15.71:0/963103852 >> v2:172.21.15.135:3300/0 conn(0x7f25080a6e10 0x7f25080a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 --2- 172.21.15.71:0/963103852 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25080a6a30 0x7f25080a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 -- 172.21.15.71:0/963103852 >> 172.21.15.71:0/963103852 conn(0x7f25080ac030 msgr2=0x7f25080ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:24.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 -- 172.21.15.71:0/963103852 shutdown_connections 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 1 -- 172.21.15.71:0/963103852 wait complete. 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 10 monclient: build_initial_monmap 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.617+0000 7f250f29f640 10 monclient: monmap: 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:24.640 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 Processor -- start 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 -- start start 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient: init 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient: _add_conns ranks=[0,8,6,1,5,3,7,2,4] 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25080a6a30 0x7f25081ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): picked mon.noname-a con 0x7f25080a6a30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 0x7f2508138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): picked mon.noname-e con 0x7f25080a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25081397f0 0x7f2508139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): picked mon.noname-d con 0x7f25081397f0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f25080a87d0 con 0x7f25080a6a30 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f25080a8590 con 0x7f25081397f0 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f25080a7730 con 0x7f25080a6e10 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:24.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250f29f640 10 monclient(hunting): authenticate will time out at 1102.659721s 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 0x7f2508138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25080a6a30 0x7f25081ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25081397f0 0x7f2508139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 0x7f2508138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:35656/0 (socket says 172.21.15.71:35656) 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 1 -- 172.21.15.71:0/2332337006 learned_addr learned my addr 172.21.15.71:0/2332337006 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): get_auth_request con 0x7f25080a6e10 auth_method 0 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): get_auth_request con 0x7f25080a6a30 auth_method 0 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:24.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): get_auth_request con 0x7f25081397f0 auth_method 0 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250c83a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d03b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:24.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.618+0000 7f250d83c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 10 monclient(hunting): handle_auth_done global_id 64880 payload 824 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 1 -- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25081397f0 msgr2=0x7f2508139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25081397f0 0x7f2508139190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 1 -- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25080a6a30 msgr2=0x7f25081ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25080a6a30 0x7f25081ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 10 monclient: _finish_hunting 0 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 1 monclient: found mon.noname-e 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250c83a640 1 -- 172.21.15.71:0/2332337006 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25080a1f00 con 0x7f25080a6e10 2024-08-19T11:17:24.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.619+0000 7f250d03b640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25080a6a30 0x7f25081ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250c83a640 1 -- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 msgr2=0x7f2508138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250c83a640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 0x7f2508138c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00ebe0 tx=0x7f24fc00c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24fc017070 con 0x7f25080a6e10 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: dump: 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.646 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:24.647 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc00ce40 con 0x7f25080a6e10 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 5 monclient: authenticate success, global_id 64880 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 10 monclient: _renew_subs 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2508126330 con 0x7f25080a6e10 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f24fc013d50 con 0x7f25080a6e10 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:24.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f2505ffb640 10 monclient: dump: 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:24.649 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 10 monclient: _renew_subs 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2508124e10 con 0x7f25080a6e10 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.621+0000 7f25077fe640 4 set_mon_vals no callback set 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.622+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f24fc01a070 con 0x7f25080a6e10 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.622+0000 7f250f29f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:24.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.622+0000 7f250f29f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.622+0000 7f250f29f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.622+0000 7f2505ffb640 1 --2- 172.21.15.71:0/2332337006 >> v2:172.21.15.135:6800/726754104 conn(0x7f24f403ea80 0x7f24f4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.622+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25080a7510 con 0x7f25080a6e10 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.623+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (secure 0 0 0) 0x7f24fc00f040 con 0x7f25080a6e10 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.623+0000 7f250d03b640 1 --2- 172.21.15.71:0/2332337006 >> v2:172.21.15.135:6800/726754104 conn(0x7f24f403ea80 0x7f24f4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.623+0000 7f250d03b640 10 monclient: get_auth_request con 0x7f24f403ea80 auth_method 0 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.625+0000 7f250d03b640 1 --2- 172.21.15.71:0/2332337006 >> v2:172.21.15.135:6800/726754104 conn(0x7f24f403ea80 0x7f24f4040f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2500009fd0 tx=0x7f250000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.627+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f25080a7510 con 0x7f25080a6e10 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.627+0000 7f2505ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:24.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.627+0000 7f2505ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f250f29f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f250f29f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f250f29f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2508077270 con 0x7f25080a6e10 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f2505ffb640 1 -- 172.21.15.71:0/2332337006 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f2508077270 con 0x7f25080a6e10 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f2505ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:24.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.870+0000 7f2505ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:24.872 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":154,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:17:24.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 >> v2:172.21.15.135:6800/726754104 conn(0x7f24f403ea80 msgr2=0x7f24f4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 --2- 172.21.15.71:0/2332337006 >> v2:172.21.15.135:6800/726754104 conn(0x7f24f403ea80 0x7f24f4040f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2500009fd0 tx=0x7f250000b040 comp rx=0 tx=0).stop 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 10 monclient: shutdown 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 msgr2=0x7f2508138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 0x7f2508138c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00ebe0 tx=0x7f24fc00c520 comp rx=0 tx=0).stop 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 shutdown_connections 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 --2- 172.21.15.71:0/2332337006 >> v2:172.21.15.135:6800/726754104 conn(0x7f24f403ea80 0x7f24f4040f40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25081397f0 0x7f2508139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f25080a6e10 0x7f2508138c50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 --2- 172.21.15.71:0/2332337006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25080a6a30 0x7f25081ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:24.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 >> 172.21.15.71:0/2332337006 conn(0x7f25080ac030 msgr2=0x7f25081c1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:24.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 shutdown_connections 2024-08-19T11:17:24.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f250f29f640 1 -- 172.21.15.71:0/2332337006 wait complete. 2024-08-19T11:17:24.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2699396142}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2816233922}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3322548509}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=639920566}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2881923474}) 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2076929754}) 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2439953384}) 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928109139}) 2024-08-19T11:17:24.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3182502819}) 2024-08-19T11:17:24.885 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:17:24.885 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:17:24.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:17:24.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=828264565}) 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=145375067}) 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.976 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3019734785}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2771655096}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2853605635}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2882923937}) 2024-08-19T11:17:24.977 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.978 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.978 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2426584554}) 2024-08-19T11:17:24.978 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.978 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365436539}) 2024-08-19T11:17:24.978 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.974+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2751366299}) 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2080777161}) 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=988923145}) 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1471889973}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1865874642}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3539137272}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=253221934}) 2024-08-19T11:17:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1890870203}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3192764541}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=396572377}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=61260121}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1467541570}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=437907207}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2628017235}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2559542873}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1241738981}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427308578}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2599979769}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=410994144}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=588116986}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=460085762}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2151127065}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4279206408}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=250430008}) 2024-08-19T11:17:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1876608880}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978956444}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.979+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272210175}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.979+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1156189540}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1401021746}) 2024-08-19T11:17:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1091138179}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2442373272}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1674588359}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3745955751}) 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1999862904}) 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1475195088}) 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4179579460}) 2024-08-19T11:17:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=380615989}) 2024-08-19T11:17:24.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.984+0000 7f63de3b1640 10 monclient: get_monmap_and_config 2024-08-19T11:17:24.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.984+0000 7f63de3b1640 10 monclient: build_initial_monmap 2024-08-19T11:17:24.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.984+0000 7f63de3b1640 10 monclient: monmap: 2024-08-19T11:17:24.996 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:24.984863+0000 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:24.984863+0000 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:24.997 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:24.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.984+0000 7f63de3b1640 1 Processor -- start 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 -- start start 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient: init 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient: _add_conns ranks=[4,8,6,0,5,10,7,3,1,9,2] 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a47c0 0x7f63d80a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): picked mon.noname-c con 0x7f63d80a47c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 0x7f63d8139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): picked mon.noname-e con 0x7f63d80a50e0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d8139eb0 0x7f63d813a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): picked mon.noname-d con 0x7f63d8139eb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:24.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f63d80a1540 con 0x7f63d80a47c0 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f63d80a32a0 con 0x7f63d8139eb0 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f63d806cc40 con 0x7f63d80a50e0 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63de3b1640 10 monclient(hunting): authenticate will time out at 1103.026546s 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a47c0 0x7f63d80a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d8139eb0 0x7f63d813a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 0x7f63d8139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d8139eb0 0x7f63d813a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:39836/0 (socket says 172.21.15.71:39836) 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): get_auth_request con 0x7f63d80a50e0 auth_method 0 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 1 -- 172.21.15.71:0/2157837659 learned_addr learned my addr 172.21.15.71:0/2157837659 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): get_auth_request con 0x7f63d80a47c0 auth_method 0 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): get_auth_request con 0x7f63d8139eb0 auth_method 0 2024-08-19T11:17:25.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63dc94e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient(hunting): handle_auth_done global_id 64889 payload 274 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 -- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d8139eb0 msgr2=0x7f63d813a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d8139eb0 0x7f63d813a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 -- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a47c0 msgr2=0x7f63d80a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a47c0 0x7f63d80a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 monclient: found mon.noname-e 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d77fe640 1 -- 172.21.15.71:0/2157837659 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d80a6380 con 0x7f63d80a50e0 2024-08-19T11:17:25.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.985+0000 7f63d7fff640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a47c0 0x7f63d80a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:25.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2348016311}) 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1251585804}) 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2891707561}) 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2260837325}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3833520290}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2028175147}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53793681}) 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443005967}) 2024-08-19T11:17:25.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:24.986+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3483475437}) 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.988+0000 7f63d77fe640 1 -- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 msgr2=0x7f63d8139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.988+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 0x7f63d8139970 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009800 tx=0x7f63c0029fe0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b43afaa4c751a8c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2157837659 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c0037070 con 0x7f63d80a50e0 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: dump: 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.019 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.020 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2157837659 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c002ad00 con 0x7f63d80a50e0 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 5 monclient: authenticate success, global_id 64889 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:25.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2157837659 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c0030c20 con 0x7f63d80a50e0 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 4 set_mon_vals no callback set 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63d6ffd640 10 monclient: dump: 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.022 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.023 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 10 monclient: shutdown 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 1 -- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 msgr2=0x7f63d8139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.989+0000 7f63de3b1640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 0x7f63d8139970 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009800 tx=0x7f63c0029fe0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 -- 172.21.15.71:0/2157837659 shutdown_connections 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d8139eb0 0x7f63d813a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d80a50e0 0x7f63d8139970 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 --2- 172.21.15.71:0/2157837659 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a47c0 0x7f63d80a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 -- 172.21.15.71:0/2157837659 >> 172.21.15.71:0/2157837659 conn(0x7f63d80a9470 msgr2=0x7f63d80a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 -- 172.21.15.71:0/2157837659 shutdown_connections 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 1 -- 172.21.15.71:0/2157837659 wait complete. 2024-08-19T11:17:25.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.990+0000 7f63de3b1640 10 monclient: monmap: 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.025 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 Processor -- start 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 -- start start 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient: init 2024-08-19T11:17:25.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient: _add_conns ranks=[5,3,8,1,2,4,7,0,6] 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d80a47c0 0x7f63d8126160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): picked mon.noname-h con 0x7f63d80a47c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a50e0 0x7f63d81266a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): picked mon.noname-g con 0x7f63d80a50e0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 0x7f63d8126be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): picked mon.noname-e con 0x7f63d8139eb0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f63d80a5500 con 0x7f63d80a50e0 2024-08-19T11:17:25.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f63d806cfd0 con 0x7f63d80a47c0 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f63d806d300 con 0x7f63d8139eb0 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63de3b1640 10 monclient(hunting): authenticate will time out at 1103.032732s 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 0x7f63d8126be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 0x7f63d8126be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:34010/0 (socket says 172.21.15.71:34010) 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 1 -- 172.21.15.71:0/561808994 learned_addr learned my addr 172.21.15.71:0/561808994 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): get_auth_request con 0x7f63d8139eb0 auth_method 0 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63dc94e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d7fff640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d80a47c0 0x7f63d8126160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d7fff640 10 monclient(hunting): get_auth_request con 0x7f63d80a47c0 auth_method 0 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d77fe640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a50e0 0x7f63d81266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d77fe640 10 monclient(hunting): get_auth_request con 0x7f63d80a50e0 auth_method 0 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.991+0000 7f63d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 10 monclient(hunting): handle_auth_done global_id 64898 payload 824 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d80a47c0 msgr2=0x7f63d8126160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f63d80a47c0 0x7f63d8126160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a50e0 msgr2=0x7f63d81266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a50e0 0x7f63d81266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 1 monclient: found mon.noname-e 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.992+0000 7f63dc94e640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d8128f30 con 0x7f63d8139eb0 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63dc94e640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 msgr2=0x7f63d8126be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63dc94e640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 0x7f63d8126be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63d000efc0 tx=0x7f63d000c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63d0003e00 con 0x7f63d8139eb0 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: dump: 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.032 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.033 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 5 monclient: authenticate success, global_id 64898 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d000cd30 con 0x7f63d8139eb0 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 10 monclient: _renew_subs 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d812a1c0 con 0x7f63d8139eb0 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63d00044a0 con 0x7f63d8139eb0 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d4ff9640 10 monclient: dump: 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.035 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63d67fc640 4 set_mon_vals no callback set 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 10 monclient: _renew_subs 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.994+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d80a3e00 con 0x7f63d8139eb0 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63de3b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63de3b1640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 0x7f63d809d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63d8076c60 con 0x7f63d809d2f0 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f63d0005d10 con 0x7f63d8139eb0 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 0x7f63d809d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient: get_auth_request con 0x7f63d809d2f0 auth_method 0 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d4ff9640 1 --2- 172.21.15.71:0/561808994 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803ea80 0x7f63b8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (secure 0 0 0) 0x7f63d0052040 con 0x7f63d8139eb0 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 10 monclient(hunting): handle_auth_done global_id 74547 payload 824 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d7fff640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63d809fab0 con 0x7f63d809d2f0 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d77fe640 1 --2- 172.21.15.71:0/561808994 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803ea80 0x7f63b8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.995+0000 7f63d77fe640 10 monclient: get_auth_request con 0x7f63b803ea80 auth_method 0 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.997+0000 7f63d7fff640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 msgr2=0x7f63d809d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.997+0000 7f63d7fff640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 0x7f63d809d6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63c80118e0 tx=0x7f63c8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c80148b0 con 0x7f63d809d2f0 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 10 monclient: dump: 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.039 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f63c8014440 con 0x7f63d809d2f0 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 msgr2=0x7f63d809d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 0x7f63d809d6d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63c80118e0 tx=0x7f63c8011da0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 msgr2=0x7f63d809d6d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d4ff9640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809d2f0 0x7f63d809d6d0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63c80118e0 tx=0x7f63c8011da0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:24.998+0000 7f63d77fe640 1 --2- 172.21.15.71:0/561808994 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803ea80 0x7f63b8040f40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f63c0034000 tx=0x7f63c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63de3b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63de3b1640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 0x7f63d81d87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63de3b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63d813a450 con 0x7f63d809dc10 2024-08-19T11:17:25.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 0x7f63d81d87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient: get_auth_request con 0x7f63d809dc10 auth_method 0 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 10 monclient(hunting): handle_auth_done global_id 74556 payload 824 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.004+0000 7f63d7fff640 1 -- 172.21.15.71:0/561808994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63d8127a40 con 0x7f63d809dc10 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d7fff640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 msgr2=0x7f63d81d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d7fff640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 0x7f63d81d87d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f63c80118e0 tx=0x7f63c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c8022bf0 con 0x7f63d809dc10 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 10 monclient: dump: 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.043 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9269 (secure 0 0 0) 0x7f63c802b3b0 con 0x7f63d809dc10 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 msgr2=0x7f63d81d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 0x7f63d81d87d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f63c80118e0 tx=0x7f63c80046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 msgr2=0x7f63d81d87d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63d4ff9640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63d809dc10 0x7f63d81d87d0 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f63c80118e0 tx=0x7f63c80046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 94040, 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:25.045 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:17:25.046 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.047 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:25.073 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803ea80 msgr2=0x7f63b8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 --2- 172.21.15.71:0/561808994 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803ea80 0x7f63b8040f40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f63c0034000 tx=0x7f63c002e000 comp rx=0 tx=0).stop 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 10 monclient: shutdown 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 msgr2=0x7f63d8126be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63dc94e640 1 -- 172.21.15.71:0/561808994 reap_dead start 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 0x7f63d8126be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63d000efc0 tx=0x7f63d000c490 comp rx=0 tx=0).stop 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 shutdown_connections 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 --2- 172.21.15.71:0/561808994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8139eb0 0x7f63d8126be0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 >> 172.21.15.71:0/561808994 conn(0x7f63d80a9470 msgr2=0x7f63d809f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 shutdown_connections 2024-08-19T11:17:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.007+0000 7f63de3b1640 1 -- 172.21.15.71:0/561808994 wait complete. 2024-08-19T11:17:25.076 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:25.076 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:17:25.076 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.174+0000 7f4fb15e2640 10 monclient: get_monmap_and_config 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.174+0000 7f4fb15e2640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.174+0000 7f4fb15e2640 10 monclient: monmap: 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:25.174905+0000 2024-08-19T11:17:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:25.174905+0000 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:25.176 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.174+0000 7f4fb15e2640 1 Processor -- start 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.174+0000 7f4fb15e2640 1 -- start start 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.174+0000 7f4fb15e2640 10 monclient: init 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient: _add_conns ranks=[1,8,9,3,6,5,10,4,0,2,7] 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4fac0a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a57c0 0x7f4fac13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): picked mon.noname-e con 0x7f4fac0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4fac0a7440 0x7f4fac1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): picked mon.noname-a con 0x7f4fac0a7440 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac0a6380 con 0x7f4fac0a6950 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f4fac0a5020 con 0x7f4fac0a7440 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4fac0a7d40 con 0x7f4fac0a57c0 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fb15e2640 10 monclient(hunting): authenticate will time out at 1103.216492s 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a57c0 0x7f4fac13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4fac0a7440 0x7f4fac1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a57c0 0x7f4fac13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:34024/0 (socket says 172.21.15.71:34024) 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 1 -- 172.21.15.71:0/450696716 learned_addr learned my addr 172.21.15.71:0/450696716 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): get_auth_request con 0x7f4fac0a7440 auth_method 0 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): get_auth_request con 0x7f4fac0a57c0 auth_method 0 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4faa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_done global_id 74565 payload 274 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 1 -- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a57c0 msgr2=0x7f4fac13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 1 --2- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a57c0 0x7f4fac13eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 1 -- 172.21.15.71:0/450696716 >> v1:172.21.15.135:6789/0 conn(0x7f4fac0a6950 legacy=0x7f4fac0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 1 monclient: found mon.noname-a 2024-08-19T11:17:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.175+0000 7f4fab7fe640 1 -- 172.21.15.71:0/450696716 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac0a3650 con 0x7f4fac0a7440 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fab7fe640 1 -- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac0a7440 msgr2=0x7f4fac1410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fab7fe640 1 --2- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac0a7440 0x7f4fac1410b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40097d0 tx=0x7f4fa402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d15b0a641c00cd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 1 -- 172.21.15.71:0/450696716 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4fa4037070 con 0x7f4fac0a7440 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: dump: 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.191 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fb15e2640 5 monclient: authenticate success, global_id 74565 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 1 -- 172.21.15.71:0/450696716 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa402ad20 con 0x7f4fac0a7440 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fb15e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fb15e2640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 1 -- 172.21.15.71:0/450696716 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4fa4030c20 con 0x7f4fac0a7440 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fb15e2640 4 set_mon_vals no callback set 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.178+0000 7f4fa9ffb640 10 monclient: dump: 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 10 monclient: shutdown 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 -- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac0a7440 msgr2=0x7f4fac1410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac0a7440 0x7f4fac1410b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40097d0 tx=0x7f4fa402a000 comp rx=0 tx=0).stop 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 -- 172.21.15.71:0/450696716 shutdown_connections 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fac0a7440 0x7f4fac1410b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/450696716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a57c0 0x7f4fac13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 -- 172.21.15.71:0/450696716 >> 172.21.15.71:0/450696716 conn(0x7f4fac0abf50 msgr2=0x7f4fac0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 -- 172.21.15.71:0/450696716 shutdown_connections 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.179+0000 7f4fb15e2640 1 -- 172.21.15.71:0/450696716 wait complete. 2024-08-19T11:17:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 10 monclient: monmap: 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.196 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 1 Processor -- start 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 1 -- start start 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 10 monclient: init 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 10 monclient: _add_conns ranks=[3,4,8,1,0,5,2,7,6] 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.180+0000 7f4fb15e2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fac0a57c0 0x7f4fac128a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): picked mon.noname-g con 0x7f4fac0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4fac0a6950 0x7f4fac1ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): picked mon.noname-c con 0x7f4fac0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 0x7f4fac126590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): picked mon.noname-e con 0x7f4fac0a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac0a8700 con 0x7f4fac0a57c0 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f4fac0a84c0 con 0x7f4fac0a6950 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f4fac1415f0 con 0x7f4fac0a7440 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fb15e2640 10 monclient(hunting): authenticate will time out at 1103.222068s 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4fac0a6950 0x7f4fac1ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 0x7f4fac126590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4fac0a6950 0x7f4fac1ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50618/0 (socket says 172.21.15.71:50618) 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 1 -- 172.21.15.71:0/1084426615 learned_addr learned my addr 172.21.15.71:0/1084426615 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): get_auth_request con 0x7f4fac0a6950 auth_method 0 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): get_auth_request con 0x7f4fac0a7440 auth_method 0 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient(hunting): handle_auth_done global_id 64916 payload 824 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4fac0a6950 msgr2=0x7f4fac1ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4fac0a6950 0x7f4fac1ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fac0a57c0 msgr2=0x7f4fac128a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4faaffd640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fac0a57c0 0x7f4fac128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4fac0a57c0 0x7f4fac128a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 monclient: found mon.noname-e 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.181+0000 7f4fab7fe640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac129f30 con 0x7f4fac0a7440 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fab7fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 msgr2=0x7f4fac126590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fab7fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 0x7f4fac126590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4034000 tx=0x7f4fa40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4fa4040020 con 0x7f4fac0a7440 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: dump: 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.201 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.202 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa4038040 con 0x7f4fac0a7440 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 5 monclient: authenticate success, global_id 64916 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 10 monclient: _renew_subs 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac141280 con 0x7f4fac0a7440 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4fa4037070 con 0x7f4fac0a7440 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa37fe640 10 monclient: dump: 2024-08-19T11:17:25.203 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.204 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fa97fa640 4 set_mon_vals no callback set 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 10 monclient: _renew_subs 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.183+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac12a210 con 0x7f4fac0a7440 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4fb15e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 0x7f4fac126ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac06a590 con 0x7f4fac1cf0b0 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4fa4043020 con 0x7f4fac0a7440 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4faaffd640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 0x7f4fac126ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4faaffd640 10 monclient: get_auth_request con 0x7f4fac1cf0b0 auth_method 0 2024-08-19T11:17:25.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4faaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4faaffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.184+0000 7f4faaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4fa37fe640 1 --2- 172.21.15.71:0/1084426615 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f8c03ea80 0x7f4f8c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (secure 0 0 0) 0x7f4fa4071b50 con 0x7f4fac0a7440 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faaffd640 10 monclient(hunting): handle_auth_done global_id 74513 payload 824 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faaffd640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fac0a93a0 con 0x7f4fac1cf0b0 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faa7fc640 1 --2- 172.21.15.71:0/1084426615 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f8c03ea80 0x7f4f8c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.185+0000 7f4faa7fc640 10 monclient: get_auth_request con 0x7f4f8c03ea80 auth_method 0 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4faaffd640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 msgr2=0x7f4fac126ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4faaffd640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 0x7f4fac126ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d6f0 tx=0x7f4f9c00dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f9c016070 con 0x7f4fac1cf0b0 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 10 monclient: dump: 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.207 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4f9c00de00 con 0x7f4fac1cf0b0 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 msgr2=0x7f4fac126ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 0x7f4fac126ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d6f0 tx=0x7f4f9c00dbb0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 msgr2=0x7f4fac126ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4fa37fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac1cf0b0 0x7f4fac126ad0 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d6f0 tx=0x7f4f9c00dbb0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.187+0000 7f4faa7fc640 1 --2- 172.21.15.71:0/1084426615 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f8c03ea80 0x7f4f8c040f40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0a3c00 tx=0x7f4f94009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.193+0000 7f4fb15e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.193+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 0x7f4fac1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.193+0000 7f4fb15e2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.193+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac1c6480 con 0x7f4fac127010 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 0x7f4fac1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient: get_auth_request con 0x7f4fac127010 auth_method 0 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 10 monclient(hunting): handle_auth_done global_id 74522 payload 824 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.194+0000 7f4faaffd640 1 -- 172.21.15.71:0/1084426615 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4fac127420 con 0x7f4fac127010 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4faaffd640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 msgr2=0x7f4fac1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4faaffd640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 0x7f4fac1225a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d6f0 tx=0x7f4f9c003a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f9c012860 con 0x7f4fac127010 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 10 monclient: dump: 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f4f9c0123f0 con 0x7f4fac127010 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 msgr2=0x7f4fac1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 0x7f4fac1225a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d6f0 tx=0x7f4f9c003a70 comp rx=0 tx=0).stop 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 msgr2=0x7f4fac1225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.196+0000 7f4fa37fe640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fac127010 0x7f4fac1225a0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d6f0 tx=0x7f4f9c003a70 comp rx=0 tx=0).stop 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 94228, 2024-08-19T11:17:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:25.221 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.224 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.227 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:25.228 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.231 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:25.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:25.237 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f8c03ea80 msgr2=0x7f4f8c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/1084426615 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f8c03ea80 0x7f4f8c040f40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0a3c00 tx=0x7f4f94009240 comp rx=0 tx=0).stop 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 10 monclient: shutdown 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 msgr2=0x7f4fac126590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fab7fe640 1 -- 172.21.15.71:0/1084426615 reap_dead start 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 0x7f4fac126590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4034000 tx=0x7f4fa40046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 shutdown_connections 2024-08-19T11:17:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 --2- 172.21.15.71:0/1084426615 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f4fac0a7440 0x7f4fac126590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 >> 172.21.15.71:0/1084426615 conn(0x7f4fac0abf50 msgr2=0x7f4fac09d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 shutdown_connections 2024-08-19T11:17:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.197+0000 7f4fb15e2640 1 -- 172.21.15.71:0/1084426615 wait complete. 2024-08-19T11:17:25.240 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:25.240 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:17:25.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:17:25.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=10055809}) 2024-08-19T11:17:25.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.279 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3065712817}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3576673012}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3529301748}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=79839331}) 2024-08-19T11:17:25.280 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2061127536}) 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385246238}) 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3499684013}) 2024-08-19T11:17:25.281 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.276+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1646595438}) 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3956147116}) 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4083369478}) 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2989746212}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3697363058}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2732670005}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=592679491}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1676801947}) 2024-08-19T11:17:25.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.295 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086354773}) 2024-08-19T11:17:25.295 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.290+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3134586388}) 2024-08-19T11:17:25.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=651856624}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=953460880}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1265199008}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.311+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4088078645}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4237365115}) 2024-08-19T11:17:25.314 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2029126504}) 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2087170015}) 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442156145}) 2024-08-19T11:17:25.315 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.312+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2906553937}) 2024-08-19T11:17:25.320 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.321 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.321 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:25.321 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27250]: starting. 2024-08-19T11:17:25.321 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27250]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27096 2024-08-19T11:17:25.322 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27250]: shutting down. 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=653745132}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1854001039}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=362883054}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3239141061}) 2024-08-19T11:17:25.324 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2771220524}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=364300921}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=862310148}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715259565}) 2024-08-19T11:17:25.325 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2565188552}) 2024-08-19T11:17:25.326 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:25.326 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:25.327 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:17:25.327 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.351+0000 7f125b563640 10 monclient: get_monmap_and_config 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.351+0000 7f125b563640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.351+0000 7f125b563640 10 monclient: monmap: 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:25.352197+0000 2024-08-19T11:17:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:25.352197+0000 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:25.353 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:25.354 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 Processor -- start 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 -- start start 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient: init 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient: _add_conns ranks=[4,10,3,2,0,8,7,9,5,6,1] 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 0x7f12540a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): picked mon.noname-c con 0x7f12540a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f12540a57c0 0x7f12540a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): picked mon.noname-f con 0x7f12540a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1254139710 0x7f1254139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): picked mon.noname-g con 0x7f1254139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f12540a5020 con 0x7f12540a57c0 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f12540a77b0 con 0x7f1254139710 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f12540a7d40 con 0x7f12540a6950 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f125b563640 10 monclient(hunting): authenticate will time out at 1103.393852s 2024-08-19T11:17:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.352+0000 7f12592ff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 0x7f12540a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 0x7f12540a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50624/0 (socket says 172.21.15.71:50624) 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 -- 172.21.15.71:0/3296378169 learned_addr learned my addr 172.21.15.71:0/3296378169 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): get_auth_request con 0x7f12540a6950 auth_method 0 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 1 --2- 172.21.15.71:0/3296378169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1254139710 0x7f1254139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1258afe640 1 --2- 172.21.15.71:0/3296378169 >> v2:172.21.15.135:3300/0 conn(0x7f12540a57c0 0x7f12540a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): get_auth_request con 0x7f1254139710 auth_method 0 2024-08-19T11:17:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1258afe640 10 monclient(hunting): get_auth_request con 0x7f12540a57c0 auth_method 0 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1258afe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1258afe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1258afe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1259b00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient(hunting): handle_auth_done global_id 84235 payload 274 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 -- 172.21.15.71:0/3296378169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1254139710 msgr2=0x7f1254139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 --2- 172.21.15.71:0/3296378169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1254139710 0x7f1254139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 -- 172.21.15.71:0/3296378169 >> v2:172.21.15.135:3300/0 conn(0x7f12540a57c0 msgr2=0x7f12540a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 --2- 172.21.15.71:0/3296378169 >> v2:172.21.15.135:3300/0 conn(0x7f12540a57c0 0x7f12540a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 monclient: found mon.noname-c 2024-08-19T11:17:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f12592ff640 1 -- 172.21.15.71:0/3296378169 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12540a6380 con 0x7f12540a6950 2024-08-19T11:17:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.353+0000 7f1258afe640 1 --2- 172.21.15.71:0/3296378169 >> v2:172.21.15.135:3300/0 conn(0x7f12540a57c0 0x7f12540a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f12592ff640 1 -- 172.21.15.71:0/3296378169 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 msgr2=0x7f12540a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f12592ff640 1 --2- 172.21.15.71:0/3296378169 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 0x7f12540a6d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12500098a0 tx=0x7f125002a0d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=983c7f15f687660f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 1 -- 172.21.15.71:0/3296378169 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1250037070 con 0x7f12540a6950 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: dump: 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 1 -- 172.21.15.71:0/3296378169 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125002adf0 con 0x7f12540a6950 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 5 monclient: authenticate success, global_id 84235 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 1 -- 172.21.15.71:0/3296378169 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1250030c20 con 0x7f12540a6950 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 4 set_mon_vals no callback set 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f124bfff640 10 monclient: dump: 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.369 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.370 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 10 monclient: shutdown 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 -- 172.21.15.71:0/3296378169 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 msgr2=0x7f12540a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 --2- 172.21.15.71:0/3296378169 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 0x7f12540a6d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12500098a0 tx=0x7f125002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 -- 172.21.15.71:0/3296378169 shutdown_connections 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 --2- 172.21.15.71:0/3296378169 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1254139710 0x7f1254139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 --2- 172.21.15.71:0/3296378169 >> v2:172.21.15.135:3300/0 conn(0x7f12540a57c0 0x7f12540a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 --2- 172.21.15.71:0/3296378169 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12540a6950 0x7f12540a6d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 -- 172.21.15.71:0/3296378169 >> 172.21.15.71:0/3296378169 conn(0x7f12540abf50 msgr2=0x7f12540ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 -- 172.21.15.71:0/3296378169 shutdown_connections 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.356+0000 7f125b563640 1 -- 172.21.15.71:0/3296378169 wait complete. 2024-08-19T11:17:25.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.357+0000 7f125b563640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.357+0000 7f125b563640 10 monclient: monmap: 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.357+0000 7f125b563640 1 Processor -- start 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.357+0000 7f125b563640 1 -- start start 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.357+0000 7f125b563640 10 monclient: init 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient: _add_conns ranks=[7,5,0,4,3,2,1,8,6] 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f12540a57c0 0x7f12541273d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): picked mon.noname-i con 0x7f12540a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12540a6950 0x7f12541ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): picked mon.noname-h con 0x7f12540a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 0x7f12541cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): picked mon.noname-a con 0x7f1254139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12540a84c0 con 0x7f1254139710 2024-08-19T11:17:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f12540a3650 con 0x7f12540a6950 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f12540a8700 con 0x7f12540a57c0 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f125b563640 10 monclient(hunting): authenticate will time out at 1103.399349s 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 0x7f12541cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12540a6950 0x7f12541ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 0x7f12541cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49864/0 (socket says 172.21.15.71:49864) 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f12540a57c0 0x7f12541273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 learned_addr learned my addr 172.21.15.71:0/648060693 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): get_auth_request con 0x7f1254139710 auth_method 0 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): get_auth_request con 0x7f12540a6950 auth_method 0 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): get_auth_request con 0x7f12540a57c0 auth_method 0 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient(hunting): handle_auth_done global_id 74574 payload 824 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f12540a57c0 msgr2=0x7f12541273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f12540a57c0 0x7f12541273d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12540a6950 msgr2=0x7f12541ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12540a6950 0x7f12541ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 monclient: found mon.noname-a 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1254128330 con 0x7f1254139710 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.358+0000 7f1258afe640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12540a6950 0x7f12541ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 msgr2=0x7f12541cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1259b00640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 0x7f12541cee80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f124c00efc0 tx=0x7f124c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f124c018020 con 0x7f1254139710 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: dump: 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124c0148f0 con 0x7f1254139710 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 5 monclient: authenticate success, global_id 74574 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 10 monclient: _renew_subs 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125413a170 con 0x7f1254139710 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f124c0133e0 con 0x7f1254139710 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f1249ffb640 10 monclient: dump: 2024-08-19T11:17:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f124b7fe640 4 set_mon_vals no callback set 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 10 monclient: _renew_subs 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.361+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1254126870 con 0x7f1254139710 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f125b563640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f125b563640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 0x7f1254124f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1254076c60 con 0x7f12541cf3c0 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 0x7f1254124f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient: get_auth_request con 0x7f12541cf3c0 auth_method 0 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f124c005d10 con 0x7f1254139710 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 10 monclient(hunting): handle_auth_done global_id 84244 payload 824 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f12592ff640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12541cf7a0 con 0x7f12541cf3c0 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f1249ffb640 1 --2- 172.21.15.71:0/648060693 >> v2:172.21.15.135:6800/726754104 conn(0x7f123803ea80 0x7f1238040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7f124c052790 con 0x7f1254139710 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f1258afe640 1 --2- 172.21.15.71:0/648060693 >> v2:172.21.15.135:6800/726754104 conn(0x7f123803ea80 0x7f1238040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.362+0000 7f1258afe640 10 monclient: get_auth_request con 0x7f123803ea80 auth_method 0 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.364+0000 7f12592ff640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 msgr2=0x7f1254124f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.364+0000 7f12592ff640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 0x7f1254124f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1250034000 tx=0x7f12500046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1250042070 con 0x7f12541cf3c0 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 10 monclient: dump: 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1250003900 con 0x7f12541cf3c0 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 msgr2=0x7f1254124f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 0x7f1254124f10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1250034000 tx=0x7f12500046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 msgr2=0x7f1254124f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1249ffb640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f12541cf3c0 0x7f1254124f10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.365+0000 7f1258afe640 1 --2- 172.21.15.71:0/648060693 >> v2:172.21.15.135:6800/726754104 conn(0x7f123803ea80 0x7f1238040f40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1254126ee0 tx=0x7f1244008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f125b563640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f125b563640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 0x7f1254125860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f125b563640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1254125da0 con 0x7f1254125450 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 0x7f1254125860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient: get_auth_request con 0x7f1254125450 auth_method 0 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 10 monclient(hunting): handle_auth_done global_id 84253 payload 824 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.371+0000 7f12592ff640 1 -- 172.21.15.71:0/648060693 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12540a1f70 con 0x7f1254125450 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.373+0000 7f12592ff640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 msgr2=0x7f1254125860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.373+0000 7f12592ff640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 0x7f1254125860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12500097c0 tx=0x7f1250009240 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.373+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1250037040 con 0x7f1254125450 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.373+0000 7f1249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.373+0000 7f1249ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.373+0000 7f1249ffb640 10 monclient: dump: 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.389 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f125003e460 con 0x7f1254125450 2024-08-19T11:17:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 msgr2=0x7f1254125860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 0x7f1254125860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12500097c0 tx=0x7f1250009240 comp rx=0 tx=0).stop 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 msgr2=0x7f1254125860 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1249ffb640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1254125450 0x7f1254125860 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f12500097c0 tx=0x7f1250009240 comp rx=0 tx=0).stop 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 27520, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:25.414 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:25.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 >> v2:172.21.15.135:6800/726754104 conn(0x7f123803ea80 msgr2=0x7f1238040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 --2- 172.21.15.71:0/648060693 >> v2:172.21.15.135:6800/726754104 conn(0x7f123803ea80 0x7f1238040f40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1254126ee0 tx=0x7f1244008040 comp rx=0 tx=0).stop 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 10 monclient: shutdown 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 msgr2=0x7f12541cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 --2- 172.21.15.71:0/648060693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1254139710 0x7f12541cee80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f124c00efc0 tx=0x7f124c00c490 comp rx=0 tx=0).stop 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 reap_dead start 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f1259b00640 1 -- 172.21.15.71:0/648060693 reap_dead start 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 shutdown_connections 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 >> 172.21.15.71:0/648060693 conn(0x7f12540abf50 msgr2=0x7f1254138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 shutdown_connections 2024-08-19T11:17:25.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.374+0000 7f125b563640 1 -- 172.21.15.71:0/648060693 wait complete. 2024-08-19T11:17:25.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:25.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:17:25.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.554+0000 7f59ec9aa640 10 monclient: get_monmap_and_config 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.554+0000 7f59ec9aa640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.554+0000 7f59ec9aa640 10 monclient: monmap: 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:25.555038+0000 2024-08-19T11:17:25.555 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:25.555038+0000 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:25.556 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.554+0000 7f59ec9aa640 1 Processor -- start 2024-08-19T11:17:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 1 -- start start 2024-08-19T11:17:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient: init 2024-08-19T11:17:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient: _add_conns ranks=[9,4,1,0,6,5,7,3,8,2,10] 2024-08-19T11:17:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 0x7f59e80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): picked mon.noname-a con 0x7f59e80a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 0x7f59e80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): picked mon.noname-c con 0x7f59e80a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f59e8139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e80a6380 con 0x7f59e8139710 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f59e80a5020 con 0x7f59e80a6950 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f59e80a77b0 con 0x7f59e80a57c0 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59ec9aa640 10 monclient(hunting): authenticate will time out at 1103.596730s 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 0x7f59e80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 0x7f59e80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 0x7f59e80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49878/0 (socket says 172.21.15.71:49878) 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 1 -- 172.21.15.71:0/1781304404 learned_addr learned my addr 172.21.15.71:0/1781304404 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 10 monclient(hunting): get_auth_request con 0x7f59e80a6950 auth_method 0 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request con 0x7f59e80a57c0 auth_method 0 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.555+0000 7f59e659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_done global_id 84280 payload 274 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 1 -- 172.21.15.71:0/1781304404 >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 msgr2=0x7f59e80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/1781304404 >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 0x7f59e80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 1 -- 172.21.15.71:0/1781304404 >> v1:172.21.15.135:6789/0 conn(0x7f59e8139710 legacy=0x7f59e8139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 1 monclient: found mon.noname-c 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e5d9b640 1 -- 172.21.15.71:0/1781304404 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e80a3650 con 0x7f59e80a57c0 2024-08-19T11:17:25.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.556+0000 7f59e659c640 1 --2- 172.21.15.71:0/1781304404 >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 0x7f59e80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:25.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.558+0000 7f59e5d9b640 1 -- 172.21.15.71:0/1781304404 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 msgr2=0x7f59e80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.558+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/1781304404 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 0x7f59e80a7270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097d0 tx=0x7f59d802a000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5698c2083373cf62 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 1 -- 172.21.15.71:0/1781304404 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d8037070 con 0x7f59e80a57c0 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: dump: 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.571 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 1 -- 172.21.15.71:0/1781304404 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d802ad20 con 0x7f59e80a57c0 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 5 monclient: authenticate success, global_id 84280 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:25.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 1 -- 172.21.15.71:0/1781304404 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d8030c20 con 0x7f59e80a57c0 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 4 set_mon_vals no callback set 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59e559a640 10 monclient: dump: 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.573 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 10 monclient: shutdown 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 -- 172.21.15.71:0/1781304404 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 msgr2=0x7f59e80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/1781304404 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 0x7f59e80a7270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097d0 tx=0x7f59d802a000 comp rx=0 tx=0).stop 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 -- 172.21.15.71:0/1781304404 shutdown_connections 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/1781304404 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f59e80a57c0 0x7f59e80a7270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/1781304404 >> v2:172.21.15.71:3300/0 conn(0x7f59e80a6950 0x7f59e80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 -- 172.21.15.71:0/1781304404 >> 172.21.15.71:0/1781304404 conn(0x7f59e80abf50 msgr2=0x7f59e80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 -- 172.21.15.71:0/1781304404 shutdown_connections 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.559+0000 7f59ec9aa640 1 -- 172.21.15.71:0/1781304404 wait complete. 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.560+0000 7f59ec9aa640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.560+0000 7f59ec9aa640 10 monclient: monmap: 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:25.575 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.560+0000 7f59ec9aa640 1 Processor -- start 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.560+0000 7f59ec9aa640 1 -- start start 2024-08-19T11:17:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.560+0000 7f59ec9aa640 10 monclient: init 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient: _add_conns ranks=[6,7,8,2,1,0,4,5,3] 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 0x7f59e81ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): picked mon.noname-d con 0x7f59e80a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f59e80a6950 0x7f59e81388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): picked mon.noname-i con 0x7f59e80a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59e8139710 0x7f59e8138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): picked mon.noname-e con 0x7f59e8139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f59e80a84c0 con 0x7f59e80a57c0 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f59e80a7d40 con 0x7f59e80a6950 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f59e80a8700 con 0x7f59e8139710 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59ec9aa640 10 monclient(hunting): authenticate will time out at 1103.602450s 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 0x7f59e81ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 0x7f59e81ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:39852/0 (socket says 172.21.15.71:39852) 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 -- 172.21.15.71:0/3962183933 learned_addr learned my addr 172.21.15.71:0/3962183933 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): get_auth_request con 0x7f59e80a57c0 auth_method 0 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59e8139710 0x7f59e8138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): get_auth_request con 0x7f59e8139710 auth_method 0 2024-08-19T11:17:25.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f59e80a6950 0x7f59e81388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request con 0x7f59e80a6950 auth_method 0 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient(hunting): handle_auth_done global_id 26070 payload 824 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59e8139710 msgr2=0x7f59e8138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59e8139710 0x7f59e8138df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f59e80a6950 msgr2=0x7f59e81388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f59e80a6950 0x7f59e81388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 monclient: found mon.noname-d 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.561+0000 7f59e659c640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e8123f10 con 0x7f59e80a57c0 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59e659c640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 msgr2=0x7f59e81ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59e659c640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 0x7f59e81ce180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59d000e9d0 tx=0x7f59d000ee90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d0017070 con 0x7f59e80a57c0 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: dump: 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d000cc70 con 0x7f59e80a57c0 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 5 monclient: authenticate success, global_id 26070 2024-08-19T11:17:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 10 monclient: _renew_subs 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d000ce20 con 0x7f59e80a57c0 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e80a1f90 con 0x7f59e80a57c0 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59deffd640 10 monclient: dump: 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.583 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59e4d99640 4 set_mon_vals no callback set 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 10 monclient: _renew_subs 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.564+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e8126270 con 0x7f59e80a57c0 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59ec9aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 0x7f59e8122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f59e806a590 con 0x7f59e81225a0 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 0x7f59e8122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient: get_auth_request con 0x7f59e81225a0 auth_method 0 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f59d001a070 con 0x7f59e80a57c0 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_done global_id 26079 payload 824 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59e80a6d30 con 0x7f59e81225a0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.565+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> v2:172.21.15.135:6800/726754104 conn(0x7f59c803eab0 0x7f59c8040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.566+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7f59d000f040 con 0x7f59e80a57c0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.566+0000 7f59e6d9d640 1 --2- 172.21.15.71:0/3962183933 >> v2:172.21.15.135:6800/726754104 conn(0x7f59c803eab0 0x7f59c8040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.566+0000 7f59e6d9d640 10 monclient: get_auth_request con 0x7f59c803eab0 auth_method 0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 msgr2=0x7f59e8122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 0x7f59e8122980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f59d8034000 tx=0x7f59d80046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d8037040 con 0x7f59e81225a0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 10 monclient: dump: 2024-08-19T11:17:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.587 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f59d8003a30 con 0x7f59e81225a0 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 msgr2=0x7f59e8122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 0x7f59e8122980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f59d8034000 tx=0x7f59d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 msgr2=0x7f59e8122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e81225a0 0x7f59e8122980 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f59d8034000 tx=0x7f59d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.568+0000 7f59e6d9d640 1 --2- 172.21.15.71:0/3962183933 >> v2:172.21.15.135:6800/726754104 conn(0x7f59c803eab0 0x7f59c8040f70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f59e00055e0 tx=0x7f59e0003d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59ec9aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:25.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59ec9aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f59e8076c60 con 0x7f59e8122ec0 2024-08-19T11:17:25.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient: get_auth_request con 0x7f59e8122ec0 auth_method 0 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_done global_id 26088 payload 824 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.574+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59e81ce6c0 con 0x7f59e8122ec0 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 msgr2=0x7f59e809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f59e80a1f20 tx=0x7f59d8009190 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 msgr2=0x7f59e809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:17:25.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 msgr2=0x7f59e809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f59e80a1f20 tx=0x7f59d8009190 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f59e80a1f20 tx=0x7f59d8009190 comp rx=0 tx=0).stop 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 msgr2=0x7f59e809da00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 0x7f59c8046cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 msgr2=0x7f59e809da00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e8122ec0 0x7f59e809da00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f59c8044330 con 0x7f59c80448c0 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 0x7f59c8046cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient: get_auth_request con 0x7f59c80448c0 auth_method 0 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 10 monclient(hunting): handle_auth_done global_id 26097 payload 824 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.577+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59d8003a30 con 0x7f59c80448c0 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.579+0000 7f59e5d9b640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 msgr2=0x7f59c8046cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.579+0000 7f59e5d9b640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 0x7f59c8046cb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f59d8000c00 tx=0x7f59d802e000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.579+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59d805d070 con 0x7f59c80448c0 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.579+0000 7f59deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.579+0000 7f59deffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:25.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.579+0000 7f59deffd640 10 monclient: dump: 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.595 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7f59d8032e50 con 0x7f59c80448c0 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 msgr2=0x7f59c8046cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 0x7f59c8046cb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f59d8000c00 tx=0x7f59d802e000 comp rx=0 tx=0).stop 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 msgr2=0x7f59c8046cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59e6d9d640 1 -- 172.21.15.71:0/3962183933 reap_dead start 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59deffd640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59c80448c0 0x7f59c8046cb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.596 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 353193, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:25.597 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.598 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.599 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:25.600 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:25.601 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:25.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.604 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.605 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.609 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:25.611 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.614 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:25.618 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.619 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.620 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.621 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:25.621 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 >> v2:172.21.15.135:6800/726754104 conn(0x7f59c803eab0 msgr2=0x7f59c8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/3962183933 >> v2:172.21.15.135:6800/726754104 conn(0x7f59c803eab0 0x7f59c8040f70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f59e00055e0 tx=0x7f59e0003d10 comp rx=0 tx=0).stop 2024-08-19T11:17:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 10 monclient: shutdown 2024-08-19T11:17:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 msgr2=0x7f59e81ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 0x7f59e81ce180 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59d000e9d0 tx=0x7f59d000ee90 comp rx=0 tx=0).stop 2024-08-19T11:17:25.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 shutdown_connections 2024-08-19T11:17:25.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/3962183933 >> v2:172.21.15.135:6800/726754104 conn(0x7f59c803eab0 0x7f59c8040f70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 --2- 172.21.15.71:0/3962183933 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f59e80a57c0 0x7f59e81ce180 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 >> 172.21.15.71:0/3962183933 conn(0x7f59e80abf50 msgr2=0x7f59e81c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 shutdown_connections 2024-08-19T11:17:25.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.580+0000 7f59ec9aa640 1 -- 172.21.15.71:0/3962183933 wait complete. 2024-08-19T11:17:25.623 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:25.623 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:17:25.623 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:17:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.722+0000 7fec04128640 10 monclient: get_monmap_and_config 2024-08-19T11:17:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.722+0000 7fec04128640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.722+0000 7fec04128640 10 monclient: monmap: 2024-08-19T11:17:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:25.723089+0000 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:25.723089+0000 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:25.725 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 Processor -- start 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 -- start start 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient: init 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient: _add_conns ranks=[6,1,3,8,10,5,9,7,4,0,2] 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 0x7febfc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): picked mon.noname-d con 0x7febfc0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7febfc0a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a7270 0x7febfc139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): picked mon.noname-g con 0x7febfc0a7270 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febfc0a6380 con 0x7febfc0a57c0 2024-08-19T11:17:25.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7febfc0a5020 con 0x7febfc0a7270 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7febfc0a7d40 con 0x7febfc0a6950 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec04128640 10 monclient(hunting): authenticate will time out at 1103.764820s 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 0x7febfc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 0x7febfc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:39882/0 (socket says 172.21.15.71:39882) 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 1 -- 172.21.15.71:0/1991982256 learned_addr learned my addr 172.21.15.71:0/1991982256 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 10 monclient(hunting): get_auth_request con 0x7febfc0a6950 auth_method 0 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.723+0000 7fec01ec4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 1 --2- 172.21.15.71:0/1991982256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a7270 0x7febfc139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): get_auth_request con 0x7febfc0a7270 auth_method 0 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec026c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 10 monclient(hunting): handle_auth_done global_id 26106 payload 274 2024-08-19T11:17:25.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 1 -- 172.21.15.71:0/1991982256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a7270 msgr2=0x7febfc139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 1 --2- 172.21.15.71:0/1991982256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a7270 0x7febfc139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 1 -- 172.21.15.71:0/1991982256 >> v1:172.21.15.135:6789/0 conn(0x7febfc0a57c0 legacy=0x7febfc139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 1 monclient: found mon.noname-d 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.724+0000 7fec01ec4640 1 -- 172.21.15.71:0/1991982256 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc0a3650 con 0x7febfc0a6950 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.726+0000 7fec01ec4640 1 -- 172.21.15.71:0/1991982256 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 msgr2=0x7febfc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.726+0000 7fec01ec4640 1 --2- 172.21.15.71:0/1991982256 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 0x7febfc0a6d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febf80098d0 tx=0x7febf802a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c6255ca6653ba64 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.732 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.732 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.732 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3181848444}) 2024-08-19T11:17:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 1 -- 172.21.15.71:0/1991982256 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febf8037070 con 0x7febfc0a6950 2024-08-19T11:17:25.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.732 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.733 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:25.733 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3212972596}) 2024-08-19T11:17:25.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: dump: 2024-08-19T11:17:25.733 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.734 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.735 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.735 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.735 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 5 monclient: authenticate success, global_id 26106 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 1 -- 172.21.15.71:0/1991982256 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf802adc0 con 0x7febfc0a6950 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 4 set_mon_vals no callback set 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 1 -- 172.21.15.71:0/1991982256 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febf8030c20 con 0x7febfc0a6950 2024-08-19T11:17:25.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.737 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=844860408}) 2024-08-19T11:17:25.737 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec00ec2640 10 monclient: dump: 2024-08-19T11:17:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.737 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.738 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=143640741}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2403073612}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1852869757}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.740 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=652404826}) 2024-08-19T11:17:25.741 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.741 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083428596}) 2024-08-19T11:17:25.741 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.727+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3811317704}) 2024-08-19T11:17:25.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 10 monclient: shutdown 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 1 -- 172.21.15.71:0/1991982256 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 msgr2=0x7febfc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 1 --2- 172.21.15.71:0/1991982256 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 0x7febfc0a6d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febf80098d0 tx=0x7febf802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 1 -- 172.21.15.71:0/1991982256 shutdown_connections 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 1 --2- 172.21.15.71:0/1991982256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a7270 0x7febfc139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 1 --2- 172.21.15.71:0/1991982256 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a6950 0x7febfc0a6d30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.727+0000 7fec04128640 1 -- 172.21.15.71:0/1991982256 >> 172.21.15.71:0/1991982256 conn(0x7febfc0abf50 msgr2=0x7febfc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.728+0000 7fec04128640 1 -- 172.21.15.71:0/1991982256 shutdown_connections 2024-08-19T11:17:25.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.728+0000 7fec04128640 1 -- 172.21.15.71:0/1991982256 wait complete. 2024-08-19T11:17:25.743 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2861875063}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1005586824}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3617497392}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3946397588}) 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.744 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.745 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3137005213}) 2024-08-19T11:17:25.745 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.728+0000 7fec04128640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.747 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.747 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4282318452}) 2024-08-19T11:17:25.747 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.747 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.728+0000 7fec04128640 10 monclient: monmap: 2024-08-19T11:17:25.747 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.747 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:25.747 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.748 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.749 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1202850240}) 2024-08-19T11:17:25.749 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.728+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.749 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.729+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073447597}) 2024-08-19T11:17:25.749 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.729+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=697141865}) 2024-08-19T11:17:25.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.729+0000 7fec04128640 1 Processor -- start 2024-08-19T11:17:25.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.729+0000 7fec04128640 1 -- start start 2024-08-19T11:17:25.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.729+0000 7fec04128640 10 monclient: init 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3600345057}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3804240655}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4278757870}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.751 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2705723290}) 2024-08-19T11:17:25.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient: _add_conns ranks=[6,3,4,0,8,7,1,5,2] 2024-08-19T11:17:25.752 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.752 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.752 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2954147242}) 2024-08-19T11:17:25.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a57c0 0x7febfc06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): picked mon.noname-d con 0x7febfc0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:25.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a6950 0x7febfc0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): picked mon.noname-g con 0x7febfc0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:25.753 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.753 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7febfc0a7270 0x7febfc0708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): picked mon.noname-c con 0x7febfc0a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:25.754 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3964522352}) 2024-08-19T11:17:25.754 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7febfc0a8700 con 0x7febfc0a6950 2024-08-19T11:17:25.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7febfc0a84c0 con 0x7febfc0a7270 2024-08-19T11:17:25.755 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.755 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2699207716}) 2024-08-19T11:17:25.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7febfc0a7690 con 0x7febfc0a57c0 2024-08-19T11:17:25.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec04128640 10 monclient(hunting): authenticate will time out at 1103.771258s 2024-08-19T11:17:25.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4292416703}) 2024-08-19T11:17:25.756 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.730+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1151556828}) 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a57c0 0x7febfc06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7febfc0a7270 0x7febfc0708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a57c0 0x7febfc06fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:39890/0 (socket says 172.21.15.71:39890) 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 1 -- 172.21.15.71:0/134071507 learned_addr learned my addr 172.21.15.71:0/134071507 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): get_auth_request con 0x7febfc0a7270 auth_method 0 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): get_auth_request con 0x7febfc0a57c0 auth_method 0 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec016c3640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a6950 0x7febfc0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec016c3640 10 monclient(hunting): get_auth_request con 0x7febfc0a6950 auth_method 0 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec016c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec016c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec016c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient(hunting): handle_auth_done global_id 84289 payload 824 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a57c0 msgr2=0x7febfc06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7febfc0a57c0 0x7febfc06fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a6950 msgr2=0x7febfc0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7febfc0a6950 0x7febfc0703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 monclient: found mon.noname-c 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:25.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.730+0000 7fec026c5640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc073550 con 0x7febfc0a7270 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=118033294}) 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=575583884}) 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=9712539}) 2024-08-19T11:17:25.762 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=148997145}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3913774949}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2876840653}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543438855}) 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.763 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665424501}) 2024-08-19T11:17:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.731+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2766558693}) 2024-08-19T11:17:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2369260613}) 2024-08-19T11:17:25.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec026c5640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7febfc0a7270 msgr2=0x7febfc0708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec026c5640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7febfc0a7270 0x7febfc0708e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febf400ebd0 tx=0x7febf400c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2425117817}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=11272085}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1079502913}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1513759970}) 2024-08-19T11:17:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febf4018020 con 0x7febfc0a7270 2024-08-19T11:17:25.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3579786723}) 2024-08-19T11:17:25.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4076215396}) 2024-08-19T11:17:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: dump: 2024-08-19T11:17:25.768 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.768 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.768 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=509254132}) 2024-08-19T11:17:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.733+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=824621975}) 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf400cd30 con 0x7febfc0a7270 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 5 monclient: authenticate success, global_id 84289 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 10 monclient: _renew_subs 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febf4014d60 con 0x7febfc0a7270 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc0a2540 con 0x7febfc0a7270 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf27fc640 10 monclient: dump: 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.772 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.773 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7febf3fff640 4 set_mon_vals no callback set 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 10 monclient: _renew_subs 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.733+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc0a9620 con 0x7febfc0a7270 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec04128640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec04128640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 0x7febfc09eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7febfc076c60 con 0x7febfc09e730 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 0x7febfc09eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient: get_auth_request con 0x7febfc09e730 auth_method 0 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7febf4005d10 con 0x7febfc0a7270 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 10 monclient(hunting): handle_auth_done global_id 64952 payload 824 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.734+0000 7fec01ec4640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febfc077730 con 0x7febfc09e730 2024-08-19T11:17:25.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.735+0000 7febf27fc640 1 --2- 172.21.15.71:0/134071507 >> v2:172.21.15.135:6800/726754104 conn(0x7febe003ea80 0x7febe0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1274843565}) 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4252648036}) 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.735+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7febf4052630 con 0x7febfc0a7270 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1836695185}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1572077307}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3192317321}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3900041751}) 2024-08-19T11:17:25.778 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.735+0000 7fec016c3640 1 --2- 172.21.15.71:0/134071507 >> v2:172.21.15.135:6800/726754104 conn(0x7febe003ea80 0x7febe0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.779 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.779 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=90285146}) 2024-08-19T11:17:25.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.735+0000 7fec016c3640 10 monclient: get_auth_request con 0x7febe003ea80 auth_method 0 2024-08-19T11:17:25.781 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286436915}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.735+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2591411792}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3831236172}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2396490533}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1048708275}) 2024-08-19T11:17:25.782 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1183489906}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2254523047}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=607704133}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3614983525}) 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.783 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822842655}) 2024-08-19T11:17:25.784 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.736+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1033831232}) 2024-08-19T11:17:25.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.737+0000 7fec01ec4640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 msgr2=0x7febfc09eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.784 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.784 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.737+0000 7fec01ec4640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 0x7febfc09eb10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7febf80098a0 tx=0x7febf80046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1861768840}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1110105947}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3339834601}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=756091934}) 2024-08-19T11:17:25.786 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.737+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febf8037040 con 0x7febfc09e730 2024-08-19T11:17:25.787 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.737+0000 7febf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.737+0000 7febf27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:25.788 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3054442790}) 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.737+0000 7febf27fc640 10 monclient: dump: 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.788 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.789 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.790 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.790 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.790 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=513299768}) 2024-08-19T11:17:25.791 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.791 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.791 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=436043093}) 2024-08-19T11:17:25.791 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.737+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.791 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.738+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394655421}) 2024-08-19T11:17:25.791 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.738+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1344243487}) 2024-08-19T11:17:25.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7febf8003a30 con 0x7febfc09e730 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 msgr2=0x7febfc09eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 0x7febfc09eb10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7febf80098a0 tx=0x7febf80046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 msgr2=0x7febfc09eb10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7fec016c3640 1 --2- 172.21.15.71:0/134071507 >> v2:172.21.15.135:6800/726754104 conn(0x7febe003ea80 0x7febe0040f40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7febfc071230 tx=0x7febec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.738+0000 7febf27fc640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09e730 0x7febfc09eb10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=680574720}) 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1679801915}) 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.802 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3287182646}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3838060434}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1202220978}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3213608536}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.803 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1383422606}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1757599008}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.739+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2131234796}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=501506013}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=69433708}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288956465}) 2024-08-19T11:17:25.804 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.740+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1302500336}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3701772740}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=920437887}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3942407564}) 2024-08-19T11:17:25.805 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3359734202}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.741+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3393427168}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1643010798}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3608338512}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4286204759}) 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.806 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2195902120}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2866920238}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2384295140}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2475247985}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517950378}) 2024-08-19T11:17:25.807 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2769725514}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=72680488}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1687900887}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1434843941}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=733440170}) 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.808 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3155767025}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1113454131}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1721292565}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3579859451}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2946708131}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.809 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1224858113}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1479472706}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2299830632}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1321636269}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2722510730}) 2024-08-19T11:17:25.810 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1457181231}) 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1263748651}) 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268472866}) 2024-08-19T11:17:25.811 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1833255764}) 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec04128640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec04128640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 0x7febfc1dd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec04128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7febfc0a6d30 con 0x7febfc09f050 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 0x7febfc1dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient: get_auth_request con 0x7febfc09f050 auth_method 0 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.813 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.814 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.814 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3727950009}) 2024-08-19T11:17:25.814 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.814 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2968861034}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1246487136}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=245438630}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.815 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=80206506}) 2024-08-19T11:17:25.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 10 monclient(hunting): handle_auth_done global_id 64961 payload 824 2024-08-19T11:17:25.816 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.816 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.746+0000 7fec01ec4640 1 -- 172.21.15.71:0/134071507 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7febfc0723e0 con 0x7febfc09f050 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1732496587}) 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1730968343}) 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008286069}) 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.746+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3171871153}) 2024-08-19T11:17:25.819 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2073032958}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3565662081}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1615039314}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3774445872}) 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.820 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3804380821}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2911688187}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2591415171}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1415952199}) 2024-08-19T11:17:25.821 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=841414916}) 2024-08-19T11:17:25.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7fec01ec4640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 msgr2=0x7febfc1dd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7fec01ec4640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 0x7febfc1dd120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7febf8000c00 tx=0x7febf8009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7febf8037040 con 0x7febfc09f050 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2270141543}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=925731243}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3568996479}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.824 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1366149048}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1457877002}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2766912220}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1122302016}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646687071}) 2024-08-19T11:17:25.825 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3622608923}) 2024-08-19T11:17:25.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:25.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 10 monclient: dump: 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.827 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7febf803ee00 con 0x7febfc09f050 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 msgr2=0x7febfc1dd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 0x7febfc1dd120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7febf8000c00 tx=0x7febf8009240 comp rx=0 tx=0).stop 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 msgr2=0x7febfc1dd120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.749+0000 7febf27fc640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7febfc09f050 0x7febfc1dd120 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7febf8000c00 tx=0x7febf8009240 comp rx=0 tx=0).stop 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 157231, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:25.829 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.831 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:25.832 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:25.833 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.834 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.838 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:25.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.843 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:25.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.848 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:25.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:25.850 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.851 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:25.852 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:25.853 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 >> v2:172.21.15.135:6800/726754104 conn(0x7febe003ea80 msgr2=0x7febe0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 --2- 172.21.15.71:0/134071507 >> v2:172.21.15.135:6800/726754104 conn(0x7febe003ea80 0x7febe0040f40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7febfc071230 tx=0x7febec009040 comp rx=0 tx=0).stop 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 10 monclient: shutdown 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7febfc0a7270 msgr2=0x7febfc0708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 --2- 172.21.15.71:0/134071507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7febfc0a7270 0x7febfc0708e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febf400ebd0 tx=0x7febf400c490 comp rx=0 tx=0).stop 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec026c5640 1 -- 172.21.15.71:0/134071507 reap_dead start 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec026c5640 1 -- 172.21.15.71:0/134071507 reap_dead start 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 shutdown_connections 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 >> 172.21.15.71:0/134071507 conn(0x7febfc0abf50 msgr2=0x7febfc1c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 shutdown_connections 2024-08-19T11:17:25.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.750+0000 7fec04128640 1 -- 172.21.15.71:0/134071507 wait complete. 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=82103300}) 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=495019474}) 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=501226414}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=735979823}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=321892687}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=601517919}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1096007686}) 2024-08-19T11:17:25.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=966983157}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.752+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3229030633}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=387896761}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1342313317}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1328876809}) 2024-08-19T11:17:25.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2842650823}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4245278093}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1215728360}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=707368311}) 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3302554621}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.753+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3756046952}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=96203313}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3882946921}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2773112300}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.864 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2794905043}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2134105145}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2975460173}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2555363862}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766232875}) 2024-08-19T11:17:25.865 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.755+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2000887776}) 2024-08-19T11:17:25.866 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:25.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:17:25.867 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.964+0000 7f5b48f14640 10 monclient: get_monmap_and_config 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.964+0000 7f5b48f14640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.964+0000 7f5b48f14640 10 monclient: monmap: 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:25.965056+0000 2024-08-19T11:17:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:25.965056+0000 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:25.966 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:25.967 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.964+0000 7f5b48f14640 1 Processor -- start 2024-08-19T11:17:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 -- start start 2024-08-19T11:17:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient: init 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient: _add_conns ranks=[9,4,3,2,6,0,5,7,10,8,1] 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 0x7f5b440a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): picked mon.noname-a con 0x7f5b440a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 0x7f5b440a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): picked mon.noname-c con 0x7f5b440a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b44139710 0x7f5b44139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): picked mon.noname-g con 0x7f5b44139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5b440a5020 con 0x7f5b440a6950 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5b440a77b0 con 0x7f5b44139710 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5b440a7d40 con 0x7f5b440a57c0 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b48f14640 10 monclient(hunting): authenticate will time out at 1104.006550s 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 0x7f5b440a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 0x7f5b440a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 0x7f5b440a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50660/0 (socket says 172.21.15.71:50660) 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 0x7f5b440a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49880/0 (socket says 172.21.15.71:49880) 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 -- 172.21.15.71:0/3794029085 learned_addr learned my addr 172.21.15.71:0/3794029085 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): get_auth_request con 0x7f5b440a57c0 auth_method 0 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): get_auth_request con 0x7f5b440a6950 auth_method 0 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b42d9d640 1 --2- 172.21.15.71:0/3794029085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b44139710 0x7f5b44139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b42d9d640 10 monclient(hunting): get_auth_request con 0x7f5b44139710 auth_method 0 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b42d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b42d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b42d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_done global_id 84298 payload 274 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 -- 172.21.15.71:0/3794029085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b44139710 msgr2=0x7f5b44139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 --2- 172.21.15.71:0/3794029085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b44139710 0x7f5b44139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 -- 172.21.15.71:0/3794029085 >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 msgr2=0x7f5b440a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 --2- 172.21.15.71:0/3794029085 >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 0x7f5b440a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 monclient: found mon.noname-c 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b39d9b640 1 -- 172.21.15.71:0/3794029085 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b440a6380 con 0x7f5b440a57c0 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.965+0000 7f5b4259c640 1 --2- 172.21.15.71:0/3794029085 >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 0x7f5b440a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:25.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b39d9b640 1 -- 172.21.15.71:0/3794029085 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 msgr2=0x7f5b440a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b39d9b640 1 --2- 172.21.15.71:0/3794029085 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 0x7f5b440a7270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098a0 tx=0x7f5b2c02a0d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=38a3eb3ac0c1ed74 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 1 -- 172.21.15.71:0/3794029085 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b2c037070 con 0x7f5b440a57c0 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: dump: 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.978 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 1 -- 172.21.15.71:0/3794029085 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2c02adf0 con 0x7f5b440a57c0 2024-08-19T11:17:25.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b48f14640 5 monclient: authenticate success, global_id 84298 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b48f14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b48f14640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 1 -- 172.21.15.71:0/3794029085 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b2c030c20 con 0x7f5b440a57c0 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b48f14640 4 set_mon_vals no callback set 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.968+0000 7f5b41d9b640 10 monclient: dump: 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.980 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 10 monclient: shutdown 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:25.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 -- 172.21.15.71:0/3794029085 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 msgr2=0x7f5b440a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 --2- 172.21.15.71:0/3794029085 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 0x7f5b440a7270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098a0 tx=0x7f5b2c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 -- 172.21.15.71:0/3794029085 shutdown_connections 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 --2- 172.21.15.71:0/3794029085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b44139710 0x7f5b44139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 --2- 172.21.15.71:0/3794029085 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5b440a57c0 0x7f5b440a7270 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 --2- 172.21.15.71:0/3794029085 >> v2:172.21.15.71:3300/0 conn(0x7f5b440a6950 0x7f5b440a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 -- 172.21.15.71:0/3794029085 >> 172.21.15.71:0/3794029085 conn(0x7f5b440abf50 msgr2=0x7f5b440ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 -- 172.21.15.71:0/3794029085 shutdown_connections 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.969+0000 7f5b48f14640 1 -- 172.21.15.71:0/3794029085 wait complete. 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.970+0000 7f5b48f14640 10 monclient: build_initial_monmap 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.970+0000 7f5b48f14640 10 monclient: monmap: 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:25.982 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.970+0000 7f5b48f14640 1 Processor -- start 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.970+0000 7f5b48f14640 1 -- start start 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.970+0000 7f5b48f14640 10 monclient: init 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient: _add_conns ranks=[7,5,6,3,0,2,1,4,8] 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b440a57c0 0x7f5b441ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): picked mon.noname-i con 0x7f5b440a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b440a6950 0x7f5b441389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): picked mon.noname-h con 0x7f5b440a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 0x7f5b44138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): picked mon.noname-d con 0x7f5b44139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5b440a84c0 con 0x7f5b440a6950 2024-08-19T11:17:25.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5b440a3650 con 0x7f5b44139710 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f5b440a8700 con 0x7f5b440a57c0 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b48f14640 10 monclient(hunting): authenticate will time out at 1104.012205s 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 0x7f5b44138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 0x7f5b44138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:39894/0 (socket says 172.21.15.71:39894) 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 learned_addr learned my addr 172.21.15.71:0/309043369 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): get_auth_request con 0x7f5b44139710 auth_method 0 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b440a57c0 0x7f5b441ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b440a6950 0x7f5b441389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): get_auth_request con 0x7f5b440a57c0 auth_method 0 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): get_auth_request con 0x7f5b440a6950 auth_method 0 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b39d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient(hunting): handle_auth_done global_id 26124 payload 824 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b440a57c0 msgr2=0x7f5b441ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5b440a57c0 0x7f5b441ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b440a6950 msgr2=0x7f5b441389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5b440a6950 0x7f5b441389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 monclient: found mon.noname-d 2024-08-19T11:17:25.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.971+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b440a1e90 con 0x7f5b44139710 2024-08-19T11:17:25.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.973+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 msgr2=0x7f5b44138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.973+0000 7f5b42d9d640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 0x7f5b44138f10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c007e60 tx=0x7f5b3c00e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b3c014890 con 0x7f5b44139710 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: dump: 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.993 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:25.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3c019070 con 0x7f5b44139710 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b3c013380 con 0x7f5b44139710 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 5 monclient: authenticate success, global_id 26124 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 10 monclient: _renew_subs 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b4159a640 4 set_mon_vals no callback set 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b44126390 con 0x7f5b44139710 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 10 monclient: dump: 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.995 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:25.996 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 10 monclient: _renew_subs 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b44124030 con 0x7f5b44139710 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.974+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5b3c014420 con 0x7f5b44139710 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b48f14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b48f14640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 0x7f5b4402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4406a590 con 0x7f5b44122da0 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b3b7fe640 1 --2- 172.21.15.71:0/309043369 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b2403ea80 0x7f5b24040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7f5b3c052250 con 0x7f5b44139710 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 0x7f5b4402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient: get_auth_request con 0x7f5b44122da0 auth_method 0 2024-08-19T11:17:25.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b39d9b640 1 --2- 172.21.15.71:0/309043369 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b2403ea80 0x7f5b24040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b39d9b640 10 monclient: get_auth_request con 0x7f5b2403ea80 auth_method 0 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 10 monclient(hunting): handle_auth_done global_id 84187 payload 824 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.975+0000 7f5b4259c640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b44125af0 con 0x7f5b44122da0 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.977+0000 7f5b4259c640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 msgr2=0x7f5b4402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.977+0000 7f5b4259c640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 0x7f5b4402d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b340118e0 tx=0x7f5b34011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.977+0000 7f5b39d9b640 1 --2- 172.21.15.71:0/309043369 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b2403ea80 0x7f5b24040f40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098a0 tx=0x7f5b2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b340148b0 con 0x7f5b44122da0 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 10 monclient: dump: 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:25.999 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5b34014440 con 0x7f5b44122da0 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 msgr2=0x7f5b4402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 0x7f5b4402d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b340118e0 tx=0x7f5b34011da0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 msgr2=0x7f5b4402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.978+0000 7f5b3b7fe640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44122da0 0x7f5b4402d1c0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b340118e0 tx=0x7f5b34011da0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b48f14640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b48f14640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 0x7f5b4402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b48f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b44125d30 con 0x7f5b44123180 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 0x7f5b4402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient: get_auth_request con 0x7f5b44123180 auth_method 0 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 10 monclient(hunting): handle_auth_done global_id 84196 payload 824 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.984+0000 7f5b4259c640 1 -- 172.21.15.71:0/309043369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b440a6d30 con 0x7f5b44123180 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b4259c640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 msgr2=0x7f5b4402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b4259c640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 0x7f5b4402d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b340118e0 tx=0x7f5b340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5b34022bf0 con 0x7f5b44123180 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 10 monclient: dump: 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.002 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f5b3402b3b0 con 0x7f5b44123180 2024-08-19T11:17:26.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 msgr2=0x7f5b4402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 0x7f5b4402d700 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b340118e0 tx=0x7f5b340046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 msgr2=0x7f5b4402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b3b7fe640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b44123180 0x7f5b4402d700 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b340118e0 tx=0x7f5b340046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:26.004 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 28148, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.006 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.007 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.008 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.011 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:26.014 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:26.016 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:26.019 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:26.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.025 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.026 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:26.027 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b2403ea80 msgr2=0x7f5b24040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b48f14640 1 --2- 172.21.15.71:0/309043369 >> v2:172.21.15.135:6800/726754104 conn(0x7f5b2403ea80 0x7f5b24040f40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098a0 tx=0x7f5b2c02e000 comp rx=0 tx=0).stop 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b48f14640 10 monclient: shutdown 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b48f14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 msgr2=0x7f5b44138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b48f14640 1 --2- 172.21.15.71:0/309043369 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5b44139710 0x7f5b44138f10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c007e60 tx=0x7f5b3c00e4b0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.987+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 reap_dead start 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.988+0000 7f5b42d9d640 1 -- 172.21.15.71:0/309043369 reap_dead start 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.988+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 shutdown_connections 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.988+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 >> 172.21.15.71:0/309043369 conn(0x7f5b440abf50 msgr2=0x7f5b440aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.988+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 shutdown_connections 2024-08-19T11:17:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:25.988+0000 7f5b48f14640 1 -- 172.21.15.71:0/309043369 wait complete. 2024-08-19T11:17:26.030 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:26.030 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:17:26.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=972313188}) 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2601132088}) 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3862662963}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3218432422}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:25.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3712756053}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2423709293}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1542601315}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832892762}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3581964968}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3376116361}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=600735477}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=611329060}) 2024-08-19T11:17:26.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3046706091}) 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=771237710}) 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=702312923}) 2024-08-19T11:17:26.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.038 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.038 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2091988328}) 2024-08-19T11:17:26.038 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.038 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198909661}) 2024-08-19T11:17:26.038 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=778240748}) 2024-08-19T11:17:26.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.135+0000 7f4d1cdc5640 10 monclient: get_monmap_and_config 2024-08-19T11:17:26.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.135+0000 7f4d1cdc5640 10 monclient: build_initial_monmap 2024-08-19T11:17:26.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.135+0000 7f4d1cdc5640 10 monclient: monmap: 2024-08-19T11:17:26.136 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:26.136296+0000 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:26.136296+0000 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:26.137 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:26.138 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:26.138 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:26.138 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:26.138 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:26.138 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 Processor -- start 2024-08-19T11:17:26.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 -- start start 2024-08-19T11:17:26.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient: init 2024-08-19T11:17:26.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient: _add_conns ranks=[10,1,5,3,9,4,0,7,8,6,2] 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d180a6950 0x7f4d180a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): picked mon.noname-f con 0x7f4d180a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4d180a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 0x7f4d18139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): picked mon.noname-h con 0x7f4d180a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d180a6380 con 0x7f4d180a57c0 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4d180a5020 con 0x7f4d180a6950 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4d180a7d40 con 0x7f4d180a7270 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:26.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.136+0000 7f4d1cdc5640 10 monclient(hunting): authenticate will time out at 1104.177951s 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 0x7f4d18139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d180a6950 0x7f4d180a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 0x7f4d18139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:47324/0 (socket says 172.21.15.71:47324) 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 1 -- 172.21.15.71:0/984029783 learned_addr learned my addr 172.21.15.71:0/984029783 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): get_auth_request con 0x7f4d180a7270 auth_method 0 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d15d9b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4d180a57c0 0x7f4d18139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:45954/0 (socket says 172.21.15.71:45954) 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): get_auth_request con 0x7f4d180a6950 auth_method 0 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient(hunting): handle_auth_done global_id 84205 payload 274 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 1 -- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 msgr2=0x7f4d18139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 1 --2- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 0x7f4d18139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 1 -- 172.21.15.71:0/984029783 >> v1:172.21.15.135:6789/0 conn(0x7f4d180a57c0 legacy=0x7f4d18139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 1 monclient: found mon.noname-f 2024-08-19T11:17:26.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:26.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:17:26.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d1659c640 1 -- 172.21.15.71:0/984029783 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d180a3650 con 0x7f4d180a6950 2024-08-19T11:17:26.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.137+0000 7f4d16d9d640 1 --2- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 0x7f4d18139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1659c640 1 -- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 msgr2=0x7f4d180a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1659c640 1 --2- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d180a6d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0097a0 tx=0x7f4d0c029fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99202ecfbb4460bd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 1 -- 172.21.15.71:0/984029783 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d0c037070 con 0x7f4d180a6950 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: dump: 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.152 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.153 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: _finish_auth 0 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: _check_auth_tickets 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 1 -- 172.21.15.71:0/984029783 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c02ad30 con 0x7f4d180a6950 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 1 -- 172.21.15.71:0/984029783 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d0c030c20 con 0x7f4d180a6950 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1cdc5640 5 monclient: authenticate success, global_id 84205 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1cdc5640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1cdc5640 4 set_mon_vals no callback set 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.140+0000 7f4d1559a640 10 monclient: dump: 2024-08-19T11:17:26.154 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.155 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 10 monclient: shutdown 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 msgr2=0x7f4d180a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d180a6d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0097a0 tx=0x7f4d0c029fd0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/984029783 shutdown_connections 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a7270 0x7f4d18139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/984029783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d180a6d30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/984029783 >> 172.21.15.71:0/984029783 conn(0x7f4d180abf50 msgr2=0x7f4d180ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/984029783 shutdown_connections 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.141+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/984029783 wait complete. 2024-08-19T11:17:26.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient: build_initial_monmap 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient: monmap: 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:26.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 Processor -- start 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 -- start start 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient: init 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient: _add_conns ranks=[5,1,0,7,2,4,6,3,8] 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 0x7f4d18123da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): picked mon.noname-h con 0x7f4d180a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d181242e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): picked mon.noname-f con 0x7f4d180a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d180a7270 0x7f4d18124820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): picked mon.noname-a con 0x7f4d180a7270 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180a76c0 con 0x7f4d180a7270 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180a84c0 con 0x7f4d180a6950 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f4d180a8700 con 0x7f4d180a57c0 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.142+0000 7f4d1cdc5640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1cdc5640 10 monclient(hunting): authenticate will time out at 1104.184015s 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d180a7270 0x7f4d18124820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 0x7f4d18123da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d181242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 0x7f4d18123da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:47328/0 (socket says 172.21.15.71:47328) 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 -- 172.21.15.71:0/3634689059 learned_addr learned my addr 172.21.15.71:0/3634689059 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): get_auth_request con 0x7f4d180a57c0 auth_method 0 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): get_auth_request con 0x7f4d180a7270 auth_method 0 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): get_auth_request con 0x7f4d180a6950 auth_method 0 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d16d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient(hunting): handle_auth_done global_id 45239 payload 824 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 msgr2=0x7f4d181242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d181242e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d180a7270 msgr2=0x7f4d18124820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d180a7270 0x7f4d18124820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 monclient: found mon.noname-h 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d1659c640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d18127a80 con 0x7f4d180a57c0 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.143+0000 7f4d15d9b640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d180a6950 0x7f4d181242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d1659c640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 msgr2=0x7f4d18123da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d1659c640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 0x7f4d18123da0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098c0 tx=0x7f4d0c0046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d0c040020 con 0x7f4d180a57c0 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: dump: 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.163 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c032440 con 0x7f4d180a57c0 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d1cdc5640 5 monclient: authenticate success, global_id 45239 2024-08-19T11:17:26.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d1cdc5640 10 monclient: _renew_subs 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d0c037040 con 0x7f4d180a57c0 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d1cdc5640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d180a9290 con 0x7f4d180a57c0 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d14d99640 4 set_mon_vals no callback set 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.145+0000 7f4d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d06ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d06ffd640 10 monclient: dump: 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.165 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 10 monclient: _renew_subs 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d18125720 con 0x7f4d180a57c0 2024-08-19T11:17:26.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4d0c043020 con 0x7f4d180a57c0 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 0x7f4d18063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.146+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4d18076c60 con 0x7f4d1802e340 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 0x7f4d18063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d06ffd640 1 --2- 172.21.15.71:0/3634689059 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cf803e9b0 0x7f4cf8040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient: get_auth_request con 0x7f4d1802e340 auth_method 0 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7f4d0c0715d0 con 0x7f4d180a57c0 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d16d9d640 1 --2- 172.21.15.71:0/3634689059 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cf803e9b0 0x7f4cf8040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d16d9d640 10 monclient: get_auth_request con 0x7f4cf803e9b0 auth_method 0 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_done global_id 45102 payload 824 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.147+0000 7f4d15d9b640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d1802e720 con 0x7f4d1802e340 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.149+0000 7f4d15d9b640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 msgr2=0x7f4d18063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.149+0000 7f4d15d9b640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 0x7f4d18063a80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d08006fd0 tx=0x7f4d0800ef70 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.149+0000 7f4d16d9d640 1 --2- 172.21.15.71:0/3634689059 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cf803e9b0 0x7f4cf8040e70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009c90 tx=0x7f4d1000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.149+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d08017070 con 0x7f4d1802e340 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 10 monclient: dump: 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4d0800cd60 con 0x7f4d1802e340 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 msgr2=0x7f4d18063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 0x7f4d18063a80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d08006fd0 tx=0x7f4d0800ef70 comp rx=0 tx=0).stop 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 msgr2=0x7f4d18063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.150+0000 7f4d06ffd640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d1802e340 0x7f4d18063a80 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d08006fd0 tx=0x7f4d0800ef70 comp rx=0 tx=0).stop 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d1cdc5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 0x7f4d181d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d1cdc5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180a2680 con 0x7f4d18063fc0 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d15d9b640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 0x7f4d181d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d15d9b640 10 monclient: get_auth_request con 0x7f4d18063fc0 auth_method 0 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d15d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d15d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.156+0000 7f4d15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.157+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.157+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.157+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.157+0000 7f4d15d9b640 10 monclient(hunting): handle_auth_done global_id 45111 payload 824 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.157+0000 7f4d15d9b640 1 -- 172.21.15.71:0/3634689059 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4d180a06c0 con 0x7f4d18063fc0 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.159+0000 7f4d15d9b640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 msgr2=0x7f4d181d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.159+0000 7f4d15d9b640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 0x7f4d181d8990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d08019000 tx=0x7f4d080058c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4d08017070 con 0x7f4d18063fc0 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 10 monclient: dump: 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.175 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f4d08013470 con 0x7f4d18063fc0 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 msgr2=0x7f4d181d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 0x7f4d181d8990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d08019000 tx=0x7f4d080058c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 msgr2=0x7f4d181d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d06ffd640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4d18063fc0 0x7f4d181d8990 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d08019000 tx=0x7f4d080058c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 215182, 2024-08-19T11:17:26.177 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.178 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.179 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.180 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:26.181 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.182 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:26.185 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.186 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:26.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.191 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:26.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.196 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:26.200 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:26.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cf803e9b0 msgr2=0x7f4cf8040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/3634689059 >> v2:172.21.15.135:6800/726754104 conn(0x7f4cf803e9b0 0x7f4cf8040e70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009c90 tx=0x7f4d1000b040 comp rx=0 tx=0).stop 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 10 monclient: shutdown 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 msgr2=0x7f4d18123da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d16d9d640 1 -- 172.21.15.71:0/3634689059 reap_dead start 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 0x7f4d18123da0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098c0 tx=0x7f4d0c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 shutdown_connections 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 --2- 172.21.15.71:0/3634689059 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4d180a57c0 0x7f4d18123da0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 >> 172.21.15.71:0/3634689059 conn(0x7f4d180abf50 msgr2=0x7f4d1809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 shutdown_connections 2024-08-19T11:17:26.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.160+0000 7f4d1cdc5640 1 -- 172.21.15.71:0/3634689059 wait complete. 2024-08-19T11:17:26.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:26.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:17:26.203 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.286+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.286+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.286+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1378768123}) 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.286+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.286+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.286+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1131546713}) 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3174851537}) 2024-08-19T11:17:26.291 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3198711217}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=965652918}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3277304368}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1843487976}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783226049}) 2024-08-19T11:17:26.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.287+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2103856985}) 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2564473336}) 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1658399322}) 2024-08-19T11:17:26.311 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783579684}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.308+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1776119445}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1107059543}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1888881121}) 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.312 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4132885319}) 2024-08-19T11:17:26.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:17:26.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1297707844}) 2024-08-19T11:17:26.313 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:17:26.309+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=307445339}) 2024-08-19T11:17:26.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.312+0000 7fd2e77c9640 10 monclient: get_monmap_and_config 2024-08-19T11:17:26.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.312+0000 7fd2e77c9640 10 monclient: build_initial_monmap 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.313+0000 7fd2e77c9640 10 monclient: monmap: 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:26.313609+0000 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:26.313609+0000 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:26.314 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:26.315 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:26.315 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:26.315 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:26.315 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:26.315 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.313+0000 7fd2e77c9640 1 Processor -- start 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.313+0000 7fd2e77c9640 1 -- start start 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.313+0000 7fd2e77c9640 10 monclient: init 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient: _add_conns ranks=[0,3,10,8,4,7,5,1,6,2,9] 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd2e009b3a0 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e00690c0 0x7fd2e013b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): picked mon.noname-g con 0x7fd2e00690c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2e013bcb0 0x7fd2e013e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): picked mon.noname-f con 0x7fd2e013bcb0 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e00a1fa0 con 0x7fd2e009b3a0 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e00a19e0 con 0x7fd2e013bcb0 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e00a1700 con 0x7fd2e00690c0 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e77c9640 10 monclient(hunting): authenticate will time out at 1104.355364s 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5565640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd2e009b3a0 0x7fd2e009b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58626/0 (socket says 172.21.15.71:58626) 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5565640 1 -- 172.21.15.71:0/265694316 learned_addr learned my addr 172.21.15.71:0/265694316 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 1 --2- 172.21.15.71:0/265694316 >> v2:172.21.15.135:3300/0 conn(0x7fd2e013bcb0 0x7fd2e013e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e00690c0 0x7fd2e013b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): get_auth_request con 0x7fd2e013bcb0 auth_method 0 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): get_auth_request con 0x7fd2e00690c0 auth_method 0 2024-08-19T11:17:26.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_done global_id 84223 payload 274 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 1 -- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e00690c0 msgr2=0x7fd2e013b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e00690c0 0x7fd2e013b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 1 -- 172.21.15.71:0/265694316 >> v1:172.21.15.71:6789/0 conn(0x7fd2e009b3a0 legacy=0x7fd2e009b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:26.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient: _finish_hunting 0 2024-08-19T11:17:26.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 1 monclient: found mon.noname-f 2024-08-19T11:17:26.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:26.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:17:26.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e5d66640 1 -- 172.21.15.71:0/265694316 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e009be90 con 0x7fd2e013bcb0 2024-08-19T11:17:26.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.314+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e00690c0 0x7fd2e013b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:26.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.317+0000 7fd2e5d66640 1 -- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e013bcb0 msgr2=0x7fd2e013e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.317+0000 7fd2e5d66640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e013bcb0 0x7fd2e013e0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009dc0 tx=0x7fd2d802a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64a442d425af7cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 1 -- 172.21.15.71:0/265694316 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd2d8007bc0 con 0x7fd2e013bcb0 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: dump: 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: _finish_auth 0 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 5 monclient: authenticate success, global_id 84223 2024-08-19T11:17:26.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 1 -- 172.21.15.71:0/265694316 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d8007d80 con 0x7fd2e013bcb0 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 4 set_mon_vals no callback set 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 1 -- 172.21.15.71:0/265694316 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd2d8031870 con 0x7fd2e013bcb0 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2d7fff640 10 monclient: dump: 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 10 monclient: shutdown 2024-08-19T11:17:26.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 1 -- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e013bcb0 msgr2=0x7fd2e013e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.318+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e013bcb0 0x7fd2e013e0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009dc0 tx=0x7fd2d802a4d0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 -- 172.21.15.71:0/265694316 shutdown_connections 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2e013bcb0 0x7fd2e013e0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/265694316 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e00690c0 0x7fd2e013b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 -- 172.21.15.71:0/265694316 >> 172.21.15.71:0/265694316 conn(0x7fd2e00a4ee0 msgr2=0x7fd2e00a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 -- 172.21.15.71:0/265694316 shutdown_connections 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 -- 172.21.15.71:0/265694316 wait complete. 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 10 monclient: build_initial_monmap 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 10 monclient: monmap: 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:26.333 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.319+0000 7fd2e77c9640 1 Processor -- start 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 -- start start 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient: init 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient: _add_conns ranks=[8,3,5,6,2,0,4,1,7] 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 0x7fd2e01ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): picked mon.noname-e con 0x7fd2e00690c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e009b3a0 0x7fd2e009a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): picked mon.noname-g con 0x7fd2e009b3a0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e013bcb0 0x7fd2e009a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): picked mon.noname-h con 0x7fd2e013bcb0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e013e5e0 con 0x7fd2e009b3a0 2024-08-19T11:17:26.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd2e00a0eb0 con 0x7fd2e013bcb0 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd2e013e760 con 0x7fd2e00690c0 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e77c9640 10 monclient(hunting): authenticate will time out at 1104.361471s 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 0x7fd2e01ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 0x7fd2e01ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:34072/0 (socket says 172.21.15.71:34072) 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 -- 172.21.15.71:0/1579169985 learned_addr learned my addr 172.21.15.71:0/1579169985 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): get_auth_request con 0x7fd2e00690c0 auth_method 0 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e009b3a0 0x7fd2e009a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e013bcb0 0x7fd2e009a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): get_auth_request con 0x7fd2e009b3a0 auth_method 0 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): get_auth_request con 0x7fd2e013bcb0 auth_method 0 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient(hunting): handle_auth_done global_id 64970 payload 824 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e013bcb0 msgr2=0x7fd2e009a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e013bcb0 0x7fd2e009a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e009b3a0 msgr2=0x7fd2e009a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e009b3a0 0x7fd2e009a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient: _finish_hunting 0 2024-08-19T11:17:26.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 monclient: found mon.noname-e 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e5565640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e013e2b0 con 0x7fd2e00690c0 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.320+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2e009b3a0 0x7fd2e009a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e5565640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 msgr2=0x7fd2e01ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e5565640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 0x7fd2e01ce710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c490 tx=0x7fd2dc00c950 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd2dc005cf0 con 0x7fd2e00690c0 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: dump: 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc0074e0 con 0x7fd2e00690c0 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 5 monclient: authenticate success, global_id 64970 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd2dc007690 con 0x7fd2e00690c0 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d5ffb640 10 monclient: dump: 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.341 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2d77fe640 4 set_mon_vals no callback set 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 10 monclient: _renew_subs 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e009abb0 con 0x7fd2e00690c0 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 10 monclient: _renew_subs 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.323+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e0095610 con 0x7fd2e00690c0 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd2dc007070 con 0x7fd2e00690c0 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e77c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 0x7fd2e0092390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd2e0076c60 con 0x7fd2e00943d0 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2d5ffb640 1 --2- 172.21.15.71:0/1579169985 >> v2:172.21.15.135:6800/726754104 conn(0x7fd2c403ea80 0x7fd2c4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7fd2dc051710 con 0x7fd2e00690c0 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 0x7fd2e0092390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient: get_auth_request con 0x7fd2e00943d0 auth_method 0 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e5d66640 1 --2- 172.21.15.71:0/1579169985 >> v2:172.21.15.135:6800/726754104 conn(0x7fd2c403ea80 0x7fd2c4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e5d66640 10 monclient: get_auth_request con 0x7fd2c403ea80 auth_method 0 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.324+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.325+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_done global_id 45257 payload 824 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.325+0000 7fd2e4d64640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2e009b780 con 0x7fd2e00943d0 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2e4d64640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 msgr2=0x7fd2e0092390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 0x7fd2e0092390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0093e90 tx=0x7fd2d000f610 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2e5d66640 1 --2- 172.21.15.71:0/1579169985 >> v2:172.21.15.135:6800/726754104 conn(0x7fd2c403ea80 0x7fd2c4040f40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006e3c0 tx=0x7fd2d802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd2d0014ac0 con 0x7fd2e00943d0 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 10 monclient: dump: 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.345 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd2d0014650 con 0x7fd2e00943d0 2024-08-19T11:17:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 msgr2=0x7fd2e0092390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 0x7fd2e0092390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0093e90 tx=0x7fd2d000f610 comp rx=0 tx=0).stop 2024-08-19T11:17:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 msgr2=0x7fd2e0092390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.327+0000 7fd2d5ffb640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00943d0 0x7fd2e0092390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.333+0000 7fd2e77c9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.333+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 0x7fd2e0092ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.333+0000 7fd2e77c9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.333+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd2e0093220 con 0x7fd2e00928d0 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 0x7fd2e0092ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient: get_auth_request con 0x7fd2e00928d0 auth_method 0 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 10 monclient(hunting): handle_auth_done global_id 45266 payload 824 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.334+0000 7fd2e4d64640 1 -- 172.21.15.71:0/1579169985 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd2e006e550 con 0x7fd2e00928d0 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.336+0000 7fd2e4d64640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 msgr2=0x7fd2e0092ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.336+0000 7fd2e4d64640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 0x7fd2e0092ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0012010 tx=0x7fd2d00046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.336+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd2d001d870 con 0x7fd2e00928d0 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.336+0000 7fd2d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.336+0000 7fd2d5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.336+0000 7fd2d5ffb640 10 monclient: dump: 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.350 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fd2d001d400 con 0x7fd2e00928d0 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 msgr2=0x7fd2e0092ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 0x7fd2e0092ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0012010 tx=0x7fd2d00046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 msgr2=0x7fd2e0092ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2d5ffb640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd2e00928d0 0x7fd2e0092ce0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0012010 tx=0x7fd2d00046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:26.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 215359, 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:26.353 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.354 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:26.355 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:26.357 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.360 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:26.364 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.376 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:17:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.377 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:26.377 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 >> v2:172.21.15.135:6800/726754104 conn(0x7fd2c403ea80 msgr2=0x7fd2c4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/1579169985 >> v2:172.21.15.135:6800/726754104 conn(0x7fd2c403ea80 0x7fd2c4040f40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd2e006e3c0 tx=0x7fd2d802f000 comp rx=0 tx=0).stop 2024-08-19T11:17:26.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 10 monclient: shutdown 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 msgr2=0x7fd2e01ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 --2- 172.21.15.71:0/1579169985 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd2e00690c0 0x7fd2e01ce710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c490 tx=0x7fd2dc00c950 comp rx=0 tx=0).stop 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e5d66640 1 -- 172.21.15.71:0/1579169985 reap_dead start 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e5d66640 1 -- 172.21.15.71:0/1579169985 reap_dead start 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 shutdown_connections 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 >> 172.21.15.71:0/1579169985 conn(0x7fd2e00a4ee0 msgr2=0x7fd2e009f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 shutdown_connections 2024-08-19T11:17:26.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.337+0000 7fd2e77c9640 1 -- 172.21.15.71:0/1579169985 wait complete. 2024-08-19T11:17:26.380 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:26.380 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:17:26.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:17:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.477+0000 7fe240304640 10 monclient: get_monmap_and_config 2024-08-19T11:17:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.477+0000 7fe240304640 10 monclient: build_initial_monmap 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.477+0000 7fe240304640 10 monclient: monmap: 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:26.478394+0000 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:26.478394+0000 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:26.480 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.478+0000 7fe240304640 1 Processor -- start 2024-08-19T11:17:26.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.478+0000 7fe240304640 1 -- start start 2024-08-19T11:17:26.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.478+0000 7fe240304640 10 monclient: init 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.478+0000 7fe240304640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient: _add_conns ranks=[9,8,5,7,2,0,10,3,6,4,1] 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2380a6fd0 0x7fe2380a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): picked mon.noname-a con 0x7fe2380a6fd0 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 0x7fe2380a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): picked mon.noname-e con 0x7fe2380a5d10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe238139610 0x7fe238139a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): picked mon.noname-h con 0x7fe238139610 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe23806db40 con 0x7fe2380a6fd0 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe2380a73b0 con 0x7fe238139610 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe23806f230 con 0x7fe2380a5d10 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe240304640 10 monclient(hunting): authenticate will time out at 1104.520083s 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 0x7fe2380a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2380a6fd0 0x7fe2380a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 0x7fe2380a6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:34078/0 (socket says 172.21.15.71:34078) 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2380a6fd0 0x7fe2380a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49898/0 (socket says 172.21.15.71:49898) 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 1 -- 172.21.15.71:0/1073749555 learned_addr learned my addr 172.21.15.71:0/1073749555 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): get_auth_request con 0x7fe2380a5d10 auth_method 0 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): get_auth_request con 0x7fe2380a6fd0 auth_method 0 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e8a1640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe238139610 0x7fe238139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e8a1640 10 monclient(hunting): get_auth_request con 0x7fe238139610 auth_method 0 2024-08-19T11:17:26.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e8a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e8a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e8a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_done global_id 74619 payload 274 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 msgr2=0x7fe2380a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 0x7fe2380a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1073749555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe238139610 msgr2=0x7fe238139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe238139610 0x7fe238139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient: _finish_hunting 0 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 monclient: found mon.noname-a 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:26.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1073749555 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23806dee0 con 0x7fe2380a6fd0 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.479+0000 7fe23d89f640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 0x7fe2380a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2380a6fd0 msgr2=0x7fe2380a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2380a6fd0 0x7fe2380a57d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2340097a0 tx=0x7fe234029fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b54e4e5b7b8374 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 1 -- 172.21.15.71:0/1073749555 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe234037070 con 0x7fe2380a6fd0 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: dump: 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.489 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: _finish_auth 0 2024-08-19T11:17:26.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: _check_auth_tickets 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 1 -- 172.21.15.71:0/1073749555 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23402ad30 con 0x7fe2380a6fd0 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe240304640 5 monclient: authenticate success, global_id 74619 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe240304640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe240304640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe240304640 4 set_mon_vals no callback set 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 1 -- 172.21.15.71:0/1073749555 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe234030c20 con 0x7fe2380a6fd0 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.482+0000 7fe23d09e640 10 monclient: dump: 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.491 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.492 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 10 monclient: shutdown 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 -- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2380a6fd0 msgr2=0x7fe2380a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2380a6fd0 0x7fe2380a57d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2340097a0 tx=0x7fe234029fd0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 -- 172.21.15.71:0/1073749555 shutdown_connections 2024-08-19T11:17:26.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe238139610 0x7fe238139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2380a5d10 0x7fe2380a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 --2- 172.21.15.71:0/1073749555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2380a6fd0 0x7fe2380a57d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 -- 172.21.15.71:0/1073749555 >> 172.21.15.71:0/1073749555 conn(0x7fe2380aa3f0 msgr2=0x7fe2380a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 -- 172.21.15.71:0/1073749555 shutdown_connections 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.483+0000 7fe240304640 1 -- 172.21.15.71:0/1073749555 wait complete. 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient: build_initial_monmap 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient: monmap: 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:26.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:26.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 Processor -- start 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 -- start start 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient: init 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient: _add_conns ranks=[7,1,2,5,6,8,0,3,4] 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2380a5d10 0x7fe238138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): picked mon.noname-i con 0x7fe2380a5d10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2380a6fd0 0x7fe2381389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): picked mon.noname-f con 0x7fe2380a6fd0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 0x7fe238124000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): picked mon.noname-b con 0x7fe238139610 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe23813a150 con 0x7fe2380a6fd0 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe238139fd0 con 0x7fe238139610 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe23813a2d0 con 0x7fe2380a5d10 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe240304640 10 monclient(hunting): authenticate will time out at 1104.525922s 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.484+0000 7fe23e8a1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 0x7fe238124000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 0x7fe238124000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:57022/0 (socket says 172.21.15.71:57022) 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 learned_addr learned my addr 172.21.15.71:0/1421850336 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): get_auth_request con 0x7fe238139610 auth_method 0 2024-08-19T11:17:26.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2380a6fd0 0x7fe2381389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2380a5d10 0x7fe238138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): get_auth_request con 0x7fe2380a6fd0 auth_method 0 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): get_auth_request con 0x7fe2380a5d10 auth_method 0 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23d89f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient(hunting): handle_auth_done global_id 74540 payload 824 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2380a5d10 msgr2=0x7fe238138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2380a5d10 0x7fe238138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2380a6fd0 msgr2=0x7fe2381389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2380a6fd0 0x7fe2381389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient: _finish_hunting 0 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 monclient: found mon.noname-b 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.485+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238127e50 con 0x7fe238139610 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 msgr2=0x7fe238124000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe23e8a1640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 0x7fe238124000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe230007e60 tx=0x7fe23000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe230014890 con 0x7fe238139610 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: dump: 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.507 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: _finish_auth 0 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe230019070 con 0x7fe238139610 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 5 monclient: authenticate success, global_id 74540 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 10 monclient: _renew_subs 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe238138ef0 con 0x7fe238139610 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe230013380 con 0x7fe238139610 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:26.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe22effd640 10 monclient: dump: 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe23c89d640 4 set_mon_vals no callback set 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 10 monclient: _renew_subs 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.487+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe238125af0 con 0x7fe238139610 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe240304640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe240304640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 0x7fe238124540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe238076c60 con 0x7fe2381275b0 2024-08-19T11:17:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe230014420 con 0x7fe238139610 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 0x7fe238124540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient: get_auth_request con 0x7fe2381275b0 auth_method 0 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe22effd640 1 --2- 172.21.15.71:0/1421850336 >> v2:172.21.15.135:6800/726754104 conn(0x7fe21c03ea80 0x7fe21c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7fe2300521d0 con 0x7fe238139610 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.488+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_done global_id 84211 payload 824 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.489+0000 7fe23d89f640 1 --2- 172.21.15.71:0/1421850336 >> v2:172.21.15.135:6800/726754104 conn(0x7fe21c03ea80 0x7fe21c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.489+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2380008d0 con 0x7fe2381275b0 2024-08-19T11:17:26.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.489+0000 7fe23d89f640 10 monclient: get_auth_request con 0x7fe21c03ea80 auth_method 0 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 msgr2=0x7fe238124540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 0x7fe238124540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe234034000 tx=0x7fe2340046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe234043070 con 0x7fe2381275b0 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe23d89f640 1 --2- 172.21.15.71:0/1421850336 >> v2:172.21.15.135:6800/726754104 conn(0x7fe21c03ea80 0x7fe21c040f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe238126160 tx=0x7fe228009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 10 monclient: dump: 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.513 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe23402ad30 con 0x7fe2381275b0 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:26.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 msgr2=0x7fe238124540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 0x7fe238124540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe234034000 tx=0x7fe2340046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 msgr2=0x7fe238124540 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.491+0000 7fe22effd640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2381275b0 0x7fe238124540 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe234034000 tx=0x7fe2340046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.497+0000 7fe240304640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.497+0000 7fe240304640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 0x7fe238124e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.497+0000 7fe240304640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.497+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe2381253d0 con 0x7fe238124a80 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 0x7fe238124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient: get_auth_request con 0x7fe238124a80 auth_method 0 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:26.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 10 monclient(hunting): handle_auth_done global_id 84220 payload 824 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.498+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1421850336 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe238126650 con 0x7fe238124a80 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe23e0a0640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 msgr2=0x7fe238124e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe23e0a0640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 0x7fe238124e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe23402a010 tx=0x7fe234009190 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe234037040 con 0x7fe238124a80 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 10 monclient: dump: 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:26.516 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fe2340487b0 con 0x7fe238124a80 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:26.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 msgr2=0x7fe238124e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 0x7fe238124e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe23402a010 tx=0x7fe234009190 comp rx=0 tx=0).stop 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 msgr2=0x7fe238124e90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.501+0000 7fe22effd640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe238124a80 0x7fe238124e90 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe23402a010 tx=0x7fe234009190 comp rx=0 tx=0).stop 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:26.518 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 154, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 28662, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:17:26.519 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.520 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.521 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:26.522 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:26.523 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:26.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:26.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.533 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:26.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:26.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:26.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:26.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:26.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:26.543 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:26.543 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 >> v2:172.21.15.135:6800/726754104 conn(0x7fe21c03ea80 msgr2=0x7fe21c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 --2- 172.21.15.71:0/1421850336 >> v2:172.21.15.135:6800/726754104 conn(0x7fe21c03ea80 0x7fe21c040f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe238126160 tx=0x7fe228009240 comp rx=0 tx=0).stop 2024-08-19T11:17:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 10 monclient: shutdown 2024-08-19T11:17:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:26.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 msgr2=0x7fe238124000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 --2- 172.21.15.71:0/1421850336 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe238139610 0x7fe238124000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe230007e60 tx=0x7fe23000e4b0 comp rx=0 tx=0).stop 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 reap_dead start 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe23e8a1640 1 -- 172.21.15.71:0/1421850336 reap_dead start 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 shutdown_connections 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 >> 172.21.15.71:0/1421850336 conn(0x7fe2380aa3f0 msgr2=0x7fe2381bfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 shutdown_connections 2024-08-19T11:17:26.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:26.502+0000 7fe240304640 1 -- 172.21.15.71:0/1421850336 wait complete. 2024-08-19T11:17:26.545 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:17:26.546 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e'] 2024-08-19T11:17:26.546 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b', 'g'] 2024-08-19T11:17:26.546 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-19T11:17:26.546 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-19T11:17:26.546 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-19T11:17:26.546 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:17:26.558 INFO:tasks.ceph.mon.e:Stopped 2024-08-19T11:17:26.558 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-19T11:17:26.558 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-19T11:17:26.558 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-08-19T11:17:26.558 INFO:tasks.ceph.mon.g:Sent signal 19 2024-08-19T11:17:26.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:17:41.559 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-19T11:17:41.560 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-19T11:17:41.560 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-08-19T11:17:41.560 INFO:tasks.ceph.mon.g:Sent signal 18 2024-08-19T11:17:41.560 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-19T11:17:41.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.670+0000 7f7d8191b640 10 monclient: get_monmap_and_config 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.670+0000 7f7d8191b640 10 monclient: build_initial_monmap 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.670+0000 7f7d8191b640 10 monclient: monmap: 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:41.670912+0000 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:41.670912+0000 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:41.671 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:41.672 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.670+0000 7f7d8191b640 1 Processor -- start 2024-08-19T11:17:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 -- start start 2024-08-19T11:17:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient: init 2024-08-19T11:17:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient: _add_conns ranks=[4,6,2,10,0,7,1,3,8,9,5] 2024-08-19T11:17:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): picked mon.noname-c con 0x7f7d7c0a57d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): picked mon.noname-d con 0x7f7d7c072400 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): picked mon.noname-b con 0x7f7d7c0a60f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7c072880 con 0x7f7d7c0a60f0 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7d7c0741c0 con 0x7f7d7c0a57d0 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7d7c0a6530 con 0x7f7d7c072400 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d8191b640 10 monclient(hunting): authenticate will time out at 1119.712595s 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:49260/0 (socket says 172.21.15.71:49260) 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:54886/0 (socket says 172.21.15.71:54886) 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 learned_addr learned my addr 172.21.15.71:0/3409460428 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a57d0 auth_method 0 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7d7c072400 auth_method 0 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a60f0 auth_method 0 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:41.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.671+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7d7c072400 auth_method 0 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a57d0 auth_method 0 2024-08-19T11:17:41.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a60f0 auth_method 0 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:41.872+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:42.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a60f0 auth_method 0 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7d7c072400 auth_method 0 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:42.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a57d0 auth_method 0 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:42.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:42.273+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:43.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:43.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a60f0 auth_method 0 2024-08-19T11:17:43.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:43.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7d7c072400 auth_method 0 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d7c0a57d0 auth_method 0 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:43.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:43.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:43.074+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): tick 2024-08-19T11:17:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:17:44.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 monclient(hunting): continuing hunt 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 msgr2=0x7f7d7c0a5bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d7c072400 0x7f7d7c0a5bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 msgr2=0x7f7d7c0a17d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7d7c0a57d0 0x7f7d7c0a17d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 msgr2=0x7f7d7c137580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d7c0a60f0 0x7f7d7c137580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient: _add_conns ranks=[3,0,8,10,5,7,1,9] 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): picked mon.noname-g con 0x7f7d64003850 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7d64006240 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 0x7f7d6400c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:44.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): picked mon.noname-e con 0x7f7d64009f10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 -- 172.21.15.71:0/3409460428 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7c0a72a0 con 0x7f7d64006240 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 -- 172.21.15.71:0/3409460428 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7c0741c0 con 0x7f7d64003850 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 1 -- 172.21.15.71:0/3409460428 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7d7c0a6530 con 0x7f7d64009f10 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d78ff9640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 msgr2=0x7f7d6400c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.671+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 0x7f7d6400c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d64003850 auth_method 0 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:44.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.672+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:44.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.674+0000 7f7d7a7fc640 1 -- 172.21.15.71:0/3409460428 >> v1:172.21.15.71:6789/0 conn(0x7f7d64006240 legacy=0x7f7d640086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.872+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 msgr2=0x7f7d6400c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:44.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.872+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 0x7f7d6400c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d64003850 auth_method 0 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:44.874+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:17:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.273+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 msgr2=0x7f7d6400c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.273+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 0x7f7d6400c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d64003850 auth_method 0 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:45.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:45.276+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:17:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.074+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 msgr2=0x7f7d6400c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:46.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.074+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 0x7f7d6400c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d64003850 auth_method 0 2024-08-19T11:17:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:17:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:17:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:17:46.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.078+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:17:46.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.581+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979786423 0 0) 0x7f7d7c0a72a0 con 0x7f7d64006240 2024-08-19T11:17:46.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.581+0000 7f7d79ffb640 10 monclient(hunting): _negotiate 2024-08-19T11:17:46.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.581+0000 7f7d79ffb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.581+0000 7f7d79ffb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.581+0000 7f7d79ffb640 10 monclient(hunting): my global_id is 74628 2024-08-19T11:17:46.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.581+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d68003520 con 0x7f7d64006240 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1469118320 0 0) 0x7f7d68003520 con 0x7f7d64006240 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 msgr2=0x7f7d6400c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d64009f10 0x7f7d6400c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 msgr2=0x7f7d64005c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d64003850 0x7f7d64005c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 10 monclient: _finish_hunting 0 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:17:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6400dbd0 con 0x7f7d64006240 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f7d7000d930 con 0x7f7d64006240 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.587+0000 7f7d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 reap_dead start 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient: dump: 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 >> v1:172.21.15.71:6789/0 conn(0x7f7d64006240 legacy=0x7f7d640086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient: _add_conns ranks=[8,7,2,6,3,4,1,0,5] 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d68004200 0x7f7d68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): picked mon.e con 0x7f7d68004200 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7d68004e10 0x7f7d68005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): picked mon.i con 0x7f7d68004e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 0x7f7d6800c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): picked mon.b con 0x7f7d68009cd0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7c0741c0 con 0x7f7d68009cd0 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7d7c0a6530 con 0x7f7d68004e10 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7d6800ca70 con 0x7f7d68004200 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7affd640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d68004200 msgr2=0x7f7d68004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d79ffb640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7affd640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d68004200 0x7f7d68004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 0x7f7d6800c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7d68009cd0 auth_method 0 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7d68004e10 0x7f7d68005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7d68004e10 auth_method 0 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_done global_id 74628 payload 293 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d68004200 msgr2=0x7f7d68004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d68004200 0x7f7d68004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7d68004e10 msgr2=0x7f7d68005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7d68004e10 0x7f7d68005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 monclient: found mon.b 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d68003520 con 0x7f7d68009cd0 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d8191b640 5 monclient: authenticate success, global_id 74628 2024-08-19T11:17:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.588+0000 7f7d8191b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 msgr2=0x7f7d6800c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 0x7f7d6800c160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0a7980 tx=0x7f7d68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a8e6fee508f549 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d74031070 con 0x7f7d68009cd0 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 10 monclient: dump: 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.605 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d8191b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d74035400 con 0x7f7d68009cd0 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d8191b640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 1 -- 172.21.15.71:0/3409460428 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d74003d30 con 0x7f7d68009cd0 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.591+0000 7f7d8191b640 4 set_mon_vals no callback set 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d79ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d79ffb640 10 monclient: dump: 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 10 monclient: shutdown 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 -- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 msgr2=0x7f7d6800c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 0x7f7d6800c160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0a7980 tx=0x7f7d68005830 comp rx=0 tx=0).stop 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 -- 172.21.15.71:0/3409460428 shutdown_connections 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7d68009cd0 0x7f7d6800c160 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7d68004e10 0x7f7d68005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 --2- 172.21.15.71:0/3409460428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7d68004200 0x7f7d68004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 -- 172.21.15.71:0/3409460428 >> 172.21.15.71:0/3409460428 conn(0x7f7d7c0aa3f0 msgr2=0x7f7d7c0a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 -- 172.21.15.71:0/3409460428 shutdown_connections 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.592+0000 7f7d8191b640 1 -- 172.21.15.71:0/3409460428 wait complete. 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.593+0000 7f7d8191b640 10 monclient: build_initial_monmap 2024-08-19T11:17:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.593+0000 7f7d8191b640 10 monclient: monmap: 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:46.609 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 Processor -- start 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 -- start start 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient: init 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient: _add_conns ranks=[5,3,6,0,2,1,7,4,8] 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7d64006240 0x7f7d7c1c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): picked mon.noname-h con 0x7f7d64006240 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d68004200 0x7f7d7c1346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): picked mon.noname-g con 0x7f7d68004200 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 0x7f7d7c09e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): picked mon.noname-d con 0x7f7d68004e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d7c0a5f40 con 0x7f7d68004200 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7d7c0a5dc0 con 0x7f7d64006240 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7d7c0a17d0 con 0x7f7d68004e10 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.594+0000 7f7d8191b640 10 monclient(hunting): authenticate will time out at 1124.635967s 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 0x7f7d7c09e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 0x7f7d7c09e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:37688/0 (socket says 172.21.15.71:37688) 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/1929439404 learned_addr learned my addr 172.21.15.71:0/1929439404 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7d68004e10 auth_method 0 2024-08-19T11:17:46.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7d64006240 0x7f7d7c1c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): get_auth_request con 0x7f7d64006240 auth_method 0 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d68004200 0x7f7d7c1346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7d68004200 auth_method 0 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient(hunting): handle_auth_done global_id 26133 payload 824 2024-08-19T11:17:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7d64006240 msgr2=0x7f7d7c1c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7d64006240 0x7f7d7c1c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d68004200 msgr2=0x7f7d7c1346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d68004200 0x7f7d7c1346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 monclient: found mon.noname-d 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.595+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/1929439404 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7c122070 con 0x7f7d68004e10 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.597+0000 7f7d7b7fe640 1 -- 172.21.15.71:0/1929439404 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 msgr2=0x7f7d7c09e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.597+0000 7f7d7b7fe640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 0x7f7d7c09e7b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7d7402b460 tx=0x7f7d74004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d74044020 con 0x7f7d68004e10 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: dump: 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: _finish_auth 0 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:46.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d74035d00 con 0x7f7d68004e10 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 5 monclient: authenticate success, global_id 26133 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 10 monclient: _renew_subs 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7c0a52d0 con 0x7f7d68004e10 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d74003d30 con 0x7f7d68004e10 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d63fff640 10 monclient: dump: 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.617 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 10 monclient: _renew_subs 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d797fa640 4 set_mon_vals no callback set 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.600+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d7c121d90 con 0x7f7d68004e10 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7d74047020 con 0x7f7d68004e10 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d8191b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d8191b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d8191b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d7c135080 con 0x7f7d68004e10 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d63fff640 1 --2- 172.21.15.71:0/1929439404 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d6403fd00 0x7f7d640421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(201..201 src has 1..201) ==== 3506+0+0 (secure 0 0 0) 0x7f7d74012040 con 0x7f7d68004e10 2024-08-19T11:17:46.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d7affd640 1 --2- 172.21.15.71:0/1929439404 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d6403fd00 0x7f7d640421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.601+0000 7f7d7affd640 10 monclient: get_auth_request con 0x7f7d6403fd00 auth_method 0 2024-08-19T11:17:46.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.604+0000 7f7d7affd640 1 --2- 172.21.15.71:0/1929439404 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d6403fd00 0x7f7d640421c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d640036a0 tx=0x7f7d6c01f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:46.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.606+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f7d7c135080 con 0x7f7d68004e10 2024-08-19T11:17:46.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.606+0000 7f7d63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:46.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.606+0000 7f7d63fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d8191b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:17:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d8191b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d8191b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7d7c078580 con 0x7f7d68004e10 2024-08-19T11:17:46.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d63fff640 1 -- 172.21.15.71:0/1929439404 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7f7d7c078580 con 0x7f7d68004e10 2024-08-19T11:17:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:17:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.853+0000 7f7d63fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:46.855 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":164,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d6403fd00 msgr2=0x7f7d640421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 --2- 172.21.15.71:0/1929439404 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d6403fd00 0x7f7d640421c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d640036a0 tx=0x7f7d6c01f040 comp rx=0 tx=0).stop 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 10 monclient: shutdown 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 msgr2=0x7f7d7c09e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 0x7f7d7c09e7b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7d7402b460 tx=0x7f7d74004a40 comp rx=0 tx=0).stop 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 shutdown_connections 2024-08-19T11:17:46.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 --2- 172.21.15.71:0/1929439404 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d6403fd00 0x7f7d640421c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d68004200 0x7f7d7c1346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7d68004e10 0x7f7d7c09e7b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 --2- 172.21.15.71:0/1929439404 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7d64006240 0x7f7d7c1c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 >> 172.21.15.71:0/1929439404 conn(0x7f7d7c0aa3f0 msgr2=0x7f7d7c1357d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 shutdown_connections 2024-08-19T11:17:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.857+0000 7f7d8191b640 1 -- 172.21.15.71:0/1929439404 wait complete. 2024-08-19T11:17:46.872 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-19T11:17:46.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-19T11:17:46.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.969+0000 7f13af898640 10 monclient: get_monmap_and_config 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.969+0000 7f13af898640 10 monclient: build_initial_monmap 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.969+0000 7f13af898640 10 monclient: monmap: 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:46.970462+0000 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:46.970462+0000 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:46.971 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.970+0000 7f13af898640 1 Processor -- start 2024-08-19T11:17:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.970+0000 7f13af898640 1 -- start start 2024-08-19T11:17:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.970+0000 7f13af898640 10 monclient: init 2024-08-19T11:17:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient: _add_conns ranks=[2,4,7,6,8,1,10,3,9,0,5] 2024-08-19T11:17:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 0x7f13a80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): picked mon.noname-b con 0x7f13a80a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 0x7f13a80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): picked mon.noname-c con 0x7f13a80a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13a8139710 0x7f13a8139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): picked mon.noname-i con 0x7f13a8139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f13a80a5020 con 0x7f13a80a6950 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f13a80a77b0 con 0x7f13a80a57c0 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f13a80a7d40 con 0x7f13a8139710 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13af898640 10 monclient(hunting): authenticate will time out at 1125.012126s 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 0x7f13a80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 0x7f13a80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 0x7f13a80a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50318/0 (socket says 172.21.15.71:50318) 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 0x7f13a80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:46498/0 (socket says 172.21.15.71:46498) 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 -- 172.21.15.71:0/558886294 learned_addr learned my addr 172.21.15.71:0/558886294 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): get_auth_request con 0x7f13a80a57c0 auth_method 0 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): get_auth_request con 0x7f13a80a6950 auth_method 0 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ade35640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13a8139710 0x7f13a8139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ade35640 10 monclient(hunting): get_auth_request con 0x7f13a8139710 auth_method 0 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ade35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ade35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ade35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient(hunting): handle_auth_done global_id 84307 payload 274 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 -- 172.21.15.71:0/558886294 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13a8139710 msgr2=0x7f13a8139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13a8139710 0x7f13a8139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 -- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 msgr2=0x7f13a80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 0x7f13a80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient: _finish_hunting 0 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 monclient: found mon.noname-c 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ace33640 1 -- 172.21.15.71:0/558886294 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a80a6380 con 0x7f13a80a57c0 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.971+0000 7f13ad634640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 0x7f13a80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13ace33640 1 -- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 msgr2=0x7f13a80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13ace33640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 0x7f13a80a7270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098d0 tx=0x7f139c02a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=9bcbaebac34c9e68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 1 -- 172.21.15.71:0/558886294 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f139c037070 con 0x7f13a80a57c0 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: dump: 2024-08-19T11:17:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: _finish_auth 0 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 1 -- 172.21.15.71:0/558886294 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139c02adc0 con 0x7f13a80a57c0 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 5 monclient: authenticate success, global_id 84307 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 1 -- 172.21.15.71:0/558886294 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f139c030c20 con 0x7f13a80a57c0 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 4 set_mon_vals no callback set 2024-08-19T11:17:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13a7fff640 10 monclient: dump: 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 10 monclient: shutdown 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 1 -- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 msgr2=0x7f13a80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.974+0000 7f13af898640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 0x7f13a80a7270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098d0 tx=0x7f139c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 -- 172.21.15.71:0/558886294 shutdown_connections 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f13a8139710 0x7f13a8139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13a80a57c0 0x7f13a80a7270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 --2- 172.21.15.71:0/558886294 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13a80a6950 0x7f13a80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 -- 172.21.15.71:0/558886294 >> 172.21.15.71:0/558886294 conn(0x7f13a80abf50 msgr2=0x7f13a80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 -- 172.21.15.71:0/558886294 shutdown_connections 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 1 -- 172.21.15.71:0/558886294 wait complete. 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 10 monclient: build_initial_monmap 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.975+0000 7f13af898640 10 monclient: monmap: 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 Processor -- start 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 -- start start 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient: init 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient: _add_conns ranks=[6,5,1,8,4,2,3,7,0] 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 0x7f13a81ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): picked mon.noname-d con 0x7f13a80a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13a80a6950 0x7f13a8138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): picked mon.noname-h con 0x7f13a80a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13a8139710 0x7f13a8138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): picked mon.noname-f con 0x7f13a8139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f13a80a84c0 con 0x7f13a8139710 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f13a80a3650 con 0x7f13a80a6950 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f13a80a8700 con 0x7f13a80a57c0 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13af898640 10 monclient(hunting): authenticate will time out at 1125.017503s 2024-08-19T11:17:46.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 0x7f13a81ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 0x7f13a81ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:37694/0 (socket says 172.21.15.71:37694) 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 -- 172.21.15.71:0/3633982241 learned_addr learned my addr 172.21.15.71:0/3633982241 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): get_auth_request con 0x7f13a80a57c0 auth_method 0 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ade35640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13a8139710 0x7f13a8138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ade35640 10 monclient(hunting): get_auth_request con 0x7f13a8139710 auth_method 0 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ade35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ade35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ade35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ace33640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13a80a6950 0x7f13a8138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ace33640 10 monclient(hunting): get_auth_request con 0x7f13a80a6950 auth_method 0 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ace33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ace33640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ace33640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient(hunting): handle_auth_done global_id 26142 payload 824 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13a80a6950 msgr2=0x7f13a8138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f13a80a6950 0x7f13a8138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13a8139710 msgr2=0x7f13a8138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13a8139710 0x7f13a8138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient: _finish_hunting 0 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 monclient: found mon.noname-d 2024-08-19T11:17:46.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ad634640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8126420 con 0x7f13a80a57c0 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.976+0000 7f13ade35640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13a8139710 0x7f13a8138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13ad634640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 msgr2=0x7f13a81ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13ad634640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 0x7f13a81ce400 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f13a000ec10 tx=0x7f13a000c520 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a0017070 con 0x7f13a80a57c0 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: dump: 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.998 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:46.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 5 monclient: authenticate success, global_id 26142 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a000ce40 con 0x7f13a80a57c0 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13a0013d50 con 0x7f13a80a57c0 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 10 monclient: _renew_subs 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a81251e0 con 0x7f13a80a57c0 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a77fe640 4 set_mon_vals no callback set 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:47.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13a5ffb640 10 monclient: dump: 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 10 monclient: _renew_subs 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.979+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a8125b80 con 0x7f13a80a57c0 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13af898640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13af898640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 0x7f13a802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13a806a590 con 0x7f13a8122f90 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f13a001a070 con 0x7f13a80a57c0 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 0x7f13a802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient: get_auth_request con 0x7f13a8122f90 auth_method 0 2024-08-19T11:17:47.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13a5ffb640 1 --2- 172.21.15.71:0/3633982241 >> v2:172.21.15.135:6800/726754104 conn(0x7f139403ea80 0x7f1394040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 10 monclient(hunting): handle_auth_done global_id 74637 payload 824 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ace33640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13a80a3f10 con 0x7f13a8122f90 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(202..202 src has 1..202) ==== 3898+0+0 (secure 0 0 0) 0x7f13a000f040 con 0x7f13a80a57c0 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ade35640 1 --2- 172.21.15.71:0/3633982241 >> v2:172.21.15.135:6800/726754104 conn(0x7f139403ea80 0x7f1394040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.980+0000 7f13ade35640 10 monclient: get_auth_request con 0x7f139403ea80 auth_method 0 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.982+0000 7f13ace33640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 msgr2=0x7f13a802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.982+0000 7f13ace33640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 0x7f13a802d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f139c034000 tx=0x7f139c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.982+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f139c041070 con 0x7f13a8122f90 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.982+0000 7f13a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.982+0000 7f13a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.982+0000 7f13a5ffb640 10 monclient: dump: 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f139c02adc0 con 0x7f13a8122f90 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 msgr2=0x7f13a802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 0x7f13a802d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f139c034000 tx=0x7f139c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 msgr2=0x7f13a802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13a5ffb640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8122f90 0x7f13a802d1c0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f139c034000 tx=0x7f139c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.983+0000 7f13ade35640 1 --2- 172.21.15.71:0/3633982241 >> v2:172.21.15.135:6800/726754104 conn(0x7f139403ea80 0x7f1394040f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13a80abe80 tx=0x7f139800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13af898640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13af898640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 0x7f13a802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13af898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8076c60 con 0x7f13a8123370 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 0x7f13a802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient: get_auth_request con 0x7f13a8123370 auth_method 0 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 10 monclient(hunting): handle_auth_done global_id 74646 payload 824 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.989+0000 7f13ace33640 1 -- 172.21.15.71:0/3633982241 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13a80a6d30 con 0x7f13a8123370 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.991+0000 7f13ace33640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 msgr2=0x7f13a802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.991+0000 7f13ace33640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 0x7f13a802d700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098d0 tx=0x7f139c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.991+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f139c037040 con 0x7f13a8123370 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.991+0000 7f13a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.991+0000 7f13a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.991+0000 7f13a5ffb640 10 monclient: dump: 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.010 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9426 (secure 0 0 0) 0x7f139c03cac0 con 0x7f13a8123370 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 msgr2=0x7f13a802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 0x7f13a802d700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098d0 tx=0x7f139c009240 comp rx=0 tx=0).stop 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 msgr2=0x7f13a802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13a5ffb640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a8123370 0x7f13a802d700 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098d0 tx=0x7f139c009240 comp rx=0 tx=0).stop 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:47.011 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 116023, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:47.012 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.013 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.014 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.015 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.016 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.017 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.019 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:47.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.027 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:47.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.033 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.034 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:47.035 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:47.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 >> v2:172.21.15.135:6800/726754104 conn(0x7f139403ea80 msgr2=0x7f1394040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 --2- 172.21.15.71:0/3633982241 >> v2:172.21.15.135:6800/726754104 conn(0x7f139403ea80 0x7f1394040f40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13a80abe80 tx=0x7f139800b040 comp rx=0 tx=0).stop 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 10 monclient: shutdown 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 msgr2=0x7f13a81ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 --2- 172.21.15.71:0/3633982241 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13a80a57c0 0x7f13a81ce400 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f13a000ec10 tx=0x7f13a000c520 comp rx=0 tx=0).stop 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13ade35640 1 -- 172.21.15.71:0/3633982241 reap_dead start 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13ade35640 1 -- 172.21.15.71:0/3633982241 reap_dead start 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 shutdown_connections 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 >> 172.21.15.71:0/3633982241 conn(0x7f13a80abf50 msgr2=0x7f13a80aaaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 shutdown_connections 2024-08-19T11:17:47.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:46.992+0000 7f13af898640 1 -- 172.21.15.71:0/3633982241 wait complete. 2024-08-19T11:17:47.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:47.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-19T11:17:47.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.136+0000 7fb558470640 10 monclient: get_monmap_and_config 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.136+0000 7fb558470640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.136+0000 7fb558470640 10 monclient: monmap: 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:47.137073+0000 2024-08-19T11:17:47.137 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:47.137073+0000 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:47.138 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:47.139 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 Processor -- start 2024-08-19T11:17:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 -- start start 2024-08-19T11:17:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient: init 2024-08-19T11:17:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient: _add_conns ranks=[0,3,10,1,8,7,5,6,2,9,4] 2024-08-19T11:17:47.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb5500a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5500a57c0 0x7fb55013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): picked mon.noname-g con 0x7fb5500a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb5500a7440 0x7fb5501410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): picked mon.noname-f con 0x7fb5500a7440 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5500a6380 con 0x7fb5500a6950 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb5500a5020 con 0x7fb5500a7440 2024-08-19T11:17:47.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb5500a7d40 con 0x7fb5500a57c0 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb558470640 10 monclient(hunting): authenticate will time out at 1125.178735s 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb55620c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb5500a6950 0x7fb5500a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57548/0 (socket says 172.21.15.71:57548) 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb55620c640 1 -- 172.21.15.71:0/3045714804 learned_addr learned my addr 172.21.15.71:0/3045714804 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.137+0000 7fb556a0d640 1 --2- 172.21.15.71:0/3045714804 >> v2:172.21.15.135:3300/0 conn(0x7fb5500a7440 0x7fb5501410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): get_auth_request con 0x7fb5500a7440 auth_method 0 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 1 --2- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5500a57c0 0x7fb55013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): get_auth_request con 0x7fb5500a57c0 auth_method 0 2024-08-19T11:17:47.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient(hunting): handle_auth_done global_id 84250 payload 274 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 1 -- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5500a57c0 msgr2=0x7fb55013eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 1 --2- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5500a57c0 0x7fb55013eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 1 -- 172.21.15.71:0/3045714804 >> v1:172.21.15.71:6789/0 conn(0x7fb5500a6950 legacy=0x7fb5500a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 1 monclient: found mon.noname-f 2024-08-19T11:17:47.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:17:47.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.138+0000 7fb556a0d640 1 -- 172.21.15.71:0/3045714804 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5500a3650 con 0x7fb5500a7440 2024-08-19T11:17:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb556a0d640 1 -- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a7440 msgr2=0x7fb5501410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb556a0d640 1 --2- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a7440 0x7fb5501410b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5400097d0 tx=0x7fb54002a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a05ce5a7e475899 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 1 -- 172.21.15.71:0/3045714804 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb540037070 con 0x7fb5500a7440 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: dump: 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.152 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 1 -- 172.21.15.71:0/3045714804 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54002ad20 con 0x7fb5500a7440 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb558470640 5 monclient: authenticate success, global_id 84250 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb558470640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:47.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb558470640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 1 -- 172.21.15.71:0/3045714804 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb540030c20 con 0x7fb5500a7440 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb558470640 4 set_mon_vals no callback set 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.141+0000 7fb55520a640 10 monclient: dump: 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.154 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 10 monclient: shutdown 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 -- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a7440 msgr2=0x7fb5501410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 --2- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a7440 0x7fb5501410b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5400097d0 tx=0x7fb54002a000 comp rx=0 tx=0).stop 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 -- 172.21.15.71:0/3045714804 shutdown_connections 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 --2- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a7440 0x7fb5501410b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 --2- 172.21.15.71:0/3045714804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5500a57c0 0x7fb55013eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 -- 172.21.15.71:0/3045714804 >> 172.21.15.71:0/3045714804 conn(0x7fb5500abf50 msgr2=0x7fb5500ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 -- 172.21.15.71:0/3045714804 shutdown_connections 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 1 -- 172.21.15.71:0/3045714804 wait complete. 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.142+0000 7fb558470640 10 monclient: monmap: 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.156 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 Processor -- start 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 -- start start 2024-08-19T11:17:47.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient: init 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient: _add_conns ranks=[4,1,8,6,3,7,5,0,2] 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 0x7fb550128a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): picked mon.noname-c con 0x7fb5500a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a6950 0x7fb5501ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): picked mon.noname-f con 0x7fb5500a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5500a7440 0x7fb550126590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): picked mon.noname-e con 0x7fb5500a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5500a8700 con 0x7fb5500a6950 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb5500a84c0 con 0x7fb5500a57c0 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fb5501415f0 con 0x7fb5500a7440 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb558470640 10 monclient(hunting): authenticate will time out at 1125.184677s 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb556a0d640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5500a7440 msgr2=0x7fb550126590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb556a0d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5500a7440 0x7fb550126590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 0x7fb550128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 0x7fb550128a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50324/0 (socket says 172.21.15.71:50324) 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 1 -- 172.21.15.71:0/1553357844 learned_addr learned my addr 172.21.15.71:0/1553357844 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): get_auth_request con 0x7fb5500a57c0 auth_method 0 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a6950 0x7fb5501ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): get_auth_request con 0x7fb5500a6950 auth_method 0 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb55620c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.143+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 10 monclient(hunting): handle_auth_done global_id 84316 payload 824 2024-08-19T11:17:47.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5500a7440 msgr2=0x7fb550126590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5500a7440 0x7fb550126590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a6950 msgr2=0x7fb5501ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a6950 0x7fb5501ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 1 monclient: found mon.noname-c 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb55620c640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb550129f30 con 0x7fb5500a57c0 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.144+0000 7fb555a0b640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5500a6950 0x7fb5501ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb55620c640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 msgr2=0x7fb550128a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb55620c640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 0x7fb550128a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c460 tx=0x7fb54800c920 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb548017070 con 0x7fb5500a57c0 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: dump: 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.162 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb548005cf0 con 0x7fb5500a57c0 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 5 monclient: authenticate success, global_id 84316 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb548004b20 con 0x7fb5500a57c0 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb554a09640 4 set_mon_vals no callback set 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb54effd640 10 monclient: dump: 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.164 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 10 monclient: _renew_subs 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb550141280 con 0x7fb5500a57c0 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 10 monclient: _renew_subs 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.146+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55012a210 con 0x7fb5500a57c0 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb558470640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb558470640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 0x7fb550126ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb55006a590 con 0x7fb5501cf0b0 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 0x7fb550126ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient: get_auth_request con 0x7fb5501cf0b0 auth_method 0 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb548007070 con 0x7fb5500a57c0 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 10 monclient(hunting): handle_auth_done global_id 74558 payload 824 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb555a0b640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5500a93a0 con 0x7fb5501cf0b0 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb54effd640 1 --2- 172.21.15.71:0/1553357844 >> v2:172.21.15.135:6800/726754104 conn(0x7fb53c03ea80 0x7fb53c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.147+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(202..202 src has 1..202) ==== 3898+0+0 (secure 0 0 0) 0x7fb548051050 con 0x7fb5500a57c0 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.148+0000 7fb556a0d640 1 --2- 172.21.15.71:0/1553357844 >> v2:172.21.15.135:6800/726754104 conn(0x7fb53c03ea80 0x7fb53c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.148+0000 7fb556a0d640 10 monclient: get_auth_request con 0x7fb53c03ea80 auth_method 0 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb555a0b640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 msgr2=0x7fb550126ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb555a0b640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 0x7fb550126ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb550127cb0 tx=0x7fb5440079f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb544016e60 con 0x7fb5501cf0b0 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 10 monclient: dump: 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.167 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb54401d070 con 0x7fb5501cf0b0 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:47.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 msgr2=0x7fb550126ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 0x7fb550126ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb550127cb0 tx=0x7fb5440079f0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 msgr2=0x7fb550126ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb54effd640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5501cf0b0 0x7fb550126ad0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb550127cb0 tx=0x7fb5440079f0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.150+0000 7fb556a0d640 1 --2- 172.21.15.71:0/1553357844 >> v2:172.21.15.135:6800/726754104 conn(0x7fb53c03ea80 0x7fb53c040f40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb5400097d0 tx=0x7fb54002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb558470640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb558470640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 0x7fb5501225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb558470640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb5501c6480 con 0x7fb550127010 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 0x7fb5501225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient: get_auth_request con 0x7fb550127010 auth_method 0 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 10 monclient(hunting): handle_auth_done global_id 74567 payload 824 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.156+0000 7fb555a0b640 1 -- 172.21.15.71:0/1553357844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5501273f0 con 0x7fb550127010 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb555a0b640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 msgr2=0x7fb5501225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb555a0b640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 0x7fb5501225a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb544009fd0 tx=0x7fb544004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb544018d10 con 0x7fb550127010 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 10 monclient: dump: 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9257 (secure 0 0 0) 0x7fb544018d10 con 0x7fb550127010 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:47.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 msgr2=0x7fb5501225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 0x7fb5501225a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb544009fd0 tx=0x7fb544004a40 comp rx=0 tx=0).stop 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 msgr2=0x7fb5501225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb54effd640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb550127010 0x7fb5501225a0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb544009fd0 tx=0x7fb544004a40 comp rx=0 tx=0).stop 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:47.174 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 116190, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:47.175 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:47.176 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:47.178 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.179 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:47.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.181 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.186 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:47.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.191 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:47.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.195 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:47.196 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 >> v2:172.21.15.135:6800/726754104 conn(0x7fb53c03ea80 msgr2=0x7fb53c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 --2- 172.21.15.71:0/1553357844 >> v2:172.21.15.135:6800/726754104 conn(0x7fb53c03ea80 0x7fb53c040f40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb5400097d0 tx=0x7fb54002e000 comp rx=0 tx=0).stop 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 10 monclient: shutdown 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 msgr2=0x7fb550128a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 --2- 172.21.15.71:0/1553357844 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5500a57c0 0x7fb550128a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c460 tx=0x7fb54800c920 comp rx=0 tx=0).stop 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb556a0d640 1 -- 172.21.15.71:0/1553357844 reap_dead start 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb556a0d640 1 -- 172.21.15.71:0/1553357844 reap_dead start 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 shutdown_connections 2024-08-19T11:17:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 >> 172.21.15.71:0/1553357844 conn(0x7fb5500abf50 msgr2=0x7fb55009d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 shutdown_connections 2024-08-19T11:17:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.159+0000 7fb558470640 1 -- 172.21.15.71:0/1553357844 wait complete. 2024-08-19T11:17:47.199 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:47.199 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-19T11:17:47.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:17:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.296+0000 7f5d3af6b640 10 monclient: get_monmap_and_config 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.296+0000 7f5d3af6b640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.296+0000 7f5d3af6b640 10 monclient: monmap: 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:47.297430+0000 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:47.297430+0000 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:47.299 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.297+0000 7f5d3af6b640 1 Processor -- start 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.297+0000 7f5d3af6b640 1 -- start start 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.297+0000 7f5d3af6b640 10 monclient: init 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient: _add_conns ranks=[5,2,1,10,0,7,6,4,9,8,3] 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5d340a6950 0x7f5d340a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): picked mon.noname-h con 0x7f5d340a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d340a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): picked mon.noname-b con 0x7f5d340a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5d34139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d340a6380 con 0x7f5d34139710 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5d340a5020 con 0x7f5d340a57c0 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5d340a77b0 con 0x7f5d340a6950 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d3af6b640 10 monclient(hunting): authenticate will time out at 1125.339293s 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d340a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d340a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:46520/0 (socket says 172.21.15.71:46520) 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 -- 172.21.15.71:0/464271915 learned_addr learned my addr 172.21.15.71:0/464271915 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): get_auth_request con 0x7f5d340a57c0 auth_method 0 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 1 --2- 172.21.15.71:0/464271915 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5d340a6950 0x7f5d340a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): get_auth_request con 0x7f5d340a6950 auth_method 0 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient(hunting): handle_auth_done global_id 74576 payload 274 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 -- 172.21.15.71:0/464271915 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5d340a6950 msgr2=0x7f5d340a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 --2- 172.21.15.71:0/464271915 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5d340a6950 0x7f5d340a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 -- 172.21.15.71:0/464271915 >> v1:172.21.15.135:6789/0 conn(0x7f5d34139710 legacy=0x7f5d34139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 monclient: found mon.noname-b 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.298+0000 7f5d33fff640 1 -- 172.21.15.71:0/464271915 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d340a3650 con 0x7f5d340a57c0 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d33fff640 1 -- 172.21.15.71:0/464271915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 msgr2=0x7f5d340a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d33fff640 1 --2- 172.21.15.71:0/464271915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d340a7270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d280098a0 tx=0x7f5d2802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a519a09dd9e51e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 1 -- 172.21.15.71:0/464271915 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d28037070 con 0x7f5d340a57c0 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: dump: 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 1 -- 172.21.15.71:0/464271915 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2802ade0 con 0x7f5d340a57c0 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d3af6b640 5 monclient: authenticate success, global_id 74576 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d3af6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d3af6b640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 1 -- 172.21.15.71:0/464271915 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d28030c20 con 0x7f5d340a57c0 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d3af6b640 4 set_mon_vals no callback set 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.301+0000 7f5d337fe640 10 monclient: dump: 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 10 monclient: shutdown 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 -- 172.21.15.71:0/464271915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 msgr2=0x7f5d340a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/464271915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d340a7270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d280098a0 tx=0x7f5d2802a080 comp rx=0 tx=0).stop 2024-08-19T11:17:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 -- 172.21.15.71:0/464271915 shutdown_connections 2024-08-19T11:17:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/464271915 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d340a7270 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/464271915 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5d340a6950 0x7f5d340a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 -- 172.21.15.71:0/464271915 >> 172.21.15.71:0/464271915 conn(0x7f5d340abf50 msgr2=0x7f5d340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 -- 172.21.15.71:0/464271915 shutdown_connections 2024-08-19T11:17:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 1 -- 172.21.15.71:0/464271915 wait complete. 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.302+0000 7f5d3af6b640 10 monclient: monmap: 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:47.318 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 Processor -- start 2024-08-19T11:17:47.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 -- start start 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient: init 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient: _add_conns ranks=[2,1,0,5,4,6,7,8,3] 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d34138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): picked mon.noname-b con 0x7f5d340a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d340a6950 0x7f5d34138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): picked mon.noname-f con 0x7f5d340a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 0x7f5d341225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): picked mon.noname-a con 0x7f5d34139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d340a84c0 con 0x7f5d34139710 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d340a7d40 con 0x7f5d340a6950 2024-08-19T11:17:47.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5d340a8700 con 0x7f5d340a57c0 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.303+0000 7f5d3af6b640 10 monclient(hunting): authenticate will time out at 1125.344935s 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d34138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 0x7f5d341225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d34138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:46528/0 (socket says 172.21.15.71:46528) 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 1 -- 172.21.15.71:0/877181443 learned_addr learned my addr 172.21.15.71:0/877181443 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): get_auth_request con 0x7f5d340a57c0 auth_method 0 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): get_auth_request con 0x7f5d34139710 auth_method 0 2024-08-19T11:17:47.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d340a6950 0x7f5d34138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): get_auth_request con 0x7f5d340a6950 auth_method 0 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient(hunting): handle_auth_done global_id 74655 payload 824 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 msgr2=0x7f5d34138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d34138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d340a6950 msgr2=0x7f5d34138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d340a6950 0x7f5d34138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 monclient: found mon.noname-a 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d39508640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d34123f80 con 0x7f5d34139710 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.304+0000 7f5d38d07640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5d340a57c0 0x7f5d34138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d39508640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 msgr2=0x7f5d341225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d39508640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 0x7f5d341225a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00be00 tx=0x7f5d2c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d2c0148b0 con 0x7f5d34139710 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: dump: 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2c014a90 con 0x7f5d34139710 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 5 monclient: authenticate success, global_id 74655 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 10 monclient: _renew_subs 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3413a2d0 con 0x7f5d34139710 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d2c014c40 con 0x7f5d34139710 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d317fa640 10 monclient: dump: 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.326 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 10 monclient: _renew_subs 2024-08-19T11:17:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341262e0 con 0x7f5d34139710 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.306+0000 7f5d32ffd640 4 set_mon_vals no callback set 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d3af6b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 0x7f5d3402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5d34076c60 con 0x7f5d341ce5a0 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 0x7f5d3402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d39508640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 0x7f5d341225a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00be00 tx=0x7f5d2c00bef0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f5d2c01b020 mgrmap(e 5) 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient: get_auth_request con 0x7f5d341ce5a0 auth_method 0 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5d2c01b020 con 0x7f5d34139710 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 10 monclient(hunting): handle_auth_done global_id 84325 payload 824 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d38d07640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d340a20a0 con 0x7f5d341ce5a0 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.307+0000 7f5d317fa640 1 --2- 172.21.15.71:0/877181443 >> v2:172.21.15.135:6800/726754104 conn(0x7f5d2003ea80 0x7f5d20040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.308+0000 7f5d33fff640 1 --2- 172.21.15.71:0/877181443 >> v2:172.21.15.135:6800/726754104 conn(0x7f5d2003ea80 0x7f5d20040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.308+0000 7f5d33fff640 10 monclient: get_auth_request con 0x7f5d2003ea80 auth_method 0 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d38d07640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 msgr2=0x7f5d3402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d38d07640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 0x7f5d3402d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d24011db0 tx=0x7f5d2400f610 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d2400fe70 con 0x7f5d341ce5a0 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:47.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 10 monclient: dump: 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.330 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5d2400fe70 con 0x7f5d341ce5a0 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 msgr2=0x7f5d3402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 0x7f5d3402d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d24011db0 tx=0x7f5d2400f610 comp rx=0 tx=0).stop 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 msgr2=0x7f5d3402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d317fa640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d341ce5a0 0x7f5d3402d1c0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d24011db0 tx=0x7f5d2400f610 comp rx=0 tx=0).stop 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.310+0000 7f5d33fff640 1 --2- 172.21.15.71:0/877181443 >> v2:172.21.15.135:6800/726754104 conn(0x7f5d2003ea80 0x7f5d20040f40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d2802afd0 tx=0x7f5d2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d3af6b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 0x7f5d3402db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d3af6b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5d340a23a0 con 0x7f5d3402d700 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 0x7f5d3402db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient: get_auth_request con 0x7f5d3402d700 auth_method 0 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.316+0000 7f5d38d07640 10 monclient(hunting): handle_auth_done global_id 84334 payload 824 2024-08-19T11:17:47.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.317+0000 7f5d38d07640 1 -- 172.21.15.71:0/877181443 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d340a1e70 con 0x7f5d3402d700 2024-08-19T11:17:47.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d38d07640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 msgr2=0x7f5d3402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d38d07640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 0x7f5d3402db10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d2401b000 tx=0x7f5d240046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5d24003c90 con 0x7f5d3402d700 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 10 monclient: dump: 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f5d24003820 con 0x7f5d3402d700 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 msgr2=0x7f5d3402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 0x7f5d3402db10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d2401b000 tx=0x7f5d240046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 msgr2=0x7f5d3402db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d317fa640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5d3402d700 0x7f5d3402db10 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d2401b000 tx=0x7f5d240046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 49466, 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:47.360 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.319+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 >> v2:172.21.15.135:6800/726754104 conn(0x7f5d2003ea80 msgr2=0x7f5d20040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/877181443 >> v2:172.21.15.135:6800/726754104 conn(0x7f5d2003ea80 0x7f5d20040f40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d2802afd0 tx=0x7f5d2802e000 comp rx=0 tx=0).stop 2024-08-19T11:17:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 10 monclient: shutdown 2024-08-19T11:17:47.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 msgr2=0x7f5d341225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 0x7f5d341225a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00be00 tx=0x7f5d2c00bef0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d39508640 1 -- 172.21.15.71:0/877181443 reap_dead start 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d317fa640 1 -- 172.21.15.71:0/877181443 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 3898+0+0 (unknown 0 0 0) 0x7f5d2c051b00 con 0x7f5d34139710 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 shutdown_connections 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 --2- 172.21.15.71:0/877181443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d34139710 0x7f5d341225a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 >> 172.21.15.71:0/877181443 conn(0x7f5d340abf50 msgr2=0x7f5d340aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 shutdown_connections 2024-08-19T11:17:47.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.320+0000 7f5d3af6b640 1 -- 172.21.15.71:0/877181443 wait complete. 2024-08-19T11:17:47.363 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:47.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-08-19T11:17:47.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:17:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.460+0000 7f18a8f14640 10 monclient: get_monmap_and_config 2024-08-19T11:17:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.460+0000 7f18a8f14640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.460+0000 7f18a8f14640 10 monclient: monmap: 2024-08-19T11:17:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:47.460945+0000 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:47.460945+0000 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.460+0000 7f18a8f14640 1 Processor -- start 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.460+0000 7f18a8f14640 1 -- start start 2024-08-19T11:17:47.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.460+0000 7f18a8f14640 10 monclient: init 2024-08-19T11:17:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient: _add_conns ranks=[6,5,2,0,7,4,10,9,3,8,1] 2024-08-19T11:17:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 0x7f18a40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): picked mon.noname-d con 0x7f18a40a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f18a40a57c0 0x7f18a40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): picked mon.noname-h con 0x7f18a40a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 0x7f18a4139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): picked mon.noname-b con 0x7f18a4139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f18a40a5020 con 0x7f18a4139710 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f18a40a77b0 con 0x7f18a40a57c0 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f18a40a7d40 con 0x7f18a40a6950 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a8f14640 10 monclient(hunting): authenticate will time out at 1125.502595s 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 0x7f18a4139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 0x7f18a40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 0x7f18a4139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:46540/0 (socket says 172.21.15.71:46540) 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): get_auth_request con 0x7f18a40a6950 auth_method 0 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 1 -- 172.21.15.71:0/1629289131 learned_addr learned my addr 172.21.15.71:0/1629289131 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): get_auth_request con 0x7f18a4139710 auth_method 0 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f18a40a57c0 0x7f18a40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): get_auth_request con 0x7f18a40a57c0 auth_method 0 2024-08-19T11:17:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.461+0000 7f18a1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 10 monclient(hunting): handle_auth_done global_id 26151 payload 274 2024-08-19T11:17:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 1 -- 172.21.15.71:0/1629289131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f18a40a57c0 msgr2=0x7f18a40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f18a40a57c0 0x7f18a40a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 1 -- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 msgr2=0x7f18a4139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 0x7f18a4139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 1 monclient: found mon.noname-d 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a259c640 1 -- 172.21.15.71:0/1629289131 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a40a6380 con 0x7f18a40a6950 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a2d9d640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 0x7f18a4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.462+0000 7f18a1d9b640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f18a40a57c0 0x7f18a40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.464+0000 7f18a259c640 1 -- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 msgr2=0x7f18a40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.464+0000 7f18a259c640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 0x7f18a40a6d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097d0 tx=0x7f188c029fb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=32e740eb0d11bc71 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.464+0000 7f18a159a640 1 -- 172.21.15.71:0/1629289131 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f188c037070 con 0x7f18a40a6950 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.464+0000 7f18a159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.464+0000 7f18a159a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.464+0000 7f18a159a640 10 monclient: dump: 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 5 monclient: authenticate success, global_id 26151 2024-08-19T11:17:47.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 1 -- 172.21.15.71:0/1629289131 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c02ad10 con 0x7f18a40a6950 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 1 -- 172.21.15.71:0/1629289131 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f188c030c20 con 0x7f18a40a6950 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 4 set_mon_vals no callback set 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a159a640 10 monclient: dump: 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 10 monclient: shutdown 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 -- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 msgr2=0x7f18a40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 0x7f18a40a6d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097d0 tx=0x7f188c029fb0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 -- 172.21.15.71:0/1629289131 shutdown_connections 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f18a4139710 0x7f18a4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f18a40a57c0 0x7f18a40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 --2- 172.21.15.71:0/1629289131 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a40a6950 0x7f18a40a6d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 -- 172.21.15.71:0/1629289131 >> 172.21.15.71:0/1629289131 conn(0x7f18a40abf50 msgr2=0x7f18a40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 -- 172.21.15.71:0/1629289131 shutdown_connections 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.465+0000 7f18a8f14640 1 -- 172.21.15.71:0/1629289131 wait complete. 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.466+0000 7f18a8f14640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.466+0000 7f18a8f14640 10 monclient: monmap: 2024-08-19T11:17:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.478 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.478 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.466+0000 7f18a8f14640 1 Processor -- start 2024-08-19T11:17:47.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.466+0000 7f18a8f14640 1 -- start start 2024-08-19T11:17:47.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.466+0000 7f18a8f14640 10 monclient: init 2024-08-19T11:17:47.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient: _add_conns ranks=[1,3,4,8,7,6,5,2,0] 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a40a57c0 0x7f18a41ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): picked mon.noname-f con 0x7f18a40a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18a40a6950 0x7f18a41389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): picked mon.noname-g con 0x7f18a40a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 0x7f18a4138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): picked mon.noname-c con 0x7f18a4139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18a40a84c0 con 0x7f18a40a57c0 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f18a40a3650 con 0x7f18a40a6950 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f18a40a8700 con 0x7f18a4139710 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a8f14640 10 monclient(hunting): authenticate will time out at 1125.508361s 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 0x7f18a4138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 0x7f18a4138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50364/0 (socket says 172.21.15.71:50364) 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 learned_addr learned my addr 172.21.15.71:0/2099536356 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): get_auth_request con 0x7f18a4139710 auth_method 0 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a40a57c0 0x7f18a41ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): get_auth_request con 0x7f18a40a57c0 auth_method 0 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a1d9b640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18a40a6950 0x7f18a41389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a1d9b640 10 monclient(hunting): get_auth_request con 0x7f18a40a6950 auth_method 0 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient(hunting): handle_auth_done global_id 84343 payload 824 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18a40a6950 msgr2=0x7f18a41389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18a40a6950 0x7f18a41389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a40a57c0 msgr2=0x7f18a41ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18a40a57c0 0x7f18a41ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 monclient: found mon.noname-c 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a4125af0 con 0x7f18a4139710 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.467+0000 7f18a1d9b640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f18a40a6950 0x7f18a41389d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.469+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 msgr2=0x7f18a4138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.469+0000 7f18a2d9d640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 0x7f18a4138f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f189c00efc0 tx=0x7f189c00c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f189c00cd30 con 0x7f18a4139710 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: dump: 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.490 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c019070 con 0x7f18a4139710 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 5 monclient: authenticate success, global_id 84343 2024-08-19T11:17:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 10 monclient: _renew_subs 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a413a360 con 0x7f18a4139710 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f189c014d60 con 0x7f18a4139710 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f189affd640 10 monclient: dump: 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a0d99640 4 set_mon_vals no callback set 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 10 monclient: _renew_subs 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a4126390 con 0x7f18a4139710 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.470+0000 7f18a8f14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a8f14640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 0x7f18a402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f18a4076c60 con 0x7f18a4122d60 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 0x7f18a402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient: get_auth_request con 0x7f18a4122d60 auth_method 0 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f189c005d10 con 0x7f18a4139710 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 10 monclient(hunting): handle_auth_done global_id 26160 payload 824 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a259c640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18a40a1e70 con 0x7f18a4122d60 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f189affd640 1 --2- 172.21.15.71:0/2099536356 >> v2:172.21.15.135:6800/726754104 conn(0x7f188403ea80 0x7f1884040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(202..202 src has 1..202) ==== 3898+0+0 (secure 0 0 0) 0x7f189c051fe0 con 0x7f18a4139710 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a1d9b640 1 --2- 172.21.15.71:0/2099536356 >> v2:172.21.15.135:6800/726754104 conn(0x7f188403ea80 0x7f1884040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.471+0000 7f18a1d9b640 10 monclient: get_auth_request con 0x7f188403ea80 auth_method 0 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f18a259c640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 msgr2=0x7f18a402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f18a259c640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 0x7f18a402d1c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c0046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f188c037040 con 0x7f18a4122d60 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 10 monclient: dump: 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f188c038040 con 0x7f18a4122d60 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.473+0000 7f189affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.474+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 msgr2=0x7f18a402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.474+0000 7f189affd640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 0x7f18a402d1c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.474+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 msgr2=0x7f18a402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.474+0000 7f189affd640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4122d60 0x7f18a402d1c0 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097a0 tx=0x7f188c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.474+0000 7f18a1d9b640 1 --2- 172.21.15.71:0/2099536356 >> v2:172.21.15.135:6800/726754104 conn(0x7f188403ea80 0x7f1884040f40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18a41246a0 tx=0x7f1894008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a8f14640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:47.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a8f14640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 0x7f18a402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a8f14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f18a40a6d30 con 0x7f18a4123140 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 0x7f18a402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient: get_auth_request con 0x7f18a4123140 auth_method 0 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 10 monclient(hunting): handle_auth_done global_id 26169 payload 824 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.480+0000 7f18a259c640 1 -- 172.21.15.71:0/2099536356 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f18a409e100 con 0x7f18a4123140 2024-08-19T11:17:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.482+0000 7f18a259c640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 msgr2=0x7f18a402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.482+0000 7f18a259c640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 0x7f18a402d700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f188c02bfd0 tx=0x7f188c008030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.482+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f188c0328b0 con 0x7f18a4123140 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.482+0000 7f189affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.482+0000 7f189affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.482+0000 7f189affd640 10 monclient: dump: 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9591 (secure 0 0 0) 0x7f188c032440 con 0x7f18a4123140 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 msgr2=0x7f18a402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 0x7f18a402d700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f188c02bfd0 tx=0x7f188c008030 comp rx=0 tx=0).stop 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 msgr2=0x7f18a402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f189affd640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f18a4123140 0x7f18a402d700 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f188c02bfd0 tx=0x7f188c008030 comp rx=0 tx=0).stop 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 375096, 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:47.501 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:47.502 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:47.503 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:47.505 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.506 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:47.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.512 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:47.516 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.519 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.523 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.524 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:47.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:47.526 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 >> v2:172.21.15.135:6800/726754104 conn(0x7f188403ea80 msgr2=0x7f1884040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 --2- 172.21.15.71:0/2099536356 >> v2:172.21.15.135:6800/726754104 conn(0x7f188403ea80 0x7f1884040f40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18a41246a0 tx=0x7f1894008040 comp rx=0 tx=0).stop 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 10 monclient: shutdown 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 msgr2=0x7f18a4138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 --2- 172.21.15.71:0/2099536356 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f18a4139710 0x7f18a4138f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f189c00efc0 tx=0x7f189c00c490 comp rx=0 tx=0).stop 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 reap_dead start 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a2d9d640 1 -- 172.21.15.71:0/2099536356 reap_dead start 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 shutdown_connections 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 >> 172.21.15.71:0/2099536356 conn(0x7f18a40abf50 msgr2=0x7f18a40aab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 shutdown_connections 2024-08-19T11:17:47.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.483+0000 7f18a8f14640 1 -- 172.21.15.71:0/2099536356 wait complete. 2024-08-19T11:17:47.529 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:47.529 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-19T11:17:47.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:17:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.627+0000 7f739c1b1640 10 monclient: get_monmap_and_config 2024-08-19T11:17:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.627+0000 7f739c1b1640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.627+0000 7f739c1b1640 10 monclient: monmap: 2024-08-19T11:17:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:47.627715+0000 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:47.627715+0000 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:47.630 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.627+0000 7f739c1b1640 1 Processor -- start 2024-08-19T11:17:47.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.627+0000 7f739c1b1640 1 -- start start 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.627+0000 7f739c1b1640 10 monclient: init 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient: _add_conns ranks=[4,6,3,10,7,9,1,8,2,0,5] 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 0x7f73940a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): picked mon.noname-c con 0x7f7394132970 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 0x7f7394135a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): picked mon.noname-d con 0x7f7394132d50 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7394133130 0x7f7394135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): picked mon.noname-g con 0x7f7394133130 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f73940a4520 con 0x7f7394133130 2024-08-19T11:17:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f73940a13b0 con 0x7f7394132970 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f7394132560 con 0x7f7394132d50 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739c1b1640 10 monclient(hunting): authenticate will time out at 1125.669424s 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 0x7f7394135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 0x7f73940a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 0x7f7394135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:37726/0 (socket says 172.21.15.71:37726) 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 0x7f73940a22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50374/0 (socket says 172.21.15.71:50374) 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 -- 172.21.15.71:0/1843575806 learned_addr learned my addr 172.21.15.71:0/1843575806 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): get_auth_request con 0x7f7394132d50 auth_method 0 2024-08-19T11:17:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): get_auth_request con 0x7f7394132970 auth_method 0 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739a74e640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7394133130 0x7f7394135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739a74e640 10 monclient(hunting): get_auth_request con 0x7f7394133130 auth_method 0 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739a74e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739a74e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739a74e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient(hunting): handle_auth_done global_id 26178 payload 274 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 -- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 msgr2=0x7f73940a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 0x7f73940a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 -- 172.21.15.71:0/1843575806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7394133130 msgr2=0x7f7394135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7394133130 0x7f7394135fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 monclient: found mon.noname-d 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f739974c640 1 -- 172.21.15.71:0/1843575806 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73940a2800 con 0x7f7394132d50 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.628+0000 7f7399f4d640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 0x7f73940a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f739974c640 1 -- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 msgr2=0x7f7394135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f739974c640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 0x7f7394135a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73880098a0 tx=0x7f738802a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=8126c84e2db82091 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 1 -- 172.21.15.71:0/1843575806 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7388037070 con 0x7f7394132d50 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:17:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: dump: 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f739c1b1640 5 monclient: authenticate success, global_id 26178 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 1 -- 172.21.15.71:0/1843575806 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738802ade0 con 0x7f7394132d50 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f739c1b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f739c1b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f739c1b1640 4 set_mon_vals no callback set 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 1 -- 172.21.15.71:0/1843575806 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7388030c20 con 0x7f7394132d50 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.631+0000 7f7398f4b640 10 monclient: dump: 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.644 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 10 monclient: shutdown 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 -- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 msgr2=0x7f7394135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 0x7f7394135a60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73880098a0 tx=0x7f738802a080 comp rx=0 tx=0).stop 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 -- 172.21.15.71:0/1843575806 shutdown_connections 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7394133130 0x7f7394135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f7394132d50 0x7f7394135a60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 --2- 172.21.15.71:0/1843575806 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394132970 0x7f73940a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 -- 172.21.15.71:0/1843575806 >> 172.21.15.71:0/1843575806 conn(0x7f73940a4e70 msgr2=0x7f73940a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 -- 172.21.15.71:0/1843575806 shutdown_connections 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.632+0000 7f739c1b1640 1 -- 172.21.15.71:0/1843575806 wait complete. 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 10 monclient: monmap: 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.647 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 1 Processor -- start 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 1 -- start start 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 10 monclient: init 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 10 monclient: _add_conns ranks=[8,7,4,5,6,2,3,0,1] 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7394132970 0x7f739412d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 10 monclient(hunting): picked mon.noname-e con 0x7f7394132970 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.633+0000 7f739c1b1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7394132d50 0x7f739412d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): picked mon.noname-i con 0x7f7394132d50 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 0x7f739412deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f7399f4d640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7394132970 msgr2=0x7f739412d430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): picked mon.noname-c con 0x7f7394133130 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f73940a4020 con 0x7f7394133130 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f73940a5c60 con 0x7f7394132d50 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f73940a41a0 con 0x7f7394132970 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f7399f4d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7394132970 0x7f739412d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739c1b1640 10 monclient(hunting): authenticate will time out at 1125.675056s 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 0x7f739412deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 0x7f739412deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50384/0 (socket says 172.21.15.71:50384) 2024-08-19T11:17:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 learned_addr learned my addr 172.21.15.71:0/2802731518 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): get_auth_request con 0x7f7394133130 auth_method 0 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739974c640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7394132d50 0x7f739412d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739974c640 10 monclient(hunting): get_auth_request con 0x7f7394132d50 auth_method 0 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739974c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739974c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739974c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient(hunting): handle_auth_done global_id 84361 payload 824 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7394132970 msgr2=0x7f739412d430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7394132970 0x7f739412d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7394132d50 msgr2=0x7f739412d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7394132d50 0x7f739412d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 monclient: found mon.noname-c 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.634+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394130140 con 0x7f7394133130 2024-08-19T11:17:47.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 msgr2=0x7f739412deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739a74e640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 0x7f739412deb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f738c00d5d0 tx=0x7f738c00da90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f738c012c70 con 0x7f7394133130 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: dump: 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 5 monclient: authenticate success, global_id 84361 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c019070 con 0x7f7394133130 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 10 monclient: _renew_subs 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7394130420 con 0x7f7394133130 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f738c0148a0 con 0x7f7394133130 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f73927fc640 10 monclient: dump: 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 10 monclient: _renew_subs 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f7393fff640 4 set_mon_vals no callback set 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.636+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f73940a6eb0 con 0x7f7394133130 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f738c014430 con 0x7f7394133130 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f739c1b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f739c1b1640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 0x7f739409e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f739412ec20 con 0x7f739409e080 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f73927fc640 1 --2- 172.21.15.71:0/2802731518 >> v2:172.21.15.135:6800/726754104 conn(0x7f738003ea80 0x7f7380040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.637+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(202..202 src has 1..202) ==== 3898+0+0 (secure 0 0 0) 0x7f738c00f040 con 0x7f7394133130 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 0x7f739409e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient: get_auth_request con 0x7f739409e080 auth_method 0 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f739974c640 1 --2- 172.21.15.71:0/2802731518 >> v2:172.21.15.135:6800/726754104 conn(0x7f738003ea80 0x7f7380040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f739974c640 10 monclient: get_auth_request con 0x7f738003ea80 auth_method 0 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 10 monclient(hunting): handle_auth_done global_id 84286 payload 824 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.638+0000 7f7399f4d640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73941359e0 con 0x7f739409e080 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f739974c640 1 --2- 172.21.15.71:0/2802731518 >> v2:172.21.15.135:6800/726754104 conn(0x7f738003ea80 0x7f7380040f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7388009870 tx=0x7f738802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f7399f4d640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 msgr2=0x7f739409e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f7399f4d640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 0x7f739409e460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f738400ae00 tx=0x7f73840075c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f73840139d0 con 0x7f739409e080 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f73927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f73927fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.640+0000 7f73927fc640 10 monclient: dump: 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7384019070 con 0x7f739409e080 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 msgr2=0x7f739409e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 0x7f739409e460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f738400ae00 tx=0x7f73840075c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 msgr2=0x7f739409e460 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.641+0000 7f73927fc640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e080 0x7f739409e460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.647+0000 7f739c1b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.647+0000 7f739c1b1640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 0x7f73941342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.647+0000 7f739c1b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.647+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73940a6960 con 0x7f739409e9a0 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.647+0000 7f7399f4d640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 0x7f73941342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient: get_auth_request con 0x7f739409e9a0 auth_method 0 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 10 monclient(hunting): handle_auth_done global_id 84295 payload 824 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.648+0000 7f7399f4d640 1 -- 172.21.15.71:0/2802731518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f73940a22a0 con 0x7f739409e9a0 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.650+0000 7f7399f4d640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 msgr2=0x7f73941342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.650+0000 7f7399f4d640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 0x7f73941342b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f738400ae00 tx=0x7f7384004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.650+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7384013d40 con 0x7f739409e9a0 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.650+0000 7f73927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.650+0000 7f73927fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.650+0000 7f73927fc640 10 monclient: dump: 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f7384013d40 con 0x7f739409e9a0 2024-08-19T11:17:47.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 msgr2=0x7f73941342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 0x7f73941342b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f738400ae00 tx=0x7f7384004ab0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 msgr2=0x7f73941342b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f73927fc640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f739409e9a0 0x7f73941342b0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f738400ae00 tx=0x7f7384004ab0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.668 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 49810, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:47.669 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.670 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.671 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:47.672 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:47.673 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.674 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.676 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:47.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.682 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:47.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.687 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.692 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:47.693 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 >> v2:172.21.15.135:6800/726754104 conn(0x7f738003ea80 msgr2=0x7f7380040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 --2- 172.21.15.71:0/2802731518 >> v2:172.21.15.135:6800/726754104 conn(0x7f738003ea80 0x7f7380040f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7388009870 tx=0x7f738802e000 comp rx=0 tx=0).stop 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 10 monclient: shutdown 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 msgr2=0x7f739412deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 --2- 172.21.15.71:0/2802731518 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7394133130 0x7f739412deb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f738c00d5d0 tx=0x7f738c00da90 comp rx=0 tx=0).stop 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 reap_dead start 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739a74e640 1 -- 172.21.15.71:0/2802731518 reap_dead start 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 shutdown_connections 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 >> 172.21.15.71:0/2802731518 conn(0x7f73940a4e70 msgr2=0x7f7394133650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 shutdown_connections 2024-08-19T11:17:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.651+0000 7f739c1b1640 1 -- 172.21.15.71:0/2802731518 wait complete. 2024-08-19T11:17:47.696 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:47.696 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-19T11:17:47.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.794+0000 7fa296c60640 10 monclient: get_monmap_and_config 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.794+0000 7fa296c60640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.794+0000 7fa296c60640 10 monclient: monmap: 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:47.794732+0000 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:47.794732+0000 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:47.796 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.794+0000 7fa296c60640 1 Processor -- start 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.794+0000 7fa296c60640 1 -- start start 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.794+0000 7fa296c60640 10 monclient: init 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient: _add_conns ranks=[8,10,9,7,2,4,5,1,3,6,0] 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2900a6950 0x7fa2900a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): picked mon.noname-e con 0x7fa2900a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2900a57c0 0x7fa2900a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): picked mon.noname-f con 0x7fa2900a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa290139710 0x7fa290139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): picked mon.noname-a con 0x7fa290139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa2900a5020 con 0x7fa290139710 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa2900a77b0 con 0x7fa2900a57c0 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa2900a7d40 con 0x7fa2900a6950 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa296c60640 10 monclient(hunting): authenticate will time out at 1125.836403s 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2949fc640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2900a6950 msgr2=0x7fa2900a6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2949fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2900a6950 0x7fa2900a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa290139710 0x7fa290139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa290139710 0x7fa290139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50974/0 (socket says 172.21.15.71:50974) 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 -- 172.21.15.71:0/2981751590 learned_addr learned my addr 172.21.15.71:0/2981751590 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): get_auth_request con 0x7fa290139710 auth_method 0 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa28ffff640 1 --2- 172.21.15.71:0/2981751590 >> v2:172.21.15.135:3300/0 conn(0x7fa2900a57c0 0x7fa2900a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa28ffff640 10 monclient(hunting): get_auth_request con 0x7fa2900a57c0 auth_method 0 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa28ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa28ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient(hunting): handle_auth_done global_id 74664 payload 274 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 -- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2900a6950 msgr2=0x7fa2900a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 --2- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2900a6950 0x7fa2900a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 -- 172.21.15.71:0/2981751590 >> v2:172.21.15.135:3300/0 conn(0x7fa2900a57c0 msgr2=0x7fa2900a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 --2- 172.21.15.71:0/2981751590 >> v2:172.21.15.135:3300/0 conn(0x7fa2900a57c0 0x7fa2900a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 monclient: found mon.noname-a 2024-08-19T11:17:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.795+0000 7fa2951fd640 1 -- 172.21.15.71:0/2981751590 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2900a6380 con 0x7fa290139710 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa2951fd640 1 -- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 msgr2=0x7fa290139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa2951fd640 1 --2- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa290139b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2900a5730 tx=0x7fa28002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be82123920ef81ba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 1 -- 172.21.15.71:0/2981751590 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa280037070 con 0x7fa290139710 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: dump: 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 1 -- 172.21.15.71:0/2981751590 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28002ae30 con 0x7fa290139710 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa296c60640 5 monclient: authenticate success, global_id 74664 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa296c60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa296c60640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 1 -- 172.21.15.71:0/2981751590 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa280030c20 con 0x7fa290139710 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa296c60640 4 set_mon_vals no callback set 2024-08-19T11:17:47.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.798+0000 7fa28f7fe640 10 monclient: dump: 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 10 monclient: shutdown 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 -- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 msgr2=0x7fa290139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 --2- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa290139b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2900a5730 tx=0x7fa28002a110 comp rx=0 tx=0).stop 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 -- 172.21.15.71:0/2981751590 shutdown_connections 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 --2- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa290139b60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 --2- 172.21.15.71:0/2981751590 >> v2:172.21.15.135:3300/0 conn(0x7fa2900a57c0 0x7fa2900a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 --2- 172.21.15.71:0/2981751590 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2900a6950 0x7fa2900a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 -- 172.21.15.71:0/2981751590 >> 172.21.15.71:0/2981751590 conn(0x7fa2900abf50 msgr2=0x7fa2900ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 -- 172.21.15.71:0/2981751590 shutdown_connections 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 1 -- 172.21.15.71:0/2981751590 wait complete. 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.799+0000 7fa296c60640 10 monclient: monmap: 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 Processor -- start 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 -- start start 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient: init 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient: _add_conns ranks=[6,4,0,8,7,3,5,2,1] 2024-08-19T11:17:47.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2900a57c0 0x7fa290138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): picked mon.noname-d con 0x7fa2900a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa2900a6950 0x7fa290138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): picked mon.noname-c con 0x7fa2900a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa2901225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): picked mon.noname-a con 0x7fa290139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa2900a84c0 con 0x7fa290139710 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa2900a3650 con 0x7fa2900a6950 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa2900a8700 con 0x7fa2900a57c0 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.800+0000 7fa296c60640 10 monclient(hunting): authenticate will time out at 1125.841944s 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa2901225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2900a57c0 0x7fa290138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa2900a6950 0x7fa290138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa2901225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50976/0 (socket says 172.21.15.71:50976) 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa2900a6950 0x7fa290138ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50390/0 (socket says 172.21.15.71:50390) 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 -- 172.21.15.71:0/3273350053 learned_addr learned my addr 172.21.15.71:0/3273350053 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): get_auth_request con 0x7fa290139710 auth_method 0 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): get_auth_request con 0x7fa2900a6950 auth_method 0 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): get_auth_request con 0x7fa2900a57c0 auth_method 0 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient(hunting): handle_auth_done global_id 74673 payload 824 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2900a57c0 msgr2=0x7fa290138980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2900a57c0 0x7fa290138980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa2900a6950 msgr2=0x7fa290138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa2900a6950 0x7fa290138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 monclient: found mon.noname-a 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2951fd640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa290123fe0 con 0x7fa290139710 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa28ffff640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa2900a6950 0x7fa290138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.801+0000 7fa2949fc640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2900a57c0 0x7fa290138980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa2951fd640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 msgr2=0x7fa2901225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa2951fd640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa2901225a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa2800090b0 tx=0x7fa2800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa280041020 con 0x7fa290139710 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: dump: 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.819 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280003bd0 con 0x7fa290139710 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 5 monclient: authenticate success, global_id 74673 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 10 monclient: _renew_subs 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2900a1e00 con 0x7fa290139710 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa280037040 con 0x7fa290139710 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28d7fa640 10 monclient: dump: 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 10 monclient: _renew_subs 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa28effd640 4 set_mon_vals no callback set 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.803+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa290126340 con 0x7fa290139710 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa296c60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa296c60640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 0x7fa29002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa29006a590 con 0x7fa2901ce430 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa280044020 con 0x7fa290139710 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa28d7fa640 1 --2- 172.21.15.71:0/3273350053 >> v2:172.21.15.135:6800/726754104 conn(0x7fa27c03ea80 0x7fa27c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.804+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 3898+0+0 (secure 0 0 0) 0x7fa280071b00 con 0x7fa290139710 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 0x7fa29002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient: get_auth_request con 0x7fa2901ce430 auth_method 0 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa28ffff640 1 --2- 172.21.15.71:0/3273350053 >> v2:172.21.15.135:6800/726754104 conn(0x7fa27c03ea80 0x7fa27c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa28ffff640 10 monclient: get_auth_request con 0x7fa27c03ea80 auth_method 0 2024-08-19T11:17:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 10 monclient(hunting): handle_auth_done global_id 45174 payload 824 2024-08-19T11:17:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.805+0000 7fa2949fc640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2900a6d30 con 0x7fa2901ce430 2024-08-19T11:17:47.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa2949fc640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 msgr2=0x7fa29002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa2949fc640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 0x7fa29002d1c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa288003d00 tx=0x7fa2880079c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa28ffff640 1 --2- 172.21.15.71:0/3273350053 >> v2:172.21.15.135:6800/726754104 conn(0x7fa27c03ea80 0x7fa27c040f40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa290124650 tx=0x7fa284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa28801a070 con 0x7fa2901ce430 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa28d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa28d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.807+0000 7fa28d7fa640 10 monclient: dump: 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa28800a9a0 con 0x7fa2901ce430 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 msgr2=0x7fa29002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 0x7fa29002d1c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa288003d00 tx=0x7fa2880079c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 msgr2=0x7fa29002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.808+0000 7fa28d7fa640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2901ce430 0x7fa29002d1c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa296c60640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa296c60640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 0x7fa29002db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa296c60640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa290076c60 con 0x7fa29002d700 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 0x7fa29002db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient: get_auth_request con 0x7fa29002d700 auth_method 0 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 10 monclient(hunting): handle_auth_done global_id 45183 payload 824 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.814+0000 7fa2949fc640 1 -- 172.21.15.71:0/3273350053 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa29009e100 con 0x7fa29002d700 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa2949fc640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 msgr2=0x7fa29002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa2949fc640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 0x7fa29002db10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa288017000 tx=0x7fa288005d50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa28801a030 con 0x7fa29002d700 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 10 monclient: dump: 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9257 (secure 0 0 0) 0x7fa288025410 con 0x7fa29002d700 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 msgr2=0x7fa29002db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 0x7fa29002db10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa288017000 tx=0x7fa288005d50 comp rx=0 tx=0).stop 2024-08-19T11:17:47.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 msgr2=0x7fa29002db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.817+0000 7fa28d7fa640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa29002d700 0x7fa29002db10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 236839, 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:47.834 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.835 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:47.836 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.837 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:47.838 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:47.839 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.841 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:47.845 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:47.848 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:47.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:47.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:47.855 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.856 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:47.857 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 >> v2:172.21.15.135:6800/726754104 conn(0x7fa27c03ea80 msgr2=0x7fa27c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 --2- 172.21.15.71:0/3273350053 >> v2:172.21.15.135:6800/726754104 conn(0x7fa27c03ea80 0x7fa27c040f40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa290124650 tx=0x7fa284008040 comp rx=0 tx=0).stop 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 10 monclient: shutdown 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 msgr2=0x7fa2901225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa2901225a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa2800090b0 tx=0x7fa2800046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa2951fd640 1 -- 172.21.15.71:0/3273350053 reap_dead start 2024-08-19T11:17:47.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 shutdown_connections 2024-08-19T11:17:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 --2- 172.21.15.71:0/3273350053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa290139710 0x7fa2901225a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 >> 172.21.15.71:0/3273350053 conn(0x7fa2900abf50 msgr2=0x7fa2900aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 shutdown_connections 2024-08-19T11:17:47.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.818+0000 7fa296c60640 1 -- 172.21.15.71:0/3273350053 wait complete. 2024-08-19T11:17:47.860 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:47.860 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-19T11:17:47.861 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:17:47.972 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: starting. 2024-08-19T11:17:47.972 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27318 2024-08-19T11:17:47.972 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: created object 0... 2024-08-19T11:17:47.972 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: created object 25... 2024-08-19T11:17:47.972 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: created object 49... 2024-08-19T11:17:47.972 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: finishing. 2024-08-19T11:17:47.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27319]: shutting down. 2024-08-19T11:17:47.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.971+0000 7f766ed86640 10 monclient: get_monmap_and_config 2024-08-19T11:17:47.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.971+0000 7f766ed86640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.972+0000 7f766ed86640 10 monclient: monmap: 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:47.972642+0000 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:47.972642+0000 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.972+0000 7f766ed86640 1 Processor -- start 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.972+0000 7f766ed86640 1 -- start start 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.972+0000 7f766ed86640 10 monclient: init 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient: _add_conns ranks=[7,2,0,9,5,10,6,8,3,4,1] 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76680a47c0 0x7f76680a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): picked mon.noname-i con 0x7f76680a47c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 0x7f76680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): picked mon.noname-b con 0x7f766806cd20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7668139970 addr v1:172.21.15.71:6789/0 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766806cae0 con 0x7f7668139970 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f76680a5620 con 0x7f766806cd20 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f76680a6320 con 0x7f76680a47c0 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766ed86640 10 monclient(hunting): authenticate will time out at 1126.014382s 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 0x7f76680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766d323640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7668139970 0x7f7668139e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57558/0 (socket says 172.21.15.71:57558) 2024-08-19T11:17:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766d323640 1 -- 172.21.15.71:0/2913880814 learned_addr learned my addr 172.21.15.71:0/2913880814 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): get_auth_request con 0x7f766806cd20 auth_method 0 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 1 --2- 172.21.15.71:0/2913880814 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76680a47c0 0x7f76680a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): get_auth_request con 0x7f76680a47c0 auth_method 0 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f766cb22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient(hunting): handle_auth_done global_id 74603 payload 274 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 1 -- 172.21.15.71:0/2913880814 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76680a47c0 msgr2=0x7f76680a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 1 --2- 172.21.15.71:0/2913880814 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76680a47c0 0x7f76680a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 1 -- 172.21.15.71:0/2913880814 >> v1:172.21.15.71:6789/0 conn(0x7f7668139970 legacy=0x7f7668139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 1 monclient: found mon.noname-b 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:17:47.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.973+0000 7f7667fff640 1 -- 172.21.15.71:0/2913880814 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76680a0b50 con 0x7f766806cd20 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f7667fff640 1 -- 172.21.15.71:0/2913880814 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 msgr2=0x7f76680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f7667fff640 1 --2- 172.21.15.71:0/2913880814 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 0x7f76680a50e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7658009dc0 tx=0x7f765802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66edaa455efd750 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 1 -- 172.21.15.71:0/2913880814 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7658007bc0 con 0x7f766806cd20 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: dump: 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.987 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: _finish_auth 0 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: _check_auth_tickets 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f766ed86640 5 monclient: authenticate success, global_id 74603 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 1 -- 172.21.15.71:0/2913880814 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7658007d80 con 0x7f766806cd20 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f766ed86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f766ed86640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 1 -- 172.21.15.71:0/2913880814 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7658031870 con 0x7f766806cd20 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f766ed86640 4 set_mon_vals no callback set 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:17:47.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.976+0000 7f76677fe640 10 monclient: dump: 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 10 monclient: shutdown 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 -- 172.21.15.71:0/2913880814 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 msgr2=0x7f76680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 --2- 172.21.15.71:0/2913880814 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 0x7f76680a50e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7658009dc0 tx=0x7f765802a480 comp rx=0 tx=0).stop 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 -- 172.21.15.71:0/2913880814 shutdown_connections 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 --2- 172.21.15.71:0/2913880814 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f766806cd20 0x7f76680a50e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 --2- 172.21.15.71:0/2913880814 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76680a47c0 0x7f76680a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 -- 172.21.15.71:0/2913880814 >> 172.21.15.71:0/2913880814 conn(0x7f76680a93e0 msgr2=0x7f76680a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 -- 172.21.15.71:0/2913880814 shutdown_connections 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 1 -- 172.21.15.71:0/2913880814 wait complete. 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 10 monclient: build_initial_monmap 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.977+0000 7f766ed86640 10 monclient: monmap: 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:47.992 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 Processor -- start 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 -- start start 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient: init 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient: _add_conns ranks=[4,5,3,7,8,6,2,1,0] 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 0x7f7668125e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): picked mon.noname-c con 0x7f76680a47c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:17:47.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7668139970 0x7f76681263d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): picked mon.noname-h con 0x7f7668139970 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7668126910 0x7f76681d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): picked mon.noname-g con 0x7f7668126910 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f766806d320 con 0x7f7668126910 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f766806d1a0 con 0x7f76680a47c0 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f766813a530 con 0x7f7668139970 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766ed86640 10 monclient(hunting): authenticate will time out at 1126.019789s 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 0x7f7668125e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 0x7f7668125e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:50394/0 (socket says 172.21.15.71:50394) 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 1 -- 172.21.15.71:0/3918730729 learned_addr learned my addr 172.21.15.71:0/3918730729 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): get_auth_request con 0x7f76680a47c0 auth_method 0 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f766cb22640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7668126910 0x7f76681d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.978+0000 7f7667fff640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7668139970 0x7f76681263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): get_auth_request con 0x7f7668139970 auth_method 0 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): get_auth_request con 0x7f7668126910 auth_method 0 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:47.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766d323640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 10 monclient(hunting): handle_auth_done global_id 84379 payload 824 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7668139970 msgr2=0x7f76681263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7668139970 0x7f76681263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7668126910 msgr2=0x7f76681d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7668126910 0x7f76681d4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 10 monclient: _finish_hunting 0 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 1 monclient: found mon.noname-c 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.979+0000 7f766cb22640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7668129ce0 con 0x7f76680a47c0 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766cb22640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 msgr2=0x7f7668125e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766cb22640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 0x7f7668125e90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9e0 tx=0x7f765000eea0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7650017070 con 0x7f76680a47c0 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: dump: 2024-08-19T11:17:47.998 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: _finish_auth 0 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: _check_auth_tickets 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 5 monclient: authenticate success, global_id 84379 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765000cbe0 con 0x7f76680a47c0 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 10 monclient: _renew_subs 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76680a83a0 con 0x7f76680a47c0 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f765000cd90 con 0x7f76680a47c0 2024-08-19T11:17:48.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f76657fa640 10 monclient: dump: 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f7666ffd640 4 set_mon_vals no callback set 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 10 monclient: _renew_subs 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.981+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7668128e70 con 0x7f76680a47c0 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f766ed86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f766ed86640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 0x7f766809d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7668076c60 con 0x7f766806cd20 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f765001a070 con 0x7f76680a47c0 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 0x7f766809d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient: get_auth_request con 0x7f766806cd20 auth_method 0 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f76657fa640 1 --2- 172.21.15.71:0/3918730729 >> v2:172.21.15.135:6800/726754104 conn(0x7f764803ea80 0x7f7648040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(203..203 src has 1..203) ==== 3898+0+0 (secure 0 0 0) 0x7f765000f040 con 0x7f76680a47c0 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 10 monclient(hunting): handle_auth_done global_id 45329 payload 824 2024-08-19T11:17:48.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f7667fff640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7668076e80 con 0x7f766806cd20 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f766d323640 1 --2- 172.21.15.71:0/3918730729 >> v2:172.21.15.135:6800/726754104 conn(0x7f764803ea80 0x7f7648040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.982+0000 7f766d323640 10 monclient: get_auth_request con 0x7f764803ea80 auth_method 0 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f7667fff640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 msgr2=0x7f766809d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f7667fff640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 0x7f766809d380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76680a1e60 tx=0x7f7658004a40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7658007e20 con 0x7f766806cd20 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 10 monclient: dump: 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.004 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f766d323640 1 --2- 172.21.15.71:0/3918730729 >> v2:172.21.15.135:6800/726754104 conn(0x7f764803ea80 0x7f7648040f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7660009250 tx=0x7f76600091e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7658007e20 con 0x7f766806cd20 2024-08-19T11:17:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:48.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:48.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 msgr2=0x7f766809d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 0x7f766809d380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76680a1e60 tx=0x7f7658004a40 comp rx=0 tx=0).stop 2024-08-19T11:17:48.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 msgr2=0x7f766809d380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:48.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.985+0000 7f76657fa640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766806cd20 0x7f766809d380 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76680a1e60 tx=0x7f7658004a40 comp rx=0 tx=0).stop 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f766ed86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f766ed86640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 0x7f766809dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f766ed86640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7668127980 con 0x7f766809d8c0 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 0x7f766809dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient: get_auth_request con 0x7f766809d8c0 auth_method 0 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.991+0000 7f7667fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.992+0000 7f7667fff640 10 monclient(hunting): handle_auth_done global_id 45338 payload 824 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.992+0000 7f7667fff640 1 -- 172.21.15.71:0/3918730729 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7668139e20 con 0x7f766809d8c0 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f7667fff640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 msgr2=0x7f766809dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f7667fff640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 0x7f766809dcd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76680779b0 tx=0x7f7658030000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f765804abf0 con 0x7f766809d8c0 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 10 monclient: dump: 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.009 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.010 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f765804a780 con 0x7f766809d8c0 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 msgr2=0x7f766809dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 0x7f766809dcd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76680779b0 tx=0x7f7658030000 comp rx=0 tx=0).stop 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 msgr2=0x7f766809dcd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.994+0000 7f76657fa640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f766809d8c0 0x7f766809dcd0 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76680779b0 tx=0x7f7658030000 comp rx=0 tx=0).stop 2024-08-19T11:17:48.011 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 237016, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:48.012 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:48.013 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:48.014 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:48.015 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.017 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:48.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:48.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.026 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.030 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:48.034 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.035 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:48.036 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 >> v2:172.21.15.135:6800/726754104 conn(0x7f764803ea80 msgr2=0x7f7648040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 --2- 172.21.15.71:0/3918730729 >> v2:172.21.15.135:6800/726754104 conn(0x7f764803ea80 0x7f7648040f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7660009250 tx=0x7f76600091e0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 10 monclient: shutdown 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 msgr2=0x7f7668125e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 0x7f7668125e90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9e0 tx=0x7f765000eea0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766d323640 1 -- 172.21.15.71:0/3918730729 reap_dead start 2024-08-19T11:17:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 shutdown_connections 2024-08-19T11:17:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 --2- 172.21.15.71:0/3918730729 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76680a47c0 0x7f7668125e90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 >> 172.21.15.71:0/3918730729 conn(0x7f76680a93e0 msgr2=0x7f766809f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 shutdown_connections 2024-08-19T11:17:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:47.995+0000 7f766ed86640 1 -- 172.21.15.71:0/3918730729 wait complete. 2024-08-19T11:17:48.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:48.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-19T11:17:48.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.137+0000 7fcf387c3640 10 monclient: get_monmap_and_config 2024-08-19T11:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.137+0000 7fcf387c3640 10 monclient: build_initial_monmap 2024-08-19T11:17:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.137+0000 7fcf387c3640 10 monclient: monmap: 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:17:48.138301+0000 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:17:48.138301+0000 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:17:48.140 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 Processor -- start 2024-08-19T11:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 -- start start 2024-08-19T11:17:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient: init 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient: _add_conns ranks=[9,6,1,7,0,3,4,10,2,8,5] 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf300a6950 0x7fcf300a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): picked mon.noname-a con 0x7fcf300a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a57c0 0x7fcf300a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): picked mon.noname-d con 0x7fcf300a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:17:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcf30139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf300a6380 con 0x7fcf30139710 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcf300a5020 con 0x7fcf300a6950 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcf300a77b0 con 0x7fcf300a57c0 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.138+0000 7fcf387c3640 10 monclient(hunting): authenticate will time out at 1126.179961s 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf300a6950 0x7fcf300a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a57c0 0x7fcf300a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf300a6950 0x7fcf300a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50980/0 (socket says 172.21.15.71:50980) 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 -- 172.21.15.71:0/2903367498 learned_addr learned my addr 172.21.15.71:0/2903367498 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): get_auth_request con 0x7fcf300a6950 auth_method 0 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): get_auth_request con 0x7fcf300a57c0 auth_method 0 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient(hunting): handle_auth_done global_id 74682 payload 274 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 -- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a57c0 msgr2=0x7fcf300a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 --2- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a57c0 0x7fcf300a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 -- 172.21.15.71:0/2903367498 >> v1:172.21.15.135:6789/0 conn(0x7fcf30139710 legacy=0x7fcf30139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient: _finish_hunting 0 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 monclient: found mon.noname-a 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf3655f640 1 -- 172.21.15.71:0/2903367498 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300a3650 con 0x7fcf300a6950 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.139+0000 7fcf35d5e640 1 --2- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a57c0 0x7fcf300a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3655f640 1 -- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 msgr2=0x7fcf300a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3655f640 1 --2- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf300a6d30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff06c7963023c18 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 1 -- 172.21.15.71:0/2903367498 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2c037070 con 0x7fcf300a6950 2024-08-19T11:17:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: dump: 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: _finish_auth 0 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: _check_auth_tickets 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 5 monclient: authenticate success, global_id 74682 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 1 -- 172.21.15.71:0/2903367498 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c02ae00 con 0x7fcf300a6950 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 10 monclient: get_monmap_and_config success 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 4 set_mon_vals no callback set 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 1 -- 172.21.15.71:0/2903367498 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2c030c20 con 0x7fcf300a6950 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf3555d640 10 monclient: dump: 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 10 monclient: shutdown 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 1 -- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 msgr2=0x7fcf300a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.142+0000 7fcf387c3640 1 --2- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf300a6d30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 -- 172.21.15.71:0/2903367498 shutdown_connections 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 --2- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a57c0 0x7fcf300a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 --2- 172.21.15.71:0/2903367498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf300a6d30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 -- 172.21.15.71:0/2903367498 >> 172.21.15.71:0/2903367498 conn(0x7fcf300abf50 msgr2=0x7fcf300ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 -- 172.21.15.71:0/2903367498 shutdown_connections 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 -- 172.21.15.71:0/2903367498 wait complete. 2024-08-19T11:17:48.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 10 monclient: build_initial_monmap 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 10 monclient: monmap: 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:17:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 Processor -- start 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 1 -- start start 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.143+0000 7fcf387c3640 10 monclient: init 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient: _reopen_session rank -1 2024-08-19T11:17:48.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient: _add_conns ranks=[3,0,2,6,8,4,1,5,7] 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf300a57c0 0x7fcf30138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): picked mon.noname-g con 0x7fcf300a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf30138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): picked mon.noname-a con 0x7fcf300a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139710 0x7fcf30122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): picked mon.noname-b con 0x7fcf30139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf300a84c0 con 0x7fcf300a6950 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcf300a7d40 con 0x7fcf30139710 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcf300a8700 con 0x7fcf300a57c0 2024-08-19T11:17:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): _renew_subs 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf387c3640 10 monclient(hunting): authenticate will time out at 1126.185405s 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf30138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf30138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50990/0 (socket says 172.21.15.71:50990) 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 -- 172.21.15.71:0/3146533738 learned_addr learned my addr 172.21.15.71:0/3146533738 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): get_auth_request con 0x7fcf300a6950 auth_method 0 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139710 0x7fcf30122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): get_auth_request con 0x7fcf30139710 auth_method 0 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf300a57c0 0x7fcf30138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): get_auth_request con 0x7fcf300a57c0 auth_method 0 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf36d60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient(hunting): handle_auth_done global_id 74691 payload 824 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf300a57c0 msgr2=0x7fcf30138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf300a57c0 0x7fcf30138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139710 msgr2=0x7fcf30122610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139710 0x7fcf30122610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient: _finish_hunting 0 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 monclient: found mon.noname-a 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.144+0000 7fcf35d5e640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf30123f90 con 0x7fcf300a6950 2024-08-19T11:17:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.146+0000 7fcf35d5e640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 msgr2=0x7fcf30138e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.146+0000 7fcf35d5e640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf30138e70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000e960 tx=0x7fcf2000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf20017070 con 0x7fcf300a6950 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: dump: 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: _finish_auth 0 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 5 monclient: authenticate success, global_id 74691 2024-08-19T11:17:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2000cc10 con 0x7fcf300a6950 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 10 monclient: _renew_subs 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf301262f0 con 0x7fcf300a6950 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2000cdc0 con 0x7fcf300a6950 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf26ffd640 10 monclient: dump: 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 10 monclient: _renew_subs 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf34d5c640 4 set_mon_vals no callback set 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf30124af0 con 0x7fcf300a6950 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 0x7fcf3002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.147+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcf3006a590 con 0x7fcf301ce4b0 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcf2001a070 con 0x7fcf300a6950 2024-08-19T11:17:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 0x7fcf3002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient: get_auth_request con 0x7fcf301ce4b0 auth_method 0 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf26ffd640 1 --2- 172.21.15.71:0/3146533738 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 3898+0+0 (secure 0 0 0) 0x7fcf2000f040 con 0x7fcf300a6950 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 10 monclient(hunting): handle_auth_done global_id 84256 payload 824 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf3655f640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf3013a310 con 0x7fcf301ce4b0 2024-08-19T11:17:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf36d60640 1 --2- 172.21.15.71:0/3146533738 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.148+0000 7fcf36d60640 10 monclient: get_auth_request con 0x7fcf1403eab0 auth_method 0 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.150+0000 7fcf3655f640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 msgr2=0x7fcf3002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.150+0000 7fcf3655f640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 0x7fcf3002d1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf3006c930 tx=0x7fcf2c0046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.150+0000 7fcf36d60640 1 --2- 172.21.15.71:0/3146533738 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf280055e0 tx=0x7fcf28003d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.150+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2c042070 con 0x7fcf301ce4b0 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.150+0000 7fcf26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 10 monclient: dump: 2024-08-19T11:17:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcf2c003a30 con 0x7fcf301ce4b0 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 msgr2=0x7fcf3002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 0x7fcf3002d1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf3006c930 tx=0x7fcf2c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 msgr2=0x7fcf3002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:48.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.151+0000 7fcf26ffd640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf301ce4b0 0x7fcf3002d1c0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf3006c930 tx=0x7fcf2c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:17:48.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf387c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:17:48.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf387c3640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 0x7fcf3002dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:17:48.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf387c3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:17:48.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcf30076c60 con 0x7fcf3002d700 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 0x7fcf3002dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient: get_auth_request con 0x7fcf3002d700 auth_method 0 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:17:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:17:48.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:17:48.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 10 monclient(hunting): handle_auth_done global_id 84265 payload 824 2024-08-19T11:17:48.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.157+0000 7fcf3655f640 1 -- 172.21.15.71:0/3146533738 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcf300a20c0 con 0x7fcf3002d700 2024-08-19T11:17:48.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.160+0000 7fcf3655f640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 msgr2=0x7fcf3002dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:17:48.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.160+0000 7fcf3655f640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 0x7fcf3002dae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097c0 tx=0x7fcf2c008030 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.160+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2c037040 con 0x7fcf3002d700 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.160+0000 7fcf26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.160+0000 7fcf26ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.160+0000 7fcf26ffd640 10 monclient: dump: 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:17:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9423 (secure 0 0 0) 0x7fcf2c030aa0 con 0x7fcf3002d700 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 msgr2=0x7fcf3002dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 0x7fcf3002dae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097c0 tx=0x7fcf2c008030 comp rx=0 tx=0).stop 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 msgr2=0x7fcf3002dae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf26ffd640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcf3002d700 0x7fcf3002dae0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097c0 tx=0x7fcf2c008030 comp rx=0 tx=0).stop 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 164, 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 50320, 2024-08-19T11:17:48.185 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:17:48.186 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.187 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:48.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:17:48.189 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:17:48.190 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:17:48.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:17:48.194 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:17:48.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:17:48.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:17:48.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:17:48.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.207 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:17:48.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:17:48.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:17:48.209 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:17:48.209 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:17:48.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 msgr2=0x7fcf14040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 --2- 172.21.15.71:0/3146533738 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf280055e0 tx=0x7fcf28003d10 comp rx=0 tx=0).stop 2024-08-19T11:17:48.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 10 monclient: shutdown 2024-08-19T11:17:48.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:17:48.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 msgr2=0x7fcf30138e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 --2- 172.21.15.71:0/3146533738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6950 0x7fcf30138e70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000e960 tx=0x7fcf2000ee20 comp rx=0 tx=0).stop 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf36d60640 1 -- 172.21.15.71:0/3146533738 reap_dead start 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf36d60640 1 -- 172.21.15.71:0/3146533738 reap_dead start 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 shutdown_connections 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 >> 172.21.15.71:0/3146533738 conn(0x7fcf300abf50 msgr2=0x7fcf300aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 shutdown_connections 2024-08-19T11:17:48.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:17:48.161+0000 7fcf387c3640 1 -- 172.21.15.71:0/3146533738 wait complete. 2024-08-19T11:17:48.211 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:17:48.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:17:49.583 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27320]: starting. 2024-08-19T11:17:49.583 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27320]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27318 2024-08-19T11:17:49.584 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27320]: shutting down. 2024-08-19T11:17:51.714 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:51.714 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: starting. 2024-08-19T11:17:51.714 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27318 2024-08-19T11:17:51.714 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: created object 0... 2024-08-19T11:17:51.714 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: created object 25... 2024-08-19T11:17:51.715 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: created object 49... 2024-08-19T11:17:51.715 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: finishing. 2024-08-19T11:17:51.715 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27353]: shutting down. 2024-08-19T11:17:51.753 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:51.754 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27355]: starting. 2024-08-19T11:17:51.754 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27355]: listing objects. 2024-08-19T11:17:51.754 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27355]: listed object 0... 2024-08-19T11:17:51.754 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27355]: listed object 25... 2024-08-19T11:17:51.754 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27355]: saw 50 objects 2024-08-19T11:17:51.754 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27355]: shutting down. 2024-08-19T11:17:52.614 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:52.614 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27354]: starting. 2024-08-19T11:17:52.614 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27354]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27318 2024-08-19T11:17:52.614 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27354]: shutting down. 2024-08-19T11:17:52.616 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:52.616 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:52.616 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:17:52.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:17:54.717 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: starting. 2024-08-19T11:17:54.718 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27421 2024-08-19T11:17:54.718 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: created object 0... 2024-08-19T11:17:54.718 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: created object 25... 2024-08-19T11:17:54.718 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: created object 49... 2024-08-19T11:17:54.718 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: finishing. 2024-08-19T11:17:54.718 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27422]: shutting down. 2024-08-19T11:17:55.628 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27423]: starting. 2024-08-19T11:17:55.628 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27423]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27421 2024-08-19T11:17:55.629 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27423]: shutting down. 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: starting. 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27421 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: created object 0... 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: created object 25... 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: created object 49... 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: finishing. 2024-08-19T11:17:58.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27456]: shutting down. 2024-08-19T11:17:58.504 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:58.504 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27458]: starting. 2024-08-19T11:17:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27458]: listing objects. 2024-08-19T11:17:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27458]: listed object 0... 2024-08-19T11:17:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27458]: listed object 25... 2024-08-19T11:17:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27458]: saw 50 objects 2024-08-19T11:17:58.505 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27458]: shutting down. 2024-08-19T11:17:59.369 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:59.369 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27457]: starting. 2024-08-19T11:17:59.369 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27457]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27421 2024-08-19T11:17:59.369 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27457]: shutting down. 2024-08-19T11:17:59.370 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:59.371 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:17:59.371 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:17:59.374 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: starting. 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27524 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: created object 0... 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: created object 25... 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: created object 49... 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: finishing. 2024-08-19T11:18:01.487 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27525]: shutting down. 2024-08-19T11:18:02.395 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27526]: starting. 2024-08-19T11:18:02.395 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27526]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27524 2024-08-19T11:18:02.395 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27526]: shutting down. 2024-08-19T11:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:04.989 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: starting. 2024-08-19T11:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27524 2024-08-19T11:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: created object 0... 2024-08-19T11:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: created object 25... 2024-08-19T11:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: created object 49... 2024-08-19T11:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: finishing. 2024-08-19T11:18:04.990 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27559]: shutting down. 2024-08-19T11:18:05.230 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:05.230 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27561]: starting. 2024-08-19T11:18:05.230 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27561]: listing objects. 2024-08-19T11:18:05.231 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27561]: listed object 0... 2024-08-19T11:18:05.231 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27561]: listed object 25... 2024-08-19T11:18:05.231 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27561]: saw 50 objects 2024-08-19T11:18:05.231 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27561]: shutting down. 2024-08-19T11:18:05.894 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:05.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27560]: starting. 2024-08-19T11:18:05.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27560]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27524 2024-08-19T11:18:05.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27560]: shutting down. 2024-08-19T11:18:05.896 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:05.896 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:05.896 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:18:05.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:18:07.124 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: starting. 2024-08-19T11:18:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27627 2024-08-19T11:18:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: created object 0... 2024-08-19T11:18:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: created object 25... 2024-08-19T11:18:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: created object 49... 2024-08-19T11:18:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: finishing. 2024-08-19T11:18:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27628]: shutting down. 2024-08-19T11:18:08.023 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27629]: starting. 2024-08-19T11:18:08.023 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27629]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27627 2024-08-19T11:18:08.023 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27629]: shutting down. 2024-08-19T11:18:08.212 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-19T11:18:08.213 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-19T11:18:08.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-19T11:18:08.216 INFO:tasks.ceph.mon.e:Started 2024-08-19T11:18:08.216 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-08-19T11:18:08.216 INFO:tasks.ceph.mon.b:Sent signal 19 2024-08-19T11:18:08.216 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-08-19T11:18:08.217 INFO:tasks.ceph.mon.g:Sent signal 19 2024-08-19T11:18:08.217 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:18:23.217 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-08-19T11:18:23.218 INFO:tasks.ceph.mon.b:Sent signal 18 2024-08-19T11:18:23.218 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-08-19T11:18:23.218 INFO:tasks.ceph.mon.g:Sent signal 18 2024-08-19T11:18:23.218 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:18:23.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:18:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.330+0000 7feaf41ba640 10 monclient: get_monmap_and_config 2024-08-19T11:18:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.330+0000 7feaf41ba640 10 monclient: build_initial_monmap 2024-08-19T11:18:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.330+0000 7feaf41ba640 10 monclient: monmap: 2024-08-19T11:18:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:23.330911+0000 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:23.330911+0000 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:23.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:23.333 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:23.333 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.330+0000 7feaf41ba640 1 Processor -- start 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 -- start start 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient: init 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient: _add_conns ranks=[6,5,10,2,1,8,0,4,3,9,7] 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 0x7feaec0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): picked mon.noname-d con 0x7feaec0a3cb0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec0a5020 0x7feaec0a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): picked mon.noname-h con 0x7feaec0a5020 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feaec139970 0x7feaec139de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): picked mon.noname-f con 0x7feaec139970 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7feaec0a4b10 con 0x7feaec139970 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7feaec0a13d0 con 0x7feaec0a5020 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7feaec074530 con 0x7feaec0a3cb0 2024-08-19T11:18:23.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf41ba640 10 monclient(hunting): authenticate will time out at 1161.372584s 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 0x7feaec0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 0x7feaec0a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47360/0 (socket says 172.21.15.71:47360) 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 1 -- 172.21.15.71:0/673489952 learned_addr learned my addr 172.21.15.71:0/673489952 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): get_auth_request con 0x7feaec0a3cb0 auth_method 0 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1f56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf2757640 1 --2- 172.21.15.71:0/673489952 >> v2:172.21.15.135:3300/0 conn(0x7feaec139970 0x7feaec139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.331+0000 7feaf1755640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec0a5020 0x7feaec0a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 10 monclient(hunting): handle_auth_done global_id 26322 payload 274 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 1 -- 172.21.15.71:0/673489952 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec0a5020 msgr2=0x7feaec0a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec0a5020 0x7feaec0a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 1 -- 172.21.15.71:0/673489952 >> v2:172.21.15.135:3300/0 conn(0x7feaec139970 msgr2=0x7feaec139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 1 --2- 172.21.15.71:0/673489952 >> v2:172.21.15.135:3300/0 conn(0x7feaec139970 0x7feaec139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 1 monclient: found mon.noname-d 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1f56640 1 -- 172.21.15.71:0/673489952 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec0a4da0 con 0x7feaec0a3cb0 2024-08-19T11:18:23.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1755640 10 monclient: get_auth_request con 0x7feaec0a5020 auth_method 0 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf2757640 10 monclient: get_auth_request con 0x7feaec139970 auth_method 0 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf1755640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec0a5020 0x7feaec0a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.332+0000 7feaf2757640 1 --2- 172.21.15.71:0/673489952 >> v2:172.21.15.135:3300/0 conn(0x7feaec139970 0x7feaec139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf1f56640 1 -- 172.21.15.71:0/673489952 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 msgr2=0x7feaec0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf1f56640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 0x7feaec0a4090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feae40098a0 tx=0x7feae402a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b80f74bc9d36fdfa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 1 -- 172.21.15.71:0/673489952 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feae4037070 con 0x7feaec0a3cb0 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: dump: 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.341 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.342 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: _finish_auth 0 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: _check_auth_tickets 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 1 -- 172.21.15.71:0/673489952 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae40307b0 con 0x7feaec0a3cb0 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf41ba640 5 monclient: authenticate success, global_id 26322 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf41ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf41ba640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 1 -- 172.21.15.71:0/673489952 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feae4030e10 con 0x7feaec0a3cb0 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf41ba640 4 set_mon_vals no callback set 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.334+0000 7feaf0f54640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf0f54640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf0f54640 10 monclient: dump: 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.344 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 10 monclient: shutdown 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 -- 172.21.15.71:0/673489952 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 msgr2=0x7feaec0a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 0x7feaec0a4090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feae40098a0 tx=0x7feae402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 -- 172.21.15.71:0/673489952 shutdown_connections 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 --2- 172.21.15.71:0/673489952 >> v2:172.21.15.135:3300/0 conn(0x7feaec139970 0x7feaec139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec0a5020 0x7feaec0a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 --2- 172.21.15.71:0/673489952 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7feaec0a3cb0 0x7feaec0a4090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 -- 172.21.15.71:0/673489952 >> 172.21.15.71:0/673489952 conn(0x7feaec0a91d0 msgr2=0x7feaec0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 -- 172.21.15.71:0/673489952 shutdown_connections 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.335+0000 7feaf41ba640 1 -- 172.21.15.71:0/673489952 wait complete. 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient: build_initial_monmap 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient: monmap: 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:23.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 Processor -- start 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 -- start start 2024-08-19T11:18:23.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient: init 2024-08-19T11:18:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient: _add_conns ranks=[8,1,5,6,2,4,0,7,3] 2024-08-19T11:18:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 0x7feaec123810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): picked mon.noname-e con 0x7feaec0a3cb0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:23.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaec0a5020 0x7feaec138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): picked mon.noname-f con 0x7feaec0a5020 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 0x7feaec138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): picked mon.noname-h con 0x7feaec139970 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feaec0a54f0 con 0x7feaec0a5020 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7feaec06cb70 con 0x7feaec139970 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7feaec13a320 con 0x7feaec0a3cb0 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.336+0000 7feaf41ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf41ba640 10 monclient(hunting): authenticate will time out at 1161.378007s 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 0x7feaec123810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 0x7feaec123810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48832/0 (socket says 172.21.15.71:48832) 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 -- 172.21.15.71:0/1283342581 learned_addr learned my addr 172.21.15.71:0/1283342581 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 10 monclient(hunting): get_auth_request con 0x7feaec0a3cb0 auth_method 0 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 0x7feaec138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): get_auth_request con 0x7feaec139970 auth_method 0 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 msgr2=0x7feaec123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 msgr2=0x7feaec123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 0x7feaec123810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1f56640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 0x7feaec123810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1755640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaec0a5020 0x7feaec138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1755640 10 monclient(hunting): get_auth_request con 0x7feaec0a5020 auth_method 0 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1755640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf1755640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient(hunting): handle_auth_done global_id 45419 payload 824 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 msgr2=0x7feaec123810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7feaec0a3cb0 0x7feaec123810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaec0a5020 msgr2=0x7feaec138a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaec0a5020 0x7feaec138a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 monclient: found mon.noname-h 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.337+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec073890 con 0x7feaec139970 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.339+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 msgr2=0x7feaec138f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.339+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 0x7feaec138f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c5c0 tx=0x7feadc00ca80 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 msgr2=0x7feaec138f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 msgr2=0x7feaec138f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 0x7feaec138f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c5c0 tx=0x7feadc00ca80 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 0x7feaec138f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c5c0 tx=0x7feadc00ca80 comp rx=0 tx=0).stop 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 msgr2=0x7feaec138f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7feaec139970 0x7feaec138f70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient: _add_conns ranks=[4,3,6,0,2,7] 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fead8003600 0x7fead8005a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): picked mon.noname-c con 0x7fead8003600 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead80065a0 0x7fead8008a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): picked mon.noname-g con 0x7fead80065a0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:23.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 0x7fead800ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): picked mon.noname-d con 0x7fead80095d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fead800c680 con 0x7fead80065a0 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fead800c800 con 0x7fead8003600 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fead800ca00 con 0x7fead80095d0 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaea7fc640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fead8003600 0x7fead8005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 0x7fead800ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): get_auth_request con 0x7fead8003600 auth_method 0 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): get_auth_request con 0x7fead80095d0 auth_method 0 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient(hunting): handle_auth_done global_id 45419 payload 293 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fead8003600 msgr2=0x7fead8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fead8003600 0x7fead8005a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead80065a0 msgr2=0x7fead8008a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fead80065a0 0x7fead8008a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 monclient: found mon.noname-d 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead800ccc0 con 0x7fead80095d0 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf1f56640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fead8003600 0x7fead8005a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.340+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 reap_dead start 2024-08-19T11:18:23.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaf2757640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 msgr2=0x7fead800ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaf2757640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 0x7fead800ba90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c590 tx=0x7feadc008040 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feae4037040 con 0x7fead80095d0 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: dump: 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.363 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:23.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc0119a0 con 0x7fead80095d0 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaf41ba640 5 monclient: authenticate success, global_id 45419 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7feadc015070 con 0x7fead80095d0 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaf41ba640 10 monclient: _renew_subs 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaf41ba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec139de0 con 0x7fead80095d0 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaea7fc640 10 monclient: dump: 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.365 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.342+0000 7feaebfff640 4 set_mon_vals no callback set 2024-08-19T11:18:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 10 monclient: _renew_subs 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec125e30 con 0x7fead80095d0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7feadc018070 con 0x7fead80095d0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.343+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec13a620 con 0x7fead80095d0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.344+0000 7feaea7fc640 1 --2- 172.21.15.71:0/1283342581 >> v2:172.21.15.135:6800/726754104 conn(0x7fead80432d0 0x7fead8045790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.344+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (secure 0 0 0) 0x7feadc052950 con 0x7fead80095d0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.344+0000 7feaf1f56640 1 --2- 172.21.15.71:0/1283342581 >> v2:172.21.15.135:6800/726754104 conn(0x7fead80432d0 0x7fead8045790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.344+0000 7feaf1f56640 10 monclient: get_auth_request con 0x7fead80432d0 auth_method 0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.346+0000 7feaf1f56640 1 --2- 172.21.15.71:0/1283342581 >> v2:172.21.15.135:6800/726754104 conn(0x7fead80432d0 0x7fead8045790 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7feae4035040 tx=0x7feae402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.348+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7feadc02c030 con 0x7fead80095d0 2024-08-19T11:18:23.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.348+0000 7feaea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.348+0000 7feaea7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.588+0000 7feaf41ba640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.588+0000 7feaf41ba640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.588+0000 7feaf41ba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.588+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feaec126210 con 0x7fead80095d0 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.588+0000 7feaea7fc640 1 -- 172.21.15.71:0/1283342581 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7feadc051840 con 0x7fead80095d0 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.589+0000 7feaea7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:23.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.589+0000 7feaea7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:23.591 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":170,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.590+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 >> v2:172.21.15.135:6800/726754104 conn(0x7fead80432d0 msgr2=0x7fead8045790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.590+0000 7feaf41ba640 1 --2- 172.21.15.71:0/1283342581 >> v2:172.21.15.135:6800/726754104 conn(0x7fead80432d0 0x7fead8045790 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7feae4035040 tx=0x7feae402e000 comp rx=0 tx=0).stop 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.590+0000 7feaf41ba640 10 monclient: shutdown 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.590+0000 7feaf41ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.590+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 msgr2=0x7fead800ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.590+0000 7feaf41ba640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 0x7fead800ba90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c590 tx=0x7feadc008040 comp rx=0 tx=0).stop 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.591+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 shutdown_connections 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.591+0000 7feaf41ba640 1 --2- 172.21.15.71:0/1283342581 >> v2:172.21.15.135:6800/726754104 conn(0x7fead80432d0 0x7fead8045790 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.591+0000 7feaf41ba640 1 --2- 172.21.15.71:0/1283342581 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fead80095d0 0x7fead800ba90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.591+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 >> 172.21.15.71:0/1283342581 conn(0x7feaec0a91d0 msgr2=0x7feaec0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:23.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.591+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 shutdown_connections 2024-08-19T11:18:23.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.591+0000 7feaf41ba640 1 -- 172.21.15.71:0/1283342581 wait complete. 2024-08-19T11:18:23.602 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:18:23.602 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:18:23.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.700+0000 7fb3fd13c640 10 monclient: get_monmap_and_config 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.700+0000 7fb3fd13c640 10 monclient: build_initial_monmap 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.700+0000 7fb3fd13c640 10 monclient: monmap: 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:23.700850+0000 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:23.700850+0000 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:23.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.700+0000 7fb3fd13c640 1 Processor -- start 2024-08-19T11:18:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.700+0000 7fb3fd13c640 1 -- start start 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.700+0000 7fb3fd13c640 10 monclient: init 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient: _add_conns ranks=[4,7,10,1,6,0,9,8,2,5,3] 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 0x7fb3f80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): picked mon.noname-c con 0x7fb3f80a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): picked mon.noname-i con 0x7fb3f80a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb3f8139710 0x7fb3f8139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): picked mon.noname-f con 0x7fb3f8139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f80a5020 con 0x7fb3f8139710 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb3f80a77b0 con 0x7fb3f80a6950 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fb3f80a7d40 con 0x7fb3f80a57c0 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3fd13c640 10 monclient(hunting): authenticate will time out at 1161.742389s 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 0x7fb3f80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 0x7fb3f80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46072/0 (socket says 172.21.15.71:46072) 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/1631619886 learned_addr learned my addr 172.21.15.71:0/1631619886 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): get_auth_request con 0x7fb3f80a6950 auth_method 0 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 1 --2- 172.21.15.71:0/1631619886 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): get_auth_request con 0x7fb3f80a57c0 auth_method 0 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 1 --2- 172.21.15.71:0/1631619886 >> v2:172.21.15.135:3300/0 conn(0x7fb3f8139710 0x7fb3f8139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): get_auth_request con 0x7fb3f8139710 auth_method 0 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_done global_id 84433 payload 274 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/1631619886 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 msgr2=0x7fb3f80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/1631619886 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/1631619886 >> v2:172.21.15.135:3300/0 conn(0x7fb3f8139710 msgr2=0x7fb3f8139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/1631619886 >> v2:172.21.15.135:3300/0 conn(0x7fb3f8139710 0x7fb3f8139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 monclient: found mon.noname-c 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.701+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/1631619886 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f80a6380 con 0x7fb3f80a6950 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/1631619886 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 msgr2=0x7fb3f80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/1631619886 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 0x7fb3f80a6d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80098a0 tx=0x7fb3e802a0d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=3ea261eeb30e5fa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 1 -- 172.21.15.71:0/1631619886 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3e8037070 con 0x7fb3f80a6950 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: dump: 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.711 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: _finish_auth 0 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 1 -- 172.21.15.71:0/1631619886 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e802adf0 con 0x7fb3f80a6950 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3fd13c640 5 monclient: authenticate success, global_id 84433 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3fd13c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3fd13c640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 1 -- 172.21.15.71:0/1631619886 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3e8030c20 con 0x7fb3f80a6950 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3fd13c640 4 set_mon_vals no callback set 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.704+0000 7fb3f5d9b640 10 monclient: dump: 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.713 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.714 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 10 monclient: shutdown 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 -- 172.21.15.71:0/1631619886 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 msgr2=0x7fb3f80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/1631619886 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 0x7fb3f80a6d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80098a0 tx=0x7fb3e802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 -- 172.21.15.71:0/1631619886 shutdown_connections 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/1631619886 >> v2:172.21.15.135:3300/0 conn(0x7fb3f8139710 0x7fb3f8139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/1631619886 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/1631619886 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3f80a6950 0x7fb3f80a6d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 -- 172.21.15.71:0/1631619886 >> 172.21.15.71:0/1631619886 conn(0x7fb3f80abf50 msgr2=0x7fb3f80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 -- 172.21.15.71:0/1631619886 shutdown_connections 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.705+0000 7fb3fd13c640 1 -- 172.21.15.71:0/1631619886 wait complete. 2024-08-19T11:18:23.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.706+0000 7fb3fd13c640 10 monclient: build_initial_monmap 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.706+0000 7fb3fd13c640 10 monclient: monmap: 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:23.717 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:23.717 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:23.717 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:23.717 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.706+0000 7fb3fd13c640 1 Processor -- start 2024-08-19T11:18:23.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.706+0000 7fb3fd13c640 1 -- start start 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.706+0000 7fb3fd13c640 10 monclient: init 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient: _add_conns ranks=[7,2,6,8,1,5,4,3,0] 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f8124c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): picked mon.noname-i con 0x7fb3f80a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 0x7fb3f81251a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): picked mon.noname-b con 0x7fb3f80a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3f8139710 0x7fb3f81256e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): picked mon.noname-d con 0x7fb3f8139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:23.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f80a84c0 con 0x7fb3f80a6950 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb3f80a3650 con 0x7fb3f8139710 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fb3f80a8700 con 0x7fb3f80a57c0 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3fd13c640 10 monclient(hunting): authenticate will time out at 1161.748177s 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 0x7fb3f81251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 0x7fb3f81251a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52860/0 (socket says 172.21.15.71:52860) 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 -- 172.21.15.71:0/2945523220 learned_addr learned my addr 172.21.15.71:0/2945523220 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): get_auth_request con 0x7fb3f80a6950 auth_method 0 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3f8139710 0x7fb3f81256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): get_auth_request con 0x7fb3f8139710 auth_method 0 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f8124c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f6d9d640 10 monclient(hunting): get_auth_request con 0x7fb3f80a57c0 auth_method 0 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient(hunting): handle_auth_done global_id 74729 payload 824 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 msgr2=0x7fb3f8124c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3f80a57c0 0x7fb3f8124c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3f8139710 msgr2=0x7fb3f81256e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb3f8139710 0x7fb3f81256e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 monclient: found mon.noname-b 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.707+0000 7fb3f659c640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f8128ab0 con 0x7fb3f80a6950 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3f659c640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 msgr2=0x7fb3f81251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3f659c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 0x7fb3f81251a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e9e0 tx=0x7fb3e000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3e0017070 con 0x7fb3f80a6950 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 10 monclient: dump: 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.729 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:23.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e000cbe0 con 0x7fb3f80a6950 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3fd13c640 5 monclient: authenticate success, global_id 74729 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3fd13c640 10 monclient: _renew_subs 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3fd13c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f813a340 con 0x7fb3f80a6950 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.709+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3e000cd90 con 0x7fb3f80a6950 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3ef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3ef7fe640 10 monclient: dump: 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.731 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3f559a640 4 set_mon_vals no callback set 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 10 monclient: _renew_subs 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f8126750 con 0x7fb3f80a6950 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 0x7fb3f809fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f8076c60 con 0x7fb3f809fa10 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.710+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb3e001a070 con 0x7fb3f80a6950 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 0x7fb3f809fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient: get_auth_request con 0x7fb3f809fa10 auth_method 0 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3ef7fe640 1 --2- 172.21.15.71:0/2945523220 >> v2:172.21.15.135:6800/726754104 conn(0x7fb3d803ea80 0x7fb3d8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (secure 0 0 0) 0x7fb3e000f040 con 0x7fb3f80a6950 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_done global_id 74799 payload 824 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3f80a20a0 con 0x7fb3f809fa10 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f759e640 1 --2- 172.21.15.71:0/2945523220 >> v2:172.21.15.135:6800/726754104 conn(0x7fb3d803ea80 0x7fb3d8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.711+0000 7fb3f759e640 10 monclient: get_auth_request con 0x7fb3d803ea80 auth_method 0 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.713+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 msgr2=0x7fb3f809fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.713+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 0x7fb3f809fdf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8074f90 tx=0x7fb3e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.713+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3e8041070 con 0x7fb3f809fa10 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.713+0000 7fb3ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.713+0000 7fb3ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.713+0000 7fb3ef7fe640 10 monclient: dump: 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.735 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3f759e640 1 --2- 172.21.15.71:0/2945523220 >> v2:172.21.15.135:6800/726754104 conn(0x7fb3d803ea80 0x7fb3d8040f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0011340 tx=0x7fb3f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb3e8003820 con 0x7fb3f809fa10 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 msgr2=0x7fb3f809fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 0x7fb3f809fdf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8074f90 tx=0x7fb3e80046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 msgr2=0x7fb3f809fdf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.714+0000 7fb3ef7fe640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f809fa10 0x7fb3f809fdf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3fd13c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 0x7fb3f81d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3fd13c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f80a6d30 con 0x7fb3f80a0330 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 0x7fb3f81d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient: get_auth_request con 0x7fb3f80a0330 auth_method 0 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 10 monclient(hunting): handle_auth_done global_id 74808 payload 824 2024-08-19T11:18:23.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.720+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/2945523220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3f806ca70 con 0x7fb3f80a0330 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.722+0000 7fb3f6d9d640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 msgr2=0x7fb3f81d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.722+0000 7fb3f6d9d640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 0x7fb3f81d8990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80098a0 tx=0x7fb3e8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.722+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3e8037040 con 0x7fb3f80a0330 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.722+0000 7fb3ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.722+0000 7fb3ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.722+0000 7fb3ef7fe640 10 monclient: dump: 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.738 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7fb3e80309f0 con 0x7fb3f80a0330 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 msgr2=0x7fb3f81d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 0x7fb3f81d8990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80098a0 tx=0x7fb3e8008030 comp rx=0 tx=0).stop 2024-08-19T11:18:23.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 msgr2=0x7fb3f81d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3ef7fe640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3f80a0330 0x7fb3f81d8990 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80098a0 tx=0x7fb3e8008030 comp rx=0 tx=0).stop 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 152755, 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:23.740 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:23.741 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:23.742 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.743 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:23.744 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:23.745 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.747 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.749 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.751 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:23.755 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:23.756 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.757 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:23.759 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:23.762 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:23.763 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 >> v2:172.21.15.135:6800/726754104 conn(0x7fb3d803ea80 msgr2=0x7fb3d8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/2945523220 >> v2:172.21.15.135:6800/726754104 conn(0x7fb3d803ea80 0x7fb3d8040f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0011340 tx=0x7fb3f000b040 comp rx=0 tx=0).stop 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 10 monclient: shutdown 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 msgr2=0x7fb3f81251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 0x7fb3f81251a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000e9e0 tx=0x7fb3e000eea0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3f759e640 1 -- 172.21.15.71:0/2945523220 reap_dead start 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 shutdown_connections 2024-08-19T11:18:23.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 --2- 172.21.15.71:0/2945523220 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb3f80a6950 0x7fb3f81251a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 >> 172.21.15.71:0/2945523220 conn(0x7fb3f80abf50 msgr2=0x7fb3f8138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:23.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 shutdown_connections 2024-08-19T11:18:23.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.723+0000 7fb3fd13c640 1 -- 172.21.15.71:0/2945523220 wait complete. 2024-08-19T11:18:23.766 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:23.766 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:18:23.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.867+0000 7fc3d94ec640 10 monclient: get_monmap_and_config 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.867+0000 7fc3d94ec640 10 monclient: build_initial_monmap 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.868+0000 7fc3d94ec640 10 monclient: monmap: 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:23.868615+0000 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:23.868615+0000 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.869 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:23.870 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.868+0000 7fc3d94ec640 1 Processor -- start 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.868+0000 7fc3d94ec640 1 -- start start 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.868+0000 7fc3d94ec640 10 monclient: init 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient: _add_conns ranks=[5,0,6,4,10,3,8,2,1,9,7] 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): picked mon.noname-h con 0x7fc3d40a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc3d40a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 0x7fc3d4139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): picked mon.noname-d con 0x7fc3d40a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d40a6380 con 0x7fc3d40a57c0 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc3d40a5020 con 0x7fc3d40a6950 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc3d40a7d40 con 0x7fc3d40a7270 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d94ec640 10 monclient(hunting): authenticate will time out at 1161.910288s 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 0x7fc3d4139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3cbfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc3d40a57c0 0x7fc3d4139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49020/0 (socket says 172.21.15.71:49020) 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3cbfff640 1 -- 172.21.15.71:0/3633924679 learned_addr learned my addr 172.21.15.71:0/3633924679 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): get_auth_request con 0x7fc3d40a7270 auth_method 0 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 1 --2- 172.21.15.71:0/3633924679 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): get_auth_request con 0x7fc3d40a6950 auth_method 0 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_done global_id 26340 payload 274 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 1 -- 172.21.15.71:0/3633924679 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 msgr2=0x7fc3d40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 1 --2- 172.21.15.71:0/3633924679 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d40a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 1 -- 172.21.15.71:0/3633924679 >> v1:172.21.15.71:6789/0 conn(0x7fc3d40a57c0 legacy=0x7fc3d4139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 1 monclient: found mon.noname-d 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.869+0000 7fc3d37fe640 1 -- 172.21.15.71:0/3633924679 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d40a3650 con 0x7fc3d40a7270 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.872+0000 7fc3d37fe640 1 -- 172.21.15.71:0/3633924679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 msgr2=0x7fc3d4139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.872+0000 7fc3d37fe640 1 --2- 172.21.15.71:0/3633924679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 0x7fc3d4139e20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc009df0 tx=0x7fc3cc02a4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b628b02b79ec38d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.872+0000 7fc3d27fc640 1 -- 172.21.15.71:0/3633924679 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3cc007bc0 con 0x7fc3d40a7270 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.872+0000 7fc3d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.872+0000 7fc3d27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.872+0000 7fc3d27fc640 10 monclient: dump: 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.877 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.878 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 1 -- 172.21.15.71:0/3633924679 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc007d80 con 0x7fc3d40a7270 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 5 monclient: authenticate success, global_id 26340 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 1 -- 172.21.15.71:0/3633924679 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3cc031870 con 0x7fc3d40a7270 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 4 set_mon_vals no callback set 2024-08-19T11:18:23.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d27fc640 10 monclient: dump: 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.881 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.881 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.881 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 10 monclient: shutdown 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 -- 172.21.15.71:0/3633924679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 msgr2=0x7fc3d4139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/3633924679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 0x7fc3d4139e20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc009df0 tx=0x7fc3cc02a4b0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 -- 172.21.15.71:0/3633924679 shutdown_connections 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/3633924679 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc3d40a7270 0x7fc3d4139e20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/3633924679 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d40a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 -- 172.21.15.71:0/3633924679 >> 172.21.15.71:0/3633924679 conn(0x7fc3d40abf50 msgr2=0x7fc3d40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 -- 172.21.15.71:0/3633924679 shutdown_connections 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.873+0000 7fc3d94ec640 1 -- 172.21.15.71:0/3633924679 wait complete. 2024-08-19T11:18:23.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient: build_initial_monmap 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient: monmap: 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:23.888 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 Processor -- start 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 -- start start 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient: init 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient: _add_conns ranks=[7,5,4,2,1,0,8,6,3] 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3d40a57c0 0x7fc3d41caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): picked mon.noname-i con 0x7fc3d40a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d4139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): picked mon.noname-h con 0x7fc3d40a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:23.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 0x7fc3d413a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): picked mon.noname-c con 0x7fc3d40a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc3d40a8700 con 0x7fc3d40a7270 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc3d40a84c0 con 0x7fc3d40a6950 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc3d40a7690 con 0x7fc3d40a57c0 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.874+0000 7fc3d94ec640 10 monclient(hunting): authenticate will time out at 1161.915967s 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 0x7fc3d413a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 0x7fc3d413a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46086/0 (socket says 172.21.15.71:46086) 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 learned_addr learned my addr 172.21.15.71:0/1329379228 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): get_auth_request con 0x7fc3d40a7270 auth_method 0 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d4139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3d40a57c0 0x7fc3d41caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): get_auth_request con 0x7fc3d40a6950 auth_method 0 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): get_auth_request con 0x7fc3d40a57c0 auth_method 0 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient(hunting): handle_auth_done global_id 84442 payload 824 2024-08-19T11:18:23.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3d40a57c0 msgr2=0x7fc3d41caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc3d40a57c0 0x7fc3d41caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 msgr2=0x7fc3d4139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc3d40a6950 0x7fc3d4139d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 monclient: found mon.noname-c 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.875+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d41266a0 con 0x7fc3d40a7270 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 msgr2=0x7fc3d413a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d37fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 0x7fc3d413a240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc02a9d0 tx=0x7fc3cc004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3cc003e50 con 0x7fc3d40a7270 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: dump: 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.894 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc0046c0 con 0x7fc3d40a7270 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 5 monclient: authenticate success, global_id 84442 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 10 monclient: _renew_subs 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d4125360 con 0x7fc3d40a7270 2024-08-19T11:18:23.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3cc03b880 con 0x7fc3d40a7270 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3cb7fe640 10 monclient: dump: 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.896 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 10 monclient: _renew_subs 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d4125ec0 con 0x7fc3d40a7270 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.877+0000 7fc3d1ffb640 4 set_mon_vals no callback set 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d94ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 0x7fc3d41ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d406a590 con 0x7fc3d41ce400 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 0x7fc3d41ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient: get_auth_request con 0x7fc3d41ce400 auth_method 0 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d37fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 0x7fc3d413a240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc02a9d0 tx=0x7fc3cc004a40 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fc3cc03b410 mgrmap(e 5) 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc3cc03b410 con 0x7fc3d40a7270 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.878+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.879+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_done global_id 74738 payload 824 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.879+0000 7fc3d2ffd640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3d4124ee0 con 0x7fc3d41ce400 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.879+0000 7fc3cb7fe640 1 --2- 172.21.15.71:0/1329379228 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3b403ec50 0x7fc3b4041110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.879+0000 7fc3cbfff640 1 --2- 172.21.15.71:0/1329379228 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3b403ec50 0x7fc3b4041110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.879+0000 7fc3cbfff640 10 monclient: get_auth_request con 0x7fc3b403ec50 auth_method 0 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3d2ffd640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 msgr2=0x7fc3d41ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3d2ffd640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 0x7fc3d41ce7e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40118e0 tx=0x7fc3c4011da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3c4019070 con 0x7fc3d41ce400 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 10 monclient: dump: 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.899 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.900 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc3c400f950 con 0x7fc3d41ce400 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 msgr2=0x7fc3d41ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 0x7fc3d41ce7e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40118e0 tx=0x7fc3c4011da0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 msgr2=0x7fc3d41ce7e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.881+0000 7fc3cb7fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ce400 0x7fc3d41ce7e0 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40118e0 tx=0x7fc3c4011da0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.882+0000 7fc3cbfff640 1 --2- 172.21.15.71:0/1329379228 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3b403ec50 0x7fc3b4041110 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc007c90 tx=0x7fc3bc007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d94ec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 0x7fc3d409e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d94ec640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d40a94a0 con 0x7fc3d41ced20 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 0x7fc3d409e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient: get_auth_request con 0x7fc3d41ced20 auth_method 0 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:23.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 10 monclient(hunting): handle_auth_done global_id 74747 payload 824 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.888+0000 7fc3d2ffd640 1 -- 172.21.15.71:0/1329379228 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3d4126150 con 0x7fc3d41ced20 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.890+0000 7fc3d2ffd640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 msgr2=0x7fc3d409e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.890+0000 7fc3d2ffd640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 0x7fc3d409e660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3c401b000 tx=0x7fc3c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.890+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc3c4019070 con 0x7fc3d41ced20 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.890+0000 7fc3cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.890+0000 7fc3cb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.890+0000 7fc3cb7fe640 10 monclient: dump: 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:23.904 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:23.905 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7fc3c401e450 con 0x7fc3d41ced20 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 msgr2=0x7fc3d409e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 0x7fc3d409e660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3c401b000 tx=0x7fc3c40046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 msgr2=0x7fc3d409e660 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3d41ced20 0x7fc3d409e660 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3c401b000 tx=0x7fc3c40046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 152922, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:23.929 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3b403ec50 msgr2=0x7fc3b4041110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/1329379228 >> v2:172.21.15.135:6800/726754104 conn(0x7fc3b403ec50 0x7fc3b4041110 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc007c90 tx=0x7fc3bc007be0 comp rx=0 tx=0).stop 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 10 monclient: shutdown 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 msgr2=0x7fc3d413a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 --2- 172.21.15.71:0/1329379228 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc3d40a7270 0x7fc3d413a240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc02a9d0 tx=0x7fc3cc004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 reap_dead start 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d37fe640 1 -- 172.21.15.71:0/1329379228 reap_dead start 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3cb7fe640 1 -- 172.21.15.71:0/1329379228 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 0 0 0) 0x7fc3cc072970 con 0x7fc3d40a7270 2024-08-19T11:18:23.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 shutdown_connections 2024-08-19T11:18:23.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 >> 172.21.15.71:0/1329379228 conn(0x7fc3d40abf50 msgr2=0x7fc3d41c1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:23.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 shutdown_connections 2024-08-19T11:18:23.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:23.891+0000 7fc3d94ec640 1 -- 172.21.15.71:0/1329379228 wait complete. 2024-08-19T11:18:23.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:23.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:18:23.932 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:18:24.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.030+0000 7f3ae8456640 10 monclient: get_monmap_and_config 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.030+0000 7f3ae8456640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.030+0000 7f3ae8456640 10 monclient: monmap: 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:24.030936+0000 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:24.030936+0000 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.032 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.030+0000 7f3ae8456640 1 Processor -- start 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.030+0000 7f3ae8456640 1 -- start start 2024-08-19T11:18:24.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.030+0000 7f3ae8456640 10 monclient: init 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient: _add_conns ranks=[3,2,7,6,5,1,0,8,10,4,9] 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): picked mon.noname-g con 0x7f3ae00a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): picked mon.noname-b con 0x7f3ae00a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae0139710 0x7f3ae0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): picked mon.noname-i con 0x7f3ae0139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae00a5020 con 0x7f3ae00a57c0 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae00a77b0 con 0x7f3ae00a6950 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3ae00a7d40 con 0x7f3ae0139710 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae8456640 10 monclient(hunting): authenticate will time out at 1162.072610s 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52878/0 (socket says 172.21.15.71:52878) 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 -- 172.21.15.71:0/542361048 learned_addr learned my addr 172.21.15.71:0/542361048 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request con 0x7f3ae00a57c0 auth_method 0 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae61f2640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae69f3640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae0139710 0x7f3ae0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_done global_id 74756 payload 274 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 -- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae0139710 msgr2=0x7f3ae0139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae0139710 0x7f3ae0139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 -- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 monclient: found mon.noname-b 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.031+0000 7f3ae59f1640 1 -- 172.21.15.71:0/542361048 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae00a6380 con 0x7f3ae00a57c0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.032+0000 7f3ae61f2640 10 monclient: get_auth_request con 0x7f3ae00a6950 auth_method 0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.032+0000 7f3ae69f3640 10 monclient: get_auth_request con 0x7f3ae0139710 auth_method 0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.032+0000 7f3ae61f2640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.032+0000 7f3ae69f3640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae0139710 0x7f3ae0139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae59f1640 1 -- 172.21.15.71:0/542361048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 msgr2=0x7f3ae00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00098d0 tx=0x7f3ad002a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424e1adf22552c12 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 1 -- 172.21.15.71:0/542361048 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0037070 con 0x7f3ae00a57c0 2024-08-19T11:18:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: dump: 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.041 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 1 -- 172.21.15.71:0/542361048 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad00307b0 con 0x7f3ae00a57c0 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae8456640 5 monclient: authenticate success, global_id 74756 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae8456640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 1 -- 172.21.15.71:0/542361048 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0030e10 con 0x7f3ae00a57c0 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae8456640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae8456640 4 set_mon_vals no callback set 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.034+0000 7f3ae51f0640 10 monclient: dump: 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.043 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 10 monclient: shutdown 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 -- 172.21.15.71:0/542361048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 msgr2=0x7f3ae00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00098d0 tx=0x7f3ad002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 -- 172.21.15.71:0/542361048 shutdown_connections 2024-08-19T11:18:24.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae0139710 0x7f3ae0139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 --2- 172.21.15.71:0/542361048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 -- 172.21.15.71:0/542361048 >> 172.21.15.71:0/542361048 conn(0x7f3ae00abf50 msgr2=0x7f3ae00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 -- 172.21.15.71:0/542361048 shutdown_connections 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.035+0000 7f3ae8456640 1 -- 172.21.15.71:0/542361048 wait complete. 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.036+0000 7f3ae8456640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.036+0000 7f3ae8456640 10 monclient: monmap: 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.045 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.036+0000 7f3ae8456640 1 Processor -- start 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.036+0000 7f3ae8456640 1 -- start start 2024-08-19T11:18:24.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.036+0000 7f3ae8456640 10 monclient: init 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient: _add_conns ranks=[7,3,5,1,0,2,6,4,8] 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 0x7f3ae0138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): picked mon.noname-i con 0x7f3ae00a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): picked mon.noname-g con 0x7f3ae00a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:24.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae0139710 0x7f3ae01229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): picked mon.noname-h con 0x7f3ae0139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae00a84c0 con 0x7f3ae00a6950 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3ae00a3650 con 0x7f3ae0139710 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3ae00a8700 con 0x7f3ae00a57c0 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae8456640 10 monclient(hunting): authenticate will time out at 1162.078158s 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 0x7f3ae0138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:49436/0 (socket says 172.21.15.71:49436) 2024-08-19T11:18:24.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae0139710 0x7f3ae01229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 learned_addr learned my addr 172.21.15.71:0/1641080343 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request con 0x7f3ae00a6950 auth_method 0 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): get_auth_request con 0x7f3ae00a57c0 auth_method 0 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): get_auth_request con 0x7f3ae0139710 auth_method 0 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_done global_id 45327 payload 824 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 msgr2=0x7f3ae0138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 0x7f3ae0138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae0139710 msgr2=0x7f3ae01229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae0139710 0x7f3ae01229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 monclient: found mon.noname-g 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae01240d0 con 0x7f3ae00a6950 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.037+0000 7f3ae69f3640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae0139710 0x7f3ae01229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae0138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad00046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae0138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae0138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad00046c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:24.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad00046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient: ms_handle_reset current mon [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae0138fb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138fb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient: _add_conns ranks=[2,8,1,6,0,4] 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 0x7f3ac4005a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f3ac4003600 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ac40065a0 0x7f3ac4008a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f3ac40065a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ac40095d0 0x7f3ac400ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): picked mon.noname-f con 0x7f3ac40095d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac400c680 con 0x7f3ac40095d0 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac400c800 con 0x7f3ac4003600 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3ac400ca00 con 0x7f3ac40065a0 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ad6ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 0x7f3ac4005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): get_auth_request con 0x7f3ac4003600 auth_method 0 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ac40065a0 0x7f3ac4008a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request con 0x7f3ac40065a0 auth_method 0 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae69f3640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ac40095d0 0x7f3ac400ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae69f3640 10 monclient(hunting): get_auth_request con 0x7f3ac40095d0 auth_method 0 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae69f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae69f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae69f3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:18:24.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient(hunting): handle_auth_done global_id 45327 payload 293 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ac40065a0 msgr2=0x7f3ac4008a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ac40065a0 0x7f3ac4008a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ac40095d0 msgr2=0x7f3ac400ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ac40095d0 0x7f3ac400ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 monclient: found mon.noname-b 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae61f2640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac400ccc0 con 0x7f3ac4003600 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.040+0000 7f3ae69f3640 1 -- 172.21.15.71:0/1641080343 reap_dead start 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.042+0000 7f3ae61f2640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 msgr2=0x7f3ac4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.042+0000 7f3ae61f2640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 0x7f3ac4005a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00abf0 tx=0x7f3ad002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.042+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc017070 con 0x7f3ac4003600 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.042+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.042+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.042+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.064 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3adc0044a0 con 0x7f3ac4003600 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc00a7c0 con 0x7f3ac4003600 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae49ef640 4 set_mon_vals no callback set 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.066 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 5 monclient: authenticate success, global_id 45327 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 10 monclient: _renew_subs 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae0126150 con 0x7f3ac4003600 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 10 monclient: _renew_subs 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae013a270 con 0x7f3ac4003600 2024-08-19T11:18:24.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 0x7f3ae01229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.043+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3ae0076c60 con 0x7f3ae01ce4a0 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 0x7f3ae01229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient: get_auth_request con 0x7f3ae01ce4a0 auth_method 0 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3adc01a070 con 0x7f3ac4003600 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_done global_id 84451 payload 824 2024-08-19T11:18:24.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac40434e0 0x7f3ac40459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ae00a1ff0 con 0x7f3ae01ce4a0 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (secure 0 0 0) 0x7f3adc050970 con 0x7f3ac4003600 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae69f3640 1 --2- 172.21.15.71:0/1641080343 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac40434e0 0x7f3ac40459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.044+0000 7f3ae69f3640 10 monclient: get_auth_request con 0x7f3ac40434e0 auth_method 0 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 msgr2=0x7f3ae01229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 0x7f3ae01229e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ad002a0e0 tx=0x7f3ad0009240 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0054070 con 0x7f3ae01ce4a0 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.069 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.070 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3ad00093d0 con 0x7f3ae01ce4a0 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 msgr2=0x7f3ae01229e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 0x7f3ae01229e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ad002a0e0 tx=0x7f3ad0009240 comp rx=0 tx=0).stop 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 msgr2=0x7f3ae01229e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.046+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 0x7f3ae01229e0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ad002a0e0 tx=0x7f3ad0009240 comp rx=0 tx=0).stop 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.047+0000 7f3ae69f3640 1 --2- 172.21.15.71:0/1641080343 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac40434e0 0x7f3ac40459a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0123fb0 tx=0x7f3ad8007700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.052+0000 7f3ae8456640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.052+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 0x7f3ae0122f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.052+0000 7f3ae8456640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.052+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3ae00a6d30 con 0x7f3ae0125b90 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 0x7f3ae0122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient: get_auth_request con 0x7f3ae0125b90 auth_method 0 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 10 monclient(hunting): handle_auth_done global_id 84460 payload 824 2024-08-19T11:18:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.053+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ae01251f0 con 0x7f3ae0125b90 2024-08-19T11:18:24.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ae59f1640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 msgr2=0x7f3ae0122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ae59f1640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 0x7f3ae0122f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad0048040 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0054040 con 0x7f3ae0125b90 2024-08-19T11:18:24.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 10 monclient: dump: 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f3ad004f8a0 con 0x7f3ae0125b90 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 msgr2=0x7f3ae0122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 0x7f3ae0122f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad0048040 comp rx=0 tx=0).stop 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 msgr2=0x7f3ae0122f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.055+0000 7f3ad6ffd640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 0x7f3ae0122f20 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad0048040 comp rx=0 tx=0).stop 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 86202, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:24.076 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.078 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:24.079 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:24.080 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:24.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:24.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:24.087 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:24.089 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.090 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.093 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.095 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.097 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.098 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:24.099 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:24.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac40434e0 msgr2=0x7f3ac40459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac40434e0 0x7f3ac40459a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0123fb0 tx=0x7f3ad8007700 comp rx=0 tx=0).stop 2024-08-19T11:18:24.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 10 monclient: shutdown 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 msgr2=0x7f3ac4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 0x7f3ac4005a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00abf0 tx=0x7f3ad002e000 comp rx=0 tx=0).stop 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 shutdown_connections 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac40434e0 0x7f3ac40459a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ac4003600 0x7f3ac4005a50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae0125b90 0x7f3ae0122f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 --2- 172.21.15.71:0/1641080343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3ae01ce4a0 0x7f3ae01229e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 >> 172.21.15.71:0/1641080343 conn(0x7f3ae00abf50 msgr2=0x7f3ae00aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 shutdown_connections 2024-08-19T11:18:24.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.056+0000 7f3ae8456640 1 -- 172.21.15.71:0/1641080343 wait complete. 2024-08-19T11:18:24.102 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:24.102 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:18:24.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:18:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.199+0000 7fcbf0f16640 10 monclient: get_monmap_and_config 2024-08-19T11:18:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.199+0000 7fcbf0f16640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.199+0000 7fcbf0f16640 10 monclient: monmap: 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:24.200140+0000 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:24.200140+0000 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.201 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:24.202 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:24.202 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 Processor -- start 2024-08-19T11:18:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 -- start start 2024-08-19T11:18:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient: init 2024-08-19T11:18:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient: _add_conns ranks=[5,9,1,3,2,6,7,4,10,0,8] 2024-08-19T11:18:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcbec0a6950 0x7fcbec0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): picked mon.noname-h con 0x7fcbec0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcbec0a57c0 0x7fcbec0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): picked mon.noname-a con 0x7fcbec0a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcbec139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec0a6380 con 0x7fcbec139710 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fcbec0a5020 con 0x7fcbec0a57c0 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcbec0a77b0 con 0x7fcbec0a6950 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbf0f16640 10 monclient(hunting): authenticate will time out at 1162.241819s 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcbec0a57c0 0x7fcbec0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcbec0a57c0 0x7fcbec0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56598/0 (socket says 172.21.15.71:56598) 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 1 -- 172.21.15.71:0/1241966560 learned_addr learned my addr 172.21.15.71:0/1241966560 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 10 monclient(hunting): get_auth_request con 0x7fcbec0a57c0 auth_method 0 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.200+0000 7fcbe3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbea59c640 1 --2- 172.21.15.71:0/1241966560 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcbec0a6950 0x7fcbec0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_done global_id 74817 payload 274 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 1 -- 172.21.15.71:0/1241966560 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcbec0a6950 msgr2=0x7fcbec0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 1 --2- 172.21.15.71:0/1241966560 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcbec0a6950 0x7fcbec0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 1 -- 172.21.15.71:0/1241966560 >> v1:172.21.15.135:6789/0 conn(0x7fcbec139710 legacy=0x7fcbec139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 1 monclient: found mon.noname-a 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.201+0000 7fcbe3fff640 1 -- 172.21.15.71:0/1241966560 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec0a3650 con 0x7fcbec0a57c0 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.203+0000 7fcbe3fff640 1 -- 172.21.15.71:0/1241966560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbec0a57c0 msgr2=0x7fcbec0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.203+0000 7fcbe3fff640 1 --2- 172.21.15.71:0/1241966560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbec0a57c0 0x7fcbec0a7270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea23023a18461511 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 1 -- 172.21.15.71:0/1241966560 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbd4037070 con 0x7fcbec0a57c0 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: dump: 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.210 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 5 monclient: authenticate success, global_id 74817 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 1 -- 172.21.15.71:0/1241966560 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd40307b0 con 0x7fcbec0a57c0 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 4 set_mon_vals no callback set 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 1 -- 172.21.15.71:0/1241966560 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbd4030e10 con 0x7fcbec0a57c0 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:24.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbe9d9b640 10 monclient: dump: 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.212 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 10 monclient: shutdown 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 -- 172.21.15.71:0/1241966560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbec0a57c0 msgr2=0x7fcbec0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/1241966560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbec0a57c0 0x7fcbec0a7270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 -- 172.21.15.71:0/1241966560 shutdown_connections 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/1241966560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbec0a57c0 0x7fcbec0a7270 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/1241966560 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcbec0a6950 0x7fcbec0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 -- 172.21.15.71:0/1241966560 >> 172.21.15.71:0/1241966560 conn(0x7fcbec0abf50 msgr2=0x7fcbec0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 -- 172.21.15.71:0/1241966560 shutdown_connections 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.204+0000 7fcbf0f16640 1 -- 172.21.15.71:0/1241966560 wait complete. 2024-08-19T11:18:24.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.205+0000 7fcbf0f16640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.205+0000 7fcbf0f16640 10 monclient: monmap: 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.214 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.215 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.215 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.215 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.205+0000 7fcbf0f16640 1 Processor -- start 2024-08-19T11:18:24.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.205+0000 7fcbf0f16640 1 -- start start 2024-08-19T11:18:24.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.205+0000 7fcbf0f16640 10 monclient: init 2024-08-19T11:18:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient: _add_conns ranks=[7,1,6,3,8,4,2,5,0] 2024-08-19T11:18:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcbec0a57c0 0x7fcbec1ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): picked mon.noname-i con 0x7fcbec0a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0a6950 0x7fcbec1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): picked mon.noname-f con 0x7fcbec0a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 0x7fcbec1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): picked mon.noname-d con 0x7fcbec139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0a84c0 con 0x7fcbec0a6950 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcbec0a7d40 con 0x7fcbec139710 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcbec0a8700 con 0x7fcbec0a57c0 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbf0f16640 10 monclient(hunting): authenticate will time out at 1162.247343s 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 0x7fcbec1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 0x7fcbec1225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47404/0 (socket says 172.21.15.71:47404) 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 learned_addr learned my addr 172.21.15.71:0/2556848009 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): get_auth_request con 0x7fcbec139710 auth_method 0 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0a6950 0x7fcbec1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcbec0a57c0 0x7fcbec1ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): get_auth_request con 0x7fcbec0a6950 auth_method 0 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): get_auth_request con 0x7fcbec0a57c0 auth_method 0 2024-08-19T11:18:24.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbe3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient(hunting): handle_auth_done global_id 26349 payload 824 2024-08-19T11:18:24.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcbec0a57c0 msgr2=0x7fcbec1ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcbec0a57c0 0x7fcbec1ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0a6950 msgr2=0x7fcbec1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbec0a6950 0x7fcbec1386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 monclient: found mon.noname-d 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.206+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec1390e0 con 0x7fcbec139710 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.208+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 msgr2=0x7fcbec1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.208+0000 7fcbead9d640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 0x7fcbec1225a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c780 tx=0x7fcbe400cc40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbe4004960 con 0x7fcbec139710 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: dump: 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe4004b20 con 0x7fcbec139710 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 5 monclient: authenticate success, global_id 26349 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbe4004d10 con 0x7fcbec139710 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 10 monclient: _renew_subs 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec1261a0 con 0x7fcbec139710 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe959a640 4 set_mon_vals no callback set 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbe2ffd640 10 monclient: dump: 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 10 monclient: _renew_subs 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec13a480 con 0x7fcbec139710 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 0x7fcbec122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.209+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcbec076c60 con 0x7fcbec138c20 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 0x7fcbec122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcbe400aa60 con 0x7fcbec139710 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient: get_auth_request con 0x7fcbec138c20 auth_method 0 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 10 monclient(hunting): handle_auth_done global_id 26358 payload 824 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbe2ffd640 1 --2- 172.21.15.71:0/2556848009 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbcc03ea80 0x7fcbcc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbea59c640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbec0a6d30 con 0x7fcbec138c20 2024-08-19T11:18:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (secure 0 0 0) 0x7fcbe4051c40 con 0x7fcbec139710 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbe3fff640 1 --2- 172.21.15.71:0/2556848009 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbcc03ea80 0x7fcbcc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.210+0000 7fcbe3fff640 10 monclient: get_auth_request con 0x7fcbcc03ea80 auth_method 0 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbea59c640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 msgr2=0x7fcbec122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbea59c640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 0x7fcbec122ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00f7e0 tx=0x7fcbdc00fca0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbdc00dc30 con 0x7fcbec138c20 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 10 monclient: dump: 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcbdc00dc30 con 0x7fcbec138c20 2024-08-19T11:18:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 msgr2=0x7fcbec122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 0x7fcbec122ae0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00f7e0 tx=0x7fcbdc00fca0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 msgr2=0x7fcbec122ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.212+0000 7fcbe2ffd640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec138c20 0x7fcbec122ae0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00f7e0 tx=0x7fcbdc00fca0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.213+0000 7fcbe3fff640 1 --2- 172.21.15.71:0/2556848009 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbcc03ea80 0x7fcbcc040f40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.218+0000 7fcbf0f16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.218+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 0x7fcbec09da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.218+0000 7fcbf0f16640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.218+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcbec123400 con 0x7fcbec123020 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 0x7fcbec09da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient: get_auth_request con 0x7fcbec123020 auth_method 0 2024-08-19T11:18:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 10 monclient(hunting): handle_auth_done global_id 26367 payload 824 2024-08-19T11:18:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.219+0000 7fcbea59c640 1 -- 172.21.15.71:0/2556848009 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcbec124b20 con 0x7fcbec123020 2024-08-19T11:18:24.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbea59c640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 msgr2=0x7fcbec09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbea59c640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 0x7fcbec09da00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00f7e0 tx=0x7fcbdc004730 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcbdc00de40 con 0x7fcbec123020 2024-08-19T11:18:24.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 10 monclient: dump: 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fcbdc00de40 con 0x7fcbec123020 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 msgr2=0x7fcbec09da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 0x7fcbec09da00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00f7e0 tx=0x7fcbdc004730 comp rx=0 tx=0).stop 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 msgr2=0x7fcbec09da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.221+0000 7fcbe2ffd640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec123020 0x7fcbec09da00 secure :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00f7e0 tx=0x7fcbdc004730 comp rx=0 tx=0).stop 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 411835, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.243 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.245 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:24.249 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.250 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.252 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.255 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.257 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.259 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:24.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:24.261 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:24.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbcc03ea80 msgr2=0x7fcbcc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/2556848009 >> v2:172.21.15.135:6800/726754104 conn(0x7fcbcc03ea80 0x7fcbcc040f40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd402e000 comp rx=0 tx=0).stop 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 10 monclient: shutdown 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 msgr2=0x7fcbec1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 --2- 172.21.15.71:0/2556848009 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcbec139710 0x7fcbec1225a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c780 tx=0x7fcbe400cc40 comp rx=0 tx=0).stop 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 reap_dead start 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbead9d640 1 -- 172.21.15.71:0/2556848009 reap_dead start 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 shutdown_connections 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 >> 172.21.15.71:0/2556848009 conn(0x7fcbec0abf50 msgr2=0x7fcbec1c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 shutdown_connections 2024-08-19T11:18:24.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.222+0000 7fcbf0f16640 1 -- 172.21.15.71:0/2556848009 wait complete. 2024-08-19T11:18:24.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:24.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:18:24.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:18:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.366+0000 7f04dcade640 10 monclient: get_monmap_and_config 2024-08-19T11:18:24.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.366+0000 7f04dcade640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.366+0000 7f04dcade640 10 monclient: monmap: 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:24.366748+0000 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:24.366748+0000 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.366+0000 7f04dcade640 1 Processor -- start 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.366+0000 7f04dcade640 1 -- start start 2024-08-19T11:18:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.366+0000 7f04dcade640 10 monclient: init 2024-08-19T11:18:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient: _add_conns ranks=[10,2,6,1,9,5,0,7,4,8,3] 2024-08-19T11:18:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f04d8069060 0x7f04d81365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): picked mon.noname-f con 0x7f04d8069060 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:24.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 0x7f04d8136f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): picked mon.noname-b con 0x7f04d8136ae0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:24.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 0x7f04d809fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): picked mon.noname-d con 0x7f04d809f950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:24.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f04d80a4cf0 con 0x7f04d8069060 2024-08-19T11:18:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04d80a4710 con 0x7f04d8136ae0 2024-08-19T11:18:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f04d8069440 con 0x7f04d809f950 2024-08-19T11:18:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04dcade640 10 monclient(hunting): authenticate will time out at 1162.408415s 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 0x7f04d8136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 0x7f04d809fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 0x7f04d8136f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52890/0 (socket says 172.21.15.71:52890) 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 0x7f04d809fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:47424/0 (socket says 172.21.15.71:47424) 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 -- 172.21.15.71:0/328321074 learned_addr learned my addr 172.21.15.71:0/328321074 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): get_auth_request con 0x7f04d8136ae0 auth_method 0 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): get_auth_request con 0x7f04d809f950 auth_method 0 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d659c640 1 --2- 172.21.15.71:0/328321074 >> v2:172.21.15.135:3300/0 conn(0x7f04d8069060 0x7f04d81365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d659c640 10 monclient(hunting): get_auth_request con 0x7f04d8069060 auth_method 0 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_done global_id 74765 payload 274 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 -- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 msgr2=0x7f04d809fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 0x7f04d809fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 -- 172.21.15.71:0/328321074 >> v2:172.21.15.135:3300/0 conn(0x7f04d8069060 msgr2=0x7f04d81365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/328321074 >> v2:172.21.15.135:3300/0 conn(0x7f04d8069060 0x7f04d81365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 monclient: found mon.noname-b 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d5d9b640 1 -- 172.21.15.71:0/328321074 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d80a0ae0 con 0x7f04d8136ae0 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d659c640 1 --2- 172.21.15.71:0/328321074 >> v2:172.21.15.135:3300/0 conn(0x7f04d8069060 0x7f04d81365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.367+0000 7f04d6d9d640 1 --2- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 0x7f04d809fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:24.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d5d9b640 1 -- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 msgr2=0x7f04d8136f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 0x7f04d8136f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009870 tx=0x7f04cc02a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ded556a5953420 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 1 -- 172.21.15.71:0/328321074 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04cc037070 con 0x7f04d8136ae0 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: dump: 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.385 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 1 -- 172.21.15.71:0/328321074 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc02ae00 con 0x7f04d8136ae0 2024-08-19T11:18:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04dcade640 5 monclient: authenticate success, global_id 74765 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04dcade640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04dcade640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 1 -- 172.21.15.71:0/328321074 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04cc030c20 con 0x7f04d8136ae0 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04dcade640 4 set_mon_vals no callback set 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.370+0000 7f04d559a640 10 monclient: dump: 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.387 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 10 monclient: shutdown 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 -- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 msgr2=0x7f04d8136f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 --2- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 0x7f04d8136f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009870 tx=0x7f04cc02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 -- 172.21.15.71:0/328321074 shutdown_connections 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 --2- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f04d809f950 0x7f04d809fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 --2- 172.21.15.71:0/328321074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8136ae0 0x7f04d8136f00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 --2- 172.21.15.71:0/328321074 >> v2:172.21.15.135:3300/0 conn(0x7f04d8069060 0x7f04d81365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 -- 172.21.15.71:0/328321074 >> 172.21.15.71:0/328321074 conn(0x7f04d80a8630 msgr2=0x7f04d80a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 -- 172.21.15.71:0/328321074 shutdown_connections 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.371+0000 7f04dcade640 1 -- 172.21.15.71:0/328321074 wait complete. 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient: monmap: 2024-08-19T11:18:24.389 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.390 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 Processor -- start 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 -- start start 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient: init 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient: _add_conns ranks=[2,1,0,3,5,8,6,7,4] 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 0x7f04d81cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): picked mon.noname-b con 0x7f04d8069060 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d809f950 0x7f04d81359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): picked mon.noname-f con 0x7f04d809f950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8136ae0 0x7f04d8135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): picked mon.noname-a con 0x7f04d8136ae0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80a1ca0 con 0x7f04d8136ae0 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80a19c0 con 0x7f04d809f950 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04d80a0340 con 0x7f04d8069060 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.372+0000 7f04dcade640 10 monclient(hunting): authenticate will time out at 1162.413992s 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 0x7f04d81cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 0x7f04d81cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52896/0 (socket says 172.21.15.71:52896) 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 -- 172.21.15.71:0/2844803462 learned_addr learned my addr 172.21.15.71:0/2844803462 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): get_auth_request con 0x7f04d8069060 auth_method 0 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8136ae0 0x7f04d8135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): get_auth_request con 0x7f04d8136ae0 auth_method 0 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d809f950 0x7f04d81359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient(hunting): handle_auth_done global_id 74774 payload 824 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d809f950 msgr2=0x7f04d81359c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d809f950 0x7f04d81359c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8136ae0 msgr2=0x7f04d8135f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8136ae0 0x7f04d8135f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 monclient: found mon.noname-b 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d659c640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d81368d0 con 0x7f04d8069060 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d5d9b640 10 monclient: get_auth_request con 0x7f04d809f950 auth_method 0 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d6d9d640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04d8136ae0 0x7f04d8135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.373+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04d809f950 0x7f04d81359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04d659c640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 msgr2=0x7f04d81cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04d659c640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 0x7f04d81cc350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009fa0 tx=0x7f04c800d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04c801a070 con 0x7f04d8069060 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: dump: 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.396 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c800de50 con 0x7f04d8069060 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 5 monclient: authenticate success, global_id 74774 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 10 monclient: _renew_subs 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d8130bc0 con 0x7f04d8069060 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04c8003e00 con 0x7f04d8069060 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04c6ffd640 10 monclient: dump: 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.398 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04d4d99640 4 set_mon_vals no callback set 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 10 monclient: _renew_subs 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.375+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81cc890 con 0x7f04d8069060 2024-08-19T11:18:24.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04dcade640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04dcade640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 0x7f04d812db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f04d806a590 con 0x7f04d812d740 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d659c640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 0x7f04d81cc350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009fa0 tx=0x7f04c800d4a0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f04c8003990 mgrmap(e 5) 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f04c8003990 con 0x7f04d8069060 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 0x7f04d812db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient: get_auth_request con 0x7f04d812d740 auth_method 0 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.376+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.377+0000 7f04c6ffd640 1 --2- 172.21.15.71:0/2844803462 >> v2:172.21.15.135:6800/726754104 conn(0x7f04b803ea80 0x7f04b8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.377+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_done global_id 94112 payload 824 2024-08-19T11:18:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.377+0000 7f04d5d9b640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04d8131310 con 0x7f04d812d740 2024-08-19T11:18:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.377+0000 7f04d6d9d640 1 --2- 172.21.15.71:0/2844803462 >> v2:172.21.15.135:6800/726754104 conn(0x7f04b803ea80 0x7f04b8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.377+0000 7f04d6d9d640 10 monclient: get_auth_request con 0x7f04b803ea80 auth_method 0 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04d5d9b640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 msgr2=0x7f04d812db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 0x7f04d812db20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80698c0 tx=0x7f04cc0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04cc041020 con 0x7f04d812d740 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 10 monclient: dump: 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.404 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f04cc003ad0 con 0x7f04d812d740 2024-08-19T11:18:24.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 msgr2=0x7f04d812db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 0x7f04d812db20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80698c0 tx=0x7f04cc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 msgr2=0x7f04d812db20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.379+0000 7f04c6ffd640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812d740 0x7f04d812db20 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04d80698c0 tx=0x7f04cc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.380+0000 7f04d6d9d640 1 --2- 172.21.15.71:0/2844803462 >> v2:172.21.15.135:6800/726754104 conn(0x7f04b803ea80 0x7f04b8040f40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009560 tx=0x7f04d0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04dcade640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04dcade640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 0x7f04d81bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04dcade640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f04d8076c60 con 0x7f04d812e060 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 0x7f04d81bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04d5d9b640 10 monclient: get_auth_request con 0x7f04d812e060 auth_method 0 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04d5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04d5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.385+0000 7f04d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.386+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.386+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.386+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.386+0000 7f04d5d9b640 10 monclient(hunting): handle_auth_done global_id 94121 payload 824 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.386+0000 7f04d5d9b640 1 -- 172.21.15.71:0/2844803462 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f04d80a8a10 con 0x7f04d812e060 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.388+0000 7f04d5d9b640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 msgr2=0x7f04d81bd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.388+0000 7f04d5d9b640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 0x7f04d81bd7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0097c0 tx=0x7f04cc008030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.388+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f04cc041040 con 0x7f04d812e060 2024-08-19T11:18:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.388+0000 7f04c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.388+0000 7f04c6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.388+0000 7f04c6ffd640 10 monclient: dump: 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.408 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f04cc048280 con 0x7f04d812e060 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 msgr2=0x7f04d81bd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 0x7f04d81bd7f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0097c0 tx=0x7f04cc008030 comp rx=0 tx=0).stop 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 msgr2=0x7f04d81bd7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f04d812e060 0x7f04d81bd7f0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0097c0 tx=0x7f04cc008030 comp rx=0 tx=0).stop 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 16085, 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:24.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.411 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:24.412 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.413 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:24.414 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.415 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.419 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.421 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:24.422 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.423 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.425 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:24.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:24.429 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:24.434 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:24.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 >> v2:172.21.15.135:6800/726754104 conn(0x7f04b803ea80 msgr2=0x7f04b8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 --2- 172.21.15.71:0/2844803462 >> v2:172.21.15.135:6800/726754104 conn(0x7f04b803ea80 0x7f04b8040f40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009560 tx=0x7f04d0009190 comp rx=0 tx=0).stop 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 10 monclient: shutdown 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 msgr2=0x7f04d81cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 --2- 172.21.15.71:0/2844803462 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04d8069060 0x7f04d81cc350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009fa0 tx=0x7f04c800d4a0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04d6d9d640 1 -- 172.21.15.71:0/2844803462 reap_dead start 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04c6ffd640 1 -- 172.21.15.71:0/2844803462 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (unknown 0 0 0) 0x7f04c8051e20 con 0x7f04d8069060 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04d6d9d640 1 -- 172.21.15.71:0/2844803462 reap_dead start 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 shutdown_connections 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 >> 172.21.15.71:0/2844803462 conn(0x7f04d80a8630 msgr2=0x7f04d81bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 shutdown_connections 2024-08-19T11:18:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.389+0000 7f04dcade640 1 -- 172.21.15.71:0/2844803462 wait complete. 2024-08-19T11:18:24.437 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:24.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:18:24.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:18:24.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.535+0000 7f333a7f7640 10 monclient: get_monmap_and_config 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.535+0000 7f333a7f7640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.535+0000 7f333a7f7640 10 monclient: monmap: 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:24.536390+0000 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:24.536390+0000 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:24.537 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:24.538 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 1 Processor -- start 2024-08-19T11:18:24.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 1 -- start start 2024-08-19T11:18:24.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 10 monclient: init 2024-08-19T11:18:24.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 10 monclient: _add_conns ranks=[3,5,0,1,4,10,7,8,2,6,9] 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 0x7f33340a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 10 monclient(hunting): picked mon.noname-g con 0x7f33340a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f33340a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 10 monclient(hunting): picked mon.noname-h con 0x7f33340a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.536+0000 7f333a7f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3334139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33340a6380 con 0x7f3334139710 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33340a5020 con 0x7f33340a6950 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f33340a77b0 con 0x7f33340a57c0 2024-08-19T11:18:24.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f333a7f7640 10 monclient(hunting): authenticate will time out at 1162.578023s 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3338d94640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3334139710 0x7f3334139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49026/0 (socket says 172.21.15.71:49026) 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3338d94640 1 -- 172.21.15.71:0/584926364 learned_addr learned my addr 172.21.15.71:0/584926364 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f33340a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 0x7f33340a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): get_auth_request con 0x7f33340a57c0 auth_method 0 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): get_auth_request con 0x7f33340a6950 auth_method 0 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f33337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient(hunting): handle_auth_done global_id 45336 payload 274 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 1 -- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 msgr2=0x7f33340a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f33340a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 1 -- 172.21.15.71:0/584926364 >> v1:172.21.15.71:6789/0 conn(0x7f3334139710 legacy=0x7f3334139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 1 monclient: found mon.noname-g 2024-08-19T11:18:24.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:18:24.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.537+0000 7f3333fff640 1 -- 172.21.15.71:0/584926364 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33340a3650 con 0x7f33340a6950 2024-08-19T11:18:24.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.540+0000 7f3333fff640 1 -- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 msgr2=0x7f33340a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.540+0000 7f3333fff640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 0x7f33340a6d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33240097d0 tx=0x7f3324029fb0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=c68d20249c415434 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 1 -- 172.21.15.71:0/584926364 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3324037070 con 0x7f33340a6950 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: dump: 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.555 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 5 monclient: authenticate success, global_id 45336 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 1 -- 172.21.15.71:0/584926364 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332402ad10 con 0x7f33340a6950 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 1 -- 172.21.15.71:0/584926364 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3324030c20 con 0x7f33340a6950 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 4 set_mon_vals no callback set 2024-08-19T11:18:24.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f3332ffd640 10 monclient: dump: 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.558 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 10 monclient: shutdown 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 -- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 msgr2=0x7f33340a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 0x7f33340a6d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33240097d0 tx=0x7f3324029fb0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 -- 172.21.15.71:0/584926364 shutdown_connections 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f33340a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 --2- 172.21.15.71:0/584926364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33340a6950 0x7f33340a6d30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 -- 172.21.15.71:0/584926364 >> 172.21.15.71:0/584926364 conn(0x7f33340abf50 msgr2=0x7f33340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.541+0000 7f333a7f7640 1 -- 172.21.15.71:0/584926364 shutdown_connections 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.542+0000 7f333a7f7640 1 -- 172.21.15.71:0/584926364 wait complete. 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.542+0000 7f333a7f7640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.542+0000 7f333a7f7640 10 monclient: monmap: 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:24.560 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.561 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.542+0000 7f333a7f7640 1 Processor -- start 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 -- start start 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient: init 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient: _add_conns ranks=[5,0,2,3,1,8,4,6,7] 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f3334122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): picked mon.noname-h con 0x7f33340a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 0x7f3334138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): picked mon.noname-a con 0x7f33340a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:24.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3334139710 0x7f3334138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): picked mon.noname-b con 0x7f3334139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33340a84c0 con 0x7f33340a6950 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f33340a7d40 con 0x7f3334139710 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f33340a8700 con 0x7f33340a57c0 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f333a7f7640 10 monclient(hunting): authenticate will time out at 1162.584544s 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 0x7f3334138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 0x7f3334138830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:56616/0 (socket says 172.21.15.71:56616) 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 -- 172.21.15.71:0/2669149893 learned_addr learned my addr 172.21.15.71:0/2669149893 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3334139710 0x7f3334138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): get_auth_request con 0x7f33340a6950 auth_method 0 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): get_auth_request con 0x7f3334139710 auth_method 0 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3333fff640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f3334122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3333fff640 10 monclient(hunting): get_auth_request con 0x7f33340a57c0 auth_method 0 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3333fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient(hunting): handle_auth_done global_id 74835 payload 824 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 msgr2=0x7f3334122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f33340a57c0 0x7f3334122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3334139710 msgr2=0x7f3334138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3334139710 0x7f3334138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 monclient: found mon.noname-a 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f33337fe640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333413a300 con 0x7f33340a6950 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.543+0000 7f3338d94640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3334139710 0x7f3334138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:24.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f33337fe640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 msgr2=0x7f3334138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f33337fe640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 0x7f3334138830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f332800e9e0 tx=0x7f332800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3328017070 con 0x7f33340a6950 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: dump: 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.567 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 5 monclient: authenticate success, global_id 74835 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332800cbe0 con 0x7f33340a6950 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 10 monclient: _renew_subs 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33340a2370 con 0x7f33340a6950 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f332800cd90 con 0x7f33340a6950 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f3330ff9640 10 monclient: dump: 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.570 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f33327fc640 4 set_mon_vals no callback set 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 10 monclient: _renew_subs 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.546+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3334124c90 con 0x7f33340a6950 2024-08-19T11:18:24.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f333a7f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f333a7f7640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 0x7f333402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f333406a590 con 0x7f33341ce9b0 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f332801a070 con 0x7f33340a6950 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 0x7f333402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient: get_auth_request con 0x7f33341ce9b0 auth_method 0 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3330ff9640 1 --2- 172.21.15.71:0/2669149893 >> v2:172.21.15.135:6800/726754104 conn(0x7f332003ea80 0x7f3320040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (secure 0 0 0) 0x7f332800f040 con 0x7f33340a6950 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3338d94640 1 --2- 172.21.15.71:0/2669149893 >> v2:172.21.15.135:6800/726754104 conn(0x7f332003ea80 0x7f3320040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3338d94640 10 monclient: get_auth_request con 0x7f332003ea80 auth_method 0 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.547+0000 7f3333fff640 10 monclient(hunting): handle_auth_done global_id 84475 payload 824 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.548+0000 7f3333fff640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33340a1e20 con 0x7f33341ce9b0 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3338d94640 1 --2- 172.21.15.71:0/2669149893 >> v2:172.21.15.135:6800/726754104 conn(0x7f332003ea80 0x7f3320040f40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f332c009400 tx=0x7f332c009350 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3333fff640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 msgr2=0x7f333402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3333fff640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 0x7f333402d1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3324034000 tx=0x7f33240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3324037040 con 0x7f33341ce9b0 2024-08-19T11:18:24.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 10 monclient: dump: 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.574 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3324003a30 con 0x7f33341ce9b0 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:24.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 msgr2=0x7f333402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 0x7f333402d1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3324034000 tx=0x7f33240046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 msgr2=0x7f333402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.550+0000 7f3330ff9640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ce9b0 0x7f333402d1c0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3324034000 tx=0x7f33240046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.556+0000 7f333a7f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.556+0000 7f333a7f7640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 0x7f333402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.556+0000 7f333a7f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.556+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3334076c60 con 0x7f33341ced90 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 0x7f333402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient: get_auth_request con 0x7f33341ced90 auth_method 0 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 10 monclient(hunting): handle_auth_done global_id 84484 payload 824 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.557+0000 7f3333fff640 1 -- 172.21.15.71:0/2669149893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f33340a6d30 con 0x7f33341ced90 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.559+0000 7f3333fff640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 msgr2=0x7f333402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.559+0000 7f3333fff640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 0x7f333402d700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33240096f0 tx=0x7f3324008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.559+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f332403e8d0 con 0x7f33341ced90 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:24.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 10 monclient: dump: 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.580 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f332403e460 con 0x7f33341ced90 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 msgr2=0x7f333402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 0x7f333402d700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33240096f0 tx=0x7f3324008030 comp rx=0 tx=0).stop 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 msgr2=0x7f333402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3330ff9640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341ced90 0x7f333402d700 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f33240096f0 tx=0x7f3324008030 comp rx=0 tx=0).stop 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 86720, 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:24.582 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:24.583 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.584 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.585 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:24.586 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:24.587 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.588 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.590 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.591 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.592 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.593 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.594 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:24.598 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.599 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.600 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.602 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.606 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.608 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.609 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.610 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:24.611 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:24.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 >> v2:172.21.15.135:6800/726754104 conn(0x7f332003ea80 msgr2=0x7f3320040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 --2- 172.21.15.71:0/2669149893 >> v2:172.21.15.135:6800/726754104 conn(0x7f332003ea80 0x7f3320040f40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f332c009400 tx=0x7f332c009350 comp rx=0 tx=0).stop 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 10 monclient: shutdown 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 msgr2=0x7f3334138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 --2- 172.21.15.71:0/2669149893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33340a6950 0x7f3334138830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f332800e9e0 tx=0x7f332800eea0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3338d94640 1 -- 172.21.15.71:0/2669149893 reap_dead start 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f3338d94640 1 -- 172.21.15.71:0/2669149893 reap_dead start 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 shutdown_connections 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 >> 172.21.15.71:0/2669149893 conn(0x7f33340abf50 msgr2=0x7f33340aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.560+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 shutdown_connections 2024-08-19T11:18:24.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.561+0000 7f333a7f7640 1 -- 172.21.15.71:0/2669149893 wait complete. 2024-08-19T11:18:24.614 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:24.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:18:24.614 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.712+0000 7f44c967e640 10 monclient: get_monmap_and_config 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.712+0000 7f44c967e640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.712+0000 7f44c967e640 10 monclient: monmap: 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:24.712709+0000 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:24.712709+0000 2024-08-19T11:18:24.713 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:24.714 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:24.715 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.712+0000 7f44c967e640 1 Processor -- start 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.712+0000 7f44c967e640 1 -- start start 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.712+0000 7f44c967e640 10 monclient: init 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient: _add_conns ranks=[8,0,4,6,2,1,10,9,7,5,3] 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f44c40a47c0 0x7f44c40a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): picked mon.noname-e con 0x7f44c40a47c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f44c409d120 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 0x7f44c40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): picked mon.noname-c con 0x7f44c40a2aa0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c40a63b0 con 0x7f44c409d120 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f44c40a5620 con 0x7f44c40a2aa0 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f44c406ccf0 con 0x7f44c40a47c0 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c967e640 10 monclient(hunting): authenticate will time out at 1162.754243s 2024-08-19T11:18:24.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f44c40a47c0 0x7f44c40a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 0x7f44c40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c27fc640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f44c409d120 0x7f44c4137580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49034/0 (socket says 172.21.15.71:49034) 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c27fc640 1 -- 172.21.15.71:0/2177323957 learned_addr learned my addr 172.21.15.71:0/2177323957 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): get_auth_request con 0x7f44c40a2aa0 auth_method 0 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): get_auth_request con 0x7f44c40a47c0 auth_method 0 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient(hunting): handle_auth_done global_id 84469 payload 274 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 1 -- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f44c40a47c0 msgr2=0x7f44c40a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 1 --2- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f44c40a47c0 0x7f44c40a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 1 -- 172.21.15.71:0/2177323957 >> v1:172.21.15.71:6789/0 conn(0x7f44c409d120 legacy=0x7f44c4137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 1 monclient: found mon.noname-c 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.713+0000 7f44c37fe640 1 -- 172.21.15.71:0/2177323957 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c406d700 con 0x7f44c40a2aa0 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c37fe640 1 -- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 msgr2=0x7f44c40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c37fe640 1 --2- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 0x7f44c40a50e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0097d0 tx=0x7f44bc029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=21c7b63975fa7d6c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 1 -- 172.21.15.71:0/2177323957 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44bc037070 con 0x7f44c40a2aa0 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: dump: 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.729 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.730 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 1 -- 172.21.15.71:0/2177323957 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc02ad10 con 0x7f44c40a2aa0 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c967e640 5 monclient: authenticate success, global_id 84469 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c967e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c967e640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 1 -- 172.21.15.71:0/2177323957 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44bc030c20 con 0x7f44c40a2aa0 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c967e640 4 set_mon_vals no callback set 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.716+0000 7f44c1ffb640 10 monclient: dump: 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.732 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 10 monclient: shutdown 2024-08-19T11:18:24.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 -- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 msgr2=0x7f44c40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 --2- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 0x7f44c40a50e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0097d0 tx=0x7f44bc029fb0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 -- 172.21.15.71:0/2177323957 shutdown_connections 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 --2- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f44c40a2aa0 0x7f44c40a50e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 --2- 172.21.15.71:0/2177323957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f44c40a47c0 0x7f44c40a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 -- 172.21.15.71:0/2177323957 >> 172.21.15.71:0/2177323957 conn(0x7f44c40a9470 msgr2=0x7f44c40a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 -- 172.21.15.71:0/2177323957 shutdown_connections 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 1 -- 172.21.15.71:0/2177323957 wait complete. 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.717+0000 7f44c967e640 10 monclient: monmap: 2024-08-19T11:18:24.734 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.735 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 Processor -- start 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 -- start start 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient: init 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient: _add_conns ranks=[6,5,1,8,7,2,4,0,3] 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): picked mon.noname-d con 0x7f44c409d120 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:24.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f44c40a2aa0 0x7f44c41ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): picked mon.noname-h con 0x7f44c40a2aa0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c40a47c0 0x7f44c411ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): picked mon.noname-f con 0x7f44c40a47c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44c4137c90 con 0x7f44c40a47c0 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f44c406d480 con 0x7f44c40a2aa0 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f44c4137e10 con 0x7f44c409d120 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c967e640 10 monclient(hunting): authenticate will time out at 1162.759772s 2024-08-19T11:18:24.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:34320/0 (socket says 172.21.15.71:34320) 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 1 -- 172.21.15.71:0/1686061800 learned_addr learned my addr 172.21.15.71:0/1686061800 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): get_auth_request con 0x7f44c409d120 auth_method 0 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.718+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f44c40a2aa0 0x7f44c41ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c40a47c0 0x7f44c411ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): get_auth_request con 0x7f44c40a2aa0 auth_method 0 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): get_auth_request con 0x7f44c40a47c0 auth_method 0 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 10 monclient(hunting): handle_auth_done global_id 26385 payload 824 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f44c40a2aa0 msgr2=0x7f44c41ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f44c40a2aa0 0x7f44c41ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c40a47c0 msgr2=0x7f44c411ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44c40a47c0 0x7f44c411ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 1 monclient: found mon.noname-d 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.719+0000 7f44c2ffd640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c41232a0 con 0x7f44c409d120 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c2ffd640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 msgr2=0x7f44c41cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c2ffd640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f44b400eed0 tx=0x7f44b400b480 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44b4018020 con 0x7f44c409d120 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: dump: 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.741 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.742 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 5 monclient: authenticate success, global_id 26385 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b400bda0 con 0x7f44c409d120 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 10 monclient: _renew_subs 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c4123580 con 0x7f44c409d120 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44b4014ce0 con 0x7f44c409d120 2024-08-19T11:18:24.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44bb7fe640 10 monclient: dump: 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.744 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c17fa640 4 set_mon_vals no callback set 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 10 monclient: _renew_subs 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.721+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c4124520 con 0x7f44c409d120 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c967e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c967e640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 0x7f44c41208b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f44c406a590 con 0x7f44c41204d0 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c2ffd640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f44b400eed0 tx=0x7f44b400b480 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f44b4052030 osd_map(224..224 src has 1..224) 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f44b401b020 con 0x7f44c409d120 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 0x7f44c41208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient: get_auth_request con 0x7f44c41204d0 auth_method 0 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44bb7fe640 1 --2- 172.21.15.71:0/1686061800 >> v2:172.21.15.135:6800/726754104 conn(0x7f44a403ea80 0x7f44a4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.722+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.723+0000 7f44c27fc640 10 monclient(hunting): handle_auth_done global_id 45345 payload 824 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.723+0000 7f44c27fc640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44c4138140 con 0x7f44c41204d0 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.723+0000 7f44c37fe640 1 --2- 172.21.15.71:0/1686061800 >> v2:172.21.15.135:6800/726754104 conn(0x7f44a403ea80 0x7f44a4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.723+0000 7f44c37fe640 10 monclient: get_auth_request con 0x7f44a403ea80 auth_method 0 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44c27fc640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 msgr2=0x7f44c41208b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44c27fc640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 0x7f44c41208b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac00ef00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44ac01a070 con 0x7f44c41204d0 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 10 monclient: dump: 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.750 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.751 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44c37fe640 1 --2- 172.21.15.71:0/1686061800 >> v2:172.21.15.135:6800/726754104 conn(0x7f44a403ea80 0x7f44a4040f40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f44c40a6320 tx=0x7f44bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f44ac00cc50 con 0x7f44c41204d0 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 msgr2=0x7f44c41208b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 0x7f44c41208b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac00ef00 comp rx=0 tx=0).stop 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 msgr2=0x7f44c41208b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.725+0000 7f44bb7fe640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c41204d0 0x7f44c41208b0 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac00ef00 comp rx=0 tx=0).stop 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.731+0000 7f44c967e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:24.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.731+0000 7f44c967e640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 0x7f44c40a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.731+0000 7f44c967e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.731+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f44c4076c60 con 0x7f44c4120df0 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 0x7f44c40a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient: get_auth_request con 0x7f44c4120df0 auth_method 0 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 10 monclient(hunting): handle_auth_done global_id 45354 payload 824 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.732+0000 7f44c27fc640 1 -- 172.21.15.71:0/1686061800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44c406ecf0 con 0x7f44c4120df0 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44c27fc640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 msgr2=0x7f44c40a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44c27fc640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 0x7f44c40a7290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac004940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f44ac01a040 con 0x7f44c4120df0 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 10 monclient: dump: 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.754 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.755 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f44ac01c260 con 0x7f44c4120df0 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 msgr2=0x7f44c40a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 0x7f44c40a7290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac004940 comp rx=0 tx=0).stop 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 msgr2=0x7f44c40a7290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.735+0000 7f44bb7fe640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f44c4120df0 0x7f44c40a7290 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac004940 comp rx=0 tx=0).stop 2024-08-19T11:18:24.756 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 273758, 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.776 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:24.778 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.780 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.782 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.783 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:24.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.784 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.784 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:24.784 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:24.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 >> v2:172.21.15.135:6800/726754104 conn(0x7f44a403ea80 msgr2=0x7f44a4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 --2- 172.21.15.71:0/1686061800 >> v2:172.21.15.135:6800/726754104 conn(0x7f44a403ea80 0x7f44a4040f40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f44c40a6320 tx=0x7f44bc02e000 comp rx=0 tx=0).stop 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 10 monclient: shutdown 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 msgr2=0x7f44c41cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c37fe640 1 -- 172.21.15.71:0/1686061800 reap_dead start 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f44b400eed0 tx=0x7f44b400b480 comp rx=0 tx=0).stop 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44bb7fe640 1 -- 172.21.15.71:0/1686061800 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (unknown 0 0 0) 0x7f44b4052030 con 0x7f44c409d120 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 shutdown_connections 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 --2- 172.21.15.71:0/1686061800 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f44c409d120 0x7f44c41cca20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 >> 172.21.15.71:0/1686061800 conn(0x7f44c40a9470 msgr2=0x7f44c409ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 shutdown_connections 2024-08-19T11:18:24.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.736+0000 7f44c967e640 1 -- 172.21.15.71:0/1686061800 wait complete. 2024-08-19T11:18:24.787 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:24.787 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:18:24.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:18:24.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.885+0000 7f1a26a56640 10 monclient: get_monmap_and_config 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.885+0000 7f1a26a56640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.885+0000 7f1a26a56640 10 monclient: monmap: 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:24.886090+0000 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:24.886090+0000 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:24.887 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 Processor -- start 2024-08-19T11:18:24.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 -- start start 2024-08-19T11:18:24.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient: init 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient: _add_conns ranks=[10,6,5,9,7,8,0,1,2,3,4] 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a200a6950 0x7f1a200a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): picked mon.noname-f con 0x7f1a200a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 0x7f1a200a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): picked mon.noname-d con 0x7f1a200a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:24.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20139710 0x7f1a20139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): picked mon.noname-h con 0x7f1a20139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1a200a5020 con 0x7f1a200a6950 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1a200a77b0 con 0x7f1a20139710 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1a200a7d40 con 0x7f1a200a57c0 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a26a56640 10 monclient(hunting): authenticate will time out at 1162.927856s 2024-08-19T11:18:24.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a1f7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 0x7f1a200a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a1f7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 0x7f1a200a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:34326/0 (socket says 172.21.15.71:34326) 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/3855264655 learned_addr learned my addr 172.21.15.71:0/3855264655 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.886+0000 7f1a1f7fe640 10 monclient(hunting): get_auth_request con 0x7f1a200a57c0 auth_method 0 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 1 --2- 172.21.15.71:0/3855264655 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20139710 0x7f1a20139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 1 --2- 172.21.15.71:0/3855264655 >> v2:172.21.15.135:3300/0 conn(0x7f1a200a6950 0x7f1a200a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): get_auth_request con 0x7f1a20139710 auth_method 0 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): get_auth_request con 0x7f1a200a6950 auth_method 0 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a24ff3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_done global_id 26394 payload 274 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/3855264655 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20139710 msgr2=0x7f1a20139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/3855264655 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20139710 0x7f1a20139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/3855264655 >> v2:172.21.15.135:3300/0 conn(0x7f1a200a6950 msgr2=0x7f1a200a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/3855264655 >> v2:172.21.15.135:3300/0 conn(0x7f1a200a6950 0x7f1a200a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 1 monclient: found mon.noname-d 2024-08-19T11:18:24.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.887+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/3855264655 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a200a6380 con 0x7f1a200a57c0 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/3855264655 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 msgr2=0x7f1a200a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/3855264655 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 0x7f1a200a7270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098a0 tx=0x7f1a1402a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=4bc84e1c67e07e12 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 1 -- 172.21.15.71:0/3855264655 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a14037070 con 0x7f1a200a57c0 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: dump: 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.903 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.904 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 1 -- 172.21.15.71:0/3855264655 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1402adf0 con 0x7f1a200a57c0 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 5 monclient: authenticate success, global_id 26394 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 1 -- 172.21.15.71:0/3855264655 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a14030c20 con 0x7f1a200a57c0 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 4 set_mon_vals no callback set 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a1effd640 10 monclient: dump: 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.906 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.907 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 10 monclient: shutdown 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 -- 172.21.15.71:0/3855264655 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 msgr2=0x7f1a200a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 --2- 172.21.15.71:0/3855264655 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 0x7f1a200a7270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098a0 tx=0x7f1a1402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 -- 172.21.15.71:0/3855264655 shutdown_connections 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 --2- 172.21.15.71:0/3855264655 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20139710 0x7f1a20139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 --2- 172.21.15.71:0/3855264655 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1a200a57c0 0x7f1a200a7270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 --2- 172.21.15.71:0/3855264655 >> v2:172.21.15.135:3300/0 conn(0x7f1a200a6950 0x7f1a200a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 -- 172.21.15.71:0/3855264655 >> 172.21.15.71:0/3855264655 conn(0x7f1a200abf50 msgr2=0x7f1a200ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 -- 172.21.15.71:0/3855264655 shutdown_connections 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.890+0000 7f1a26a56640 1 -- 172.21.15.71:0/3855264655 wait complete. 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.891+0000 7f1a26a56640 10 monclient: build_initial_monmap 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.891+0000 7f1a26a56640 10 monclient: monmap: 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:24.909 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.891+0000 7f1a26a56640 1 Processor -- start 2024-08-19T11:18:24.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 -- start start 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient: init 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient: _add_conns ranks=[2,0,3,4,8,6,7,5,1] 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 0x7f1a201ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): picked mon.noname-b con 0x7f1a200a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200a6950 0x7f1a201389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): picked mon.noname-a con 0x7f1a200a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20139710 0x7f1a20138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): picked mon.noname-g con 0x7f1a20139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200a84c0 con 0x7f1a200a6950 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1a200a3650 con 0x7f1a200a57c0 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1a200a8700 con 0x7f1a20139710 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a26a56640 10 monclient(hunting): authenticate will time out at 1162.933465s 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200a6950 0x7f1a201389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 0x7f1a201ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 0x7f1a201ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38396/0 (socket says 172.21.15.71:38396) 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 -- 172.21.15.71:0/1882677555 learned_addr learned my addr 172.21.15.71:0/1882677555 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:24.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): get_auth_request con 0x7f1a200a57c0 auth_method 0 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200a6950 0x7f1a201389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47230/0 (socket says 172.21.15.71:47230) 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): get_auth_request con 0x7f1a200a6950 auth_method 0 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a24ff3640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20139710 0x7f1a20138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a24ff3640 10 monclient(hunting): get_auth_request con 0x7f1a20139710 auth_method 0 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a24ff3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a24ff3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a24ff3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient(hunting): handle_auth_done global_id 74792 payload 824 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20139710 msgr2=0x7f1a20138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a20139710 0x7f1a20138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200a6950 msgr2=0x7f1a201389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200a6950 0x7f1a201389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 monclient: found mon.noname-b 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1ffff640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a200a1e90 con 0x7f1a200a57c0 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.892+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1a200a6950 0x7f1a201389d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1ffff640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 msgr2=0x7f1a201ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1ffff640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 0x7f1a201ce290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000e9b0 tx=0x7f1a1000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a10017070 con 0x7f1a200a57c0 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: dump: 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.916 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1000cbb0 con 0x7f1a200a57c0 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 5 monclient: authenticate success, global_id 74792 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 10 monclient: _renew_subs 2024-08-19T11:18:24.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a20126390 con 0x7f1a200a57c0 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a1000cd60 con 0x7f1a200a57c0 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1cff9640 10 monclient: dump: 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.918 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.919 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 10 monclient: _renew_subs 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a20124030 con 0x7f1a200a57c0 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.895+0000 7f1a1dffb640 4 set_mon_vals no callback set 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a26a56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a26a56640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 0x7f1a2002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1a2006a590 con 0x7f1a20122da0 2024-08-19T11:18:24.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1a1001a070 con 0x7f1a200a57c0 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1cff9640 1 --2- 172.21.15.71:0/1882677555 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a0c03ea80 0x7f1a0c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 0x7f1a2002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient: get_auth_request con 0x7f1a20122da0 auth_method 0 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (secure 0 0 0) 0x7f1a1000f040 con 0x7f1a200a57c0 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a24ff3640 1 --2- 172.21.15.71:0/1882677555 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a0c03ea80 0x7f1a0c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a24ff3640 10 monclient: get_auth_request con 0x7f1a0c03ea80 auth_method 0 2024-08-19T11:18:24.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_done global_id 45491 payload 824 2024-08-19T11:18:24.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.896+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a20125cf0 con 0x7f1a20122da0 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 msgr2=0x7f1a2002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 0x7f1a2002d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a14034000 tx=0x7f1a140046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a24ff3640 1 --2- 172.21.15.71:0/1882677555 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a0c03ea80 0x7f1a0c040f40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1a200aa9a0 tx=0x7f1a1800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a14042070 con 0x7f1a20122da0 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 10 monclient: dump: 2024-08-19T11:18:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a14003d20 con 0x7f1a20122da0 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 msgr2=0x7f1a2002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 0x7f1a2002d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a14034000 tx=0x7f1a140046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 msgr2=0x7f1a2002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.899+0000 7f1a1cff9640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20122da0 0x7f1a2002d1c0 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a14034000 tx=0x7f1a140046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a26a56640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a26a56640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 0x7f1a2002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a26a56640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1a20076c60 con 0x7f1a20123180 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 0x7f1a2002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a1f7fe640 10 monclient: get_auth_request con 0x7f1a20123180 auth_method 0 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.905+0000 7f1a1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.906+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:24.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.906+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.906+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.906+0000 7f1a1f7fe640 10 monclient(hunting): handle_auth_done global_id 45500 payload 824 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.906+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/1882677555 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a20125af0 con 0x7f1a20123180 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.908+0000 7f1a1f7fe640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 msgr2=0x7f1a2002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.908+0000 7f1a1f7fe640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 0x7f1a2002d700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1a140097c0 tx=0x7f1a14009240 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.908+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1a14048e60 con 0x7f1a20123180 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.908+0000 7f1a1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.908+0000 7f1a1cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.908+0000 7f1a1cff9640 10 monclient: dump: 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:24.929 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:24.930 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f1a1403e460 con 0x7f1a20123180 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 msgr2=0x7f1a2002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 0x7f1a2002d700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1a140097c0 tx=0x7f1a14009240 comp rx=0 tx=0).stop 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 msgr2=0x7f1a2002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a1cff9640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1a20123180 0x7f1a2002d700 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1a140097c0 tx=0x7f1a14009240 comp rx=0 tx=0).stop 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 273931, 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:24.932 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:24.933 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.934 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.935 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:24.936 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:24.937 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:24.938 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.939 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.940 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:24.946 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:24.947 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.948 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.949 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.952 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.953 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:24.954 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:24.956 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:24.957 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:24.958 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:24.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.961 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:24.962 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:18:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:24.963 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:24.963 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a0c03ea80 msgr2=0x7f1a0c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 --2- 172.21.15.71:0/1882677555 >> v2:172.21.15.135:6800/726754104 conn(0x7f1a0c03ea80 0x7f1a0c040f40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1a200aa9a0 tx=0x7f1a1800b040 comp rx=0 tx=0).stop 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 10 monclient: shutdown 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 msgr2=0x7f1a201ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 --2- 172.21.15.71:0/1882677555 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1a200a57c0 0x7f1a201ce290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000e9b0 tx=0x7f1a1000ee70 comp rx=0 tx=0).stop 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a24ff3640 1 -- 172.21.15.71:0/1882677555 reap_dead start 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a24ff3640 1 -- 172.21.15.71:0/1882677555 reap_dead start 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 shutdown_connections 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 >> 172.21.15.71:0/1882677555 conn(0x7f1a200abf50 msgr2=0x7f1a200aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 shutdown_connections 2024-08-19T11:18:24.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:24.909+0000 7f1a26a56640 1 -- 172.21.15.71:0/1882677555 wait complete. 2024-08-19T11:18:24.966 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:24.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:18:24.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:18:25.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.063+0000 7f9367f72640 10 monclient: get_monmap_and_config 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.063+0000 7f9367f72640 10 monclient: build_initial_monmap 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.063+0000 7f9367f72640 10 monclient: monmap: 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:25.064475+0000 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:25.064475+0000 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:25.065 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:25.066 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.064+0000 7f9367f72640 1 Processor -- start 2024-08-19T11:18:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.064+0000 7f9367f72640 1 -- start start 2024-08-19T11:18:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.064+0000 7f9367f72640 10 monclient: init 2024-08-19T11:18:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient: _add_conns ranks=[4,3,9,1,8,0,2,10,6,7,5] 2024-08-19T11:18:25.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f93600a6950 0x7f93600a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): picked mon.noname-c con 0x7f93600a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93600a57c0 0x7f93600a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): picked mon.noname-g con 0x7f93600a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9360139710 0x7f9360139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): picked mon.noname-a con 0x7f9360139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f93600a5020 con 0x7f9360139710 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93600a77b0 con 0x7f93600a57c0 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f93600a7d40 con 0x7f93600a6950 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9367f72640 10 monclient(hunting): authenticate will time out at 1163.106204s 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9360139710 0x7f9360139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9360139710 0x7f9360139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47238/0 (socket says 172.21.15.71:47238) 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 -- 172.21.15.71:0/3565573626 learned_addr learned my addr 172.21.15.71:0/3565573626 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): get_auth_request con 0x7f9360139710 auth_method 0 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f93600a6950 0x7f93600a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): get_auth_request con 0x7f93600a6950 auth_method 0 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936550d640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93600a57c0 0x7f93600a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936550d640 10 monclient(hunting): get_auth_request con 0x7f93600a57c0 auth_method 0 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936550d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936550d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient(hunting): handle_auth_done global_id 74853 payload 274 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 -- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f93600a6950 msgr2=0x7f93600a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f93600a6950 0x7f93600a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 -- 172.21.15.71:0/3565573626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93600a57c0 msgr2=0x7f93600a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:25.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93600a57c0 0x7f93600a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient: _finish_hunting 0 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 monclient: found mon.noname-a 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f936650f640 1 -- 172.21.15.71:0/3565573626 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93600a6380 con 0x7f9360139710 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.065+0000 7f9365d0e640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f93600a6950 0x7f93600a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f936650f640 1 -- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9360139710 msgr2=0x7f9360139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f936650f640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9360139710 0x7f9360139b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e80 tx=0x7f935802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4662f9c2fe6c4a2a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 1 -- 172.21.15.71:0/3565573626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9358036070 con 0x7f9360139710 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: dump: 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.079 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: _finish_auth 0 2024-08-19T11:18:25.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: _check_auth_tickets 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 1 -- 172.21.15.71:0/3565573626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9358007a70 con 0x7f9360139710 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9367f72640 5 monclient: authenticate success, global_id 74853 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9367f72640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 1 -- 172.21.15.71:0/3565573626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9358007ca0 con 0x7f9360139710 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9367f72640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9367f72640 4 set_mon_vals no callback set 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:25.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.068+0000 7f9364d0c640 10 monclient: dump: 2024-08-19T11:18:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.082 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.083 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 10 monclient: shutdown 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 -- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9360139710 msgr2=0x7f9360139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9360139710 0x7f9360139b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e80 tx=0x7f935802a580 comp rx=0 tx=0).stop 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 -- 172.21.15.71:0/3565573626 shutdown_connections 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9360139710 0x7f9360139b30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93600a57c0 0x7f93600a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 --2- 172.21.15.71:0/3565573626 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f93600a6950 0x7f93600a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 -- 172.21.15.71:0/3565573626 >> 172.21.15.71:0/3565573626 conn(0x7f93600abf50 msgr2=0x7f93600ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 -- 172.21.15.71:0/3565573626 shutdown_connections 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 1 -- 172.21.15.71:0/3565573626 wait complete. 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 10 monclient: build_initial_monmap 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.069+0000 7f9367f72640 10 monclient: monmap: 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:25.085 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:25.086 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 Processor -- start 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 -- start start 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient: init 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient: _add_conns ranks=[0,5,7,3,4,8,1,2,6] 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 0x7f9360138210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): picked mon.noname-a con 0x7f93600a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f93600a6950 0x7f9360124c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): picked mon.noname-h con 0x7f93600a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9360139710 0x7f9360125150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): picked mon.noname-i con 0x7f9360139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93600a84c0 con 0x7f93600a57c0 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 0x7f9360138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f93600a3650 con 0x7f93600a6950 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f93600a8700 con 0x7f9360139710 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9367f72640 10 monclient(hunting): authenticate will time out at 1163.111755s 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 0x7f9360138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47242/0 (socket says 172.21.15.71:47242) 2024-08-19T11:18:25.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 -- 172.21.15.71:0/417912452 learned_addr learned my addr 172.21.15.71:0/417912452 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): get_auth_request con 0x7f93600a57c0 auth_method 0 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient(hunting): handle_auth_done global_id 74862 payload 824 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9360139710 msgr2=0x7f9360125150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9360139710 0x7f9360125150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f93600a6950 msgr2=0x7f9360124c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f93600a6950 0x7f9360124c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient: _finish_hunting 0 2024-08-19T11:18:25.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 monclient: found mon.noname-a 2024-08-19T11:18:25.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:25.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:25.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.070+0000 7f9365d0e640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93601285f0 con 0x7f93600a57c0 2024-08-19T11:18:25.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9365d0e640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 msgr2=0x7f9360138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:25.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9365d0e640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 0x7f9360138210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f935c00ebe0 tx=0x7f935c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f935c017070 con 0x7f93600a57c0 2024-08-19T11:18:25.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:25.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: dump: 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f935c00cdc0 con 0x7f93600a57c0 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 5 monclient: authenticate success, global_id 74862 2024-08-19T11:18:25.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f935c013d50 con 0x7f93600a57c0 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 10 monclient: _renew_subs 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93601288d0 con 0x7f93600a57c0 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9357fff640 4 set_mon_vals no callback set 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f93567fc640 10 monclient: dump: 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.098 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.099 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 10 monclient: _renew_subs 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.073+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9360126570 con 0x7f93600a57c0 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f9367f72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f9367f72640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 0x7f936002d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9360076c60 con 0x7f936002d1c0 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 0x7f936002d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f935c01a070 con 0x7f93600a57c0 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient: get_auth_request con 0x7f936002d1c0 auth_method 0 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f93567fc640 1 --2- 172.21.15.71:0/417912452 >> v2:172.21.15.135:6800/726754104 conn(0x7f934403ea80 0x7f9344040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (secure 0 0 0) 0x7f935c00f040 con 0x7f93600a57c0 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 10 monclient(hunting): handle_auth_done global_id 84418 payload 824 2024-08-19T11:18:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936550d640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93600a6d30 con 0x7f936002d1c0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936650f640 1 --2- 172.21.15.71:0/417912452 >> v2:172.21.15.135:6800/726754104 conn(0x7f934403ea80 0x7f9344040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.074+0000 7f936650f640 10 monclient: get_auth_request con 0x7f934403ea80 auth_method 0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.076+0000 7f936550d640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 msgr2=0x7f936002d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.076+0000 7f936550d640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 0x7f936002d5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9360126be0 tx=0x7f935000d940 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f936650f640 1 --2- 172.21.15.71:0/417912452 >> v2:172.21.15.135:6800/726754104 conn(0x7f934403ea80 0x7f9344040f40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9358033000 tx=0x7f935802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9350012c70 con 0x7f936002d1c0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 10 monclient: dump: 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.102 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.103 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9350019070 con 0x7f936002d1c0 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 msgr2=0x7f936002d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 0x7f936002d5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9360126be0 tx=0x7f935000d940 comp rx=0 tx=0).stop 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 msgr2=0x7f936002d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.077+0000 7f93567fc640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002d1c0 0x7f936002d5a0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9360126be0 tx=0x7f935000d940 comp rx=0 tx=0).stop 2024-08-19T11:18:25.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f9367f72640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f9367f72640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 0x7f936002def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f9367f72640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f93600a1120 con 0x7f936002dae0 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f936550d640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 0x7f936002def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f936550d640 10 monclient: get_auth_request con 0x7f936002dae0 auth_method 0 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f936550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f936550d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.083+0000 7f936550d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.084+0000 7f936550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.084+0000 7f936550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.084+0000 7f936550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.084+0000 7f936550d640 10 monclient(hunting): handle_auth_done global_id 84427 payload 824 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.084+0000 7f936550d640 1 -- 172.21.15.71:0/417912452 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f936006ca70 con 0x7f936002dae0 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.086+0000 7f936550d640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 msgr2=0x7f936002def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.086+0000 7f936550d640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 0x7f936002def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9350018000 tx=0x7f93500046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.086+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f935001ec30 con 0x7f936002dae0 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.086+0000 7f93567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.086+0000 7f93567fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.086+0000 7f93567fc640 10 monclient: dump: 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.106 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.107 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f935001e7c0 con 0x7f936002dae0 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 msgr2=0x7f936002def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 0x7f936002def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9350018000 tx=0x7f93500046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 msgr2=0x7f936002def0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:25.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f93567fc640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f936002dae0 0x7f936002def0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 87247, 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:25.137 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 >> v2:172.21.15.135:6800/726754104 conn(0x7f934403ea80 msgr2=0x7f9344040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 --2- 172.21.15.71:0/417912452 >> v2:172.21.15.135:6800/726754104 conn(0x7f934403ea80 0x7f9344040f40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9358033000 tx=0x7f935802e000 comp rx=0 tx=0).stop 2024-08-19T11:18:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 10 monclient: shutdown 2024-08-19T11:18:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 msgr2=0x7f9360138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 --2- 172.21.15.71:0/417912452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93600a57c0 0x7f9360138210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f935c00ebe0 tx=0x7f935c00c520 comp rx=0 tx=0).stop 2024-08-19T11:18:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f936650f640 1 -- 172.21.15.71:0/417912452 reap_dead start 2024-08-19T11:18:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f936650f640 1 -- 172.21.15.71:0/417912452 reap_dead start 2024-08-19T11:18:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 shutdown_connections 2024-08-19T11:18:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 >> 172.21.15.71:0/417912452 conn(0x7f93600abf50 msgr2=0x7f93600aaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 shutdown_connections 2024-08-19T11:18:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.087+0000 7f9367f72640 1 -- 172.21.15.71:0/417912452 wait complete. 2024-08-19T11:18:25.140 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:25.140 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:18:25.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:18:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.238+0000 7fc9af48b640 10 monclient: get_monmap_and_config 2024-08-19T11:18:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.238+0000 7fc9af48b640 10 monclient: build_initial_monmap 2024-08-19T11:18:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.238+0000 7fc9af48b640 10 monclient: monmap: 2024-08-19T11:18:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:25.238942+0000 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:25.238942+0000 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:25.240 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:25.241 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:25.241 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:25.241 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.238+0000 7fc9af48b640 1 Processor -- start 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 -- start start 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient: init 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient: _add_conns ranks=[9,7,2,8,1,6,5,3,4,10,0] 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9a80a5860 0x7fc9a80a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): picked mon.noname-a con 0x7fc9a80a5860 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9a8072350 0x7fc9a80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): picked mon.noname-i con 0x7fc9a8072350 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 0x7fc9a8137b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): picked mon.noname-b con 0x7fc9a81376f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a80a66c0 con 0x7fc9a80a5860 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a80a40f0 con 0x7fc9a81376f0 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fc9a8074110 con 0x7fc9a8072350 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:25.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9af48b640 10 monclient(hunting): authenticate will time out at 1163.280669s 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9a80a5860 0x7fc9a80a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 0x7fc9a8137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9a80a5860 0x7fc9a80a5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47244/0 (socket says 172.21.15.71:47244) 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 1 -- 172.21.15.71:0/4247226422 learned_addr learned my addr 172.21.15.71:0/4247226422 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): get_auth_request con 0x7fc9a80a5860 auth_method 0 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 0x7fc9a8137b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38402/0 (socket says 172.21.15.71:38402) 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): get_auth_request con 0x7fc9a81376f0 auth_method 0 2024-08-19T11:18:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ad227640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9ada28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9aca26640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9a8072350 0x7fc9a80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9aca26640 10 monclient(hunting): get_auth_request con 0x7fc9a8072350 auth_method 0 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9aca26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9aca26640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.239+0000 7fc9aca26640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 10 monclient(hunting): handle_auth_done global_id 74871 payload 274 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 1 -- 172.21.15.71:0/4247226422 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9a8072350 msgr2=0x7fc9a80a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9a8072350 0x7fc9a80a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 1 -- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 msgr2=0x7fc9a8137b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 0x7fc9a8137b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 10 monclient: _finish_hunting 0 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 1 monclient: found mon.noname-a 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:25.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ad227640 1 -- 172.21.15.71:0/4247226422 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80a7390 con 0x7fc9a80a5860 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9aca26640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9a8072350 0x7fc9a80a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.240+0000 7fc9ada28640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 0x7fc9a8137b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.242+0000 7fc9ad227640 1 -- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a80a5860 msgr2=0x7fc9a80a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.242+0000 7fc9ad227640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a80a5860 0x7fc9a80a5c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009870 tx=0x7fc99c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa83191fdfc35f58 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.242+0000 7fc99bfff640 1 -- 172.21.15.71:0/4247226422 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc99c037070 con 0x7fc9a80a5860 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: dump: 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: _finish_auth 0 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 1 -- 172.21.15.71:0/4247226422 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c02ae00 con 0x7fc9a80a5860 2024-08-19T11:18:25.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 5 monclient: authenticate success, global_id 74871 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 1 -- 172.21.15.71:0/4247226422 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc99c030c20 con 0x7fc9a80a5860 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc99bfff640 10 monclient: dump: 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.256 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:25.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 4 set_mon_vals no callback set 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 10 monclient: shutdown 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 -- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a80a5860 msgr2=0x7fc9a80a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a80a5860 0x7fc9a80a5c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009870 tx=0x7fc99c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 -- 172.21.15.71:0/4247226422 shutdown_connections 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9a81376f0 0x7fc9a8137b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fc9a8072350 0x7fc9a80a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 --2- 172.21.15.71:0/4247226422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a80a5860 0x7fc9a80a5c40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 -- 172.21.15.71:0/4247226422 >> 172.21.15.71:0/4247226422 conn(0x7fc9a80aa480 msgr2=0x7fc9a80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:25.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 -- 172.21.15.71:0/4247226422 shutdown_connections 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.243+0000 7fc9af48b640 1 -- 172.21.15.71:0/4247226422 wait complete. 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.244+0000 7fc9af48b640 10 monclient: build_initial_monmap 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.244+0000 7fc9af48b640 10 monclient: monmap: 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.259 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.244+0000 7fc9af48b640 1 Processor -- start 2024-08-19T11:18:25.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.244+0000 7fc9af48b640 1 -- start start 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.244+0000 7fc9af48b640 10 monclient: init 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient: _add_conns ranks=[5,8,1,6,4,3,7,0,2] 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9a8072350 0x7fc9a81ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): picked mon.noname-h con 0x7fc9a8072350 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 0x7fc9a8136b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): picked mon.noname-e con 0x7fc9a80a5860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9a81376f0 0x7fc9a81370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): picked mon.noname-f con 0x7fc9a81376f0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80a1a50 con 0x7fc9a81376f0 2024-08-19T11:18:25.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc9a80a18d0 con 0x7fc9a8072350 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc9a8138090 con 0x7fc9a80a5860 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9af48b640 10 monclient(hunting): authenticate will time out at 1163.286142s 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 0x7fc9a8136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 0x7fc9a8136b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48140/0 (socket says 172.21.15.71:48140) 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 -- 172.21.15.71:0/1543846657 learned_addr learned my addr 172.21.15.71:0/1543846657 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): get_auth_request con 0x7fc9a80a5860 auth_method 0 2024-08-19T11:18:25.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ada28640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9a81376f0 0x7fc9a81370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ada28640 10 monclient(hunting): get_auth_request con 0x7fc9a81376f0 auth_method 0 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ada28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ada28640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ada28640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ad227640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9a8072350 0x7fc9a81ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ad227640 10 monclient(hunting): get_auth_request con 0x7fc9a8072350 auth_method 0 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ad227640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ad227640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ad227640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient(hunting): handle_auth_done global_id 94139 payload 824 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 -- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9a8072350 msgr2=0x7fc9a81ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9a8072350 0x7fc9a81ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 -- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9a81376f0 msgr2=0x7fc9a81370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9a81376f0 0x7fc9a81370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient: _finish_hunting 0 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 monclient: found mon.noname-e 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9aca26640 1 -- 172.21.15.71:0/1543846657 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8126560 con 0x7fc9a80a5860 2024-08-19T11:18:25.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.245+0000 7fc9ada28640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9a81376f0 0x7fc9a81370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc9aca26640 1 -- 172.21.15.71:0/1543846657 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 msgr2=0x7fc9a8136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc9aca26640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 0x7fc9a8136b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e840 tx=0x7fc9a400ed00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9a4017070 con 0x7fc9a80a5860 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: dump: 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.269 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: _finish_auth 0 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc9af48b640 5 monclient: authenticate success, global_id 94139 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a400cb40 con 0x7fc9a80a5860 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc9a400f040 con 0x7fc9a80a5860 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc9af48b640 10 monclient: _renew_subs 2024-08-19T11:18:25.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc9af48b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8073040 con 0x7fc9a80a5860 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc99b7fe640 4 set_mon_vals no callback set 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.247+0000 7fc999ffb640 10 monclient: dump: 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:25.271 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:25.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.248+0000 7fc9af48b640 10 monclient: _renew_subs 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.248+0000 7fc9af48b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.248+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a8126280 con 0x7fc9a80a5860 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc9a401a070 con 0x7fc9a80a5860 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc9af48b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc9af48b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc9af48b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a81383c0 con 0x7fc9a80a5860 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc999ffb640 1 --2- 172.21.15.71:0/1543846657 >> v2:172.21.15.135:6800/726754104 conn(0x7fc98c03ea80 0x7fc98c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (secure 0 0 0) 0x7fc9a4051850 con 0x7fc9a80a5860 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc9ad227640 1 --2- 172.21.15.71:0/1543846657 >> v2:172.21.15.135:6800/726754104 conn(0x7fc98c03ea80 0x7fc98c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:25.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.249+0000 7fc9ad227640 10 monclient: get_auth_request con 0x7fc98c03ea80 auth_method 0 2024-08-19T11:18:25.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.252+0000 7fc9ad227640 1 --2- 172.21.15.71:0/1543846657 >> v2:172.21.15.135:6800/726754104 conn(0x7fc98c03ea80 0x7fc98c040f40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc99c034000 tx=0x7fc99c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:25.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.254+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc9a40505c0 con 0x7fc9a80a5860 2024-08-19T11:18:25.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.254+0000 7fc999ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:25.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.254+0000 7fc999ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:25.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.508+0000 7fc9af48b640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:18:25.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.508+0000 7fc9af48b640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:18:25.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.508+0000 7fc9af48b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:25.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.508+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc9a80a3040 con 0x7fc9a80a5860 2024-08-19T11:18:25.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=4152186543,config=2586702516,health=1729711716,kv=3646823213,logm=1924485014}) 2024-08-19T11:18:25.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=1,health=10,kv=12,logm=63} crc {auth=2543792680,config=1747058506,health=501710228,kv=3646823213,logm=3475173205}) 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=4277156669,config=2586702516,health=2096750356,kv=1566686170,logm=702334480}) 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=16,config=2,health=12,kv=12,logm=58} crc {auth=4277156669,config=2586702516,health=2096750356,kv=3646823213,logm=2788663157}) 2024-08-19T11:18:25.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.510+0000 7fc999ffb640 1 -- 172.21.15.71:0/1543846657 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc9a401bdc0 con 0x7fc9a80a5860 2024-08-19T11:18:25.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.510+0000 7fc999ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:18:25.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.510+0000 7fc999ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:25.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1491010532,config=1747058506,health=2096750356,kv=3646823213,logm=2173507354}) 2024-08-19T11:18:25.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.510+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=3608520656,config=2586702516,health=2096750356,kv=3646823213,logm=1524841798}) 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=17,config=2,health=10,kv=12,logm=59} crc {auth=3608520656,config=2586702517,health=3267057823,kv=3646823213,logm=1411634290}) 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=11,logm=60} crc {auth=560699441,config=2586702516,health=2096750356,kv=2976341814,logm=2517211371}) 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.511+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=3608520656,config=2586702516,health=1655724640,kv=4277926840,logm=1625445729}) 2024-08-19T11:18:25.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3945431181}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3075694695}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1626668343}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=148817949}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3792521912}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.513+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1473820729}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1784094088}) 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3892208078}) 2024-08-19T11:18:25.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.514+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2572388700}) 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.514+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 >> v2:172.21.15.135:6800/726754104 conn(0x7fc98c03ea80 msgr2=0x7fc98c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.514+0000 7fc9af48b640 1 --2- 172.21.15.71:0/1543846657 >> v2:172.21.15.135:6800/726754104 conn(0x7fc98c03ea80 0x7fc98c040f40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc99c034000 tx=0x7fc99c02e000 comp rx=0 tx=0).stop 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.514+0000 7fc9af48b640 10 monclient: shutdown 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.514+0000 7fc9af48b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.514+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 msgr2=0x7fc9a8136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.514+0000 7fc9af48b640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 0x7fc9a8136b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e840 tx=0x7fc9a400ed00 comp rx=0 tx=0).stop 2024-08-19T11:18:25.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 shutdown_connections 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 --2- 172.21.15.71:0/1543846657 >> v2:172.21.15.135:6800/726754104 conn(0x7fc98c03ea80 0x7fc98c040f40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc9a80a5860 0x7fc9a8136b60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9a81376f0 0x7fc9a81370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 --2- 172.21.15.71:0/1543846657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc9a8072350 0x7fc9a81ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 >> 172.21.15.71:0/1543846657 conn(0x7fc9a80aa480 msgr2=0x7fc9a80a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 shutdown_connections 2024-08-19T11:18:25.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:25.515+0000 7fc9af48b640 1 -- 172.21.15.71:0/1543846657 wait complete. 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1464706106}) 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1415925292}) 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1005460439}) 2024-08-19T11:18:25.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2942010261}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3280856468}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1305837830}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3004046082}) 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4178012548}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.515+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1232209380}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.516+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.516+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2186103779}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2085714920}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=833766529}) 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1273868095}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1846476351}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3401197036}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1333745262}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673910503}) 2024-08-19T11:18:25.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.517+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=70388820}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3408990899}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4222430000}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2034723976}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2171242422}) 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1700157869}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=66373013}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=793426564}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3473956025}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.518+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3495242432}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3014940592}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=255079717}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1384537868}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=272708143}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3770349650}) 2024-08-19T11:18:25.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1224833544}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.519+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3289103743}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.520+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.520+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2480851224}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.520+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3382391498}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3929781185}) 2024-08-19T11:18:25.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=328669254}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3810239694}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=545123545}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1411903940}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1188489882}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=490617333}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212100904}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.521+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3288465627}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1472982285}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=509673003}) 2024-08-19T11:18:25.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1651135786}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3682517855}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=903054131}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2903079067}) 2024-08-19T11:18:25.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3030505920}) 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864083368}) 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.522+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3490749306}) 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1344304769}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=46194945}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1908447044}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2201557948}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3395700511}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3922156397}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1058151984}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329173088}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.523+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2430514499}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1569679221}) 2024-08-19T11:18:25.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1876915071}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=632414877}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.524+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=285043514}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2984206422}) 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1233376564}) 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=514607106}) 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=364430891}) 2024-08-19T11:18:25.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.525+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2661469307}) 2024-08-19T11:18:25.551 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:18:25.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=5667531}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1223970377}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.532+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4114785772}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3871415542}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2870624203}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1568059643}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=282478183}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=618675359}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.533+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=211476560}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=743357049}) 2024-08-19T11:18:25.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=957614938}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2330716235}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3115958915}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=5144812}) 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1833232305}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=432569597}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1144174129}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2067915703}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=683174407}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2141230846}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1180335402}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3369031220}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=219989703}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=959796091}) 2024-08-19T11:18:25.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.542+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.542+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.542+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=551777852}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.542+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.542+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177974077}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.542+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2164336983}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=366879522}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1667501238}) 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1802500504}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3054706115}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=416522632}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3702513717}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1764896793}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1935627267}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3899084473}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1281399761}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1974928554}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2306093656}) 2024-08-19T11:18:25.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1679586939}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.550+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1194250882}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2356654983}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=435789158}) 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1329712069}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.551+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1893819846}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=34766618}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1967106089}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4105790330}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4251827637}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1262059841}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1990968246}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3954995744}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=855289710}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.552+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=207759284}) 2024-08-19T11:18:25.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3160345974}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3012848123}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1512752971}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=408494863}) 2024-08-19T11:18:25.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1221184755}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=270827692}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2806957456}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3704802779}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1973538707}) 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3563813243}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1706915501}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=194865896}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=376098212}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3420697020}) 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4262600822}) 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1696818391}) 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=445674600}) 2024-08-19T11:18:25.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:25.555+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4126375937}) 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: starting. 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27627 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: created object 0... 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: created object 25... 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: created object 49... 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: finishing. 2024-08-19T11:18:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27662]: shutting down. 2024-08-19T11:18:25.620 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:25.620 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27664]: starting. 2024-08-19T11:18:25.620 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27664]: listing objects. 2024-08-19T11:18:25.620 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27664]: listed object 0... 2024-08-19T11:18:25.620 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27664]: listed object 25... 2024-08-19T11:18:25.621 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27664]: saw 50 objects 2024-08-19T11:18:25.621 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27664]: shutting down. 2024-08-19T11:18:26.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1028999549}) 2024-08-19T11:18:26.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3025048848}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=950619653}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=713873929}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2552051749}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2318925160}) 2024-08-19T11:18:26.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3022800171}) 2024-08-19T11:18:26.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=47143080}) 2024-08-19T11:18:26.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.220+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1724758344}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1942080115}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=123909279}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=759035940}) 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.464 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1955898769}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3688188478}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3406200129}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4235548610}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2246987504}) 2024-08-19T11:18:26.465 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=77423647}) 2024-08-19T11:18:26.470 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.470 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.470 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2416601503}) 2024-08-19T11:18:26.470 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.470 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.470 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1345958910}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4021374746}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=632486995}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2951988190}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1524402347}) 2024-08-19T11:18:26.471 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.472 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.472 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2172351037}) 2024-08-19T11:18:26.472 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.472 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4048737533}) 2024-08-19T11:18:26.472 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.468+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1304413262}) 2024-08-19T11:18:26.552 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:18:26.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:18:26.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.654+0000 7f484e269640 10 monclient: get_monmap_and_config 2024-08-19T11:18:26.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.654+0000 7f484e269640 10 monclient: build_initial_monmap 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.654+0000 7f484e269640 10 monclient: monmap: 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:26.655381+0000 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:26.655381+0000 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:26.656 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:26.657 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:26.657 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:26.657 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:26.657 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:26.657 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.655+0000 7f484e269640 1 Processor -- start 2024-08-19T11:18:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.655+0000 7f484e269640 1 -- start start 2024-08-19T11:18:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.655+0000 7f484e269640 10 monclient: init 2024-08-19T11:18:26.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.655+0000 7f484e269640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.655+0000 7f484e269640 10 monclient: _add_conns ranks=[2,8,4,1,0,7,9,5,3,10,6] 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 0x7f48480a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): picked mon.noname-b con 0x7f48480a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 0x7f48480a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): picked mon.noname-e con 0x7f48480a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 0x7f4848139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): picked mon.noname-c con 0x7f4848139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f48480a4f90 con 0x7f48480a6a30 2024-08-19T11:18:26.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f48480a6380 con 0x7f4848139860 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f48480a49d0 con 0x7f48480a6e10 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484e269640 10 monclient(hunting): authenticate will time out at 1164.697070s 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 0x7f48480a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 0x7f48480a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 0x7f4848139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 0x7f48480a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48150/0 (socket says 172.21.15.71:48150) 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 0x7f4848139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:45976/0 (socket says 172.21.15.71:45976) 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 1 -- 172.21.15.71:0/3098079994 learned_addr learned my addr 172.21.15.71:0/3098079994 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:26.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 0x7f48480a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38422/0 (socket says 172.21.15.71:38422) 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): get_auth_request con 0x7f48480a6a30 auth_method 0 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): get_auth_request con 0x7f48480a6e10 auth_method 0 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): get_auth_request con 0x7f4848139860 auth_method 0 2024-08-19T11:18:26.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:26.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient(hunting): handle_auth_done global_id 74810 payload 274 2024-08-19T11:18:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 -- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 msgr2=0x7f48480a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 0x7f48480a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 -- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 msgr2=0x7f4848139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 0x7f4848139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 monclient: found mon.noname-b 2024-08-19T11:18:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f4847fff640 1 -- 172.21.15.71:0/3098079994 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48480a46f0 con 0x7f48480a6a30 2024-08-19T11:18:26.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f484c806640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 0x7f4848139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:26.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.656+0000 7f48477fe640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 0x7f48480a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4847fff640 1 -- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 msgr2=0x7f48480a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4847fff640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 0x7f48480a57f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4838009800 tx=0x7f4838029fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7806298cd90ced1e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 1 -- 172.21.15.71:0/3098079994 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4838037070 con 0x7f48480a6a30 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: dump: 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:26.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 5 monclient: authenticate success, global_id 74810 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 1 -- 172.21.15.71:0/3098079994 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f483802ad00 con 0x7f48480a6a30 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 4 set_mon_vals no callback set 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 1 -- 172.21.15.71:0/3098079994 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4838030c20 con 0x7f48480a6a30 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f4846ffd640 10 monclient: dump: 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 10 monclient: shutdown 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 1 -- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 msgr2=0x7f48480a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.659+0000 7f484e269640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 0x7f48480a57f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4838009800 tx=0x7f4838029fe0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 -- 172.21.15.71:0/3098079994 shutdown_connections 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f4848139860 0x7f4848139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f48480a6e10 0x7f48480a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 --2- 172.21.15.71:0/3098079994 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f48480a6a30 0x7f48480a57f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 -- 172.21.15.71:0/3098079994 >> 172.21.15.71:0/3098079994 conn(0x7f48480ac030 msgr2=0x7f48480ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 -- 172.21.15.71:0/3098079994 shutdown_connections 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 -- 172.21.15.71:0/3098079994 wait complete. 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 10 monclient: build_initial_monmap 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 10 monclient: monmap: 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:26.680 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.660+0000 7f484e269640 1 Processor -- start 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 -- start start 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient: init 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient: _add_conns ranks=[0,6,5,3,4,8,7,2,1] 2024-08-19T11:18:26.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 0x7f4848123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): picked mon.noname-a con 0x7f48480a6a30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f48480a6e10 0x7f4848123590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): picked mon.noname-d con 0x7f48480a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4848139860 0x7f4848123ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): picked mon.noname-h con 0x7f4848139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f48480a7730 con 0x7f48480a6a30 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f484813a1a0 con 0x7f4848139860 2024-08-19T11:18:26.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4848126a00 con 0x7f48480a6e10 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f484e269640 10 monclient(hunting): authenticate will time out at 1164.702661s 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 0x7f4848123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f48480a6e10 0x7f4848123590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 0x7f4848123050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47282/0 (socket says 172.21.15.71:47282) 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f48480a6e10 0x7f4848123590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:34336/0 (socket says 172.21.15.71:34336) 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 1 -- 172.21.15.71:0/3689971281 learned_addr learned my addr 172.21.15.71:0/3689971281 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): get_auth_request con 0x7f48480a6a30 auth_method 0 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:26.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): get_auth_request con 0x7f48480a6e10 auth_method 0 2024-08-19T11:18:26.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:26.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:26.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:26.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f48477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.661+0000 7f4847fff640 10 monclient(hunting): handle_auth_done global_id 74880 payload 824 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 1 -- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f48480a6e10 msgr2=0x7f4848123590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f48480a6e10 0x7f4848123590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f484c806640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4848139860 0x7f4848123ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 1 -- 172.21.15.71:0/3689971281 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4848139860 msgr2=0x7f4848123ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4848139860 0x7f4848123ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 1 monclient: found mon.noname-a 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f4847fff640 1 -- 172.21.15.71:0/3689971281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4848126ce0 con 0x7f48480a6a30 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f484c806640 10 monclient: get_auth_request con 0x7f4848139860 auth_method 0 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.662+0000 7f484c806640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4848139860 0x7f4848123ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4847fff640 1 -- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 msgr2=0x7f4848123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4847fff640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 0x7f4848123050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4838009920 tx=0x7f48380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4838041020 con 0x7f48480a6a30 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:26.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: dump: 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:26.687 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:26.688 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:26.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4838032440 con 0x7f48480a6a30 2024-08-19T11:18:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4838037040 con 0x7f48480a6a30 2024-08-19T11:18:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 5 monclient: authenticate success, global_id 74880 2024-08-19T11:18:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 10 monclient: _renew_subs 2024-08-19T11:18:26.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:26.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4848127190 con 0x7f48480a6a30 2024-08-19T11:18:26.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:26.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:26.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f4844ff9640 10 monclient: dump: 2024-08-19T11:18:26.690 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:26.691 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f48467fc640 4 set_mon_vals no callback set 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 10 monclient: _renew_subs 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.664+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48480a21f0 con 0x7f48480a6a30 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f484e269640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f484e269640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:26.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f484e269640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4838044020 con 0x7f48480a6a30 2024-08-19T11:18:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4848139cf0 con 0x7f48480a6a30 2024-08-19T11:18:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f4844ff9640 1 --2- 172.21.15.71:0/3689971281 >> v2:172.21.15.135:6800/726754104 conn(0x7f483403ea80 0x7f4834040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.665+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 3898+0+0 (secure 0 0 0) 0x7f4838071df0 con 0x7f48480a6a30 2024-08-19T11:18:26.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.666+0000 7f48477fe640 1 --2- 172.21.15.71:0/3689971281 >> v2:172.21.15.135:6800/726754104 conn(0x7f483403ea80 0x7f4834040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:26.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.666+0000 7f48477fe640 10 monclient: get_auth_request con 0x7f483403ea80 auth_method 0 2024-08-19T11:18:26.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.668+0000 7f48477fe640 1 --2- 172.21.15.71:0/3689971281 >> v2:172.21.15.135:6800/726754104 conn(0x7f483403ea80 0x7f4834040f40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4848124ff0 tx=0x7f483c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:26.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.670+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f4838075030 con 0x7f48480a6a30 2024-08-19T11:18:26.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.670+0000 7f4844ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:26.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.670+0000 7f4844ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2463377182}) 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1682257154}) 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1733314985}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3050693903}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1114645557}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1295446706}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2741748341}) 2024-08-19T11:18:26.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:26.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=638197316}) 2024-08-19T11:18:26.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:26.870+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1397926083}) 2024-08-19T11:18:26.874 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:26.874 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27663]: starting. 2024-08-19T11:18:26.874 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27663]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27627 2024-08-19T11:18:26.874 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27663]: shutting down. 2024-08-19T11:18:26.875 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:26.875 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:26.875 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:18:26.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.926+0000 7f484e269640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.927+0000 7f484e269640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.927+0000 7f484e269640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.927+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f484813a500 con 0x7f48480a6a30 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.927+0000 7f4844ff9640 1 -- 172.21.15.71:0/3689971281 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f483804b030 con 0x7f48480a6a30 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.927+0000 7f4844ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:26.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.927+0000 7f4844ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:26.929 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":170,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:18:26.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 >> v2:172.21.15.135:6800/726754104 conn(0x7f483403ea80 msgr2=0x7f4834040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 --2- 172.21.15.71:0/3689971281 >> v2:172.21.15.135:6800/726754104 conn(0x7f483403ea80 0x7f4834040f40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4848124ff0 tx=0x7f483c009240 comp rx=0 tx=0).stop 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 10 monclient: shutdown 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 msgr2=0x7f4848123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 0x7f4848123050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4838009920 tx=0x7f48380046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 shutdown_connections 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 --2- 172.21.15.71:0/3689971281 >> v2:172.21.15.135:6800/726754104 conn(0x7f483403ea80 0x7f4834040f40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f4848139860 0x7f4848123ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f48480a6e10 0x7f4848123590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 --2- 172.21.15.71:0/3689971281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48480a6a30 0x7f4848123050 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:26.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.929+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 >> 172.21.15.71:0/3689971281 conn(0x7f48480ac030 msgr2=0x7f484809cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:26.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.930+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 shutdown_connections 2024-08-19T11:18:26.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:26.930+0000 7f484e269640 1 -- 172.21.15.71:0/3689971281 wait complete. 2024-08-19T11:18:26.941 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:18:26.941 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:18:26.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:18:26.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:18:27.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.038+0000 7fd6a83cf640 10 monclient: get_monmap_and_config 2024-08-19T11:18:27.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.038+0000 7fd6a83cf640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.038+0000 7fd6a83cf640 10 monclient: monmap: 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:27.039455+0000 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:27.039455+0000 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:27.040 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:27.041 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.039+0000 7fd6a83cf640 1 Processor -- start 2024-08-19T11:18:27.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.039+0000 7fd6a83cf640 1 -- start start 2024-08-19T11:18:27.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.039+0000 7fd6a83cf640 10 monclient: init 2024-08-19T11:18:27.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient: _add_conns ranks=[4,2,5,6,0,7,10,1,3,8,9] 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 0x7fd6a00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): picked mon.noname-c con 0x7fd6a00a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 0x7fd6a00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): picked mon.noname-b con 0x7fd6a00a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd6a0139710 0x7fd6a0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): picked mon.noname-h con 0x7fd6a0139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a00a5020 con 0x7fd6a00a57c0 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd6a00a77b0 con 0x7fd6a00a6950 2024-08-19T11:18:27.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd6a00a7d40 con 0x7fd6a0139710 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a83cf640 10 monclient(hunting): authenticate will time out at 1165.081139s 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 0x7fd6a00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 0x7fd6a00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 0x7fd6a00a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38436/0 (socket says 172.21.15.71:38436) 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 0x7fd6a00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:45988/0 (socket says 172.21.15.71:45988) 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 -- 172.21.15.71:0/569832144 learned_addr learned my addr 172.21.15.71:0/569832144 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): get_auth_request con 0x7fd6a00a57c0 auth_method 0 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): get_auth_request con 0x7fd6a00a6950 auth_method 0 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a696c640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd6a0139710 0x7fd6a0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient(hunting): handle_auth_done global_id 74828 payload 274 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 -- 172.21.15.71:0/569832144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd6a0139710 msgr2=0x7fd6a0139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd6a0139710 0x7fd6a0139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 -- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 msgr2=0x7fd6a00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 0x7fd6a00a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 monclient: found mon.noname-b 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a596a640 1 -- 172.21.15.71:0/569832144 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a00a6380 con 0x7fd6a00a57c0 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.040+0000 7fd6a616b640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 0x7fd6a00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a596a640 1 -- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 msgr2=0x7fd6a00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a596a640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 0x7fd6a00a7270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098d0 tx=0x7fd69002a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cafef61d25bbe00 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 1 -- 172.21.15.71:0/569832144 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd690037070 con 0x7fd6a00a57c0 2024-08-19T11:18:27.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: dump: 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.050 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 1 -- 172.21.15.71:0/569832144 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69002adc0 con 0x7fd6a00a57c0 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 5 monclient: authenticate success, global_id 74828 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 1 -- 172.21.15.71:0/569832144 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd690030c20 con 0x7fd6a00a57c0 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 4 set_mon_vals no callback set 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a5169640 10 monclient: dump: 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.052 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 10 monclient: shutdown 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 1 -- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 msgr2=0x7fd6a00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.043+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 0x7fd6a00a7270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098d0 tx=0x7fd69002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 -- 172.21.15.71:0/569832144 shutdown_connections 2024-08-19T11:18:27.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd6a0139710 0x7fd6a0139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6a00a57c0 0x7fd6a00a7270 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/569832144 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a6950 0x7fd6a00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 -- 172.21.15.71:0/569832144 >> 172.21.15.71:0/569832144 conn(0x7fd6a00abf50 msgr2=0x7fd6a00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 -- 172.21.15.71:0/569832144 shutdown_connections 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 -- 172.21.15.71:0/569832144 wait complete. 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 10 monclient: monmap: 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.044+0000 7fd6a83cf640 1 Processor -- start 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 -- start start 2024-08-19T11:18:27.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient: init 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient: _add_conns ranks=[4,8,1,0,2,5,7,6,3] 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 0x7fd6a01ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): picked mon.noname-c con 0x7fd6a00a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd6a00a6950 0x7fd6a0138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): picked mon.noname-e con 0x7fd6a00a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a0139710 0x7fd6a0139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): picked mon.noname-f con 0x7fd6a0139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:27.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a00a84c0 con 0x7fd6a0139710 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd6a00a3650 con 0x7fd6a00a57c0 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd6a00a8700 con 0x7fd6a00a6950 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a83cf640 10 monclient(hunting): authenticate will time out at 1165.086524s 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd6a00a6950 0x7fd6a0138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 0x7fd6a01ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd6a00a6950 0x7fd6a0138b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48160/0 (socket says 172.21.15.71:48160) 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 1 -- 172.21.15.71:0/3119323135 learned_addr learned my addr 172.21.15.71:0/3119323135 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): get_auth_request con 0x7fd6a00a6950 auth_method 0 2024-08-19T11:18:27.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): get_auth_request con 0x7fd6a00a57c0 auth_method 0 2024-08-19T11:18:27.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a0139710 0x7fd6a0139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): get_auth_request con 0x7fd6a0139710 auth_method 0 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a696c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient(hunting): handle_auth_done global_id 84514 payload 824 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd6a00a6950 msgr2=0x7fd6a0138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd6a00a6950 0x7fd6a0138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a0139710 msgr2=0x7fd6a0139040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a0139710 0x7fd6a0139040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 monclient: found mon.noname-c 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a616b640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a00a1dc0 con 0x7fd6a00a57c0 2024-08-19T11:18:27.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.045+0000 7fd6a596a640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd6a00a6950 0x7fd6a0138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a616b640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 msgr2=0x7fd6a01ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a616b640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 0x7fd6a01ce300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e900 tx=0x7fd69c00edc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd69c017070 con 0x7fd6a00a57c0 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: dump: 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.066 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c00cc10 con 0x7fd6a00a57c0 2024-08-19T11:18:27.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 5 monclient: authenticate success, global_id 84514 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 10 monclient: _renew_subs 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a013a270 con 0x7fd6a00a57c0 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd69c00cdc0 con 0x7fd6a00a57c0 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd696ffd640 10 monclient: dump: 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.068 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a4968640 4 set_mon_vals no callback set 2024-08-19T11:18:27.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 10 monclient: _renew_subs 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.048+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a0125c20 con 0x7fd6a00a57c0 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a83cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 0x7fd6a002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a006a590 con 0x7fd6a0122f90 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a616b640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 0x7fd6a01ce300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e900 tx=0x7fd69c00edc0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fd69c01a070 mgrmap(e 5) 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 0x7fd6a002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient: get_auth_request con 0x7fd6a0122f90 auth_method 0 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd69c01a070 con 0x7fd6a00a57c0 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 10 monclient(hunting): handle_auth_done global_id 74898 payload 824 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a596a640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6a0126090 con 0x7fd6a0122f90 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd696ffd640 1 --2- 172.21.15.71:0/3119323135 >> v2:172.21.15.135:6800/726754104 conn(0x7fd68403eab0 0x7fd684040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a696c640 1 --2- 172.21.15.71:0/3119323135 >> v2:172.21.15.135:6800/726754104 conn(0x7fd68403eab0 0x7fd684040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.049+0000 7fd6a696c640 10 monclient: get_auth_request con 0x7fd68403eab0 auth_method 0 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.051+0000 7fd6a596a640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 msgr2=0x7fd6a002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.051+0000 7fd6a596a640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 0x7fd6a002d1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6900090b0 tx=0x7fd6900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.051+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd690042070 con 0x7fd6a0122f90 2024-08-19T11:18:27.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.051+0000 7fd696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.051+0000 7fd696ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.051+0000 7fd696ffd640 10 monclient: dump: 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.072 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd69002adc0 con 0x7fd6a0122f90 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 msgr2=0x7fd6a002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 0x7fd6a002d1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6900090b0 tx=0x7fd6900046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 msgr2=0x7fd6a002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd696ffd640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0122f90 0x7fd6a002d1c0 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6900090b0 tx=0x7fd6900046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.052+0000 7fd6a696c640 1 --2- 172.21.15.71:0/3119323135 >> v2:172.21.15.135:6800/726754104 conn(0x7fd68403eab0 0x7fd684040f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd6a01246b0 tx=0x7fd698007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=485684849}) 2024-08-19T11:18:27.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3584609893}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941802080}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3350267313}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=796539453}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1088608124}) 2024-08-19T11:18:27.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597649153}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081476730}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.054+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3719350494}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4060462594}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3026194531}) 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1461995296}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3799998074}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2754791630}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=222483175}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2431730969}) 2024-08-19T11:18:27.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.080 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4285099470}) 2024-08-19T11:18:27.080 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.056+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=284534125}) 2024-08-19T11:18:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a83cf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 0x7fd6a002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a83cf640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0076c60 con 0x7fd6a0123370 2024-08-19T11:18:27.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 0x7fd6a002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient: get_auth_request con 0x7fd6a0123370 auth_method 0 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 10 monclient(hunting): handle_auth_done global_id 74907 payload 824 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.059+0000 7fd6a596a640 1 -- 172.21.15.71:0/3119323135 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd6a00a1ff0 con 0x7fd6a0123370 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a596a640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 msgr2=0x7fd6a002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a596a640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 0x7fd6a002d700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd69002a0e0 tx=0x7fd690009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd690037040 con 0x7fd6a0123370 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 10 monclient: dump: 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.083 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7fd690030cb0 con 0x7fd6a0123370 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 msgr2=0x7fd6a002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 0x7fd6a002d700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd69002a0e0 tx=0x7fd690009240 comp rx=0 tx=0).stop 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 msgr2=0x7fd6a002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6a0123370 0x7fd6a002d700 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd69002a0e0 tx=0x7fd690009240 comp rx=0 tx=0).stop 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 156095, 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:27.085 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:27.089 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.090 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:27.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:27.094 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.097 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:27.100 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:27.101 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.103 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.104 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:27.105 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.106 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.107 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:27.108 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:27.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 >> v2:172.21.15.135:6800/726754104 conn(0x7fd68403eab0 msgr2=0x7fd684040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/3119323135 >> v2:172.21.15.135:6800/726754104 conn(0x7fd68403eab0 0x7fd684040f70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd6a01246b0 tx=0x7fd698007670 comp rx=0 tx=0).stop 2024-08-19T11:18:27.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 10 monclient: shutdown 2024-08-19T11:18:27.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 msgr2=0x7fd6a01ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 1 --2- 172.21.15.71:0/3119323135 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd6a00a57c0 0x7fd6a01ce300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e900 tx=0x7fd69c00edc0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a696c640 1 -- 172.21.15.71:0/3119323135 reap_dead start 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd696ffd640 1 -- 172.21.15.71:0/3119323135 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 0 0 0) 0x7fd69c00f040 con 0x7fd6a00a57c0 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a696c640 1 -- 172.21.15.71:0/3119323135 reap_dead start 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 shutdown_connections 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.062+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 >> 172.21.15.71:0/3119323135 conn(0x7fd6a00abf50 msgr2=0x7fd6a00aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.063+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 shutdown_connections 2024-08-19T11:18:27.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.063+0000 7fd6a83cf640 1 -- 172.21.15.71:0/3119323135 wait complete. 2024-08-19T11:18:27.111 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:27.111 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:18:27.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:18:27.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.208+0000 7f3ae7e70640 10 monclient: get_monmap_and_config 2024-08-19T11:18:27.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.208+0000 7f3ae7e70640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.208+0000 7f3ae7e70640 10 monclient: monmap: 2024-08-19T11:18:27.209 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.209 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:27.209075+0000 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:27.209075+0000 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.210 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.211 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.211 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:27.211 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:27.211 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 Processor -- start 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 -- start start 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient: init 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient: _add_conns ranks=[7,5,0,8,2,3,10,1,6,9,4] 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): picked mon.noname-i con 0x7f3ae00a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): picked mon.noname-h con 0x7f3ae00a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3ae0139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae00a6380 con 0x7f3ae0139710 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3ae00a5020 con 0x7f3ae00a57c0 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3ae00a77b0 con 0x7f3ae00a6950 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae7e70640 10 monclient(hunting): authenticate will time out at 1165.250784s 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae640d640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3ae0139710 0x7f3ae0139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43952/0 (socket says 172.21.15.71:43952) 2024-08-19T11:18:27.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.209+0000 7f3ae640d640 1 -- 172.21.15.71:0/797802352 learned_addr learned my addr 172.21.15.71:0/797802352 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): get_auth_request con 0x7f3ae00a57c0 auth_method 0 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): get_auth_request con 0x7f3ae00a6950 auth_method 0 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient(hunting): handle_auth_done global_id 45536 payload 274 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 1 -- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 1 -- 172.21.15.71:0/797802352 >> v1:172.21.15.71:6789/0 conn(0x7f3ae0139710 legacy=0x7f3ae0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 1 monclient: found mon.noname-h 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae540b640 1 -- 172.21.15.71:0/797802352 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae00a3650 con 0x7f3ae00a57c0 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.210+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:27.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae540b640 1 -- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 msgr2=0x7f3ae00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae540b640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00097d0 tx=0x7f3ad0029fb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=782c1d294fae6e02 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 1 -- 172.21.15.71:0/797802352 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0037070 con 0x7f3ae00a57c0 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: dump: 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.222 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 1 -- 172.21.15.71:0/797802352 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad002ad10 con 0x7f3ae00a57c0 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 1 -- 172.21.15.71:0/797802352 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad0030c20 con 0x7f3ae00a57c0 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae7e70640 5 monclient: authenticate success, global_id 45536 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae7e70640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae7e70640 4 set_mon_vals no callback set 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.213+0000 7f3ae4c0a640 10 monclient: dump: 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.224 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 10 monclient: shutdown 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 -- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 msgr2=0x7f3ae00a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00097d0 tx=0x7f3ad0029fb0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 -- 172.21.15.71:0/797802352 shutdown_connections 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3ae00a57c0 0x7f3ae00a7270 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/797802352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a6950 0x7f3ae00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 -- 172.21.15.71:0/797802352 >> 172.21.15.71:0/797802352 conn(0x7f3ae00abf50 msgr2=0x7f3ae00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 -- 172.21.15.71:0/797802352 shutdown_connections 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 1 -- 172.21.15.71:0/797802352 wait complete. 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.214+0000 7f3ae7e70640 10 monclient: monmap: 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.226 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.227 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 Processor -- start 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 -- start start 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient: init 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient: _add_conns ranks=[7,2,8,6,0,3,5,4,1] 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 0x7f3ae01ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): picked mon.noname-i con 0x7f3ae00a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): picked mon.noname-b con 0x7f3ae00a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ae0139710 0x7f3ae0138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): picked mon.noname-e con 0x7f3ae0139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae00a84c0 con 0x7f3ae00a6950 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3ae00a7d40 con 0x7f3ae00a57c0 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3ae00a8700 con 0x7f3ae0139710 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae7e70640 10 monclient(hunting): authenticate will time out at 1165.256683s 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ae0139710 0x7f3ae0138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38440/0 (socket says 172.21.15.71:38440) 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 1 -- 172.21.15.71:0/1166521202 learned_addr learned my addr 172.21.15.71:0/1166521202 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): get_auth_request con 0x7f3ae00a6950 auth_method 0 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): get_auth_request con 0x7f3ae0139710 auth_method 0 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae540b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.215+0000 7f3ae640d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 0x7f3ae01ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae5c0c640 10 monclient(hunting): get_auth_request con 0x7f3ae00a57c0 auth_method 0 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae5c0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 10 monclient(hunting): handle_auth_done global_id 94175 payload 824 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 msgr2=0x7f3ae01ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3ae00a57c0 0x7f3ae01ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a6950 msgr2=0x7f3ae0138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 1 monclient: found mon.noname-e 2024-08-19T11:18:27.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:27.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae640d640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae0124100 con 0x7f3ae0139710 2024-08-19T11:18:27.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.216+0000 7f3ae540b640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae00a6950 0x7f3ae0138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae640d640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ae0139710 msgr2=0x7f3ae0138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae640d640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ae0139710 0x7f3ae0138fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800be40 tx=0x7f3ad800bf30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad8011b90 con 0x7f3ae0139710 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: dump: 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.237 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 5 monclient: authenticate success, global_id 94175 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad8011d50 con 0x7f3ae0139710 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 10 monclient: _renew_subs 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae00a2430 con 0x7f3ae0139710 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3ad8013870 con 0x7f3ae0139710 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:27.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad7fff640 4 set_mon_vals no callback set 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ad67fc640 10 monclient: dump: 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.240 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 10 monclient: _renew_subs 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.218+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01ce760 con 0x7f3ae0139710 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3ad8013400 con 0x7f3ae0139710 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae7e70640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 0x7f3ae002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae006a590 con 0x7f3ae0122dd0 2024-08-19T11:18:27.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ad67fc640 1 --2- 172.21.15.71:0/1166521202 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac403ea80 0x7f3ac4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 0x7f3ae002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient: get_auth_request con 0x7f3ae0122dd0 auth_method 0 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (secure 0 0 0) 0x7f3ad8052750 con 0x7f3ae0139710 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_done global_id 74846 payload 824 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae5c0c640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ae00a1ee0 con 0x7f3ae0122dd0 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae540b640 1 --2- 172.21.15.71:0/1166521202 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac403ea80 0x7f3ac4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.219+0000 7f3ae540b640 10 monclient: get_auth_request con 0x7f3ac403ea80 auth_method 0 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ae5c0c640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 msgr2=0x7f3ae002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 0x7f3ae002d1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011590 tx=0x7f3adc011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc00fe70 con 0x7f3ae0122dd0 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 10 monclient: dump: 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.243 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ae540b640 1 --2- 172.21.15.71:0/1166521202 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac403ea80 0x7f3ac4040f40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3adc00fa00 con 0x7f3ae0122dd0 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 msgr2=0x7f3ae002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 0x7f3ae002d1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011590 tx=0x7f3adc011a50 comp rx=0 tx=0).stop 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 msgr2=0x7f3ae002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.222+0000 7f3ad67fc640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae0122dd0 0x7f3ae002d1c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae7e70640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 0x7f3ae002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae7e70640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae0076c60 con 0x7f3ae01231b0 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 0x7f3ae002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient: get_auth_request con 0x7f3ae01231b0 auth_method 0 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.228+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.229+0000 7f3ae5c0c640 10 monclient(hunting): handle_auth_done global_id 74855 payload 824 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.229+0000 7f3ae5c0c640 1 -- 172.21.15.71:0/1166521202 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ae013a370 con 0x7f3ae01231b0 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ae5c0c640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 msgr2=0x7f3ae002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ae5c0c640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 0x7f3ae002d700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011590 tx=0x7f3adc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3adc004470 con 0x7f3ae01231b0 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 10 monclient: dump: 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.246 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.247 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f3adc026070 con 0x7f3ae01231b0 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 msgr2=0x7f3ae002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 0x7f3ae002d700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011590 tx=0x7f3adc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 msgr2=0x7f3ae002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.231+0000 7f3ad67fc640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3ae01231b0 0x7f3ae002d700 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3adc011590 tx=0x7f3adc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:27.248 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 156263, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:27.249 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.250 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:27.252 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.253 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.254 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:27.256 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.259 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.262 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:27.263 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.264 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.266 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:27.269 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:27.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.272 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:27.272 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:27.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac403ea80 msgr2=0x7f3ac4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/1166521202 >> v2:172.21.15.135:6800/726754104 conn(0x7f3ac403ea80 0x7f3ac4040f40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000c00 tx=0x7f3ad002e000 comp rx=0 tx=0).stop 2024-08-19T11:18:27.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 10 monclient: shutdown 2024-08-19T11:18:27.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ae0139710 msgr2=0x7f3ae0138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 --2- 172.21.15.71:0/1166521202 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3ae0139710 0x7f3ae0138fe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800be40 tx=0x7f3ad800bf30 comp rx=0 tx=0).stop 2024-08-19T11:18:27.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae640d640 1 -- 172.21.15.71:0/1166521202 reap_dead start 2024-08-19T11:18:27.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae640d640 1 -- 172.21.15.71:0/1166521202 reap_dead start 2024-08-19T11:18:27.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 shutdown_connections 2024-08-19T11:18:27.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 >> 172.21.15.71:0/1166521202 conn(0x7f3ae00abf50 msgr2=0x7f3ae00aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 shutdown_connections 2024-08-19T11:18:27.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.232+0000 7f3ae7e70640 1 -- 172.21.15.71:0/1166521202 wait complete. 2024-08-19T11:18:27.274 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:27.274 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:18:27.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:18:27.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.371+0000 7f39f5986640 10 monclient: get_monmap_and_config 2024-08-19T11:18:27.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.371+0000 7f39f5986640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.371+0000 7f39f5986640 10 monclient: monmap: 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:27.372454+0000 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:27.372454+0000 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.373 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:27.374 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:27.374 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 Processor -- start 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 -- start start 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient: init 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient: _add_conns ranks=[7,9,6,10,3,5,1,0,4,2,8] 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f00a57d0 0x7f39f00a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): picked mon.noname-i con 0x7f39f00a57d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 0x7f39f00a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): picked mon.noname-a con 0x7f39f00a5bb0 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 0x7f39f0137a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): picked mon.noname-d con 0x7f39f0137580 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f39f00a41b0 con 0x7f39f00a5bb0 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f39f00728a0 con 0x7f39f0137580 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f39f0072620 con 0x7f39f00a57d0 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.372+0000 7f39f5986640 10 monclient(hunting): authenticate will time out at 1165.413956s 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 0x7f39f00a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 0x7f39f0137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 0x7f39f00a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47310/0 (socket says 172.21.15.71:47310) 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): get_auth_request con 0x7f39f0137580 auth_method 0 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 1 -- 172.21.15.71:0/111257717 learned_addr learned my addr 172.21.15.71:0/111257717 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): get_auth_request con 0x7f39f00a5bb0 auth_method 0 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 1 --2- 172.21.15.71:0/111257717 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f00a57d0 0x7f39f00a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): get_auth_request con 0x7f39f00a57d0 auth_method 0 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_done global_id 26439 payload 274 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 -- 172.21.15.71:0/111257717 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f00a57d0 msgr2=0x7f39f00a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 --2- 172.21.15.71:0/111257717 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f00a57d0 0x7f39f00a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 -- 172.21.15.71:0/111257717 >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 msgr2=0x7f39f00a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 --2- 172.21.15.71:0/111257717 >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 0x7f39f00a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 monclient: found mon.noname-d 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ef7fe640 1 -- 172.21.15.71:0/111257717 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f0073940 con 0x7f39f0137580 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.373+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/111257717 >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 0x7f39f00a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39ef7fe640 1 -- 172.21.15.71:0/111257717 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 msgr2=0x7f39f0137a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39ef7fe640 1 --2- 172.21.15.71:0/111257717 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 0x7f39f0137a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009d90 tx=0x7f39e802a530 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b656b32612bf0335 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 1 -- 172.21.15.71:0/111257717 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39e8007bc0 con 0x7f39f0137580 2024-08-19T11:18:27.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: dump: 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.386 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 1 -- 172.21.15.71:0/111257717 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e8007d80 con 0x7f39f0137580 2024-08-19T11:18:27.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 5 monclient: authenticate success, global_id 26439 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 1 -- 172.21.15.71:0/111257717 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39e8031870 con 0x7f39f0137580 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 4 set_mon_vals no callback set 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39edffb640 10 monclient: dump: 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.388 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 10 monclient: shutdown 2024-08-19T11:18:27.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 -- 172.21.15.71:0/111257717 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 msgr2=0x7f39f0137a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 --2- 172.21.15.71:0/111257717 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 0x7f39f0137a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009d90 tx=0x7f39e802a530 comp rx=0 tx=0).stop 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 -- 172.21.15.71:0/111257717 shutdown_connections 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 --2- 172.21.15.71:0/111257717 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39f0137580 0x7f39f0137a00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 --2- 172.21.15.71:0/111257717 >> v2:172.21.15.71:3300/0 conn(0x7f39f00a5bb0 0x7f39f00a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 --2- 172.21.15.71:0/111257717 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f00a57d0 0x7f39f00a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 -- 172.21.15.71:0/111257717 >> 172.21.15.71:0/111257717 conn(0x7f39f00aa3f0 msgr2=0x7f39f00a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 -- 172.21.15.71:0/111257717 shutdown_connections 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.376+0000 7f39f5986640 1 -- 172.21.15.71:0/111257717 wait complete. 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.377+0000 7f39f5986640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.377+0000 7f39f5986640 10 monclient: monmap: 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.390 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.391 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.377+0000 7f39f5986640 1 Processor -- start 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 -- start start 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient: init 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient: _add_conns ranks=[0,1,7,4,5,8,3,6,2] 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 0x7f39f01ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): picked mon.noname-a con 0x7f39f00a57d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f00a5bb0 0x7f39f01369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): picked mon.noname-f con 0x7f39f00a5bb0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f0137580 0x7f39f0136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): picked mon.noname-i con 0x7f39f0137580 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0137f40 con 0x7f39f00a57d0 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39f00a64f0 con 0x7f39f00a5bb0 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f39f01380c0 con 0x7f39f0137580 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39f5986640 10 monclient(hunting): authenticate will time out at 1165.419484s 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 0x7f39f01ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 0x7f39f01ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47312/0 (socket says 172.21.15.71:47312) 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 -- 172.21.15.71:0/3412905969 learned_addr learned my addr 172.21.15.71:0/3412905969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): get_auth_request con 0x7f39f00a57d0 auth_method 0 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f0137580 0x7f39f0136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): get_auth_request con 0x7f39f0137580 auth_method 0 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f00a5bb0 0x7f39f01369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ee7fc640 10 monclient(hunting): get_auth_request con 0x7f39f00a5bb0 auth_method 0 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient(hunting): handle_auth_done global_id 74925 payload 824 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f0137580 msgr2=0x7f39f0136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f39f0137580 0x7f39f0136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f00a5bb0 msgr2=0x7f39f01369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f00a5bb0 0x7f39f01369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 monclient: found mon.noname-a 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:27.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39eeffd640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f00a31e0 con 0x7f39f00a57d0 2024-08-19T11:18:27.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.378+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39f00a5bb0 0x7f39f01369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39eeffd640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 msgr2=0x7f39f01ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39eeffd640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 0x7f39f01ce1b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39e000e9b0 tx=0x7f39e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39e0017070 con 0x7f39f00a57d0 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: dump: 2024-08-19T11:18:27.402 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.403 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 5 monclient: authenticate success, global_id 74925 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e000cbb0 con 0x7f39f00a57d0 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 10 monclient: _renew_subs 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f00a8cd0 con 0x7f39f00a57d0 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39e000cd60 con 0x7f39f00a57d0 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39e7fff640 10 monclient: dump: 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.405 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39ed7fa640 4 set_mon_vals no callback set 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 10 monclient: _renew_subs 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.381+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f0125ae0 con 0x7f39f00a57d0 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39f5986640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39f5986640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 0x7f39f006dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f39f0076c60 con 0x7f39f006d9b0 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39eeffd640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 0x7f39f01ce1b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39e000e9b0 tx=0x7f39e000ee70 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f39e001a070 mgrmap(e 5) 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f39e001a070 con 0x7f39f00a57d0 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 0x7f39f006dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient: get_auth_request con 0x7f39f006d9b0 auth_method 0 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39e7fff640 1 --2- 172.21.15.71:0/3412905969 >> v2:172.21.15.135:6800/726754104 conn(0x7f39d003ea80 0x7f39d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_done global_id 84523 payload 824 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ee7fc640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39f0125f50 con 0x7f39f006d9b0 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ef7fe640 1 --2- 172.21.15.71:0/3412905969 >> v2:172.21.15.135:6800/726754104 conn(0x7f39d003ea80 0x7f39d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.382+0000 7f39ef7fe640 10 monclient: get_auth_request con 0x7f39d003ea80 auth_method 0 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.384+0000 7f39ee7fc640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 msgr2=0x7f39f006dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.384+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 0x7f39f006dd90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39f00a7650 tx=0x7f39d8011a60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.384+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39d800fe20 con 0x7f39f006d9b0 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.384+0000 7f39e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.384+0000 7f39e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.384+0000 7f39e7fff640 10 monclient: dump: 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f39d800f9b0 con 0x7f39f006d9b0 2024-08-19T11:18:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 msgr2=0x7f39f006dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 0x7f39f006dd90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39f00a7650 tx=0x7f39d8011a60 comp rx=0 tx=0).stop 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 msgr2=0x7f39f006dd90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39e7fff640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006d9b0 0x7f39f006dd90 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39f00a7650 tx=0x7f39d8011a60 comp rx=0 tx=0).stop 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.385+0000 7f39ef7fe640 1 --2- 172.21.15.71:0/3412905969 >> v2:172.21.15.135:6800/726754104 conn(0x7f39d003ea80 0x7f39d0040f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f39e8034000 tx=0x7f39e802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39f5986640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39f5986640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 0x7f39f009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39f5986640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f39f00a1680 con 0x7f39f006e2d0 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 0x7f39f009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient: get_auth_request con 0x7f39f006e2d0 auth_method 0 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 10 monclient(hunting): handle_auth_done global_id 84532 payload 824 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.391+0000 7f39ee7fc640 1 -- 172.21.15.71:0/3412905969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f39f00a5fb0 con 0x7f39f006e2d0 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.393+0000 7f39ee7fc640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 msgr2=0x7f39f009c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.393+0000 7f39ee7fc640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 0x7f39f009c9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39f00a7650 tx=0x7f39d80046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.393+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f39d8003610 con 0x7f39f006e2d0 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.393+0000 7f39e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.393+0000 7f39e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.393+0000 7f39e7fff640 10 monclient: dump: 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f39d8004240 con 0x7f39f006e2d0 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 msgr2=0x7f39f009c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 0x7f39f009c9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39f00a7650 tx=0x7f39d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 msgr2=0x7f39f009c9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f39f006e2d0 0x7f39f009c9f0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39f00a7650 tx=0x7f39d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 89540, 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:27.414 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:27.415 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.416 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:27.418 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.419 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.421 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:27.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:27.425 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.428 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:27.431 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:27.432 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.433 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:27.434 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.435 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.436 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.437 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.437 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:27.437 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 >> v2:172.21.15.135:6800/726754104 conn(0x7f39d003ea80 msgr2=0x7f39d0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 --2- 172.21.15.71:0/3412905969 >> v2:172.21.15.135:6800/726754104 conn(0x7f39d003ea80 0x7f39d0040f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f39e8034000 tx=0x7f39e802f000 comp rx=0 tx=0).stop 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 10 monclient: shutdown 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 msgr2=0x7f39f01ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 --2- 172.21.15.71:0/3412905969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39f00a57d0 0x7f39f01ce1b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39e000e9b0 tx=0x7f39e000ee70 comp rx=0 tx=0).stop 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39ef7fe640 1 -- 172.21.15.71:0/3412905969 reap_dead start 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39e7fff640 1 -- 172.21.15.71:0/3412905969 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 0 0 0) 0x7f39e000f040 con 0x7f39f00a57d0 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39ef7fe640 1 -- 172.21.15.71:0/3412905969 reap_dead start 2024-08-19T11:18:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 shutdown_connections 2024-08-19T11:18:27.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 >> 172.21.15.71:0/3412905969 conn(0x7f39f00aa3f0 msgr2=0x7f39f01bf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 shutdown_connections 2024-08-19T11:18:27.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.394+0000 7f39f5986640 1 -- 172.21.15.71:0/3412905969 wait complete. 2024-08-19T11:18:27.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3957357220}) 2024-08-19T11:18:27.447 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3534528165}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710209098}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3595813581}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3812959729}) 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.448 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4189661996}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3800660083}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224486572}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.399+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1687807933}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2966554241}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.449 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=486270976}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3423146831}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1047818212}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2555515925}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.400+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.450 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3270052347}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1721374645}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=413414241}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.401+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1092447212}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3158793455}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1789820576}) 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.451 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1577503168}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1666554456}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1268787969}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=217976911}) 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.452 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2526021933}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=198896853}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.402+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=695503049}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=562173003}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1473814446}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=597242990}) 2024-08-19T11:18:27.453 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2175945627}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3971705851}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3004660841}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977593198}) 2024-08-19T11:18:27.454 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3056039633}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.403+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2107893040}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4283713842}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1901875535}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597223282}) 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.455 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3899673987}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3465658089}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2748530387}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=49473020}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221887712}) 2024-08-19T11:18:27.456 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.404+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1948950634}) 2024-08-19T11:18:27.458 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:27.458 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:18:27.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:18:27.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=545818322}) 2024-08-19T11:18:27.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4161528511}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4254282554}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3551715632}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1929835706}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1270027377}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1805251194}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107102187}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.406+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3972686710}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=712353289}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=633200208}) 2024-08-19T11:18:27.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012681291}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2157791409}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2876166858}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1033476181}) 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.526 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1259026273}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2916230582}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.407+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1202824710}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3918440337}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=109025974}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.527 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1401278183}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4218637866}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3133716064}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3391065227}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1090170184}) 2024-08-19T11:18:27.528 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=144152932}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.408+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=547573121}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2219988576}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=196692585}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=785226751}) 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.529 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3156081479}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3013143602}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1301466614}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1408765546}) 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.530 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3527064189}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.409+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=327142709}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3928825546}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2305093457}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2467298156}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4279995210}) 2024-08-19T11:18:27.531 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=8594934}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=91005230}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3453577309}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021499257}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.411+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=17914502}) 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.532 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2793911178}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2872648216}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3169322781}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3237274765}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.533 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1007605436}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1142249524}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2322879677}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4011788109}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.412+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1629012117}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1579888406}) 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.534 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=131011709}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=166072224}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=561332884}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4107742286}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.535 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=791465271}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=876998750}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3203704228}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.414+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3049533848}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1480033859}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2852914704}) 2024-08-19T11:18:27.536 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=798290010}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=911881586}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2190992285}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4165193464}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.537 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1558937208}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683620519}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.415+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3976043867}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3429996097}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=289179274}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2903139714}) 2024-08-19T11:18:27.538 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3010923926}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=297181345}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1192753369}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2756777051}) 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.539 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2435214925}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.417+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1366490839}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2721461800}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1823764201}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252280873}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1063328371}) 2024-08-19T11:18:27.540 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1573272266}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1688693397}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1916008022}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421844905}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.418+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1381851847}) 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.419+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.541 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3987631570}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=555744210}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=868395909}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=828917354}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3995312882}) 2024-08-19T11:18:27.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1200654376}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=713767213}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2386332900}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.420+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1274304584}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1836778716}) 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2744434957}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2241654106}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2790526157}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1179658824}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1206983977}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2032969513}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=661062392}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.421+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=814302211}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.422+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.422+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4057061940}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1344008061}) 2024-08-19T11:18:27.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=863329787}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2353709896}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2110260272}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=633553901}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3321914542}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289442351}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.423+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3194380662}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=648363700}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3119056835}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3696667362}) 2024-08-19T11:18:27.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2825522412}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1015248180}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3109028421}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3106239590}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898335563}) 2024-08-19T11:18:27.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.424+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3787291151}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.425+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.425+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.425+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1733366126}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.425+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.425+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.425+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2093162994}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=298347731}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=29741082}) 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1292481699}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=45908604}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3489931282}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199444823}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.426+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4079592730}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=330790144}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=385545937}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3533546220}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3595987037}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2344823316}) 2024-08-19T11:18:27.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=890900414}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2472228047}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361200987}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.427+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=279840051}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2292806332}) 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3931278130}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.428+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4148915225}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1105382249}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2817986385}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1337590267}) 2024-08-19T11:18:27.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1266915409}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2630846985}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.429+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2276627707}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1251139819}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4089179573}) 2024-08-19T11:18:27.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3828862871}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3911011005}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2063264953}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=664118130}) 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=285104783}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581715606}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.430+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=794355285}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.431+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.431+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3375339557}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1477313911}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3087643683}) 2024-08-19T11:18:27.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4028015771}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1597049930}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4028194244}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3202900213}) 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3051048225}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.432+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1461084660}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=744811528}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3991157198}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=440701608}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1582708218}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=660424130}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1566739772}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=819521423}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953156194}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.433+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1167198624}) 2024-08-19T11:18:27.559 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.434+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2415874646}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3936802970}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4190828468}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=880529236}) 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.560 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2225257882}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3755380525}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3485121554}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3678199871}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.435+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=513940301}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1052352796}) 2024-08-19T11:18:27.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1693330376}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=383565399}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3037954986}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2291028154}) 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3427535384}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=750943006}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241241672}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.436+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=181322844}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.437+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.437+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.437+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3271961689}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.437+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2398944726}) 2024-08-19T11:18:27.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2503250210}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3286739678}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2955618912}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=331183058}) 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.564 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3973513491}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4109340518}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.438+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3000353372}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2840724513}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2574961190}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.565 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2490746865}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2285209352}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4243215213}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3683118545}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1803991408}) 2024-08-19T11:18:27.566 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4082775693}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.439+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=986980526}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=107291433}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1756904314}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=510016479}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.567 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4093376129}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1192030635}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1777256662}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.440+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1016694767}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1613810034}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2726325683}) 2024-08-19T11:18:27.568 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1897940328}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1739254892}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3427176061}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=287701790}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.441+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.569 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3464558393}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2753583960}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2815369969}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4250086511}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3420944765}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1248923727}) 2024-08-19T11:18:27.570 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3780625417}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.442+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=56209182}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1703632299}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1297299215}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.571 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=89410448}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1337664069}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1692614873}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.443+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3912551600}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3889998631}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2428593868}) 2024-08-19T11:18:27.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3164082688}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1183896180}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=482084144}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2469500209}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.573 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=584061063}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3890930198}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.444+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=75306772}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=697408337}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=577482389}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3903213191}) 2024-08-19T11:18:27.574 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=410521999}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=237102901}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=938547591}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=163600307}) 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.575 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635375258}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.445+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=737087715}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=52,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1} crc {logm=24132943,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3521807598,mon_config_key=221826564,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3155997262}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=55,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,osd_metadata=3} crc {logm=858084883,mdsmap=4204236774,mgr=1057647138,mgr_metadata=880626121,mgrstat=3717507449,mon_config_key=1054931774,monmap=1080203526,osd_metadata=2729632640}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=51,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=12,mon_config_key=15,monmap=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3349199405,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgrstat=3717507449,mon_config_key=2126067888,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3155997262}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=51,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,osd_metadata=5} crc {logm=352256557,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3717507449,mon_config_key=623018936,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.576 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=52,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=3935946962,mdsmap=4081106307,mgr=357733488,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3542335625,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=57,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3} crc {logm=1354306222,mdsmap=3140514009,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3745275190,mon_config_key=4042291128,monmap=1080203526}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.446+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.447+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=17,monmap=2,osd_metadata=1} crc {logm=2126534980,mdsmap=4204236774,mgr=7801448,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3717507449,mon_config_key=2720761110,monmap=2667667542,osd_metadata=1748737375}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.447+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.447+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,osd_metadata=5} crc {logm=2285092755,mdsmap=4204236774,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2445794010,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.447+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=17,monmap=3} crc {logm=3549271682,mdsmap=13535970,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3717507449,mon_config_key=2720761110,monmap=1080203526}) 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.577 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=1271024555}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=1,osdmap=97} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=3823785925,osdmap=759976473}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=117273687}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=1248595041}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.578 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=1936109688}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=707802130}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=1,osdmap=97} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=2639422064,osdmap=2346358102}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osd_snap=2,osdmap=96} crc {osd_metadata=3193044352,osd_pg_creating=3155997262,osd_snap=421676469,osdmap=2623632056}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3155997262,osd_snap=421676469,osdmap=3017200512}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3548226419}) 2024-08-19T11:18:27.579 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=642908048}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=503796919}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3366096977}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.580 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2690055206}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2720957399}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3156165766}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4093297072}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2760415054}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1043984408}) 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.581 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3867583730}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=1741856899}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=519930022}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2417939758}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=4009484869}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=739737329}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1091020396}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1271895073}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=43} crc {osdmap=322916559}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=41} crc {osdmap=2542040632}) 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=41} crc {osdmap=1574777308}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=46} crc {osdmap=645024115}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=45} crc {osdmap=2277762885}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=44} crc {osdmap=2137704781}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=46} crc {osdmap=1044780054}) 2024-08-19T11:18:27.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:18:27.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=45} crc {osdmap=1499731568}) 2024-08-19T11:18:27.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:18:27.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=42} crc {osdmap=3906229486}) 2024-08-19T11:18:27.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.617+0000 7f4f64258640 10 monclient: get_monmap_and_config 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.617+0000 7f4f64258640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.617+0000 7f4f64258640 10 monclient: monmap: 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:27.618383+0000 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:27.618383+0000 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.619 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.618+0000 7f4f64258640 1 Processor -- start 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.618+0000 7f4f64258640 1 -- start start 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.618+0000 7f4f64258640 10 monclient: init 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.618+0000 7f4f64258640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient: _add_conns ranks=[7,3,6,1,9,4,8,5,0,2,10] 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4f5c0a6950 0x7f4f5c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): picked mon.noname-i con 0x7f4f5c0a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a57c0 0x7f4f5c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): picked mon.noname-g con 0x7f4f5c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 0x7f4f5c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): picked mon.noname-d con 0x7f4f5c139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5c0a5020 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4f5c0a77b0 con 0x7f4f5c139710 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f4f5c0a7d40 con 0x7f4f5c0a6950 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f64258640 10 monclient(hunting): authenticate will time out at 1165.660085s 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 0x7f4f5c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 0x7f4f5c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:34352/0 (socket says 172.21.15.71:34352) 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 -- 172.21.15.71:0/3590350799 learned_addr learned my addr 172.21.15.71:0/3590350799 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): get_auth_request con 0x7f4f5c139710 auth_method 0 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f61ff4640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4f5c0a6950 0x7f4f5c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f617f3640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a57c0 0x7f4f5c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient(hunting): handle_auth_done global_id 26448 payload 274 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 -- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4f5c0a6950 msgr2=0x7f4f5c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4f5c0a6950 0x7f4f5c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 -- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a57c0 msgr2=0x7f4f5c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a57c0 0x7f4f5c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 monclient: found mon.noname-d 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:27.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.619+0000 7f4f627f5640 1 -- 172.21.15.71:0/3590350799 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c0a6380 con 0x7f4f5c139710 2024-08-19T11:18:27.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f627f5640 1 -- 172.21.15.71:0/3590350799 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 msgr2=0x7f4f5c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f627f5640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 0x7f4f5c139b10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009eb0 tx=0x7f4f5402a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=7ab9349dbf77d5cd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 1 -- 172.21.15.71:0/3590350799 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f54036070 con 0x7f4f5c139710 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: dump: 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.631 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 1 -- 172.21.15.71:0/3590350799 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54007a70 con 0x7f4f5c139710 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 5 monclient: authenticate success, global_id 26448 2024-08-19T11:18:27.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 1 -- 172.21.15.71:0/3590350799 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f54007c60 con 0x7f4f5c139710 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 4 set_mon_vals no callback set 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f60ff2640 10 monclient: dump: 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.633 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 10 monclient: shutdown 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 1 -- 172.21.15.71:0/3590350799 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 msgr2=0x7f4f5c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 0x7f4f5c139b10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009eb0 tx=0x7f4f5402a560 comp rx=0 tx=0).stop 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.622+0000 7f4f64258640 1 -- 172.21.15.71:0/3590350799 shutdown_connections 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c139710 0x7f4f5c139b10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a57c0 0x7f4f5c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 --2- 172.21.15.71:0/3590350799 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f4f5c0a6950 0x7f4f5c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 -- 172.21.15.71:0/3590350799 >> 172.21.15.71:0/3590350799 conn(0x7f4f5c0abf50 msgr2=0x7f4f5c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 -- 172.21.15.71:0/3590350799 shutdown_connections 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 -- 172.21.15.71:0/3590350799 wait complete. 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 10 monclient: monmap: 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:27.635 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.623+0000 7f4f64258640 1 Processor -- start 2024-08-19T11:18:27.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 -- start start 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient: init 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient: _add_conns ranks=[6,3,1,0,4,2,8,7,5] 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 0x7f4f5c1ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): picked mon.noname-d con 0x7f4f5c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a6950 0x7f4f5c1cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): picked mon.noname-g con 0x7f4f5c0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c139710 0x7f4f5c125090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): picked mon.noname-f con 0x7f4f5c139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c0a84c0 con 0x7f4f5c139710 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5c0a3650 con 0x7f4f5c0a6950 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4f5c0a8700 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f64258640 10 monclient(hunting): authenticate will time out at 1165.665468s 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 0x7f4f5c1ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 0x7f4f5c1ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:34360/0 (socket says 172.21.15.71:34360) 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 -- 172.21.15.71:0/4257070069 learned_addr learned my addr 172.21.15.71:0/4257070069 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): get_auth_request con 0x7f4f5c0a57c0 auth_method 0 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f627f5640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c139710 0x7f4f5c125090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f617f3640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a6950 0x7f4f5c1cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f627f5640 10 monclient(hunting): get_auth_request con 0x7f4f5c139710 auth_method 0 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f627f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f627f5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f627f5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f617f3640 10 monclient(hunting): get_auth_request con 0x7f4f5c0a6950 auth_method 0 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f617f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f617f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f617f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient(hunting): handle_auth_done global_id 26457 payload 824 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a6950 msgr2=0x7f4f5c1cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f5c0a6950 0x7f4f5c1cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c139710 msgr2=0x7f4f5c125090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f5c139710 0x7f4f5c125090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 monclient: found mon.noname-d 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.624+0000 7f4f61ff4640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c1383c0 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f61ff4640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 msgr2=0x7f4f5c1ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f61ff4640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 0x7f4f5c1ced20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c7f0 tx=0x7f4f5800ccb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f58015070 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: dump: 2024-08-19T11:18:27.640 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f58007ca0 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 5 monclient: authenticate success, global_id 26457 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f58007e50 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 10 monclient: _renew_subs 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c126aa0 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f53fff640 4 set_mon_vals no callback set 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f527fc640 10 monclient: dump: 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 10 monclient: _renew_subs 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c128560 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 0x7f4f5c1259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.627+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4f5c06a590 con 0x7f4f5c1255d0 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 0x7f4f5c1259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient: get_auth_request con 0x7f4f5c1255d0 auth_method 0 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f4f58007830 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 10 monclient(hunting): handle_auth_done global_id 26466 payload 824 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f617f3640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f5c0a1f60 con 0x7f4f5c1255d0 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f527fc640 1 --2- 172.21.15.71:0/4257070069 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f4003ec20 0x7f4f400410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (secure 0 0 0) 0x7f4f580515c0 con 0x7f4f5c0a57c0 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f627f5640 1 --2- 172.21.15.71:0/4257070069 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f4003ec20 0x7f4f400410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.628+0000 7f4f627f5640 10 monclient: get_auth_request con 0x7f4f4003ec20 auth_method 0 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f617f3640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 msgr2=0x7f4f5c1259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f617f3640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 0x7f4f5c1259b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c127110 tx=0x7f4f4c00ec00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f4c019020 con 0x7f4f5c1255d0 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 10 monclient: dump: 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.648 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4f4c00aba0 con 0x7f4f5c1255d0 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 msgr2=0x7f4f5c1259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 0x7f4f5c1259b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c127110 tx=0x7f4f4c00ec00 comp rx=0 tx=0).stop 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 msgr2=0x7f4f5c1259b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.630+0000 7f4f527fc640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c1255d0 0x7f4f5c1259b0 secure :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c127110 tx=0x7f4f4c00ec00 comp rx=0 tx=0).stop 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.631+0000 7f4f627f5640 1 --2- 172.21.15.71:0/4257070069 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f4003ec20 0x7f4f400410e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009e80 tx=0x7f4f54009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.636+0000 7f4f64258640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.636+0000 7f4f64258640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 0x7f4f5c09fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.636+0000 7f4f64258640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.636+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f4f5c076c60 con 0x7f4f5c125ef0 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 0x7f4f5c09fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient: get_auth_request con 0x7f4f5c125ef0 auth_method 0 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 10 monclient(hunting): handle_auth_done global_id 26475 payload 824 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.637+0000 7f4f617f3640 1 -- 172.21.15.71:0/4257070069 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f5c0a6d30 con 0x7f4f5c125ef0 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f617f3640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 msgr2=0x7f4f5c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f617f3640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 0x7f4f5c09fa10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c01a000 tx=0x7f4f4c0046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f4f4c027070 con 0x7f4f5c125ef0 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 10 monclient: dump: 2024-08-19T11:18:27.651 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.652 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f4f4c020280 con 0x7f4f5c125ef0 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 msgr2=0x7f4f5c09fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 0x7f4f5c09fa10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c01a000 tx=0x7f4f4c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 msgr2=0x7f4f5c09fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.639+0000 7f4f527fc640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c125ef0 0x7f4f5c09fa10 secure :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c01a000 tx=0x7f4f4c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 415253, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:27.677 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f4003ec20 msgr2=0x7f4f400410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 --2- 172.21.15.71:0/4257070069 >> v2:172.21.15.135:6800/726754104 conn(0x7f4f4003ec20 0x7f4f400410e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009e80 tx=0x7f4f54009000 comp rx=0 tx=0).stop 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 10 monclient: shutdown 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 msgr2=0x7f4f5c1ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 --2- 172.21.15.71:0/4257070069 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f4f5c0a57c0 0x7f4f5c1ced20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c7f0 tx=0x7f4f5800ccb0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f627f5640 1 -- 172.21.15.71:0/4257070069 reap_dead start 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f627f5640 1 -- 172.21.15.71:0/4257070069 reap_dead start 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 shutdown_connections 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 >> 172.21.15.71:0/4257070069 conn(0x7f4f5c0abf50 msgr2=0x7f4f5c138f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 shutdown_connections 2024-08-19T11:18:27.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.640+0000 7f4f64258640 1 -- 172.21.15.71:0/4257070069 wait complete. 2024-08-19T11:18:27.680 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:27.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:18:27.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:18:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.817+0000 7f68bb260640 10 monclient: get_monmap_and_config 2024-08-19T11:18:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.817+0000 7f68bb260640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.817+0000 7f68bb260640 10 monclient: monmap: 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:27.818062+0000 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:27.818062+0000 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.819 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:27.820 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:27.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 Processor -- start 2024-08-19T11:18:27.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 -- start start 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient: init 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient: _add_conns ranks=[0,7,9,4,8,10,5,2,1,6,3] 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f68b40a3450 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 0x7f68b406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): picked mon.noname-i con 0x7f68b40a3f40 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68b4142f10 0x7f68b4145300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): picked mon.noname-a con 0x7f68b4142f10 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b40a44d0 con 0x7f68b40a3450 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f68b40a6280 con 0x7f68b4142f10 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f68b4074db0 con 0x7f68b40a3f40 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68bb260640 10 monclient(hunting): authenticate will time out at 1165.859796s 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b8ffc640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f68b40a3450 0x7f68b40a3830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43966/0 (socket says 172.21.15.71:43966) 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b8ffc640 1 -- 172.21.15.71:0/2476850073 learned_addr learned my addr 172.21.15.71:0/2476850073 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b97fd640 1 --2- 172.21.15.71:0/2476850073 >> v2:172.21.15.71:3300/0 conn(0x7f68b4142f10 0x7f68b4145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b97fd640 10 monclient(hunting): get_auth_request con 0x7f68b4142f10 auth_method 0 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b97fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b97fd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.818+0000 7f68b97fd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 1 --2- 172.21.15.71:0/2476850073 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 0x7f68b406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): get_auth_request con 0x7f68b40a3f40 auth_method 0 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient(hunting): handle_auth_done global_id 84490 payload 274 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 1 -- 172.21.15.71:0/2476850073 >> v2:172.21.15.71:3300/0 conn(0x7f68b4142f10 msgr2=0x7f68b4145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 1 --2- 172.21.15.71:0/2476850073 >> v2:172.21.15.71:3300/0 conn(0x7f68b4142f10 0x7f68b4145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 1 -- 172.21.15.71:0/2476850073 >> v1:172.21.15.71:6789/0 conn(0x7f68b40a3450 legacy=0x7f68b40a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 1 monclient: found mon.noname-i 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:18:27.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.819+0000 7f68b3fff640 1 -- 172.21.15.71:0/2476850073 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b40a54c0 con 0x7f68b40a3f40 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b3fff640 1 -- 172.21.15.71:0/2476850073 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 msgr2=0x7f68b406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b3fff640 1 --2- 172.21.15.71:0/2476850073 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 0x7f68b406f910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68a00097d0 tx=0x7f68a002a000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=86beb7800b09e0c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 1 -- 172.21.15.71:0/2476850073 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68a0037070 con 0x7f68b40a3f40 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: dump: 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.831 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68bb260640 5 monclient: authenticate success, global_id 84490 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 1 -- 172.21.15.71:0/2476850073 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a002ad20 con 0x7f68b40a3f40 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68bb260640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68bb260640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 1 -- 172.21.15.71:0/2476850073 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68a0030c20 con 0x7f68b40a3f40 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68bb260640 4 set_mon_vals no callback set 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.822+0000 7f68b37fe640 10 monclient: dump: 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.833 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.834 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 10 monclient: shutdown 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 -- 172.21.15.71:0/2476850073 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 msgr2=0x7f68b406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 --2- 172.21.15.71:0/2476850073 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 0x7f68b406f910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68a00097d0 tx=0x7f68a002a000 comp rx=0 tx=0).stop 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 -- 172.21.15.71:0/2476850073 shutdown_connections 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 --2- 172.21.15.71:0/2476850073 >> v2:172.21.15.71:3300/0 conn(0x7f68b4142f10 0x7f68b4145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 --2- 172.21.15.71:0/2476850073 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f68b40a3f40 0x7f68b406f910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 -- 172.21.15.71:0/2476850073 >> 172.21.15.71:0/2476850073 conn(0x7f68b40a8e70 msgr2=0x7f68b40a9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 -- 172.21.15.71:0/2476850073 shutdown_connections 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 1 -- 172.21.15.71:0/2476850073 wait complete. 2024-08-19T11:18:27.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.823+0000 7f68bb260640 10 monclient: monmap: 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.836 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 Processor -- start 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 -- start start 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient: init 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient: _add_conns ranks=[8,6,4,7,5,1,2,3,0] 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b40a3450 0x7f68b409c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): picked mon.noname-e con 0x7f68b40a3450 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f68b40a3f40 0x7f68b409cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): picked mon.noname-d con 0x7f68b40a3f40 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 0x7f68b409d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): picked mon.noname-c con 0x7f68b4142f10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f68b4145840 con 0x7f68b4142f10 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f68b40a4e90 con 0x7f68b40a3f40 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f68b41459c0 con 0x7f68b40a3450 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68bb260640 10 monclient(hunting): authenticate will time out at 1165.865849s 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b40a3450 0x7f68b409c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f68b40a3f40 0x7f68b409cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b97fd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 0x7f68b409d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b40a3450 0x7f68b409c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48186/0 (socket says 172.21.15.71:48186) 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 1 -- 172.21.15.71:0/2744565614 learned_addr learned my addr 172.21.15.71:0/2744565614 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 10 monclient(hunting): get_auth_request con 0x7f68b40a3450 auth_method 0 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b8ffc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b97fd640 10 monclient(hunting): get_auth_request con 0x7f68b4142f10 auth_method 0 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b97fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b97fd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b97fd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b3fff640 10 monclient(hunting): get_auth_request con 0x7f68b40a3f40 auth_method 0 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.824+0000 7f68b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 10 monclient(hunting): handle_auth_done global_id 84541 payload 824 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b40a3450 msgr2=0x7f68b409c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b40a3450 0x7f68b409c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f68b40a3f40 msgr2=0x7f68b409cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f68b40a3f40 0x7f68b409cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 1 monclient: found mon.noname-c 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b97fd640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b409f120 con 0x7f68b4142f10 2024-08-19T11:18:27.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.825+0000 7f68b3fff640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f68b40a3f40 0x7f68b409cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b97fd640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 msgr2=0x7f68b409d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b97fd640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 0x7f68b409d470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68ac007cc0 tx=0x7f68ac00e4b0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68ac014890 con 0x7f68b4142f10 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: dump: 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.846 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: _finish_auth 0 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: _check_auth_tickets 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac014a50 con 0x7f68b4142f10 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 5 monclient: authenticate success, global_id 84541 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 10 monclient: _renew_subs 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b409f400 con 0x7f68b4142f10 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68ac014c00 con 0x7f68b4142f10 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b17fa640 10 monclient: dump: 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.848 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.849 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68b2ffd640 4 set_mon_vals no callback set 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 10 monclient: _renew_subs 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.827+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b409dc00 con 0x7f68b4142f10 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f68ac01b030 con 0x7f68b4142f10 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68bb260640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68bb260640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 0x7f68b41d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f68b4076c60 con 0x7f68b41d28d0 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b17fa640 1 --2- 172.21.15.71:0/2744565614 >> v2:172.21.15.135:6800/726754104 conn(0x7f689803ea80 0x7f6898040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 0x7f68b41d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient: get_auth_request con 0x7f68b41d28d0 auth_method 0 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (secure 0 0 0) 0x7f68ac019020 con 0x7f68b4142f10 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.828+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.829+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_done global_id 94193 payload 824 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.829+0000 7f68b8ffc640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68b406f910 con 0x7f68b41d28d0 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.829+0000 7f68b3fff640 1 --2- 172.21.15.71:0/2744565614 >> v2:172.21.15.135:6800/726754104 conn(0x7f689803ea80 0x7f6898040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.829+0000 7f68b3fff640 10 monclient: get_auth_request con 0x7f689803ea80 auth_method 0 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b8ffc640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 msgr2=0x7f68b41d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b8ffc640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 0x7f68b41d2cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68a800eaa0 tx=0x7f68a800ef60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68a800cc80 con 0x7f68b41d28d0 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 10 monclient: dump: 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.852 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b3fff640 1 --2- 172.21.15.71:0/2744565614 >> v2:172.21.15.135:6800/726754104 conn(0x7f689803ea80 0x7f6898040f40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f68a0031000 tx=0x7f68a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f68a8019070 con 0x7f68b41d28d0 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 msgr2=0x7f68b41d2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 0x7f68b41d2cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68a800eaa0 tx=0x7f68a800ef60 comp rx=0 tx=0).stop 2024-08-19T11:18:27.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 msgr2=0x7f68b41d2cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.831+0000 7f68b17fa640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d28d0 0x7f68b41d2cb0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68a800eaa0 tx=0x7f68a800ef60 comp rx=0 tx=0).stop 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68bb260640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68bb260640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 0x7f68b4140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68bb260640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f68b40a2240 con 0x7f68b41d31f0 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 0x7f68b4140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient: get_auth_request con 0x7f68b41d31f0 auth_method 0 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.837+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.838+0000 7f68b8ffc640 10 monclient(hunting): handle_auth_done global_id 94202 payload 824 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.838+0000 7f68b8ffc640 1 -- 172.21.15.71:0/2744565614 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68b406ca70 con 0x7f68b41d31f0 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b8ffc640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 msgr2=0x7f68b4140100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b8ffc640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 0x7f68b4140100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f68a80070c0 tx=0x7f68a8004940 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f68a8024070 con 0x7f68b41d31f0 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 10 monclient: dump: 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:27.856 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f68a8014480 con 0x7f68b41d31f0 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 msgr2=0x7f68b4140100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 0x7f68b4140100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f68a80070c0 tx=0x7f68a8004940 comp rx=0 tx=0).stop 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 msgr2=0x7f68b4140100 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.840+0000 7f68b17fa640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f68b41d31f0 0x7f68b4140100 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f68a80070c0 tx=0x7f68a8004940 comp rx=0 tx=0).stop 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:27.857 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 19537, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:27.858 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.859 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.860 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.861 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:27.862 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.863 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:27.866 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.870 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.874 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.876 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:27.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:27.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.880 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:27.881 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 >> v2:172.21.15.135:6800/726754104 conn(0x7f689803ea80 msgr2=0x7f6898040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 --2- 172.21.15.71:0/2744565614 >> v2:172.21.15.135:6800/726754104 conn(0x7f689803ea80 0x7f6898040f40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f68a0031000 tx=0x7f68a002e000 comp rx=0 tx=0).stop 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 10 monclient: shutdown 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68b97fd640 1 -- 172.21.15.71:0/2744565614 reap_dead start 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 msgr2=0x7f68b409d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 0x7f68b409d470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68ac007cc0 tx=0x7f68ac00e4b0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 shutdown_connections 2024-08-19T11:18:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 --2- 172.21.15.71:0/2744565614 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f68b4142f10 0x7f68b409d470 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 >> 172.21.15.71:0/2744565614 conn(0x7f68b40a8e70 msgr2=0x7f68b4143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 shutdown_connections 2024-08-19T11:18:27.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.841+0000 7f68bb260640 1 -- 172.21.15.71:0/2744565614 wait complete. 2024-08-19T11:18:27.884 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:27.884 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:18:27.884 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:18:27.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.990+0000 7f0b79331640 10 monclient: get_monmap_and_config 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.990+0000 7f0b79331640 10 monclient: build_initial_monmap 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.990+0000 7f0b79331640 10 monclient: monmap: 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:27.990794+0000 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:27.990794+0000 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:27.991 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:27.992 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.990+0000 7f0b79331640 1 Processor -- start 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.990+0000 7f0b79331640 1 -- start start 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.990+0000 7f0b79331640 10 monclient: init 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient: _add_conns ranks=[3,5,10,1,7,2,9,0,6,4,8] 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 0x7f0b740a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): picked mon.noname-g con 0x7f0b740a58d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b740723d0 0x7f0b740a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): picked mon.noname-h con 0x7f0b740723d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b74137760 0x7f0b74137c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): picked mon.noname-f con 0x7f0b74137760 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0b740a6730 con 0x7f0b74137760 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0b74072190 con 0x7f0b740a58d0 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0b74073eb0 con 0x7f0b740723d0 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b79331640 10 monclient(hunting): authenticate will time out at 1166.032301s 2024-08-19T11:18:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b74137760 0x7f0b74137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 0x7f0b740a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b740723d0 0x7f0b740a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 0x7f0b740a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:42798/0 (socket says 172.21.15.71:42798) 2024-08-19T11:18:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 1 -- 172.21.15.71:0/3765675519 learned_addr learned my addr 172.21.15.71:0/3765675519 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): get_auth_request con 0x7f0b740a58d0 auth_method 0 2024-08-19T11:18:28.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): get_auth_request con 0x7f0b74137760 auth_method 0 2024-08-19T11:18:28.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): get_auth_request con 0x7f0b740723d0 auth_method 0 2024-08-19T11:18:28.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient(hunting): handle_auth_done global_id 84556 payload 274 2024-08-19T11:18:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 -- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b740723d0 msgr2=0x7f0b740a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b740723d0 0x7f0b740a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 -- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 msgr2=0x7f0b740a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 0x7f0b740a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 monclient: found mon.noname-f 2024-08-19T11:18:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:18:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b737fe640 1 -- 172.21.15.71:0/3765675519 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b74074190 con 0x7f0b74137760 2024-08-19T11:18:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.991+0000 7f0b72ffd640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 0x7f0b740a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.994+0000 7f0b737fe640 1 -- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74137760 msgr2=0x7f0b74137c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.994+0000 7f0b737fe640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74137760 0x7f0b74137c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009dc0 tx=0x7f0b6c02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2a55d2242b080f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 1 -- 172.21.15.71:0/3765675519 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b6c007bc0 con 0x7f0b74137760 2024-08-19T11:18:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:18:28.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: dump: 2024-08-19T11:18:28.006 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.006 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.006 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.006 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.007 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.008 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.008 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.008 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.008 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.008 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.008 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 1 -- 172.21.15.71:0/3765675519 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6c007d80 con 0x7f0b74137760 2024-08-19T11:18:28.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 5 monclient: authenticate success, global_id 84556 2024-08-19T11:18:28.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:28.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:28.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 1 -- 172.21.15.71:0/3765675519 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b6c031870 con 0x7f0b74137760 2024-08-19T11:18:28.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 4 set_mon_vals no callback set 2024-08-19T11:18:28.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:28.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b727fc640 10 monclient: dump: 2024-08-19T11:18:28.013 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.013 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.014 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.014 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.014 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.014 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.014 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.015 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.015 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.015 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.015 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.015 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.015 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.016 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 10 monclient: shutdown 2024-08-19T11:18:28.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 -- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74137760 msgr2=0x7f0b74137c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74137760 0x7f0b74137c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009dc0 tx=0x7f0b6c02a560 comp rx=0 tx=0).stop 2024-08-19T11:18:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 -- 172.21.15.71:0/3765675519 shutdown_connections 2024-08-19T11:18:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74137760 0x7f0b74137c10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0b740723d0 0x7f0b740a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 --2- 172.21.15.71:0/3765675519 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b740a58d0 0x7f0b740a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 -- 172.21.15.71:0/3765675519 >> 172.21.15.71:0/3765675519 conn(0x7f0b740aa4f0 msgr2=0x7f0b740a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 -- 172.21.15.71:0/3765675519 shutdown_connections 2024-08-19T11:18:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.995+0000 7f0b79331640 1 -- 172.21.15.71:0/3765675519 wait complete. 2024-08-19T11:18:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.996+0000 7f0b79331640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.996+0000 7f0b79331640 10 monclient: monmap: 2024-08-19T11:18:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.019 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.020 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.021 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.021 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.021 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.021 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.996+0000 7f0b79331640 1 Processor -- start 2024-08-19T11:18:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.996+0000 7f0b79331640 1 -- start start 2024-08-19T11:18:28.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.996+0000 7f0b79331640 10 monclient: init 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient: _add_conns ranks=[0,7,8,2,3,4,1,5,6] 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 0x7f0b741cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): picked mon.noname-a con 0x7f0b740723d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b740a58d0 0x7f0b74136850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): picked mon.noname-i con 0x7f0b740a58d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0b74137760 0x7f0b74136d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): picked mon.noname-e con 0x7f0b74137760 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:28.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74073bd0 con 0x7f0b740723d0 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0b740a7430 con 0x7f0b740a58d0 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0b740745b0 con 0x7f0b74137760 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b79331640 10 monclient(hunting): authenticate will time out at 1166.038359s 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 0x7f0b741cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0b74137760 0x7f0b74136d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 0x7f0b741cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47334/0 (socket says 172.21.15.71:47334) 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 -- 172.21.15.71:0/2980335652 learned_addr learned my addr 172.21.15.71:0/2980335652 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): get_auth_request con 0x7f0b74137760 auth_method 0 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): get_auth_request con 0x7f0b740723d0 auth_method 0 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b740a58d0 0x7f0b74136850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): get_auth_request con 0x7f0b740a58d0 auth_method 0 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient(hunting): handle_auth_done global_id 74943 payload 824 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0b74137760 msgr2=0x7f0b74136d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0b74137760 0x7f0b74136d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b740a58d0 msgr2=0x7f0b74136850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0b740a58d0 0x7f0b74136850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 monclient: found mon.noname-a 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b72ffd640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b74121eb0 con 0x7f0b740723d0 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.997+0000 7f0b737fe640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0b74137760 0x7f0b74136d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:27.999+0000 7f0b72ffd640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 msgr2=0x7f0b741cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b72ffd640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 0x7f0b741cc0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ea30 tx=0x7f0b6400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b64017070 con 0x7f0b740723d0 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: dump: 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.040 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.041 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.042 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 5 monclient: authenticate success, global_id 74943 2024-08-19T11:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6400cc70 con 0x7f0b740723d0 2024-08-19T11:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b6400ce20 con 0x7f0b740723d0 2024-08-19T11:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b6bfff640 10 monclient: dump: 2024-08-19T11:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.044 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.045 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.046 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.047 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b71ffb640 4 set_mon_vals no callback set 2024-08-19T11:18:28.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 10 monclient: _renew_subs 2024-08-19T11:18:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b74138280 con 0x7f0b740723d0 2024-08-19T11:18:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 10 monclient: _renew_subs 2024-08-19T11:18:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.000+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b74123970 con 0x7f0b740723d0 2024-08-19T11:18:28.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b79331640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b79331640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 0x7f0b74120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7406a590 con 0x7f0b74120550 2024-08-19T11:18:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0b6401a070 con 0x7f0b740723d0 2024-08-19T11:18:28.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 0x7f0b74120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient: get_auth_request con 0x7f0b74120550 auth_method 0 2024-08-19T11:18:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6bfff640 1 --2- 172.21.15.71:0/2980335652 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b5403ea80 0x7f0b54040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7f0b6400f040 con 0x7f0b740723d0 2024-08-19T11:18:28.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_done global_id 84565 payload 824 2024-08-19T11:18:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b6a7fc640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b740a3050 con 0x7f0b74120550 2024-08-19T11:18:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b737fe640 1 --2- 172.21.15.71:0/2980335652 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b5403ea80 0x7f0b54040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.001+0000 7f0b737fe640 10 monclient: get_auth_request con 0x7f0b5403ea80 auth_method 0 2024-08-19T11:18:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.003+0000 7f0b6a7fc640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 msgr2=0x7f0b74120930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.003+0000 7f0b6a7fc640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 0x7f0b74120930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b74122520 tx=0x7f0b5c011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b5c019070 con 0x7f0b74120550 2024-08-19T11:18:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 10 monclient: dump: 2024-08-19T11:18:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.053 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.054 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.055 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.056 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b737fe640 1 --2- 172.21.15.71:0/2980335652 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b5403ea80 0x7f0b54040f40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0b740735a0 tx=0x7f0b6c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0b5c00f800 con 0x7f0b74120550 2024-08-19T11:18:28.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:28.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 msgr2=0x7f0b74120930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 0x7f0b74120930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b74122520 tx=0x7f0b5c011d60 comp rx=0 tx=0).stop 2024-08-19T11:18:28.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 msgr2=0x7f0b74120930 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.004+0000 7f0b6bfff640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120550 0x7f0b74120930 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0b74122520 tx=0x7f0b5c011d60 comp rx=0 tx=0).stop 2024-08-19T11:18:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b79331640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b79331640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 0x7f0b740a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b79331640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74076c60 con 0x7f0b74120e70 2024-08-19T11:18:28.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 0x7f0b740a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient: get_auth_request con 0x7f0b74120e70 auth_method 0 2024-08-19T11:18:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.010+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.011+0000 7f0b6a7fc640 10 monclient(hunting): handle_auth_done global_id 84574 payload 824 2024-08-19T11:18:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.011+0000 7f0b6a7fc640 1 -- 172.21.15.71:0/2980335652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0b74123de0 con 0x7f0b74120e70 2024-08-19T11:18:28.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.013+0000 7f0b6a7fc640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 msgr2=0x7f0b740a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.013+0000 7f0b6a7fc640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 0x7f0b740a7d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c01b000 tx=0x7f0b5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.013+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0b5c019040 con 0x7f0b74120e70 2024-08-19T11:18:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.013+0000 7f0b6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.013+0000 7f0b6bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.013+0000 7f0b6bfff640 10 monclient: dump: 2024-08-19T11:18:28.061 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.062 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.063 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.064 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7f0b5c003e50 con 0x7f0b74120e70 2024-08-19T11:18:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 msgr2=0x7f0b740a7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 0x7f0b740a7d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c01b000 tx=0x7f0b5c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 msgr2=0x7f0b740a7d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b6bfff640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74120e70 0x7f0b740a7d80 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c01b000 tx=0x7f0b5c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.066 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:28.066 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:28.066 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 90174, 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:28.067 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.068 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:28.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:28.071 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.072 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.075 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:28.077 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.078 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:28.079 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.082 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:28.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:28.094 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b5403ea80 msgr2=0x7f0b54040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 --2- 172.21.15.71:0/2980335652 >> v2:172.21.15.135:6800/726754104 conn(0x7f0b5403ea80 0x7f0b54040f40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0b740735a0 tx=0x7f0b6c02f000 comp rx=0 tx=0).stop 2024-08-19T11:18:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 10 monclient: shutdown 2024-08-19T11:18:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 msgr2=0x7f0b741cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 0x7f0b741cc0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ea30 tx=0x7f0b6400eef0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b737fe640 1 -- 172.21.15.71:0/2980335652 reap_dead start 2024-08-19T11:18:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 shutdown_connections 2024-08-19T11:18:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 --2- 172.21.15.71:0/2980335652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b740723d0 0x7f0b741cc0a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 >> 172.21.15.71:0/2980335652 conn(0x7f0b740aa4f0 msgr2=0x7f0b740685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 shutdown_connections 2024-08-19T11:18:28.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.014+0000 7f0b79331640 1 -- 172.21.15.71:0/2980335652 wait complete. 2024-08-19T11:18:28.097 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:28.097 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:18:28.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:18:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.194+0000 7fd42ae91640 10 monclient: get_monmap_and_config 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.194+0000 7fd42ae91640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.194+0000 7fd42ae91640 10 monclient: monmap: 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:28.195513+0000 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:28.195513+0000 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:28.197 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.195+0000 7fd42ae91640 1 Processor -- start 2024-08-19T11:18:28.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.195+0000 7fd42ae91640 1 -- start start 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.195+0000 7fd42ae91640 10 monclient: init 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient: _add_conns ranks=[1,4,3,5,10,7,2,8,0,9,6] 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd4240a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 0x7fd42413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): picked mon.noname-c con 0x7fd4240a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4240a7440 0x7fd4241410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): picked mon.noname-g con 0x7fd4240a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4240a6380 con 0x7fd4240a6950 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd4240a5020 con 0x7fd4240a7440 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd4240a7d40 con 0x7fd4240a57c0 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42ae91640 10 monclient(hunting): authenticate will time out at 1166.237376s 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 0x7fd42413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 0x7fd42413eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46022/0 (socket says 172.21.15.71:46022) 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 -- 172.21.15.71:0/934149402 learned_addr learned my addr 172.21.15.71:0/934149402 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): get_auth_request con 0x7fd4240a57c0 auth_method 0 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 1 --2- 172.21.15.71:0/934149402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4240a7440 0x7fd4241410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): get_auth_request con 0x7fd4240a7440 auth_method 0 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd42942e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient(hunting): handle_auth_done global_id 84550 payload 274 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 -- 172.21.15.71:0/934149402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4240a7440 msgr2=0x7fd4241410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 --2- 172.21.15.71:0/934149402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4240a7440 0x7fd4241410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 -- 172.21.15.71:0/934149402 >> v1:172.21.15.135:6789/0 conn(0x7fd4240a6950 legacy=0x7fd4240a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 monclient: found mon.noname-c 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.196+0000 7fd423fff640 1 -- 172.21.15.71:0/934149402 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4240a3650 con 0x7fd4240a57c0 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd423fff640 1 -- 172.21.15.71:0/934149402 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 msgr2=0x7fd42413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd423fff640 1 --2- 172.21.15.71:0/934149402 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 0x7fd42413eb60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4180098d0 tx=0x7fd41802a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=39377b2cee125fff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 1 -- 172.21.15.71:0/934149402 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd418037070 con 0x7fd4240a57c0 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: dump: 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 1 -- 172.21.15.71:0/934149402 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41802adc0 con 0x7fd4240a57c0 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd42ae91640 5 monclient: authenticate success, global_id 84550 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd42ae91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd42ae91640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 1 -- 172.21.15.71:0/934149402 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd418030c20 con 0x7fd4240a57c0 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd42ae91640 4 set_mon_vals no callback set 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.199+0000 7fd4237fe640 10 monclient: dump: 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.214 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 10 monclient: shutdown 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 -- 172.21.15.71:0/934149402 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 msgr2=0x7fd42413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 --2- 172.21.15.71:0/934149402 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 0x7fd42413eb60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4180098d0 tx=0x7fd41802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 -- 172.21.15.71:0/934149402 shutdown_connections 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 --2- 172.21.15.71:0/934149402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4240a7440 0x7fd4241410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 --2- 172.21.15.71:0/934149402 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd4240a57c0 0x7fd42413eb60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 -- 172.21.15.71:0/934149402 >> 172.21.15.71:0/934149402 conn(0x7fd4240abf50 msgr2=0x7fd4240ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 -- 172.21.15.71:0/934149402 shutdown_connections 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 1 -- 172.21.15.71:0/934149402 wait complete. 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.200+0000 7fd42ae91640 10 monclient: monmap: 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.215 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.216 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 Processor -- start 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 -- start start 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient: init 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient: _add_conns ranks=[0,1,6,7,8,3,2,4,5] 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 0x7fd424126c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): picked mon.noname-a con 0x7fd4240a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4240a6950 0x7fd424128d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): picked mon.noname-f con 0x7fd4240a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd4240a7440 0x7fd42413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): picked mon.noname-d con 0x7fd4240a7440 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240a8700 con 0x7fd4240a57c0 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240a84c0 con 0x7fd4240a6950 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd4241415f0 con 0x7fd4240a7440 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42ae91640 10 monclient(hunting): authenticate will time out at 1166.242816s 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd428c2d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 0x7fd424126c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd4240a7440 0x7fd42413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd4240a7440 0x7fd42413fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:34388/0 (socket says 172.21.15.71:34388) 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd428c2d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 0x7fd424126c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47336/0 (socket says 172.21.15.71:47336) 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 1 -- 172.21.15.71:0/1213004152 learned_addr learned my addr 172.21.15.71:0/1213004152 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 10 monclient(hunting): get_auth_request con 0x7fd4240a7440 auth_method 0 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd42942e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd428c2d640 10 monclient(hunting): get_auth_request con 0x7fd4240a57c0 auth_method 0 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd428c2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd428c2d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.201+0000 7fd428c2d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4240a6950 0x7fd424128d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): get_auth_request con 0x7fd4240a6950 auth_method 0 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd42942e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd42942e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd42942e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 10 monclient(hunting): handle_auth_done global_id 74952 payload 824 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd4240a7440 msgr2=0x7fd42413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd4240a7440 0x7fd42413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4240a6950 msgr2=0x7fd424128d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4240a6950 0x7fd424128d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 1 monclient: found mon.noname-a 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd428c2d640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4240a9530 con 0x7fd4240a57c0 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.202+0000 7fd42942e640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd4240a7440 0x7fd42413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd428c2d640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 msgr2=0x7fd424126c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd428c2d640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 0x7fd424126c30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c7b0 tx=0x7fd41400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd414016020 con 0x7fd4240a57c0 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: dump: 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.221 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.222 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 5 monclient: authenticate success, global_id 74952 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd414012420 con 0x7fd4240a57c0 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd41400ce60 con 0x7fd4240a57c0 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd422ffd640 4 set_mon_vals no callback set 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd4217fa640 10 monclient: dump: 2024-08-19T11:18:28.223 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.224 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 10 monclient: _renew_subs 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd424140850 con 0x7fd4240a57c0 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 10 monclient: _renew_subs 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.204+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42412a260 con 0x7fd4240a57c0 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd42ae91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd42ae91640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 0x7fd4241ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd424076c60 con 0x7fd4241400f0 2024-08-19T11:18:28.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd414019020 con 0x7fd4240a57c0 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 0x7fd4241ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient: get_auth_request con 0x7fd4241400f0 auth_method 0 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.205+0000 7fd4217fa640 1 --2- 172.21.15.71:0/1213004152 >> v2:172.21.15.135:6800/726754104 conn(0x7fd41003ea80 0x7fd410040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.206+0000 7fd423fff640 10 monclient(hunting): handle_auth_done global_id 45408 payload 824 2024-08-19T11:18:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.206+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7fd414051b00 con 0x7fd4240a57c0 2024-08-19T11:18:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.206+0000 7fd423fff640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd424140d30 con 0x7fd4241400f0 2024-08-19T11:18:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.206+0000 7fd42942e640 1 --2- 172.21.15.71:0/1213004152 >> v2:172.21.15.135:6800/726754104 conn(0x7fd41003ea80 0x7fd410040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.206+0000 7fd42942e640 10 monclient: get_auth_request con 0x7fd41003ea80 auth_method 0 2024-08-19T11:18:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd423fff640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 msgr2=0x7fd4241ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd423fff640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 0x7fd4241ce570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd418034000 tx=0x7fd4180046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd418037040 con 0x7fd4241400f0 2024-08-19T11:18:28.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd42942e640 1 --2- 172.21.15.71:0/1213004152 >> v2:172.21.15.135:6800/726754104 conn(0x7fd41003ea80 0x7fd410040f40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009f90 tx=0x7fd41c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 10 monclient: dump: 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.231 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd418003a30 con 0x7fd4241400f0 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 msgr2=0x7fd4241ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 0x7fd4241ce570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd418034000 tx=0x7fd4180046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 msgr2=0x7fd4241ce570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.208+0000 7fd4217fa640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241400f0 0x7fd4241ce570 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd42ae91640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd42ae91640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 0x7fd4241ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd42ae91640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd4241cf400 con 0x7fd4241ceab0 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 0x7fd4241ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient: get_auth_request con 0x7fd4241ceab0 auth_method 0 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 10 monclient(hunting): handle_auth_done global_id 45417 payload 824 2024-08-19T11:18:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.215+0000 7fd423fff640 1 -- 172.21.15.71:0/1213004152 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd424129e30 con 0x7fd4241ceab0 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd423fff640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 msgr2=0x7fd4241ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd423fff640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 0x7fd4241ceec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097c0 tx=0x7fd418009240 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd418048cc0 con 0x7fd4241ceab0 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 10 monclient: dump: 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.234 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7fd41804c070 con 0x7fd4241ceab0 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 msgr2=0x7fd4241ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 0x7fd4241ceec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097c0 tx=0x7fd418009240 comp rx=0 tx=0).stop 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 msgr2=0x7fd4241ceec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.218+0000 7fd4217fa640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4241ceab0 0x7fd4241ceec0 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097c0 tx=0x7fd418009240 comp rx=0 tx=0).stop 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 277241, 2024-08-19T11:18:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:28.261 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:28.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 >> v2:172.21.15.135:6800/726754104 conn(0x7fd41003ea80 msgr2=0x7fd410040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 --2- 172.21.15.71:0/1213004152 >> v2:172.21.15.135:6800/726754104 conn(0x7fd41003ea80 0x7fd410040f40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009f90 tx=0x7fd41c009190 comp rx=0 tx=0).stop 2024-08-19T11:18:28.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 10 monclient: shutdown 2024-08-19T11:18:28.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 msgr2=0x7fd424126c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 --2- 172.21.15.71:0/1213004152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4240a57c0 0x7fd424126c30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c7b0 tx=0x7fd41400cc70 comp rx=0 tx=0).stop 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42942e640 1 -- 172.21.15.71:0/1213004152 reap_dead start 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42942e640 1 -- 172.21.15.71:0/1213004152 reap_dead start 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 shutdown_connections 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 >> 172.21.15.71:0/1213004152 conn(0x7fd4240abf50 msgr2=0x7fd42409f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 shutdown_connections 2024-08-19T11:18:28.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.219+0000 7fd42ae91640 1 -- 172.21.15.71:0/1213004152 wait complete. 2024-08-19T11:18:28.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:28.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:18:28.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.363+0000 7ff7b5d5a640 10 monclient: get_monmap_and_config 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.363+0000 7ff7b5d5a640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.363+0000 7ff7b5d5a640 10 monclient: monmap: 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:28.363753+0000 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:28.363753+0000 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:28.365 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.363+0000 7ff7b5d5a640 1 Processor -- start 2024-08-19T11:18:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.363+0000 7ff7b5d5a640 1 -- start start 2024-08-19T11:18:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.363+0000 7ff7b5d5a640 10 monclient: init 2024-08-19T11:18:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient: _add_conns ranks=[8,10,9,0,1,3,4,5,6,7,2] 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 0x7ff7b0136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): picked mon.noname-e con 0x7ff7b00a3d80 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff7b0136ab0 0x7ff7b0136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): picked mon.noname-f con 0x7ff7b0136ab0 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7b00a4160 0x7ff7b00a4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): picked mon.noname-a con 0x7ff7b00a4160 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b00a1fa0 con 0x7ff7b00a4160 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b009fe70 con 0x7ff7b0136ab0 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff7b01373d0 con 0x7ff7b00a3d80 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7b5d5a640 10 monclient(hunting): authenticate will time out at 1166.405412s 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 0x7ff7b0136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff7b00a4160 0x7ff7b00a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 0x7ff7b0136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48210/0 (socket says 172.21.15.71:48210) 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 1 -- 172.21.15.71:0/72134304 learned_addr learned my addr 172.21.15.71:0/72134304 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): get_auth_request con 0x7ff7b00a3d80 auth_method 0 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): get_auth_request con 0x7ff7b00a4160 auth_method 0 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7aeffd640 1 --2- 172.21.15.71:0/72134304 >> v2:172.21.15.135:3300/0 conn(0x7ff7b0136ab0 0x7ff7b0136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7aeffd640 10 monclient(hunting): get_auth_request con 0x7ff7b0136ab0 auth_method 0 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7aeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient(hunting): handle_auth_done global_id 74961 payload 274 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 -- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 msgr2=0x7ff7b0136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 --2- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 0x7ff7b0136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 -- 172.21.15.71:0/72134304 >> v2:172.21.15.135:3300/0 conn(0x7ff7b0136ab0 msgr2=0x7ff7b0136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 --2- 172.21.15.71:0/72134304 >> v2:172.21.15.135:3300/0 conn(0x7ff7b0136ab0 0x7ff7b0136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 monclient: found mon.noname-a 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7affff640 1 -- 172.21.15.71:0/72134304 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b00a24d0 con 0x7ff7b00a4160 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.364+0000 7ff7af7fe640 1 --2- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 0x7ff7b0136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7affff640 1 -- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 msgr2=0x7ff7b00a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7affff640 1 --2- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b00a4610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00a3450 tx=0x7ff7a802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fd8a88712f3fa8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 1 -- 172.21.15.71:0/72134304 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7a8037070 con 0x7ff7b00a4160 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: dump: 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7b5d5a640 5 monclient: authenticate success, global_id 74961 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 1 -- 172.21.15.71:0/72134304 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a802ad60 con 0x7ff7b00a4160 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7b5d5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7b5d5a640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7b5d5a640 4 set_mon_vals no callback set 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 1 -- 172.21.15.71:0/72134304 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7a8030c20 con 0x7ff7b00a4160 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.367+0000 7ff7ae7fc640 10 monclient: dump: 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.378 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 10 monclient: shutdown 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 msgr2=0x7ff7b00a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b00a4610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00a3450 tx=0x7ff7a802a000 comp rx=0 tx=0).stop 2024-08-19T11:18:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/72134304 shutdown_connections 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b00a4610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/72134304 >> v2:172.21.15.135:3300/0 conn(0x7ff7b0136ab0 0x7ff7b0136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/72134304 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff7b00a3d80 0x7ff7b0136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/72134304 >> 172.21.15.71:0/72134304 conn(0x7ff7b00a91d0 msgr2=0x7ff7b00a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/72134304 shutdown_connections 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.368+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/72134304 wait complete. 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 10 monclient: monmap: 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.381 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 1 Processor -- start 2024-08-19T11:18:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 1 -- start start 2024-08-19T11:18:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 10 monclient: init 2024-08-19T11:18:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 10 monclient: _add_conns ranks=[4,0,1,7,8,3,5,2,6] 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.369+0000 7ff7b5d5a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7b00a3d80 0x7ff7b0122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): picked mon.noname-c con 0x7ff7b00a3d80 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b01ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): picked mon.noname-a con 0x7ff7b00a4160 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7b0136ab0 0x7ff7b0134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): picked mon.noname-f con 0x7ff7b0136ab0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b00a08c0 con 0x7ff7b00a4160 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b00a1c10 con 0x7ff7b0136ab0 2024-08-19T11:18:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff7b00a2ca0 con 0x7ff7b00a3d80 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7b5d5a640 10 monclient(hunting): authenticate will time out at 1166.411052s 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7b00a3d80 0x7ff7b0122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b01ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b01ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47352/0 (socket says 172.21.15.71:47352) 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7b00a3d80 0x7ff7b0122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:46032/0 (socket says 172.21.15.71:46032) 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 -- 172.21.15.71:0/1082382947 learned_addr learned my addr 172.21.15.71:0/1082382947 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): get_auth_request con 0x7ff7b00a4160 auth_method 0 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): get_auth_request con 0x7ff7b00a3d80 auth_method 0 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7b0136ab0 0x7ff7b0134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): get_auth_request con 0x7ff7b0136ab0 auth_method 0 2024-08-19T11:18:28.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient(hunting): handle_auth_done global_id 74970 payload 824 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7b00a3d80 msgr2=0x7ff7b0122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7b00a3d80 0x7ff7b0122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7b0136ab0 msgr2=0x7ff7b0134bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7b0136ab0 0x7ff7b0134bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 monclient: found mon.noname-a 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7aeffd640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b0122250 con 0x7ff7b00a4160 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.370+0000 7ff7af7fe640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff7b00a3d80 0x7ff7b0122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7aeffd640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 msgr2=0x7ff7b01ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7aeffd640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b01ca090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400d620 tx=0x7ff7a400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7a4012c70 con 0x7ff7b00a4160 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: dump: 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.393 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4019070 con 0x7ff7b00a4160 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 5 monclient: authenticate success, global_id 74970 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 10 monclient: _renew_subs 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7a40148a0 con 0x7ff7b00a4160 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b0123d10 con 0x7ff7b00a4160 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff797fff640 10 monclient: dump: 2024-08-19T11:18:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7adffb640 4 set_mon_vals no callback set 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 10 monclient: _renew_subs 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.372+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b01352f0 con 0x7ff7b00a4160 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7b5d5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 0x7ff7b01c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff7b006a590 con 0x7ff7b01c66b0 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff7a4014430 con 0x7ff7b00a4160 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7af7fe640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 0x7ff7b01c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7af7fe640 10 monclient: get_auth_request con 0x7ff7b01c66b0 auth_method 0 2024-08-19T11:18:28.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.373+0000 7ff7af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff797fff640 1 --2- 172.21.15.71:0/1082382947 >> v2:172.21.15.135:6800/726754104 conn(0x7ff79c03ea80 0x7ff79c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7ff7a400f040 con 0x7ff7b00a4160 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_done global_id 45554 payload 824 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7affff640 1 --2- 172.21.15.71:0/1082382947 >> v2:172.21.15.135:6800/726754104 conn(0x7ff79c03ea80 0x7ff79c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7af7fe640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7b00a1410 con 0x7ff7b01c66b0 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.374+0000 7ff7affff640 10 monclient: get_auth_request con 0x7ff79c03ea80 auth_method 0 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff7af7fe640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 msgr2=0x7ff7b01c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff7af7fe640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 0x7ff7b01c6a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004950 tx=0x7ff7a0010920 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7a001b020 con 0x7ff7b01c66b0 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff797fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff797fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff797fff640 10 monclient: dump: 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.399 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.376+0000 7ff7affff640 1 --2- 172.21.15.71:0/1082382947 >> v2:172.21.15.135:6800/726754104 conn(0x7ff79c03ea80 0x7ff79c040f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff7a000b480 con 0x7ff7b01c66b0 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 msgr2=0x7ff7b01c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 0x7ff7b01c6a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004950 tx=0x7ff7a0010920 comp rx=0 tx=0).stop 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 msgr2=0x7ff7b01c6a90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.377+0000 7ff797fff640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c66b0 0x7ff7b01c6a90 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004950 tx=0x7ff7a0010920 comp rx=0 tx=0).stop 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7b5d5a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 0x7ff7b0070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7b5d5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff7b00a8210 con 0x7ff7b01c6fd0 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 0x7ff7b0070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient: get_auth_request con 0x7ff7b01c6fd0 auth_method 0 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 10 monclient(hunting): handle_auth_done global_id 45563 payload 824 2024-08-19T11:18:28.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.383+0000 7ff7af7fe640 1 -- 172.21.15.71:0/1082382947 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff7b0136570 con 0x7ff7b01c6fd0 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.385+0000 7ff7af7fe640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 msgr2=0x7ff7b0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.385+0000 7ff7af7fe640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 0x7ff7b0070e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004950 tx=0x7ff7a0004a40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff7a001b040 con 0x7ff7b01c6fd0 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 10 monclient: dump: 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.402 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7ff7a0022e30 con 0x7ff7b01c6fd0 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 msgr2=0x7ff7b0070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 0x7ff7b0070e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004950 tx=0x7ff7a0004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 msgr2=0x7ff7b0070e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff797fff640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff7b01c6fd0 0x7ff7b0070e10 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0004950 tx=0x7ff7a0004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 277408, 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:28.404 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.405 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:28.406 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.407 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:28.408 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.409 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.411 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:28.413 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.415 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:28.417 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.422 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:28.423 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.426 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.429 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:18:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.431 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.431 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:28.431 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:28.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 >> v2:172.21.15.135:6800/726754104 conn(0x7ff79c03ea80 msgr2=0x7ff79c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/1082382947 >> v2:172.21.15.135:6800/726754104 conn(0x7ff79c03ea80 0x7ff79c040f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a802e000 comp rx=0 tx=0).stop 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 10 monclient: shutdown 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 msgr2=0x7ff7b01ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b01ca090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400d620 tx=0x7ff7a400da20 comp rx=0 tx=0).stop 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7affff640 1 -- 172.21.15.71:0/1082382947 reap_dead start 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 shutdown_connections 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 --2- 172.21.15.71:0/1082382947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7b00a4160 0x7ff7b01ca090 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 >> 172.21.15.71:0/1082382947 conn(0x7ff7b00a91d0 msgr2=0x7ff7b009ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 shutdown_connections 2024-08-19T11:18:28.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.386+0000 7ff7b5d5a640 1 -- 172.21.15.71:0/1082382947 wait complete. 2024-08-19T11:18:28.434 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:28.434 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:18:28.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:18:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.532+0000 7fefc23b3640 10 monclient: get_monmap_and_config 2024-08-19T11:18:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.532+0000 7fefc23b3640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.532+0000 7fefc23b3640 10 monclient: monmap: 2024-08-19T11:18:28.533 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:28.532951+0000 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:28.532951+0000 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.534 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:28.535 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 Processor -- start 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 -- start start 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient: init 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient: _add_conns ranks=[0,4,5,6,7,8,2,1,3,10,9] 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fefbc0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 0x7fefbc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): picked mon.noname-c con 0x7fefbc0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc0a7440 0x7fefbc1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): picked mon.noname-h con 0x7fefbc0a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefbc0a6380 con 0x7fefbc0a6950 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fefbc0a5020 con 0x7fefbc0a57c0 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fefbc0a7d40 con 0x7fefbc0a7440 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc23b3640 10 monclient(hunting): authenticate will time out at 1166.574696s 2024-08-19T11:18:28.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbbfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fefbc0a6950 0x7fefbc0a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43976/0 (socket says 172.21.15.71:43976) 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 0x7fefbc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbbfff640 1 -- 172.21.15.71:0/602132662 learned_addr learned my addr 172.21.15.71:0/602132662 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): get_auth_request con 0x7fefbc0a57c0 auth_method 0 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc0950640 1 --2- 172.21.15.71:0/602132662 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc0a7440 0x7fefbc1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc0950640 10 monclient(hunting): get_auth_request con 0x7fefbc0a7440 auth_method 0 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc0950640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc0950640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.533+0000 7fefc0950640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefc0950640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefc0950640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefc0950640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_done global_id 84568 payload 274 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 1 -- 172.21.15.71:0/602132662 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc0a7440 msgr2=0x7fefbc1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 1 --2- 172.21.15.71:0/602132662 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc0a7440 0x7fefbc1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 1 -- 172.21.15.71:0/602132662 >> v1:172.21.15.71:6789/0 conn(0x7fefbc0a6950 legacy=0x7fefbc0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 1 monclient: found mon.noname-c 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.534+0000 7fefbb7fe640 1 -- 172.21.15.71:0/602132662 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc0a3650 con 0x7fefbc0a57c0 2024-08-19T11:18:28.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.536+0000 7fefbb7fe640 1 -- 172.21.15.71:0/602132662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 msgr2=0x7fefbc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.536+0000 7fefbb7fe640 1 --2- 172.21.15.71:0/602132662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 0x7fefbc13eb60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009800 tx=0x7fefb0029fe0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=40ff4670ead73749 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 1 -- 172.21.15.71:0/602132662 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb0037070 con 0x7fefbc0a57c0 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: dump: 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.546 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 1 -- 172.21.15.71:0/602132662 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb002ad00 con 0x7fefbc0a57c0 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 5 monclient: authenticate success, global_id 84568 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 1 -- 172.21.15.71:0/602132662 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb0030c20 con 0x7fefbc0a57c0 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 4 set_mon_vals no callback set 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefbaffd640 10 monclient: dump: 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.548 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 10 monclient: shutdown 2024-08-19T11:18:28.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 -- 172.21.15.71:0/602132662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 msgr2=0x7fefbc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 --2- 172.21.15.71:0/602132662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 0x7fefbc13eb60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009800 tx=0x7fefb0029fe0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 -- 172.21.15.71:0/602132662 shutdown_connections 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 --2- 172.21.15.71:0/602132662 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc0a7440 0x7fefbc1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 --2- 172.21.15.71:0/602132662 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a57c0 0x7fefbc13eb60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 -- 172.21.15.71:0/602132662 >> 172.21.15.71:0/602132662 conn(0x7fefbc0abf50 msgr2=0x7fefbc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 -- 172.21.15.71:0/602132662 shutdown_connections 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.537+0000 7fefc23b3640 1 -- 172.21.15.71:0/602132662 wait complete. 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.538+0000 7fefc23b3640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.538+0000 7fefc23b3640 10 monclient: monmap: 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.550 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.551 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.538+0000 7fefc23b3640 1 Processor -- start 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.538+0000 7fefc23b3640 1 -- start start 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.538+0000 7fefc23b3640 10 monclient: init 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient: _add_conns ranks=[3,8,6,7,5,0,2,4,1] 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a57c0 0x7fefbc126d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): picked mon.noname-g con 0x7fefbc0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fefbc0a6950 0x7fefbc128de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): picked mon.noname-e con 0x7fefbc0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc0a7440 0x7fefbc13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): picked mon.noname-d con 0x7fefbc0a7440 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc0a8700 con 0x7fefbc0a57c0 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fefbc0a84c0 con 0x7fefbc0a7440 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fefbc1415f0 con 0x7fefbc0a6950 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc23b3640 10 monclient(hunting): authenticate will time out at 1166.580294s 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fefbc0a6950 0x7fefbc128de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fefbc0a6950 0x7fefbc128de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48222/0 (socket says 172.21.15.71:48222) 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 1 -- 172.21.15.71:0/2832654885 learned_addr learned my addr 172.21.15.71:0/2832654885 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): get_auth_request con 0x7fefbc0a6950 auth_method 0 2024-08-19T11:18:28.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc0a7440 0x7fefbc13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): get_auth_request con 0x7fefbc0a7440 auth_method 0 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a57c0 0x7fefbc126d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): get_auth_request con 0x7fefbc0a57c0 auth_method 0 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient(hunting): handle_auth_done global_id 26502 payload 824 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fefbc0a6950 msgr2=0x7fefbc128de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fefbc0a6950 0x7fefbc128de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a57c0 msgr2=0x7fefbc126d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a57c0 0x7fefbc126d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 monclient: found mon.noname-d 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefc0950640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc128280 con 0x7fefbc0a7440 2024-08-19T11:18:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.539+0000 7fefbb7fe640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fefbc0a6950 0x7fefbc128de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.541+0000 7fefc0950640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc0a7440 msgr2=0x7fefbc13fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.541+0000 7fefc0950640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc0a7440 0x7fefbc13fc50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fefb400eba0 tx=0x7fefb400c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb4018020 con 0x7fefbc0a7440 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: dump: 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb400cd30 con 0x7fefbc0a7440 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 5 monclient: authenticate success, global_id 26502 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 10 monclient: _renew_subs 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb4014d60 con 0x7fefbc0a7440 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefbc1408f0 con 0x7fefbc0a7440 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefb8ff9640 10 monclient: dump: 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefba7fc640 4 set_mon_vals no callback set 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 10 monclient: _renew_subs 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fefbc12a020 con 0x7fefbc0a7440 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.542+0000 7fefc23b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefc23b3640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 0x7fefbc1ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fefbc06a590 con 0x7fefbc140190 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fefb4005d10 con 0x7fefbc0a7440 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 0x7fefbc1ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefb8ff9640 1 --2- 172.21.15.71:0/2832654885 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa803ea80 0x7fefa8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient: get_auth_request con 0x7fefbc140190 auth_method 0 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7fefb4052820 con 0x7fefbc0a7440 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbb7fe640 1 --2- 172.21.15.71:0/2832654885 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa803ea80 0x7fefa8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbb7fe640 10 monclient: get_auth_request con 0x7fefa803ea80 auth_method 0 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 10 monclient(hunting): handle_auth_done global_id 84508 payload 824 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.543+0000 7fefbbfff640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefbc0a94a0 con 0x7fefbc140190 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.545+0000 7fefbbfff640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 msgr2=0x7fefbc1ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.545+0000 7fefbbfff640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 0x7fefbc1ce5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefac00ea70 tx=0x7fefac00ef30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.545+0000 7fefbb7fe640 1 --2- 172.21.15.71:0/2832654885 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa803ea80 0x7fefa8040f40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fefb002a020 tx=0x7fefb002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefac01a070 con 0x7fefbc140190 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 10 monclient: dump: 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fefac00cc50 con 0x7fefbc140190 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 msgr2=0x7fefbc1ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 0x7fefbc1ce5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fefac00ea70 tx=0x7fefac00ef30 comp rx=0 tx=0).stop 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 msgr2=0x7fefbc1ce5e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.546+0000 7fefb8ff9640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc140190 0x7fefbc1ce5e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefc23b3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefc23b3640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 0x7fefbc1cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefc23b3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fefbc076c60 con 0x7fefbc1ceb20 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 0x7fefbc1cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient: get_auth_request con 0x7fefbc1ceb20 auth_method 0 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 10 monclient(hunting): handle_auth_done global_id 84517 payload 824 2024-08-19T11:18:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.552+0000 7fefbbfff640 1 -- 172.21.15.71:0/2832654885 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fefbc0a6050 con 0x7fefbc1ceb20 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefbbfff640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 msgr2=0x7fefbc1cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefbbfff640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 0x7fefbc1cef30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefac017000 tx=0x7fefac004940 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefac01a050 con 0x7fefbc1ceb20 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 10 monclient: dump: 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9434 (secure 0 0 0) 0x7fefac01b040 con 0x7fefbc1ceb20 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 msgr2=0x7fefbc1cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 0x7fefbc1cef30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefac017000 tx=0x7fefac004940 comp rx=0 tx=0).stop 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 msgr2=0x7fefbc1cef30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefb8ff9640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fefbc1ceb20 0x7fefbc1cef30 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fefac017000 tx=0x7fefac004940 comp rx=0 tx=0).stop 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 170, 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 90716, 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:28.572 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:28.573 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.574 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:28.576 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:28.577 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.578 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:28.579 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:28.582 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:28.583 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.584 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:28.585 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:28.587 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.588 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.589 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.590 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:28.591 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:28.595 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa803ea80 msgr2=0x7fefa8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 1 --2- 172.21.15.71:0/2832654885 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa803ea80 0x7fefa8040f40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fefb002a020 tx=0x7fefb002e000 comp rx=0 tx=0).stop 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 10 monclient: shutdown 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc0a7440 msgr2=0x7fefbc13fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 1 --2- 172.21.15.71:0/2832654885 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc0a7440 0x7fefbc13fc50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fefb400eba0 tx=0x7fefb400c490 comp rx=0 tx=0).stop 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc0950640 1 -- 172.21.15.71:0/2832654885 reap_dead start 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc0950640 1 -- 172.21.15.71:0/2832654885 reap_dead start 2024-08-19T11:18:28.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 shutdown_connections 2024-08-19T11:18:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.555+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 >> 172.21.15.71:0/2832654885 conn(0x7fefbc0abf50 msgr2=0x7fefbc09f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.556+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 shutdown_connections 2024-08-19T11:18:28.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.556+0000 7fefc23b3640 1 -- 172.21.15.71:0/2832654885 wait complete. 2024-08-19T11:18:28.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:18:28.598 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d'] 2024-08-19T11:18:28.598 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-19T11:18:28.599 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-08-19T11:18:28.599 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-08-19T11:18:28.599 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-19T11:18:28.599 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:18:28.612 INFO:tasks.ceph.mon.d:Stopped 2024-08-19T11:18:28.612 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-19T11:18:28.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:18:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.747+0000 7f8075602640 10 monclient: get_monmap_and_config 2024-08-19T11:18:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.747+0000 7f8075602640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.747+0000 7f8075602640 10 monclient: monmap: 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:28.748392+0000 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:28.748392+0000 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:28.750 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 Processor -- start 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 -- start start 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient: init 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient: _add_conns ranks=[7,2,0,5,8,10,3,9,6,4,1] 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139630 0x7f8070139a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): picked mon.noname-i con 0x7f8070139630 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 0x7f80700a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): picked mon.noname-b con 0x7f8070139f50 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f80700a6db0 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80700a8290 con 0x7f80700a6db0 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f80700a4b80 con 0x7f8070139f50 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f80700a4dd0 con 0x7f8070139630 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.748+0000 7f8075602640 10 monclient(hunting): authenticate will time out at 1166.789974s 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 0x7f80700a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 0x7f80700a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38472/0 (socket says 172.21.15.71:38472) 2024-08-19T11:18:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806f7fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f80700a6db0 0x7f80700a71b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43984/0 (socket says 172.21.15.71:43984) 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 -- 172.21.15.71:0/2301590360 learned_addr learned my addr 172.21.15.71:0/2301590360 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): get_auth_request con 0x7f8070139f50 auth_method 0 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806effd640 1 --2- 172.21.15.71:0/2301590360 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139630 0x7f8070139a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient(hunting): handle_auth_done global_id 74864 payload 274 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 -- 172.21.15.71:0/2301590360 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139630 msgr2=0x7f8070139a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 --2- 172.21.15.71:0/2301590360 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139630 0x7f8070139a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 -- 172.21.15.71:0/2301590360 >> v1:172.21.15.71:6789/0 conn(0x7f80700a6db0 legacy=0x7f80700a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 monclient: found mon.noname-b 2024-08-19T11:18:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.749+0000 7f806e7fc640 1 -- 172.21.15.71:0/2301590360 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80700a4530 con 0x7f8070139f50 2024-08-19T11:18:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806e7fc640 1 -- 172.21.15.71:0/2301590360 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 msgr2=0x7f80700a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806e7fc640 1 --2- 172.21.15.71:0/2301590360 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 0x7f80700a6870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8064009eb0 tx=0x7f806402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb9b00b72c37700 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 1 -- 172.21.15.71:0/2301590360 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8064036070 con 0x7f8070139f50 2024-08-19T11:18:28.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: dump: 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.761 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 5 monclient: authenticate success, global_id 74864 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:28.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 1 -- 172.21.15.71:0/2301590360 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8064007a70 con 0x7f8070139f50 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 4 set_mon_vals no callback set 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 1 -- 172.21.15.71:0/2301590360 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8064007c20 con 0x7f8070139f50 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f806dffb640 10 monclient: dump: 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.763 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 10 monclient: shutdown 2024-08-19T11:18:28.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 -- 172.21.15.71:0/2301590360 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 msgr2=0x7f80700a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 --2- 172.21.15.71:0/2301590360 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 0x7f80700a6870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8064009eb0 tx=0x7f806402a5f0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 -- 172.21.15.71:0/2301590360 shutdown_connections 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 --2- 172.21.15.71:0/2301590360 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8070139f50 0x7f80700a6870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 --2- 172.21.15.71:0/2301590360 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139630 0x7f8070139a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 -- 172.21.15.71:0/2301590360 >> 172.21.15.71:0/2301590360 conn(0x7f8070074b30 msgr2=0x7f80700abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 -- 172.21.15.71:0/2301590360 shutdown_connections 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.752+0000 7f8075602640 1 -- 172.21.15.71:0/2301590360 wait complete. 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.753+0000 7f8075602640 10 monclient: build_initial_monmap 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.753+0000 7f8075602640 10 monclient: monmap: 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:28.765 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:28.766 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.753+0000 7f8075602640 1 Processor -- start 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.753+0000 7f8075602640 1 -- start start 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.753+0000 7f8075602640 10 monclient: init 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient: _add_conns ranks=[2,0,7,6,5,4,3,8,1] 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 0x7f8070138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): picked mon.noname-b con 0x7f80700a6db0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8070139630 0x7f8070138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): picked mon.noname-a con 0x7f8070139630 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139f50 0x7f8070122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): picked mon.noname-i con 0x7f8070139f50 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:28.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f80700644e0 con 0x7f8070139630 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f80700a3490 con 0x7f80700a6db0 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f80700a2280 con 0x7f8070139f50 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f8075602640 10 monclient(hunting): authenticate will time out at 1166.795355s 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 0x7f8070138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8070139630 0x7f8070138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8070139630 0x7f8070138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47372/0 (socket says 172.21.15.71:47372) 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 0x7f8070138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38486/0 (socket says 172.21.15.71:38486) 2024-08-19T11:18:28.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 1 -- 172.21.15.71:0/2613753836 learned_addr learned my addr 172.21.15.71:0/2613753836 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): get_auth_request con 0x7f8070139630 auth_method 0 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): get_auth_request con 0x7f80700a6db0 auth_method 0 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:28.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient(hunting): handle_auth_done global_id 74873 payload 824 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 -- 172.21.15.71:0/2613753836 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139f50 msgr2=0x7f8070122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139f50 0x7f8070122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 -- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8070139630 msgr2=0x7f8070138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8070139630 0x7f8070138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 monclient: found mon.noname-b 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.754+0000 7f806effd640 1 -- 172.21.15.71:0/2613753836 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80700a6a20 con 0x7f80700a6db0 2024-08-19T11:18:28.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.756+0000 7f806effd640 1 -- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 msgr2=0x7f8070138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.756+0000 7f806effd640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 0x7f8070138920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f806800c5e0 tx=0x7f806800caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8068015070 con 0x7f80700a6db0 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: dump: 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.771 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 5 monclient: authenticate success, global_id 74873 2024-08-19T11:18:28.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8068011c80 con 0x7f80700a6db0 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 10 monclient: _renew_subs 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8070123f80 con 0x7f80700a6db0 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8068011e30 con 0x7f80700a6db0 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f80577fe640 10 monclient: dump: 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:28.773 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f806d7fa640 4 set_mon_vals no callback set 2024-08-19T11:18:28.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 10 monclient: _renew_subs 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8070124ae0 con 0x7f80700a6db0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.757+0000 7f8075602640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f8075602640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f8075602640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8068011810 con 0x7f80700a6db0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8070124cb0 con 0x7f80700a6db0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f80577fe640 1 --2- 172.21.15.71:0/2613753836 >> v2:172.21.15.135:6800/726754104 conn(0x7f805c03ea80 0x7f805c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7f8068051950 con 0x7f80700a6db0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f806e7fc640 1 --2- 172.21.15.71:0/2613753836 >> v2:172.21.15.135:6800/726754104 conn(0x7f805c03ea80 0x7f805c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:28.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.758+0000 7f806e7fc640 10 monclient: get_auth_request con 0x7f805c03ea80 auth_method 0 2024-08-19T11:18:28.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.761+0000 7f806e7fc640 1 --2- 172.21.15.71:0/2613753836 >> v2:172.21.15.135:6800/726754104 conn(0x7f805c03ea80 0x7f805c040f40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f80701245f0 tx=0x7f8064009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:28.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.762+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f8070124cb0 con 0x7f80700a6db0 2024-08-19T11:18:28.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.762+0000 7f80577fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:28.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:28.762+0000 7f80577fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:29.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.006+0000 7f8075602640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.006+0000 7f8075602640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.006+0000 7f8075602640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.006+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f807013a330 con 0x7f80700a6db0 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.007+0000 7f80577fe640 1 -- 172.21.15.71:0/2613753836 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f806801e030 con 0x7f80700a6db0 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.007+0000 7f80577fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.007+0000 7f80577fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:29.008 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":170,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 >> v2:172.21.15.135:6800/726754104 conn(0x7f805c03ea80 msgr2=0x7f805c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 --2- 172.21.15.71:0/2613753836 >> v2:172.21.15.135:6800/726754104 conn(0x7f805c03ea80 0x7f805c040f40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f80701245f0 tx=0x7f8064009000 comp rx=0 tx=0).stop 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 10 monclient: shutdown 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 msgr2=0x7f8070138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 0x7f8070138920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f806800c5e0 tx=0x7f806800caa0 comp rx=0 tx=0).stop 2024-08-19T11:18:29.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 shutdown_connections 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 --2- 172.21.15.71:0/2613753836 >> v2:172.21.15.135:6800/726754104 conn(0x7f805c03ea80 0x7f805c040f40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8070139f50 0x7f8070122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8070139630 0x7f8070138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 --2- 172.21.15.71:0/2613753836 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f80700a6db0 0x7f8070138920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 >> 172.21.15.71:0/2613753836 conn(0x7f8070074b30 msgr2=0x7f80701c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 shutdown_connections 2024-08-19T11:18:29.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:29.009+0000 7f8075602640 1 -- 172.21.15.71:0/2613753836 wait complete. 2024-08-19T11:18:32.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:18:32.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.129+0000 7fdc6343f640 10 monclient: get_monmap_and_config 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.129+0000 7fdc6343f640 10 monclient: build_initial_monmap 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.129+0000 7fdc6343f640 10 monclient: monmap: 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:32.130567+0000 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:32.130567+0000 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:32.131 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:32.132 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.130+0000 7fdc6343f640 1 Processor -- start 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.130+0000 7fdc6343f640 1 -- start start 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.130+0000 7fdc6343f640 10 monclient: init 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient: _add_conns ranks=[0,2,1,9,7,8,3,5,10,4,6] 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdc5c0a6a30 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 0x7fdc5c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient(hunting): picked mon.noname-b con 0x7fdc5c0a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdc5c13eb10 addr v1:172.21.15.135:6789/0 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5c0a4f90 con 0x7fdc5c0a6a30 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5c0a6380 con 0x7fdc5c13eb10 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0a3650 con 0x7fdc5c0a6e10 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc6343f640 10 monclient(hunting): authenticate will time out at 1170.172301s 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 0x7fdc5c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc611db640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdc5c0a6a30 0x7fdc5c0a57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44000/0 (socket says 172.21.15.71:44000) 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc611db640 1 -- 172.21.15.71:0/702527382 learned_addr learned my addr 172.21.15.71:0/702527382 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): get_auth_request con 0x7fdc5c0a6e10 auth_method 0 2024-08-19T11:18:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient(hunting): handle_auth_done global_id 74882 payload 274 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 1 -- 172.21.15.71:0/702527382 >> v1:172.21.15.135:6789/0 conn(0x7fdc5c13eb10 legacy=0x7fdc5c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 1 -- 172.21.15.71:0/702527382 >> v1:172.21.15.71:6789/0 conn(0x7fdc5c0a6a30 legacy=0x7fdc5c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient: _finish_hunting 0 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 1 monclient: found mon.noname-b 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:32.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.131+0000 7fdc609da640 1 -- 172.21.15.71:0/702527382 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c0a49d0 con 0x7fdc5c0a6e10 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc609da640 1 -- 172.21.15.71:0/702527382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 msgr2=0x7fdc5c0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc609da640 1 --2- 172.21.15.71:0/702527382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 0x7fdc5c0a71f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097d0 tx=0x7fdc4c029fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa86c141dfdc7631 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 1 -- 172.21.15.71:0/702527382 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc4c037070 con 0x7fdc5c0a6e10 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: dump: 2024-08-19T11:18:32.143 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:32.144 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: _finish_auth 0 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: _check_auth_tickets 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 1 -- 172.21.15.71:0/702527382 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c02adf0 con 0x7fdc5c0a6e10 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 1 -- 172.21.15.71:0/702527382 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc4c030c20 con 0x7fdc5c0a6e10 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc53fff640 10 monclient: dump: 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:32.145 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:32.146 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc6343f640 5 monclient: authenticate success, global_id 74882 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc6343f640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.134+0000 7fdc6343f640 4 set_mon_vals no callback set 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 10 monclient: shutdown 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 -- 172.21.15.71:0/702527382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 msgr2=0x7fdc5c0a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 --2- 172.21.15.71:0/702527382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 0x7fdc5c0a71f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097d0 tx=0x7fdc4c029fb0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 -- 172.21.15.71:0/702527382 shutdown_connections 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 --2- 172.21.15.71:0/702527382 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c0a6e10 0x7fdc5c0a71f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 -- 172.21.15.71:0/702527382 >> 172.21.15.71:0/702527382 conn(0x7fdc5c0ac030 msgr2=0x7fdc5c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 -- 172.21.15.71:0/702527382 shutdown_connections 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.135+0000 7fdc6343f640 1 -- 172.21.15.71:0/702527382 wait complete. 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 10 monclient: build_initial_monmap 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 10 monclient: monmap: 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:32.148 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 1 Processor -- start 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 1 -- start start 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 10 monclient: init 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:32.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.136+0000 7fdc6343f640 10 monclient: _add_conns ranks=[3,6,2,0,4,5,1,8,7] 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc5c0a6a30 0x7fdc5c124e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): picked mon.noname-g con 0x7fdc5c0a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc5c0a6e10 0x7fdc5c122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): picked mon.noname-d con 0x7fdc5c0a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 0x7fdc5c123640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): picked mon.noname-b con 0x7fdc5c13eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0a7730 con 0x7fdc5c13eb10 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c142620 con 0x7fdc5c0a6a30 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:32.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fdc5c0ac6c0 con 0x7fdc5c0a6e10 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc6343f640 10 monclient(hunting): authenticate will time out at 1170.178077s 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc609da640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc5c0a6e10 msgr2=0x7fdc5c122dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc609da640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc5c0a6e10 0x7fdc5c122dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 0x7fdc5c123640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 0x7fdc5c123640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38516/0 (socket says 172.21.15.71:38516) 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 -- 172.21.15.71:0/2825514124 learned_addr learned my addr 172.21.15.71:0/2825514124 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): get_auth_request con 0x7fdc5c13eb10 auth_method 0 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:32.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc5c0a6a30 0x7fdc5c124e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): get_auth_request con 0x7fdc5c0a6a30 auth_method 0 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc611db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient(hunting): handle_auth_done global_id 74891 payload 824 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 -- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc5c0a6e10 msgr2=0x7fdc5c122dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc5c0a6e10 0x7fdc5c122dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 -- 172.21.15.71:0/2825514124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc5c0a6a30 msgr2=0x7fdc5c124e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:32.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc5c0a6a30 0x7fdc5c124e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient: _finish_hunting 0 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 monclient: found mon.noname-b 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.137+0000 7fdc619dc640 1 -- 172.21.15.71:0/2825514124 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c1257b0 con 0x7fdc5c13eb10 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc619dc640 1 -- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 msgr2=0x7fdc5c123640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc619dc640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 0x7fdc5c123640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400ba10 tx=0x7fdc5400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc54019070 con 0x7fdc5c13eb10 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: dump: 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:32.153 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:32.154 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: _finish_auth 0 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc54012340 con 0x7fdc5c13eb10 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc6343f640 5 monclient: authenticate success, global_id 74891 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc6343f640 10 monclient: _renew_subs 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc6343f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c126620 con 0x7fdc5c13eb10 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fdc540129a0 con 0x7fdc5c13eb10 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:32.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.140+0000 7fdc51ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.140+0000 7fdc51ffb640 10 monclient: dump: 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:32.156 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.140+0000 7fdc6343f640 10 monclient: _renew_subs 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.140+0000 7fdc6343f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.140+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c13d2d0 con 0x7fdc5c13eb10 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.139+0000 7fdc537fe640 4 set_mon_vals no callback set 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fdc54012530 con 0x7fdc5c13eb10 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc6343f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc6343f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:32.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc6343f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:32.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5c0a71f0 con 0x7fdc5c13eb10 2024-08-19T11:18:32.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc51ffb640 1 --2- 172.21.15.71:0/2825514124 >> v2:172.21.15.135:6800/726754104 conn(0x7fdc4003ea80 0x7fdc40040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:32.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7fdc54051820 con 0x7fdc5c13eb10 2024-08-19T11:18:32.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc611db640 1 --2- 172.21.15.71:0/2825514124 >> v2:172.21.15.135:6800/726754104 conn(0x7fdc4003ea80 0x7fdc40040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:32.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.141+0000 7fdc611db640 10 monclient: get_auth_request con 0x7fdc4003ea80 auth_method 0 2024-08-19T11:18:32.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.144+0000 7fdc611db640 1 --2- 172.21.15.71:0/2825514124 >> v2:172.21.15.135:6800/726754104 conn(0x7fdc4003ea80 0x7fdc40040f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007c90 tx=0x7fdc58007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:32.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.146+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fdc54050590 con 0x7fdc5c13eb10 2024-08-19T11:18:32.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.146+0000 7fdc51ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:32.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.146+0000 7fdc51ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:32.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.388+0000 7fdc6343f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:18:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.388+0000 7fdc6343f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.388+0000 7fdc6343f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.389+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc5c06ca70 con 0x7fdc5c13eb10 2024-08-19T11:18:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.389+0000 7fdc51ffb640 1 -- 172.21.15.71:0/2825514124 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7fdc5401c360 con 0x7fdc5c13eb10 2024-08-19T11:18:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.389+0000 7fdc51ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:32.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.389+0000 7fdc51ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:32.391 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":170,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:18:32.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 >> v2:172.21.15.135:6800/726754104 conn(0x7fdc4003ea80 msgr2=0x7fdc40040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:32.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 --2- 172.21.15.71:0/2825514124 >> v2:172.21.15.135:6800/726754104 conn(0x7fdc4003ea80 0x7fdc40040f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007c90 tx=0x7fdc58007be0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 10 monclient: shutdown 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 msgr2=0x7fdc5c123640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 0x7fdc5c123640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400ba10 tx=0x7fdc5400bed0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 shutdown_connections 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 --2- 172.21.15.71:0/2825514124 >> v2:172.21.15.135:6800/726754104 conn(0x7fdc4003ea80 0x7fdc40040f40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fdc5c0a6e10 0x7fdc5c122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc5c13eb10 0x7fdc5c123640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 --2- 172.21.15.71:0/2825514124 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc5c0a6a30 0x7fdc5c124e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 >> 172.21.15.71:0/2825514124 conn(0x7fdc5c0ac030 msgr2=0x7fdc5c0aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:32.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 shutdown_connections 2024-08-19T11:18:32.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:32.391+0000 7fdc6343f640 1 -- 172.21.15.71:0/2825514124 wait complete. 2024-08-19T11:18:35.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.513+0000 7f63dd402640 10 monclient: get_monmap_and_config 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.513+0000 7f63dd402640 10 monclient: build_initial_monmap 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.513+0000 7f63dd402640 10 monclient: monmap: 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:35.513948+0000 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:35.513948+0000 2024-08-19T11:18:35.514 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:35.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 Processor -- start 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 -- start start 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient: init 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient: _add_conns ranks=[4,3,8,10,6,7,9,5,0,2,1] 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 0x7f63d80a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): picked mon.noname-c con 0x7f63d80a5650 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:35.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a5f70 0x7f63d81374e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): picked mon.noname-g con 0x7f63d80a5f70 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d8137e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): picked mon.noname-e con 0x7f63d8137a20 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f63d8072430 con 0x7f63d80a5f70 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f63d8073f10 con 0x7f63d80a5650 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f63d8072630 con 0x7f63d8137a20 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63dd402640 10 monclient(hunting): authenticate will time out at 1173.555759s 2024-08-19T11:18:35.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d8137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 0x7f63d80a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d8137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53088/0 (socket says 172.21.15.71:53088) 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 1 -- 172.21.15.71:0/2888660341 learned_addr learned my addr 172.21.15.71:0/2888660341 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 0x7f63d80a5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35432/0 (socket says 172.21.15.71:35432) 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 10 monclient(hunting): get_auth_request con 0x7f63d8137a20 auth_method 0 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:35.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d6ffd640 10 monclient(hunting): get_auth_request con 0x7f63d80a5650 auth_method 0 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.514+0000 7f63d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:35.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63cffff640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a5f70 0x7f63d81374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 10 monclient(hunting): handle_auth_done global_id 84577 payload 274 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 msgr2=0x7f63d8137e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d8137e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2888660341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a5f70 msgr2=0x7f63d81374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a5f70 0x7f63d81374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 1 monclient: found mon.noname-c 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2888660341 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d8074680 con 0x7f63d80a5650 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d8137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63cffff640 10 monclient: get_auth_request con 0x7f63d80a5f70 auth_method 0 2024-08-19T11:18:35.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.515+0000 7f63cffff640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a5f70 0x7f63d81374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.517+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 msgr2=0x7f63d80a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.517+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 0x7f63d80a5a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097d0 tx=0x7f63c8029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4d36a43947d5f946 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 1 -- 172.21.15.71:0/2888660341 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c8037070 con 0x7f63d80a5650 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: dump: 2024-08-19T11:18:35.529 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:35.530 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 5 monclient: authenticate success, global_id 84577 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 1 -- 172.21.15.71:0/2888660341 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c802ad10 con 0x7f63d80a5650 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 4 set_mon_vals no callback set 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 1 -- 172.21.15.71:0/2888660341 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63c8030c20 con 0x7f63d80a5650 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:35.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63d67fc640 10 monclient: dump: 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:35.532 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 10 monclient: shutdown 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 -- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 msgr2=0x7f63d80a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 0x7f63d80a5a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097d0 tx=0x7f63c8029fb0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 -- 172.21.15.71:0/2888660341 shutdown_connections 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f63d80a5f70 0x7f63d81374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d8137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 --2- 172.21.15.71:0/2888660341 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f63d80a5650 0x7f63d80a5a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 -- 172.21.15.71:0/2888660341 >> 172.21.15.71:0/2888660341 conn(0x7f63d80aa360 msgr2=0x7f63d80a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 -- 172.21.15.71:0/2888660341 shutdown_connections 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.518+0000 7f63dd402640 1 -- 172.21.15.71:0/2888660341 wait complete. 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.519+0000 7f63dd402640 10 monclient: build_initial_monmap 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.519+0000 7f63dd402640 10 monclient: monmap: 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:35.534 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.519+0000 7f63dd402640 1 Processor -- start 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.519+0000 7f63dd402640 1 -- start start 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.519+0000 7f63dd402640 10 monclient: init 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:35.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient: _add_conns ranks=[6,2,8,5,0,1,7,4,3] 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d80a5650 0x7f63d8136b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): picked mon.noname-d con 0x7f63d80a5650 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63d80a5f70 0x7f63d8137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): picked mon.noname-b con 0x7f63d80a5f70 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): picked mon.noname-e con 0x7f63d8137a20 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f63d80a7230 con 0x7f63d80a5f70 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f63d80644e0 con 0x7f63d80a5650 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:35.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f63d80a6350 con 0x7f63d8137a20 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63dd402640 10 monclient(hunting): authenticate will time out at 1173.561293s 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d6ffd640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d80a5650 msgr2=0x7f63d8136b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d6ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d80a5650 0x7f63d8136b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63d80a5f70 0x7f63d8137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53090/0 (socket says 172.21.15.71:53090) 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 -- 172.21.15.71:0/2351161826 learned_addr learned my addr 172.21.15.71:0/2351161826 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): get_auth_request con 0x7f63d8137a20 auth_method 0 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): get_auth_request con 0x7f63d80a5f70 auth_method 0 2024-08-19T11:18:35.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient(hunting): handle_auth_done global_id 94247 payload 824 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 -- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d80a5650 msgr2=0x7f63d8136b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d80a5650 0x7f63d8136b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 -- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63d80a5f70 msgr2=0x7f63d8137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:35.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63d80a5f70 0x7f63d8137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 monclient: found mon.noname-e 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63d77fe640 1 -- 172.21.15.71:0/2351161826 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d8137f60 con 0x7f63d8137a20 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.520+0000 7f63cffff640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63d80a5f70 0x7f63d8137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.522+0000 7f63d77fe640 1 -- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 msgr2=0x7f63d809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.522+0000 7f63d77fe640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d809ca20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63d000efc0 tx=0x7f63d000c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63d000cd30 con 0x7f63d8137a20 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:35.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: dump: 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:35.540 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d0019070 con 0x7f63d8137a20 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 5 monclient: authenticate success, global_id 94247 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 10 monclient: _renew_subs 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d80a0590 con 0x7f63d8137a20 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f63d0014d60 con 0x7f63d8137a20 2024-08-19T11:18:35.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63cf7fe640 10 monclient: dump: 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:35.542 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63d57fa640 4 set_mon_vals no callback set 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 10 monclient: _renew_subs 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.523+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d809f250 con 0x7f63d8137a20 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f63d0005d10 con 0x7f63d8137a20 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63dd402640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:35.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63dd402640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63dd402640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d80a16c0 con 0x7f63d8137a20 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63cf7fe640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (secure 0 0 0) 0x7f63d0051f60 con 0x7f63d8137a20 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.524+0000 7f63d6ffd640 10 monclient: get_auth_request con 0x7f63b803eab0 auth_method 0 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.525+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 msgr2=0x7f63b8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.525+0000 7f63d6ffd640 1 -- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 msgr2=0x7f63b8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.525+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f63c80097d0 tx=0x7f63c802e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:35.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.525+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:35.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.529+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f63d8137f60 con 0x7f63d8137a20 2024-08-19T11:18:35.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.529+0000 7f63cf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:35.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.529+0000 7f63cf7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:35.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.726+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:35.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.726+0000 7f63d6ffd640 10 monclient: get_auth_request con 0x7f63b803eab0 auth_method 0 2024-08-19T11:18:35.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.729+0000 7f63d6ffd640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f63c8001eb0 tx=0x7f63c8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:35.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63dd402640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:18:35.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63dd402640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:35.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63dd402640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:35.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f63d806fbc0 con 0x7f63d8137a20 2024-08-19T11:18:35.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63cf7fe640 1 -- 172.21.15.71:0/2351161826 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3194 (secure 0 0 0) 0x7f63d0010040 con 0x7f63d8137a20 2024-08-19T11:18:35.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63cf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:35.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.769+0000 7f63cf7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:35.771 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":170,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.771+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 msgr2=0x7f63b8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.771+0000 7f63dd402640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f63c8001eb0 tx=0x7f63c8009190 comp rx=0 tx=0).stop 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.771+0000 7f63dd402640 10 monclient: shutdown 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.771+0000 7f63dd402640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.771+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 msgr2=0x7f63d809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.771+0000 7f63dd402640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d809ca20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63d000efc0 tx=0x7f63d000c490 comp rx=0 tx=0).stop 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 shutdown_connections 2024-08-19T11:18:35.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 --2- 172.21.15.71:0/2351161826 >> v2:172.21.15.135:6800/726754104 conn(0x7f63b803eab0 0x7f63b8040f70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f63d8137a20 0x7f63d809ca20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f63d80a5f70 0x7f63d8137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 --2- 172.21.15.71:0/2351161826 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f63d80a5650 0x7f63d8136b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:35.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 >> 172.21.15.71:0/2351161826 conn(0x7f63d80aa360 msgr2=0x7f63d80a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:35.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 shutdown_connections 2024-08-19T11:18:35.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:35.772+0000 7f63dd402640 1 -- 172.21.15.71:0/2351161826 wait complete. 2024-08-19T11:18:38.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.891+0000 7f47eceb3640 10 monclient: get_monmap_and_config 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.891+0000 7f47eceb3640 10 monclient: build_initial_monmap 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.891+0000 7f47eceb3640 10 monclient: monmap: 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:38.892034+0000 2024-08-19T11:18:38.892 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:38.892034+0000 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:38.893 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:38.894 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:38.894 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.891+0000 7f47eceb3640 1 Processor -- start 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 -- start start 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient: init 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient: _add_conns ranks=[2,10,3,4,8,6,7,5,1,0,9] 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): picked mon.noname-b con 0x7f47e80a3cb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): picked mon.noname-f con 0x7f47e80a5020 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): picked mon.noname-g con 0x7f47e8139970 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f47e80a4b10 con 0x7f47e80a5020 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f47e80a13d0 con 0x7f47e80a3cb0 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47e8074530 con 0x7f47e8139970 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47eceb3640 10 monclient(hunting): authenticate will time out at 1176.933730s 2024-08-19T11:18:38.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33462/0 (socket says 172.21.15.71:33462) 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 learned_addr learned my addr 172.21.15.71:0/1331702857 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 10 monclient(hunting): get_auth_request con 0x7f47e80a3cb0 auth_method 0 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.892+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:38.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47e8139970 auth_method 0 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request con 0x7f47e80a5020 auth_method 0 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:38.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:38.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:38.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:38.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:38.893+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:39.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:39.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 10 monclient(hunting): get_auth_request con 0x7f47e80a3cb0 auth_method 0 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47e8139970 auth_method 0 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:39.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request con 0x7f47e80a5020 auth_method 0 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:39.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.094+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:18:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 10 monclient(hunting): get_auth_request con 0x7f47e80a3cb0 auth_method 0 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47e8139970 auth_method 0 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.495+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request con 0x7f47e80a5020 auth_method 0 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:39.496+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:18:40.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 10 monclient(hunting): get_auth_request con 0x7f47e80a3cb0 auth_method 0 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:40.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.296+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:18:40.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:40.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request con 0x7f47e80a5020 auth_method 0 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.297+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47e8139970 auth_method 0 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:40.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:40.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:40.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:40.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:40.298+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:18:41.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): tick 2024-08-19T11:18:41.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 monclient(hunting): continuing hunt 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 msgr2=0x7f47e8139e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47e8139970 0x7f47e8139e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 msgr2=0x7f47e80a4090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47e80a3cb0 0x7f47e80a4090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 msgr2=0x7f47e80a45d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.135:3300/0 conn(0x7f47e80a5020 0x7f47e80a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient: _add_conns ranks=[6,0,9,5,1,7,8,4] 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 0x7f47d0005c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:41.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): picked mon.noname-d con 0x7f47d0003830 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f47d0006280 addr v1:172.21.15.71:6789/0 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): picked mon.noname-a con 0x7f47d0009f90 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 -- 172.21.15.71:0/1331702857 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e80a4da0 con 0x7f47d0006280 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 -- 172.21.15.71:0/1331702857 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f47e80a4b10 con 0x7f47d0009f90 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 1 -- 172.21.15.71:0/1331702857 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f47e80a13d0 con 0x7f47d0003830 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47d7fff640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.892+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 msgr2=0x7f47d0005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.893+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 0x7f47d0005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.893+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.893+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47d0009f90 auth_method 0 2024-08-19T11:18:41.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.893+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:41.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.893+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:41.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.893+0000 7f47e6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:41.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.895+0000 7f47e5d9b640 1 -- 172.21.15.71:0/1331702857 >> v1:172.21.15.71:6789/0 conn(0x7f47d0006280 legacy=0x7f47d00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:41.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.895+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 DispatchQueue::entry inject delay of 0.002000 2024-08-19T11:18:41.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.895+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:18:41.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.895+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:41.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.895+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:41.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:41.895+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:42.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.094+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 msgr2=0x7f47d0005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:42.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.094+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 0x7f47d0005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:18:42.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.096+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47d0009f90 auth_method 0 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:42.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.097+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:18:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.496+0000 7f47e659c640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 msgr2=0x7f47d0005c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.496+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 0x7f47d0005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.498+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.498+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47d0009f90 auth_method 0 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.498+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.498+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.498+0000 7f47e6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.499+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.499+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.499+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.499+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:18:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.924+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061622958 0 0) 0x7f47e80a4da0 con 0x7f47d0006280 2024-08-19T11:18:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.924+0000 7f47e559a640 10 monclient(hunting): _negotiate 2024-08-19T11:18:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.924+0000 7f47e559a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.924+0000 7f47e559a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.924+0000 7f47e559a640 10 monclient(hunting): my global_id is 74988 2024-08-19T11:18:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.924+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c8003520 con 0x7f47d0006280 2024-08-19T11:18:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930242913 0 0) 0x7f47c8003520 con 0x7f47d0006280 2024-08-19T11:18:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 msgr2=0x7f47d0005c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f47d0003830 0x7f47d0005c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 msgr2=0x7f47d000c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 --2- 172.21.15.71:0/1331702857 >> v2:172.21.15.71:3300/0 conn(0x7f47d0009f90 0x7f47d000c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: _finish_hunting 0 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d000dc40 con 0x7f47d0006280 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: _finish_auth 0 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: _check_auth_tickets 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f47dc00d8f0 con 0x7f47d0006280 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: dump: 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 reap_dead start 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 >> v1:172.21.15.71:6789/0 conn(0x7f47d0006280 legacy=0x7f47d00086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient: _add_conns ranks=[1,0,5,7,8,6,2,3,4] 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): picked mon.f con 0x7f47c80041b0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47c8004d90 0x7f47c80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): picked mon.a con 0x7f47c8004d90 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 0x7f47c80148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): picked mon.h con 0x7f47c8012440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47e80a4b10 con 0x7f47c8004d90 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47e80a13d0 con 0x7f47c80041b0 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f47c80151e0 con 0x7f47c8012440 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.926+0000 7f47e559a640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 0x7f47c80148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47c8012440 auth_method 0 2024-08-19T11:18:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): get_auth_request con 0x7f47c80041b0 auth_method 0 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e659c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_done global_id 74988 payload 293 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 msgr2=0x7f47c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47c8004d90 msgr2=0x7f47c80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47c8004d90 0x7f47c80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 monclient: found mon.h 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c8003520 con 0x7f47c8012440 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient: _finish_auth 0 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 10 monclient: _check_auth_tickets 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.927+0000 7f47e6d9d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.928+0000 7f47eceb3640 5 monclient: authenticate success, global_id 74988 2024-08-19T11:18:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.928+0000 7f47eceb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.931+0000 7f47e6d9d640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 msgr2=0x7f47c80148d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.931+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 0x7f47c80148d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f47e806cb10 tx=0x7f47c8005830 comp rx=0 tx=0).ready entity=mon.5 client_cookie=69414579d36cf5d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0032070 con 0x7f47c8012440 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: dump: 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e002cc70 con 0x7f47c8012440 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47eceb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47eceb3640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 1 -- 172.21.15.71:0/1331702857 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0009a50 con 0x7f47c8012440 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47eceb3640 4 set_mon_vals no callback set 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.935+0000 7f47e559a640 10 monclient: dump: 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 10 monclient: shutdown 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 -- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 msgr2=0x7f47c80148d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 0x7f47c80148d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f47e806cb10 tx=0x7f47c8005830 comp rx=0 tx=0).stop 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 -- 172.21.15.71:0/1331702857 shutdown_connections 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47c8004d90 0x7f47c80051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f47c8012440 0x7f47c80148d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 --2- 172.21.15.71:0/1331702857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47c8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 -- 172.21.15.71:0/1331702857 >> 172.21.15.71:0/1331702857 conn(0x7f47e80a91d0 msgr2=0x7f47e80a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 -- 172.21.15.71:0/1331702857 shutdown_connections 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.936+0000 7f47eceb3640 1 -- 172.21.15.71:0/1331702857 wait complete. 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.937+0000 7f47eceb3640 10 monclient: build_initial_monmap 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.937+0000 7f47eceb3640 10 monclient: monmap: 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 Processor -- start 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 -- start start 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient: init 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient: _add_conns ranks=[1,3,2,5,7,6,0,8,4] 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47e8122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): picked mon.noname-f con 0x7f47c80041b0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c8004d90 0x7f47e8120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): picked mon.noname-g con 0x7f47c8004d90 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 0x7f47e81377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): picked mon.noname-b con 0x7f47c8012440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47e80a54f0 con 0x7f47c80041b0 2024-08-19T11:18:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f47e806cb70 con 0x7f47c8012440 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f47e80a4090 con 0x7f47c8004d90 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47eceb3640 10 monclient(hunting): authenticate will time out at 1180.979774s 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 0x7f47e81377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 0x7f47e81377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33502/0 (socket says 172.21.15.71:33502) 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 1 -- 172.21.15.71:0/3812810067 learned_addr learned my addr 172.21.15.71:0/3812810067 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request con 0x7f47c8012440 auth_method 0 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.938+0000 7f47e6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e659c640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47e8122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e659c640 10 monclient(hunting): get_auth_request con 0x7f47c80041b0 auth_method 0 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e5d9b640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c8004d90 0x7f47e8120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request con 0x7f47c8004d90 auth_method 0 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e5d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 10 monclient(hunting): handle_auth_done global_id 74909 payload 824 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 1 -- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c8004d90 msgr2=0x7f47e8120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c8004d90 0x7f47e8120a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 1 -- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 msgr2=0x7f47e8122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47e8122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 1 monclient: found mon.noname-b 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e6d9d640 1 -- 172.21.15.71:0/3812810067 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e8121e20 con 0x7f47c8012440 2024-08-19T11:18:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.939+0000 7f47e659c640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47e8122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47e6d9d640 1 -- 172.21.15.71:0/3812810067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 msgr2=0x7f47e81377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47e6d9d640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 0x7f47e81377d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47e806ced0 tx=0x7f47e0004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0045070 con 0x7f47c8012440 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: dump: 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e0036c10 con 0x7f47c8012440 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 5 monclient: authenticate success, global_id 74909 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 10 monclient: _renew_subs 2024-08-19T11:18:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e80a46f0 con 0x7f47c8012440 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f47e0036dc0 con 0x7f47c8012440 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47d6ffd640 10 monclient: dump: 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 10 monclient: _renew_subs 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47e4d99640 4 set_mon_vals no callback set 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.941+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e81238e0 con 0x7f47c8012440 2024-08-19T11:18:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.942+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f47e0048070 con 0x7f47c8012440 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.942+0000 7f47eceb3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.942+0000 7f47eceb3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.942+0000 7f47eceb3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.942+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e80a43c0 con 0x7f47c8012440 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.943+0000 7f47d6ffd640 1 --2- 172.21.15.71:0/3812810067 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003f860 0x7f47d0041d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.943+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (secure 0 0 0) 0x7f47e0074090 con 0x7f47c8012440 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.943+0000 7f47e659c640 1 --2- 172.21.15.71:0/3812810067 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003f860 0x7f47d0041d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.943+0000 7f47e659c640 10 monclient: get_auth_request con 0x7f47d003f860 auth_method 0 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.945+0000 7f47e659c640 1 --2- 172.21.15.71:0/3812810067 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003f860 0x7f47d0041d20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f47d8008010 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.947+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f47e002ce20 con 0x7f47c8012440 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.947+0000 7f47d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:42.947+0000 7f47d6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:43.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.191+0000 7f47eceb3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.191+0000 7f47eceb3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.191+0000 7f47eceb3640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.191+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47e806ed40 con 0x7f47c8012440 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.192+0000 7f47d6ffd640 1 -- 172.21.15.71:0/3812810067 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7f47e0010040 con 0x7f47c8012440 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.192+0000 7f47d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.192+0000 7f47d6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:43.193 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":174,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003f860 msgr2=0x7f47d0041d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 --2- 172.21.15.71:0/3812810067 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003f860 0x7f47d0041d20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f47d8008010 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 10 monclient: shutdown 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 msgr2=0x7f47e81377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 0x7f47e81377d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47e806ced0 tx=0x7f47e0004ab0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 shutdown_connections 2024-08-19T11:18:43.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 --2- 172.21.15.71:0/3812810067 >> v2:172.21.15.135:6800/726754104 conn(0x7f47d003f860 0x7f47d0041d20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f47c8012440 0x7f47e81377d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f47c8004d90 0x7f47e8120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 --2- 172.21.15.71:0/3812810067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47c80041b0 0x7f47e8122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 >> 172.21.15.71:0/3812810067 conn(0x7f47e80a91d0 msgr2=0x7f47e809ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 shutdown_connections 2024-08-19T11:18:43.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.194+0000 7f47eceb3640 1 -- 172.21.15.71:0/3812810067 wait complete. 2024-08-19T11:18:43.206 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-19T11:18:43.206 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-19T11:18:43.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:18:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.304+0000 7fd76bfaa640 10 monclient: get_monmap_and_config 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.304+0000 7fd76bfaa640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.304+0000 7fd76bfaa640 10 monclient: monmap: 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:43.305505+0000 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:43.305505+0000 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:43.307 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.305+0000 7fd76bfaa640 1 Processor -- start 2024-08-19T11:18:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.305+0000 7fd76bfaa640 1 -- start start 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.305+0000 7fd76bfaa640 10 monclient: init 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient: _add_conns ranks=[4,2,9,7,10,0,3,8,1,6,5] 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7640a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): picked mon.noname-c con 0x7fd7640a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 0x7fd7640a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): picked mon.noname-b con 0x7fd7640a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 0x7fd764139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): picked mon.noname-a con 0x7fd764139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd7640a5020 con 0x7fd764139710 2024-08-19T11:18:43.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd7640a77b0 con 0x7fd7640a57c0 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd7640a7d40 con 0x7fd7640a6950 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76bfaa640 10 monclient(hunting): authenticate will time out at 1181.347244s 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 0x7fd7640a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7640a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 0x7fd764139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 0x7fd7640a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33518/0 (socket says 172.21.15.71:33518) 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 0x7fd764139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54482/0 (socket says 172.21.15.71:54482) 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7640a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35442/0 (socket says 172.21.15.71:35442) 2024-08-19T11:18:43.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 -- 172.21.15.71:0/109190839 learned_addr learned my addr 172.21.15.71:0/109190839 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): get_auth_request con 0x7fd7640a57c0 auth_method 0 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): get_auth_request con 0x7fd764139710 auth_method 0 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): get_auth_request con 0x7fd7640a6950 auth_method 0 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient(hunting): handle_auth_done global_id 74918 payload 274 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 -- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 msgr2=0x7fd7640a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 --2- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7640a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 -- 172.21.15.71:0/109190839 >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 msgr2=0x7fd764139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 --2- 172.21.15.71:0/109190839 >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 0x7fd764139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 monclient: found mon.noname-b 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769545640 1 -- 172.21.15.71:0/109190839 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7640a6380 con 0x7fd7640a57c0 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd769d46640 1 --2- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7640a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.306+0000 7fd76a547640 1 --2- 172.21.15.71:0/109190839 >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 0x7fd764139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd769545640 1 -- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 msgr2=0x7fd7640a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd769545640 1 --2- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 0x7fd7640a7270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7540098a0 tx=0x7fd75402a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b684b7beac7fc43 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 1 -- 172.21.15.71:0/109190839 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd754037070 con 0x7fd7640a57c0 2024-08-19T11:18:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: dump: 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 1 -- 172.21.15.71:0/109190839 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75402adf0 con 0x7fd7640a57c0 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd76bfaa640 5 monclient: authenticate success, global_id 74918 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd76bfaa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd76bfaa640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 1 -- 172.21.15.71:0/109190839 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd754030c20 con 0x7fd7640a57c0 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd76bfaa640 4 set_mon_vals no callback set 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.309+0000 7fd768d44640 10 monclient: dump: 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 10 monclient: shutdown 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 -- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 msgr2=0x7fd7640a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 0x7fd7640a7270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7540098a0 tx=0x7fd75402a0d0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 -- 172.21.15.71:0/109190839 shutdown_connections 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/109190839 >> v2:172.21.15.71:3300/0 conn(0x7fd764139710 0x7fd764139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd7640a57c0 0x7fd7640a7270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/109190839 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7640a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 -- 172.21.15.71:0/109190839 >> 172.21.15.71:0/109190839 conn(0x7fd7640abf50 msgr2=0x7fd7640ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 -- 172.21.15.71:0/109190839 shutdown_connections 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 1 -- 172.21.15.71:0/109190839 wait complete. 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.310+0000 7fd76bfaa640 10 monclient: monmap: 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 Processor -- start 2024-08-19T11:18:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 -- start start 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient: init 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient: _add_conns ranks=[1,4,5,7,3,6,8,0,2] 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7640a57c0 0x7fd7641cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): picked mon.noname-f con 0x7fd7640a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7641cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): picked mon.noname-c con 0x7fd7640a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd764139710 0x7fd764123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): picked mon.noname-h con 0x7fd764139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7640a84c0 con 0x7fd7640a57c0 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd7640a3650 con 0x7fd7640a6950 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fd7640a8700 con 0x7fd764139710 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76bfaa640 10 monclient(hunting): authenticate will time out at 1181.352766s 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7641cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7641cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35456/0 (socket says 172.21.15.71:35456) 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 1 -- 172.21.15.71:0/3391332969 learned_addr learned my addr 172.21.15.71:0/3391332969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): get_auth_request con 0x7fd7640a6950 auth_method 0 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769545640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769d46640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7640a57c0 0x7fd7641cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769d46640 10 monclient(hunting): get_auth_request con 0x7fd7640a57c0 auth_method 0 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769d46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769d46640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd769d46640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.311+0000 7fd76a547640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd764139710 0x7fd764123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd76a547640 10 monclient(hunting): get_auth_request con 0x7fd764139710 auth_method 0 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd76a547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd76a547640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd76a547640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 10 monclient(hunting): handle_auth_done global_id 84595 payload 824 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd764139710 msgr2=0x7fd764123100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fd764139710 0x7fd764123100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7640a57c0 msgr2=0x7fd7641cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7640a57c0 0x7fd7641cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 1 monclient: found mon.noname-c 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769545640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76413a200 con 0x7fd7640a6950 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.312+0000 7fd769d46640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7640a57c0 0x7fd7641cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd769545640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 msgr2=0x7fd7641cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd769545640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7641cf120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd7540090b0 tx=0x7fd7540046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd754041020 con 0x7fd7640a6950 2024-08-19T11:18:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: dump: 2024-08-19T11:18:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.333 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd754003d50 con 0x7fd7640a6950 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 5 monclient: authenticate success, global_id 84595 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd754037040 con 0x7fd7640a6950 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 10 monclient: _renew_subs 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7641267c0 con 0x7fd7640a6950 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75bfff640 4 set_mon_vals no callback set 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd75a7fc640 10 monclient: dump: 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.335 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.336 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 10 monclient: _renew_subs 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.314+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7640a1db0 con 0x7fd7640a6950 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd76bfaa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 0x7fd76402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd764076c60 con 0x7fd764123e00 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 0x7fd76402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient: get_auth_request con 0x7fd764123e00 auth_method 0 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd754044020 con 0x7fd7640a6950 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 10 monclient(hunting): handle_auth_done global_id 75006 payload 824 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd769d46640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7640a2300 con 0x7fd764123e00 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd75a7fc640 1 --2- 172.21.15.71:0/3391332969 >> v2:172.21.15.135:6800/726754104 conn(0x7fd74803ea80 0x7fd748040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.315+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (secure 0 0 0) 0x7fd754071ae0 con 0x7fd7640a6950 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.316+0000 7fd76a547640 1 --2- 172.21.15.71:0/3391332969 >> v2:172.21.15.135:6800/726754104 conn(0x7fd74803ea80 0x7fd748040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.316+0000 7fd76a547640 10 monclient: get_auth_request con 0x7fd74803ea80 auth_method 0 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd769d46640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 msgr2=0x7fd76402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd769d46640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 0x7fd76402d1c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd760007f30 tx=0x7fd760011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd76001a020 con 0x7fd764123e00 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 10 monclient: dump: 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.339 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd760016890 con 0x7fd764123e00 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 msgr2=0x7fd76402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 0x7fd76402d1c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd760007f30 tx=0x7fd760011660 comp rx=0 tx=0).stop 2024-08-19T11:18:43.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 msgr2=0x7fd76402d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd75a7fc640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd764123e00 0x7fd76402d1c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.318+0000 7fd76a547640 1 --2- 172.21.15.71:0/3391332969 >> v2:172.21.15.135:6800/726754104 conn(0x7fd74803ea80 0x7fd748040f40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0099b0 tx=0x7fd75c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd76bfaa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 0x7fd76402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd76bfaa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7640a6d30 con 0x7fd7641241e0 2024-08-19T11:18:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 0x7fd76402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient: get_auth_request con 0x7fd7641241e0 auth_method 0 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 10 monclient(hunting): handle_auth_done global_id 75015 payload 824 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.324+0000 7fd769d46640 1 -- 172.21.15.71:0/3391332969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd76409f110 con 0x7fd7641241e0 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd769d46640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 msgr2=0x7fd76402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd769d46640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 0x7fd76402d700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd76001b000 tx=0x7fd760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd76001a030 con 0x7fd7641241e0 2024-08-19T11:18:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 10 monclient: dump: 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9426 (secure 0 0 0) 0x7fd760021020 con 0x7fd7641241e0 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 msgr2=0x7fd76402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 0x7fd76402d700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd76001b000 tx=0x7fd760004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 msgr2=0x7fd76402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd75a7fc640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7641241e0 0x7fd76402d700 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd76001b000 tx=0x7fd760004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 172359, 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:43.350 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.351 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:43.352 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:43.353 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:43.354 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.355 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:43.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:43.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:43.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.366 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.368 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.372 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.373 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.374 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:43.374 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 >> v2:172.21.15.135:6800/726754104 conn(0x7fd74803ea80 msgr2=0x7fd748040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/3391332969 >> v2:172.21.15.135:6800/726754104 conn(0x7fd74803ea80 0x7fd748040f40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0099b0 tx=0x7fd75c008040 comp rx=0 tx=0).stop 2024-08-19T11:18:43.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 10 monclient: shutdown 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 msgr2=0x7fd7641cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 --2- 172.21.15.71:0/3391332969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7640a6950 0x7fd7641cf120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd7540090b0 tx=0x7fd7540046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76a547640 1 -- 172.21.15.71:0/3391332969 reap_dead start 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76a547640 1 -- 172.21.15.71:0/3391332969 reap_dead start 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 shutdown_connections 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 >> 172.21.15.71:0/3391332969 conn(0x7fd7640abf50 msgr2=0x7fd7640aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 shutdown_connections 2024-08-19T11:18:43.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.327+0000 7fd76bfaa640 1 -- 172.21.15.71:0/3391332969 wait complete. 2024-08-19T11:18:43.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:43.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-19T11:18:43.377 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:18:43.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.474+0000 7fc8b69b1640 10 monclient: get_monmap_and_config 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.474+0000 7fc8b69b1640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.474+0000 7fc8b69b1640 10 monclient: monmap: 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:43.475144+0000 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:43.475144+0000 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.476 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 Processor -- start 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 -- start start 2024-08-19T11:18:43.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient: init 2024-08-19T11:18:43.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient: _add_conns ranks=[9,5,4,1,3,6,2,10,0,7,8] 2024-08-19T11:18:43.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8b00a6950 0x7fc8b00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): picked mon.noname-a con 0x7fc8b00a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:43.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc8b00a57c0 0x7fc8b00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): picked mon.noname-h con 0x7fc8b00a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 0x7fc8b0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): picked mon.noname-c con 0x7fc8b0139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b00a5020 con 0x7fc8b00a6950 2024-08-19T11:18:43.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc8b00a77b0 con 0x7fc8b0139710 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc8b00a7d40 con 0x7fc8b00a57c0 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b69b1640 10 monclient(hunting): authenticate will time out at 1181.516758s 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8affff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8b00a6950 0x7fc8b00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 0x7fc8b0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 0x7fc8b0139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35470/0 (socket says 172.21.15.71:35470) 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8affff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8b00a6950 0x7fc8b00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54520/0 (socket says 172.21.15.71:54520) 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/816046950 learned_addr learned my addr 172.21.15.71:0/816046950 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 10 monclient(hunting): get_auth_request con 0x7fc8b0139710 auth_method 0 2024-08-19T11:18:43.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8b4f4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8affff640 10 monclient(hunting): get_auth_request con 0x7fc8b00a6950 auth_method 0 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8affff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.475+0000 7fc8affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8af7fe640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc8b00a57c0 0x7fc8b00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8af7fe640 10 monclient(hunting): get_auth_request con 0x7fc8b00a57c0 auth_method 0 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8af7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 10 monclient(hunting): handle_auth_done global_id 75024 payload 274 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 1 -- 172.21.15.71:0/816046950 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc8b00a57c0 msgr2=0x7fc8b00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc8b00a57c0 0x7fc8b00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 1 -- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 msgr2=0x7fc8b0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 0x7fc8b0139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 1 monclient: found mon.noname-a 2024-08-19T11:18:43.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8affff640 1 -- 172.21.15.71:0/816046950 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b00a6380 con 0x7fc8b00a6950 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.476+0000 7fc8b4f4e640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 0x7fc8b0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8affff640 1 -- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8b00a6950 msgr2=0x7fc8b00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8affff640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8b00a6950 0x7fc8b00a6d30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00097d0 tx=0x7fc8a002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cc9d9b0fcc32b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 1 -- 172.21.15.71:0/816046950 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8a0037070 con 0x7fc8b00a6950 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: dump: 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.489 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.490 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 5 monclient: authenticate success, global_id 75024 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 1 -- 172.21.15.71:0/816046950 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a002ad20 con 0x7fc8b00a6950 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 1 -- 172.21.15.71:0/816046950 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8a0030c20 con 0x7fc8b00a6950 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8aeffd640 10 monclient: dump: 2024-08-19T11:18:43.491 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.492 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 4 set_mon_vals no callback set 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 10 monclient: shutdown 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 -- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8b00a6950 msgr2=0x7fc8b00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8b00a6950 0x7fc8b00a6d30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00097d0 tx=0x7fc8a002a000 comp rx=0 tx=0).stop 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 -- 172.21.15.71:0/816046950 shutdown_connections 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc8b0139710 0x7fc8b0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc8b00a57c0 0x7fc8b00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/816046950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8b00a6950 0x7fc8b00a6d30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 -- 172.21.15.71:0/816046950 >> 172.21.15.71:0/816046950 conn(0x7fc8b00abf50 msgr2=0x7fc8b00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 -- 172.21.15.71:0/816046950 shutdown_connections 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.479+0000 7fc8b69b1640 1 -- 172.21.15.71:0/816046950 wait complete. 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.480+0000 7fc8b69b1640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.480+0000 7fc8b69b1640 10 monclient: monmap: 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.494 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.480+0000 7fc8b69b1640 1 Processor -- start 2024-08-19T11:18:43.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.480+0000 7fc8b69b1640 1 -- start start 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.480+0000 7fc8b69b1640 10 monclient: init 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient: _add_conns ranks=[6,1,8,7,3,4,0,2,5] 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc8b00a57c0 0x7fc8b0138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): picked mon.noname-d con 0x7fc8b00a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b00a6950 0x7fc8b0138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): picked mon.noname-f con 0x7fc8b00a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 0x7fc8b01225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): picked mon.noname-e con 0x7fc8b0139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b00a84c0 con 0x7fc8b00a6950 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc8b00a3650 con 0x7fc8b00a57c0 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc8b00a8700 con 0x7fc8b0139710 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8affff640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc8b00a57c0 msgr2=0x7fc8b0138550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b69b1640 10 monclient(hunting): authenticate will time out at 1181.522427s 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8affff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc8b00a57c0 0x7fc8b0138550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 0x7fc8b01225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 0x7fc8b01225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53096/0 (socket says 172.21.15.71:53096) 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/3823758434 learned_addr learned my addr 172.21.15.71:0/3823758434 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): get_auth_request con 0x7fc8b0139710 auth_method 0 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b00a6950 0x7fc8b0138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): get_auth_request con 0x7fc8b00a6950 auth_method 0 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient(hunting): handle_auth_done global_id 94256 payload 824 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc8b00a57c0 msgr2=0x7fc8b0138550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc8b00a57c0 0x7fc8b0138550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b00a6950 msgr2=0x7fc8b0138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b00a6950 0x7fc8b0138a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 monclient: found mon.noname-e 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.481+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b00a1e00 con 0x7fc8b0139710 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.483+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 msgr2=0x7fc8b01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.483+0000 7fc8b4f4e640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 0x7fc8b01225a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800efc0 tx=0x7fc8a800c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8a800cdf0 con 0x7fc8b0139710 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: dump: 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.505 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.506 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 5 monclient: authenticate success, global_id 94256 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a80148f0 con 0x7fc8b0139710 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8a80073f0 con 0x7fc8b0139710 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 10 monclient: _renew_subs 2024-08-19T11:18:43.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b0125e20 con 0x7fc8b0139710 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8ae7fc640 4 set_mon_vals no callback set 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8acff9640 10 monclient: dump: 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.508 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 10 monclient: _renew_subs 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.484+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b013a2f0 con 0x7fc8b0139710 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc8a801b070 con 0x7fc8b0139710 2024-08-19T11:18:43.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8b69b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 0x7fc8b002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b0076c60 con 0x7fc8b01232a0 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 0x7fc8b002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8acff9640 1 --2- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 0x7fc89c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient: get_auth_request con 0x7fc8b01232a0 auth_method 0 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (secure 0 0 0) 0x7fc8a8019020 con 0x7fc8b0139710 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8af7fe640 1 --2- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 0x7fc89c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8af7fe640 10 monclient: get_auth_request con 0x7fc89c03ea80 auth_method 0 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 10 monclient(hunting): handle_auth_done global_id 74927 payload 824 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8affff640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8b0124960 con 0x7fc8b01232a0 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8af7fe640 1 -- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 msgr2=0x7fc89c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8af7fe640 1 -- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 msgr2=0x7fc89c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8af7fe640 1 --2- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 0x7fc89c040f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0124410 tx=0x7fc8a4008040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.485+0000 7fc8af7fe640 1 --2- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 0x7fc89c040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.487+0000 7fc8affff640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 msgr2=0x7fc8b002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.487+0000 7fc8affff640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 0x7fc8b002d1c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.487+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8a0041020 con 0x7fc8b01232a0 2024-08-19T11:18:43.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.487+0000 7fc8acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.487+0000 7fc8acff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.487+0000 7fc8acff9640 10 monclient: dump: 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.512 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc8a002ad20 con 0x7fc8b01232a0 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 msgr2=0x7fc8b002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 0x7fc8b002d1c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 msgr2=0x7fc8b002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.488+0000 7fc8acff9640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b01232a0 0x7fc8b002d1c0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8b69b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 0x7fc8b002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8b69b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b00a6d30 con 0x7fc8b0123680 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 0x7fc8b002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient: get_auth_request con 0x7fc8b0123680 auth_method 0 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 10 monclient(hunting): handle_auth_done global_id 74936 payload 824 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.494+0000 7fc8affff640 1 -- 172.21.15.71:0/3823758434 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc8b009e100 con 0x7fc8b0123680 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.496+0000 7fc8affff640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 msgr2=0x7fc8b002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.496+0000 7fc8affff640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 0x7fc8b002d700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a0009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.496+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc8a0041040 con 0x7fc8b0123680 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.496+0000 7fc8acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 10 monclient: dump: 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.515 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.516 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9257 (secure 0 0 0) 0x7fc8a0030340 con 0x7fc8b0123680 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 msgr2=0x7fc8b002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 0x7fc8b002d700 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a0009190 comp rx=0 tx=0).stop 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 msgr2=0x7fc8b002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8acff9640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc8b0123680 0x7fc8b002d700 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000c00 tx=0x7fc8a0009190 comp rx=0 tx=0).stop 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:43.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 172528, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:43.518 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.519 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.520 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:43.521 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:43.522 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:43.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:43.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:43.541 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 msgr2=0x7fc89c040f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/3823758434 >> v2:172.21.15.135:6800/726754104 conn(0x7fc89c03ea80 0x7fc89c040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 10 monclient: shutdown 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 msgr2=0x7fc8b01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b4f4e640 1 -- 172.21.15.71:0/3823758434 reap_dead start 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 0x7fc8b01225a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800efc0 tx=0x7fc8a800c490 comp rx=0 tx=0).stop 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 shutdown_connections 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 --2- 172.21.15.71:0/3823758434 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8b0139710 0x7fc8b01225a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 >> 172.21.15.71:0/3823758434 conn(0x7fc8b00abf50 msgr2=0x7fc8b00aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 shutdown_connections 2024-08-19T11:18:43.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.497+0000 7fc8b69b1640 1 -- 172.21.15.71:0/3823758434 wait complete. 2024-08-19T11:18:43.544 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:43.544 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-19T11:18:43.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:18:43.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.641+0000 7fae88be7640 10 monclient: get_monmap_and_config 2024-08-19T11:18:43.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.641+0000 7fae88be7640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.641+0000 7fae88be7640 10 monclient: monmap: 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:43.642249+0000 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:43.642249+0000 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.643 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.644 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.644 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:43.644 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:43.644 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 Processor -- start 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 -- start start 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient: init 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient: _add_conns ranks=[1,2,6,9,3,5,7,10,8,0,4] 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fae840a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 0x7fae8413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): picked mon.noname-b con 0x7fae840a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:43.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fae840a7440 0x7fae841410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): picked mon.noname-d con 0x7fae840a7440 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae840a6380 con 0x7fae840a6950 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fae840a5020 con 0x7fae840a57c0 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fae840a7d40 con 0x7fae840a7440 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae88be7640 10 monclient(hunting): authenticate will time out at 1181.683735s 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae82d9d640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fae840a7440 msgr2=0x7fae841410b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae82d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fae840a7440 0x7fae841410b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 0x7fae8413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 0x7fae8413eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33534/0 (socket says 172.21.15.71:33534) 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 1 -- 172.21.15.71:0/2458412253 learned_addr learned my addr 172.21.15.71:0/2458412253 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): get_auth_request con 0x7fae840a57c0 auth_method 0 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.642+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 10 monclient(hunting): handle_auth_done global_id 74945 payload 274 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 1 -- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fae840a7440 msgr2=0x7fae841410b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 1 --2- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fae840a7440 0x7fae841410b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 1 -- 172.21.15.71:0/2458412253 >> v1:172.21.15.135:6789/0 conn(0x7fae840a6950 legacy=0x7fae840a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 1 monclient: found mon.noname-b 2024-08-19T11:18:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:43.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.643+0000 7fae79d9b640 1 -- 172.21.15.71:0/2458412253 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840a3650 con 0x7fae840a57c0 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.645+0000 7fae79d9b640 1 -- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 msgr2=0x7fae8413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.645+0000 7fae79d9b640 1 --2- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 0x7fae8413eb60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0098d0 tx=0x7fae6c02a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38e106119762b00 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 1 -- 172.21.15.71:0/2458412253 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fae6c037070 con 0x7fae840a57c0 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: dump: 2024-08-19T11:18:43.655 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.656 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 1 -- 172.21.15.71:0/2458412253 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6c0307b0 con 0x7fae840a57c0 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 5 monclient: authenticate success, global_id 74945 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 1 -- 172.21.15.71:0/2458412253 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fae6c030e10 con 0x7fae840a57c0 2024-08-19T11:18:43.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae81d9b640 10 monclient: dump: 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.658 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 4 set_mon_vals no callback set 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 10 monclient: shutdown 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 -- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 msgr2=0x7fae8413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 --2- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 0x7fae8413eb60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0098d0 tx=0x7fae6c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 -- 172.21.15.71:0/2458412253 shutdown_connections 2024-08-19T11:18:43.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 --2- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fae840a7440 0x7fae841410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 --2- 172.21.15.71:0/2458412253 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fae840a57c0 0x7fae8413eb60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 -- 172.21.15.71:0/2458412253 >> 172.21.15.71:0/2458412253 conn(0x7fae840abf50 msgr2=0x7fae840ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 -- 172.21.15.71:0/2458412253 shutdown_connections 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.646+0000 7fae88be7640 1 -- 172.21.15.71:0/2458412253 wait complete. 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.647+0000 7fae88be7640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.647+0000 7fae88be7640 10 monclient: monmap: 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 Processor -- start 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 -- start start 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient: init 2024-08-19T11:18:43.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient: _add_conns ranks=[8,3,1,6,2,0,7,5,4] 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 0x7fae841ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): picked mon.noname-e con 0x7fae840a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae840a6950 0x7fae84139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): picked mon.noname-g con 0x7fae840a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae840a7440 0x7fae8413ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): picked mon.noname-f con 0x7fae840a7440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae840a8700 con 0x7fae840a7440 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fae840a84c0 con 0x7fae840a6950 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fae841415f0 con 0x7fae840a57c0 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae88be7640 10 monclient(hunting): authenticate will time out at 1181.689710s 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 0x7fae841ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 0x7fae841ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53108/0 (socket says 172.21.15.71:53108) 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 1 -- 172.21.15.71:0/4278422013 learned_addr learned my addr 172.21.15.71:0/4278422013 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): get_auth_request con 0x7fae840a57c0 auth_method 0 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.648+0000 7fae8259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 10 monclient(hunting): handle_auth_done global_id 94265 payload 824 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae840a6950 msgr2=0x7fae84139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae79d9b640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae840a6950 0x7fae84139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae82d9d640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae840a7440 0x7fae8413ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae840a6950 0x7fae84139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae840a7440 msgr2=0x7fae8413ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae840a7440 0x7fae8413ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 1 monclient: found mon.noname-e 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae8259c640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae84140cc0 con 0x7fae840a57c0 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae79d9b640 10 monclient: get_auth_request con 0x7fae840a6950 auth_method 0 2024-08-19T11:18:43.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.649+0000 7fae79d9b640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fae840a6950 0x7fae84139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae8259c640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 msgr2=0x7fae841ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae8259c640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 0x7fae841ce670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c430 tx=0x7fae7400c8f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae8259c640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 0x7fae841ce670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c430 tx=0x7fae7400c8f0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fae74011c10 mon_map magic: 0 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fae74011c10 con 0x7fae840a57c0 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 10 monclient: dump: 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 5 monclient: authenticate success, global_id 94265 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae74017070 con 0x7fae840a57c0 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae7b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 10 monclient: _renew_subs 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae841cf590 con 0x7fae840a57c0 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae8159a640 4 set_mon_vals no callback set 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 10 monclient: _renew_subs 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.651+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fae84124420 con 0x7fae840a57c0 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae88be7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae88be7640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 0x7fae8413f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fae84141210 con 0x7fae84139fd0 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fae74011e10 con 0x7fae840a57c0 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae7b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae7b7fe640 10 monclient: dump: 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fae740117a0 con 0x7fae840a57c0 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 0x7fae8413f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient: get_auth_request con 0x7fae84139fd0 auth_method 0 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae7b7fe640 1 --2- 172.21.15.71:0/4278422013 >> v2:172.21.15.135:6800/726754104 conn(0x7fae6403ead0 0x7fae64040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 10 monclient(hunting): handle_auth_done global_id 84613 payload 824 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae79d9b640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae840a9510 con 0x7fae84139fd0 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae82d9d640 1 --2- 172.21.15.71:0/4278422013 >> v2:172.21.15.135:6800/726754104 conn(0x7fae6403ead0 0x7fae64040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.652+0000 7fae82d9d640 10 monclient: get_auth_request con 0x7fae6403ead0 auth_method 0 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.654+0000 7fae79d9b640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 msgr2=0x7fae8413f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.654+0000 7fae79d9b640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 0x7fae8413f210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fae840a2e70 tx=0x7fae6c0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fae6c037040 con 0x7fae84139fd0 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 10 monclient: dump: 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fae6c003a30 con 0x7fae84139fd0 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 msgr2=0x7fae8413f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 0x7fae8413f210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fae840a2e70 tx=0x7fae6c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 msgr2=0x7fae8413f210 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae7b7fe640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae84139fd0 0x7fae8413f210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.655+0000 7fae82d9d640 1 --2- 172.21.15.71:0/4278422013 >> v2:172.21.15.135:6800/726754104 conn(0x7fae6403ead0 0x7fae64040f90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fae7c003cb0 tx=0x7fae7c0071c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae88be7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae88be7640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 0x7fae8413ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae88be7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fae84076c60 con 0x7fae8413f750 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 0x7fae8413ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient: get_auth_request con 0x7fae8413f750 auth_method 0 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 10 monclient(hunting): handle_auth_done global_id 84622 payload 824 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.661+0000 7fae79d9b640 1 -- 172.21.15.71:0/4278422013 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae8413fb60 con 0x7fae8413f750 2024-08-19T11:18:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae79d9b640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 msgr2=0x7fae8413ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae79d9b640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 0x7fae8413ab40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097c0 tx=0x7fae6c008030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fae6c04c070 con 0x7fae8413f750 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 10 monclient: dump: 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7fae6c047280 con 0x7fae8413f750 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 msgr2=0x7fae8413ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 0x7fae8413ab40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097c0 tx=0x7fae6c008030 comp rx=0 tx=0).stop 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 msgr2=0x7fae8413ab40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fae8413f750 0x7fae8413ab40 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097c0 tx=0x7fae6c008030 comp rx=0 tx=0).stop 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:43.679 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 105811, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.680 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.681 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.682 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:43.683 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:43.684 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:43.685 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.686 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.690 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:43.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.699 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.703 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:43.705 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 >> v2:172.21.15.135:6800/726754104 conn(0x7fae6403ead0 msgr2=0x7fae64040f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 --2- 172.21.15.71:0/4278422013 >> v2:172.21.15.135:6800/726754104 conn(0x7fae6403ead0 0x7fae64040f90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fae7c003cb0 tx=0x7fae7c0071c0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 10 monclient: shutdown 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 msgr2=0x7fae841ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 --2- 172.21.15.71:0/4278422013 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fae840a57c0 0x7fae841ce670 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c430 tx=0x7fae7400c8f0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae82d9d640 1 -- 172.21.15.71:0/4278422013 reap_dead start 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae7b7fe640 1 -- 172.21.15.71:0/4278422013 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 0 0 0) 0x7fae74052160 con 0x7fae840a57c0 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae82d9d640 1 -- 172.21.15.71:0/4278422013 reap_dead start 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 shutdown_connections 2024-08-19T11:18:43.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 >> 172.21.15.71:0/4278422013 conn(0x7fae840abf50 msgr2=0x7fae8409f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 shutdown_connections 2024-08-19T11:18:43.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.664+0000 7fae88be7640 1 -- 172.21.15.71:0/4278422013 wait complete. 2024-08-19T11:18:43.708 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:43.708 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-08-19T11:18:43.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:18:43.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.809+0000 7f5617b21640 10 monclient: get_monmap_and_config 2024-08-19T11:18:43.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.809+0000 7f5617b21640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.809+0000 7f5617b21640 10 monclient: monmap: 2024-08-19T11:18:43.813 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.813 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.813 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:43.809675+0000 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:43.809675+0000 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.814 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.809+0000 7f5617b21640 1 Processor -- start 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.809+0000 7f5617b21640 1 -- start start 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.809+0000 7f5617b21640 10 monclient: init 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient: _add_conns ranks=[8,10,4,3,5,9,6,2,0,1,7] 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f561009d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): picked mon.noname-e con 0x7f5610136730 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5610136b10 0x7f56100a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): picked mon.noname-f con 0x7f5610136b10 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 0x7f56100a4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): picked mon.noname-c con 0x7f5610136f50 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f561009e260 con 0x7f5610136b10 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f561009e540 con 0x7f5610136f50 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f561009e820 con 0x7f5610136730 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f5617b21640 10 monclient(hunting): authenticate will time out at 1181.851309s 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 0x7f56100a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f561009d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 0x7f56100a4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35490/0 (socket says 172.21.15.71:35490) 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 -- 172.21.15.71:0/1889445957 learned_addr learned my addr 172.21.15.71:0/1889445957 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): get_auth_request con 0x7f5610136f50 auth_method 0 2024-08-19T11:18:43.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): get_auth_request con 0x7f5610136730 auth_method 0 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 1 --2- 172.21.15.71:0/1889445957 >> v2:172.21.15.135:3300/0 conn(0x7f5610136b10 0x7f56100a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): get_auth_request con 0x7f5610136b10 auth_method 0 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient(hunting): handle_auth_done global_id 84631 payload 274 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 -- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 msgr2=0x7f561009d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 --2- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f561009d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 -- 172.21.15.71:0/1889445957 >> v2:172.21.15.135:3300/0 conn(0x7f5610136b10 msgr2=0x7f56100a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 --2- 172.21.15.71:0/1889445957 >> v2:172.21.15.135:3300/0 conn(0x7f5610136b10 0x7f56100a3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 monclient: found mon.noname-c 2024-08-19T11:18:43.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:43.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56160be640 1 -- 172.21.15.71:0/1889445957 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56101362b0 con 0x7f5610136f50 2024-08-19T11:18:43.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.810+0000 7f56158bd640 1 --2- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f561009d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:43.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56160be640 1 -- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 msgr2=0x7f56100a4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56160be640 1 --2- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 0x7f56100a4040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f560000bb10 tx=0x7f560002c750 comp rx=0 tx=0).ready entity=mon.4 client_cookie=ba6a4cd2480cb8c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 1 -- 172.21.15.71:0/1889445957 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5600031b90 con 0x7f5610136f50 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: dump: 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.827 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f5617b21640 5 monclient: authenticate success, global_id 84631 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f5617b21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 1 -- 172.21.15.71:0/1889445957 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5600031d50 con 0x7f5610136f50 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f5617b21640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f5617b21640 4 set_mon_vals no callback set 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 1 -- 172.21.15.71:0/1889445957 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5600033870 con 0x7f5610136f50 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.813+0000 7f56148bb640 10 monclient: dump: 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.829 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.830 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 10 monclient: shutdown 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 -- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 msgr2=0x7f56100a4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 --2- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 0x7f56100a4040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f560000bb10 tx=0x7f560002c750 comp rx=0 tx=0).stop 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 -- 172.21.15.71:0/1889445957 shutdown_connections 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 --2- 172.21.15.71:0/1889445957 >> v2:172.21.15.135:3300/0 conn(0x7f5610136b10 0x7f56100a3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 --2- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f5610136f50 0x7f56100a4040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 --2- 172.21.15.71:0/1889445957 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f561009d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 -- 172.21.15.71:0/1889445957 >> 172.21.15.71:0/1889445957 conn(0x7f56100a4bf0 msgr2=0x7f56100a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 -- 172.21.15.71:0/1889445957 shutdown_connections 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.814+0000 7f5617b21640 1 -- 172.21.15.71:0/1889445957 wait complete. 2024-08-19T11:18:43.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient: monmap: 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.832 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 Processor -- start 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 -- start start 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient: init 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient: _add_conns ranks=[8,1,5,4,2,7,3,0,6] 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f56101ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): picked mon.noname-e con 0x7f5610136730 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5610136b10 0x7f561009c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): picked mon.noname-f con 0x7f5610136b10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:43.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5610136f50 0x7f561009c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): picked mon.noname-h con 0x7f5610136f50 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56100a4700 con 0x7f5610136b10 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f56100a4580 con 0x7f5610136f50 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f56100a4880 con 0x7f5610136730 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.815+0000 7f5617b21640 10 monclient(hunting): authenticate will time out at 1181.856970s 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f56101ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f56101ce960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53132/0 (socket says 172.21.15.71:53132) 2024-08-19T11:18:43.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 -- 172.21.15.71:0/3431415273 learned_addr learned my addr 172.21.15.71:0/3431415273 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): get_auth_request con 0x7f5610136730 auth_method 0 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56150bc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5610136b10 0x7f561009c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5610136f50 0x7f561009c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56150bc640 10 monclient(hunting): get_auth_request con 0x7f5610136b10 auth_method 0 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56150bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56150bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56150bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): get_auth_request con 0x7f5610136f50 auth_method 0 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56160be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient(hunting): handle_auth_done global_id 94283 payload 824 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5610136f50 msgr2=0x7f561009c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5610136f50 0x7f561009c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5610136b10 msgr2=0x7f561009c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5610136b10 0x7f561009c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 monclient: found mon.noname-e 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56158bd640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5610135e00 con 0x7f5610136730 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.816+0000 7f56150bc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5610136b10 0x7f561009c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f56158bd640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 msgr2=0x7f56101ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f56158bd640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f56101ce960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f560800ebe0 tx=0x7f560800c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5608017070 con 0x7f5610136730 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: dump: 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.837 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.838 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 5 monclient: authenticate success, global_id 94283 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560800ce40 con 0x7f5610136730 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 10 monclient: _renew_subs 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56100a0500 con 0x7f5610136730 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5608013d50 con 0x7f5610136730 2024-08-19T11:18:43.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560e7fc640 10 monclient: dump: 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.840 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f560ffff640 4 set_mon_vals no callback set 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 10 monclient: _renew_subs 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.818+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f56100a0970 con 0x7f5610136730 2024-08-19T11:18:43.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f5617b21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f5617b21640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 0x7f5610134950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f5610076c60 con 0x7f5610134570 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56158bd640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f56101ce960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f560800ebe0 tx=0x7f560800c520 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f560801a070 mgrmap(e 5) 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 0x7f5610134950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f560801a070 con 0x7f5610136730 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient: get_auth_request con 0x7f5610134570 auth_method 0 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 10 monclient(hunting): handle_auth_done global_id 94292 payload 824 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.819+0000 7f56150bc640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f561009d730 con 0x7f5610134570 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.820+0000 7f560e7fc640 1 --2- 172.21.15.71:0/3431415273 >> v2:172.21.15.135:6800/726754104 conn(0x7f55fc03ea80 0x7f55fc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.820+0000 7f56160be640 1 --2- 172.21.15.71:0/3431415273 >> v2:172.21.15.135:6800/726754104 conn(0x7f55fc03ea80 0x7f55fc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.820+0000 7f56160be640 10 monclient: get_auth_request con 0x7f55fc03ea80 auth_method 0 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f56150bc640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 msgr2=0x7f5610134950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f56150bc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 0x7f5610134950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561006fe70 tx=0x7f56040115a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f560401a020 con 0x7f5610134570 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 10 monclient: dump: 2024-08-19T11:18:43.843 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.844 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5604016890 con 0x7f5610134570 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 msgr2=0x7f5610134950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 0x7f5610134950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561006fe70 tx=0x7f56040115a0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 msgr2=0x7f5610134950 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f560e7fc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134570 0x7f5610134950 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561006fe70 tx=0x7f56040115a0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.822+0000 7f56160be640 1 --2- 172.21.15.71:0/3431415273 >> v2:172.21.15.135:6800/726754104 conn(0x7f55fc03ea80 0x7f55fc040f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5600033000 tx=0x7f5600031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f5617b21640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f5617b21640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 0x7f561012d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f5617b21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f561008e640 con 0x7f5610134e90 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 0x7f561012d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient: get_auth_request con 0x7f5610134e90 auth_method 0 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 10 monclient(hunting): handle_auth_done global_id 94301 payload 824 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.829+0000 7f56150bc640 1 -- 172.21.15.71:0/3431415273 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f561008e390 con 0x7f5610134e90 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.831+0000 7f56150bc640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 msgr2=0x7f561012d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.831+0000 7f56150bc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 0x7f561012d1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5604009fd0 tx=0x7f5604004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.831+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f560401a070 con 0x7f5610134e90 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.831+0000 7f560e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.831+0000 7f560e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.831+0000 7f560e7fc640 10 monclient: dump: 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:43.848 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:43.849 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f56040157a0 con 0x7f5610134e90 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 msgr2=0x7f561012d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 0x7f561012d1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5604009fd0 tx=0x7f5604004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 msgr2=0x7f561012d1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610134e90 0x7f561012d1b0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5604009fd0 tx=0x7f5604004a40 comp rx=0 tx=0).stop 2024-08-19T11:18:43.850 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 35528, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:43.851 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.852 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:43.854 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:43.855 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:43.856 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.860 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:43.865 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:43.866 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.869 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.870 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:43.871 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:43.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:43.874 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:43.875 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:43.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 >> v2:172.21.15.135:6800/726754104 conn(0x7f55fc03ea80 msgr2=0x7f55fc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 --2- 172.21.15.71:0/3431415273 >> v2:172.21.15.135:6800/726754104 conn(0x7f55fc03ea80 0x7f55fc040f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5600033000 tx=0x7f5600031000 comp rx=0 tx=0).stop 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 10 monclient: shutdown 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 msgr2=0x7f56101ce960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 --2- 172.21.15.71:0/3431415273 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5610136730 0x7f56101ce960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f560800ebe0 tx=0x7f560800c520 comp rx=0 tx=0).stop 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f56160be640 1 -- 172.21.15.71:0/3431415273 reap_dead start 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f560e7fc640 1 -- 172.21.15.71:0/3431415273 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 0 0 0) 0x7f560800f040 con 0x7f5610136730 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f56160be640 1 -- 172.21.15.71:0/3431415273 reap_dead start 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 shutdown_connections 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 >> 172.21.15.71:0/3431415273 conn(0x7f56100a4bf0 msgr2=0x7f56101bc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 shutdown_connections 2024-08-19T11:18:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.832+0000 7f5617b21640 1 -- 172.21.15.71:0/3431415273 wait complete. 2024-08-19T11:18:43.878 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:43.878 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-19T11:18:43.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:18:43.893 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: starting. 2024-08-19T11:18:43.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27730 2024-08-19T11:18:43.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: created object 0... 2024-08-19T11:18:43.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: created object 25... 2024-08-19T11:18:43.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: created object 49... 2024-08-19T11:18:43.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: finishing. 2024-08-19T11:18:43.894 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27731]: shutting down. 2024-08-19T11:18:43.938 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27732]: starting. 2024-08-19T11:18:43.938 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27732]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27730 2024-08-19T11:18:43.938 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27732]: shutting down. 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.985+0000 7f76c29e9640 10 monclient: get_monmap_and_config 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.985+0000 7f76c29e9640 10 monclient: build_initial_monmap 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.985+0000 7f76c29e9640 10 monclient: monmap: 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:43.986209+0000 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:43.986209+0000 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:43.987 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:43.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 Processor -- start 2024-08-19T11:18:43.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 -- start start 2024-08-19T11:18:43.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient: init 2024-08-19T11:18:43.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient: _add_conns ranks=[4,7,8,2,9,5,10,6,3,0,1] 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 0x7f76bc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): picked mon.noname-c con 0x7f76bc0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76bc0a57c0 0x7f76bc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): picked mon.noname-i con 0x7f76bc0a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 0x7f76bc139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): picked mon.noname-e con 0x7f76bc139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f76bc0a5020 con 0x7f76bc0a6950 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f76bc0a77b0 con 0x7f76bc0a57c0 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f76bc0a7d40 con 0x7f76bc139710 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c29e9640 10 monclient(hunting): authenticate will time out at 1182.027842s 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76bbfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 0x7f76bc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76c0f86640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 0x7f76bc139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.986+0000 7f76bbfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 0x7f76bc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35500/0 (socket says 172.21.15.71:35500) 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 1 -- 172.21.15.71:0/3631382869 learned_addr learned my addr 172.21.15.71:0/3631382869 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): get_auth_request con 0x7f76bc0a6950 auth_method 0 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): get_auth_request con 0x7f76bc139710 auth_method 0 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76bc0a57c0 0x7f76bc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient(hunting): handle_auth_done global_id 94328 payload 274 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 1 -- 172.21.15.71:0/3631382869 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76bc0a57c0 msgr2=0x7f76bc0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76bc0a57c0 0x7f76bc0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 1 -- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 msgr2=0x7f76bc0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 0x7f76bc0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient: _finish_hunting 0 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 1 monclient: found mon.noname-e 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76c0f86640 1 -- 172.21.15.71:0/3631382869 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0a6380 con 0x7f76bc139710 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bb7fe640 10 monclient: get_auth_request con 0x7f76bc0a57c0 auth_method 0 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bbfff640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 0x7f76bc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.987+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76bc0a57c0 0x7f76bc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:18:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c0f86640 1 -- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 msgr2=0x7f76bc139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c0f86640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 0x7f76bc139b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009dc0 tx=0x7f76b402a480 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f2e6617c9a7eaec7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 1 -- 172.21.15.71:0/3631382869 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76b4007bc0 con 0x7f76bc139710 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: dump: 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 5 monclient: authenticate success, global_id 94328 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 1 -- 172.21.15.71:0/3631382869 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b4007d80 con 0x7f76bc139710 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 4 set_mon_vals no callback set 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 1 -- 172.21.15.71:0/3631382869 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76b4031870 con 0x7f76bc139710 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76baffd640 10 monclient: dump: 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 10 monclient: shutdown 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 -- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 msgr2=0x7f76bc139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 0x7f76bc139b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009dc0 tx=0x7f76b402a480 comp rx=0 tx=0).stop 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 -- 172.21.15.71:0/3631382869 shutdown_connections 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f76bc0a57c0 0x7f76bc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc139710 0x7f76bc139b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 --2- 172.21.15.71:0/3631382869 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f76bc0a6950 0x7f76bc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 -- 172.21.15.71:0/3631382869 >> 172.21.15.71:0/3631382869 conn(0x7f76bc0abf50 msgr2=0x7f76bc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 -- 172.21.15.71:0/3631382869 shutdown_connections 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.990+0000 7f76c29e9640 1 -- 172.21.15.71:0/3631382869 wait complete. 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.991+0000 7f76c29e9640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.991+0000 7f76c29e9640 10 monclient: monmap: 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.991+0000 7f76c29e9640 1 Processor -- start 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.991+0000 7f76c29e9640 1 -- start start 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.991+0000 7f76c29e9640 10 monclient: init 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient: _add_conns ranks=[8,0,6,5,4,1,2,3,7] 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 0x7f76bc138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): picked mon.noname-e con 0x7f76bc0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76bc0a6950 0x7f76bc138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): picked mon.noname-a con 0x7f76bc0a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f76bc139710 0x7f76bc122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): picked mon.noname-d con 0x7f76bc139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc0a84c0 con 0x7f76bc0a6950 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f76bc0a3650 con 0x7f76bc139710 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f76bc0a8700 con 0x7f76bc0a57c0 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c29e9640 10 monclient(hunting): authenticate will time out at 1182.033345s 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c0f86640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f76bc139710 msgr2=0x7f76bc122610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76c0f86640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f76bc139710 0x7f76bc122610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 0x7f76bc138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 0x7f76bc138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53164/0 (socket says 172.21.15.71:53164) 2024-08-19T11:18:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 -- 172.21.15.71:0/452339955 learned_addr learned my addr 172.21.15.71:0/452339955 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): get_auth_request con 0x7f76bc0a57c0 auth_method 0 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76bc0a6950 0x7f76bc138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): get_auth_request con 0x7f76bc0a6950 auth_method 0 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient(hunting): handle_auth_done global_id 94337 payload 824 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f76bc139710 msgr2=0x7f76bc122610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f76bc139710 0x7f76bc122610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76bc0a6950 msgr2=0x7f76bc138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76bc0a6950 0x7f76bc138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 monclient: found mon.noname-e 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:18:44.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.992+0000 7f76bbfff640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc126150 con 0x7f76bc0a57c0 2024-08-19T11:18:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.994+0000 7f76bbfff640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 msgr2=0x7f76bc138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.994+0000 7f76bbfff640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 0x7f76bc138a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e9d0 tx=0x7f76ac00ee90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76ac017070 con 0x7f76bc0a57c0 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: dump: 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.015 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac00cc70 con 0x7f76bc0a57c0 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 5 monclient: authenticate success, global_id 94337 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 10 monclient: _renew_subs 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc126430 con 0x7f76bc0a57c0 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76ac00ce20 con 0x7f76bc0a57c0 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76b8ff9640 10 monclient: dump: 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.017 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.018 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 10 monclient: _renew_subs 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76ba7fc640 4 set_mon_vals no callback set 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.997+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc1251f0 con 0x7f76bc0a57c0 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76c29e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76c29e9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 0x7f76bc02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc076c60 con 0x7f76bc1ce3f0 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f76ac01a070 con 0x7f76bc0a57c0 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 0x7f76bc02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient: get_auth_request con 0x7f76bc1ce3f0 auth_method 0 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76b8ff9640 1 --2- 172.21.15.71:0/452339955 >> v2:172.21.15.135:6800/726754104 conn(0x7f76a803ea80 0x7f76a8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(229..229 src has 1..229) ==== 3506+0+0 (secure 0 0 0) 0x7f76ac00f040 con 0x7f76bc0a57c0 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76c0f86640 1 --2- 172.21.15.71:0/452339955 >> v2:172.21.15.135:6800/726754104 conn(0x7f76a803ea80 0x7f76a8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_done global_id 84664 payload 824 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76bb7fe640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76bc0a1f90 con 0x7f76bc1ce3f0 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:43.998+0000 7f76c0f86640 10 monclient: get_auth_request con 0x7f76a803ea80 auth_method 0 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.000+0000 7f76bb7fe640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 msgr2=0x7f76bc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.000+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 0x7f76bc02d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76b000f850 tx=0x7f76b000fd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76b000dc30 con 0x7f76bc1ce3f0 2024-08-19T11:18:44.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 10 monclient: dump: 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.021 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76c0f86640 1 --2- 172.21.15.71:0/452339955 >> v2:172.21.15.135:6800/726754104 conn(0x7f76a803ea80 0x7f76a8040f40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f76bc074f90 tx=0x7f76b402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f76b000dc30 con 0x7f76bc1ce3f0 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 msgr2=0x7f76bc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 0x7f76bc02d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76b000f850 tx=0x7f76b000fd10 comp rx=0 tx=0).stop 2024-08-19T11:18:44.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 msgr2=0x7f76bc02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.001+0000 7f76b8ff9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc1ce3f0 0x7f76bc02d1c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76c29e9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76c29e9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 0x7f76bc02db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76c29e9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc0a6d30 con 0x7f76bc02d700 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 0x7f76bc02db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient: get_auth_request con 0x7f76bc02d700 auth_method 0 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 10 monclient(hunting): handle_auth_done global_id 84673 payload 824 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.007+0000 7f76bb7fe640 1 -- 172.21.15.71:0/452339955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f76bc09e100 con 0x7f76bc02d700 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76bb7fe640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 msgr2=0x7f76bc02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76bb7fe640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 0x7f76bc02db10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76b000f850 tx=0x7f76b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f76b0004490 con 0x7f76bc02d700 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 10 monclient: dump: 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f76b0013440 con 0x7f76bc02d700 2024-08-19T11:18:44.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 msgr2=0x7f76bc02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 0x7f76bc02db10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76b000f850 tx=0x7f76b00046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 msgr2=0x7f76bc02db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.010+0000 7f76b8ff9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76bc02d700 0x7f76bc02db10 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76b000f850 tx=0x7f76b00046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:44.026 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 106170, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:44.027 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.028 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.029 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:44.030 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.031 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.033 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:44.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:44.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:44.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:44.047 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.048 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:44.049 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:44.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 >> v2:172.21.15.135:6800/726754104 conn(0x7f76a803ea80 msgr2=0x7f76a8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 --2- 172.21.15.71:0/452339955 >> v2:172.21.15.135:6800/726754104 conn(0x7f76a803ea80 0x7f76a8040f40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f76bc074f90 tx=0x7f76b402f000 comp rx=0 tx=0).stop 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 10 monclient: shutdown 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 msgr2=0x7f76bc138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 --2- 172.21.15.71:0/452339955 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f76bc0a57c0 0x7f76bc138a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e9d0 tx=0x7f76ac00ee90 comp rx=0 tx=0).stop 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c0f86640 1 -- 172.21.15.71:0/452339955 reap_dead start 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c0f86640 1 -- 172.21.15.71:0/452339955 reap_dead start 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 shutdown_connections 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 >> 172.21.15.71:0/452339955 conn(0x7f76bc0abf50 msgr2=0x7f76bc0aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 shutdown_connections 2024-08-19T11:18:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.011+0000 7f76c29e9640 1 -- 172.21.15.71:0/452339955 wait complete. 2024-08-19T11:18:44.052 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:44.052 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-19T11:18:44.052 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.150+0000 7f1d668e5640 10 monclient: get_monmap_and_config 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.150+0000 7f1d668e5640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.150+0000 7f1d668e5640 10 monclient: monmap: 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:44.150838+0000 2024-08-19T11:18:44.151 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:44.150838+0000 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:44.152 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.150+0000 7f1d668e5640 1 Processor -- start 2024-08-19T11:18:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 -- start start 2024-08-19T11:18:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient: init 2024-08-19T11:18:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient: _add_conns ranks=[5,4,2,8,10,0,6,1,9,7,3] 2024-08-19T11:18:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1d600a6950 0x7f1d600a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): picked mon.noname-h con 0x7f1d600a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 0x7f1d600a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): picked mon.noname-c con 0x7f1d600a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d60139710 0x7f1d60139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): picked mon.noname-b con 0x7f1d60139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1d600a5020 con 0x7f1d60139710 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f1d600a77b0 con 0x7f1d600a57c0 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f1d600a7d40 con 0x7f1d600a6950 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d668e5640 10 monclient(hunting): authenticate will time out at 1182.192554s 2024-08-19T11:18:44.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 0x7f1d600a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d60139710 0x7f1d60139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 0x7f1d600a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:35508/0 (socket says 172.21.15.71:35508) 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/3328508894 learned_addr learned my addr 172.21.15.71:0/3328508894 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): get_auth_request con 0x7f1d600a57c0 auth_method 0 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): get_auth_request con 0x7f1d60139710 auth_method 0 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5ffff640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1d600a6950 0x7f1d600a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5ffff640 10 monclient(hunting): get_auth_request con 0x7f1d600a6950 auth_method 0 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_done global_id 84676 payload 274 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/3328508894 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1d600a6950 msgr2=0x7f1d600a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1d600a6950 0x7f1d600a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d60139710 msgr2=0x7f1d60139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:44.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d60139710 0x7f1d60139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 monclient: found mon.noname-c 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/3328508894 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d600a6380 con 0x7f1d600a57c0 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.151+0000 7f1d64e82640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d60139710 0x7f1d60139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 msgr2=0x7f1d600a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 0x7f1d600a7270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d480098d0 tx=0x7f1d4802a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=e16a5384917cab28 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 1 -- 172.21.15.71:0/3328508894 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d48037070 con 0x7f1d600a57c0 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: dump: 2024-08-19T11:18:44.163 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.164 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 1 -- 172.21.15.71:0/3328508894 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4802adc0 con 0x7f1d600a57c0 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d668e5640 5 monclient: authenticate success, global_id 84676 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d668e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d668e5640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 1 -- 172.21.15.71:0/3328508894 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d48030c20 con 0x7f1d600a57c0 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d668e5640 4 set_mon_vals no callback set 2024-08-19T11:18:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.154+0000 7f1d5effd640 10 monclient: dump: 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.166 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 10 monclient: shutdown 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 -- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 msgr2=0x7f1d600a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 0x7f1d600a7270 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d480098d0 tx=0x7f1d4802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 -- 172.21.15.71:0/3328508894 shutdown_connections 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d60139710 0x7f1d60139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1d600a57c0 0x7f1d600a7270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 --2- 172.21.15.71:0/3328508894 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f1d600a6950 0x7f1d600a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 -- 172.21.15.71:0/3328508894 >> 172.21.15.71:0/3328508894 conn(0x7f1d600abf50 msgr2=0x7f1d600ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 -- 172.21.15.71:0/3328508894 shutdown_connections 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.155+0000 7f1d668e5640 1 -- 172.21.15.71:0/3328508894 wait complete. 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 10 monclient: monmap: 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 1 Processor -- start 2024-08-19T11:18:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 1 -- start start 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 10 monclient: init 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 10 monclient: _add_conns ranks=[7,2,1,3,4,8,0,5,6] 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.156+0000 7f1d668e5640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1d600a57c0 0x7f1d601ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): picked mon.noname-i con 0x7f1d600a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 0x7f1d60138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): picked mon.noname-b con 0x7f1d600a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d60139710 0x7f1d60139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): picked mon.noname-f con 0x7f1d60139710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d600a84c0 con 0x7f1d60139710 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1d600a3650 con 0x7f1d600a6950 2024-08-19T11:18:44.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f1d600a8700 con 0x7f1d600a57c0 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d668e5640 10 monclient(hunting): authenticate will time out at 1182.198055s 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 0x7f1d60138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 0x7f1d60138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:33540/0 (socket says 172.21.15.71:33540) 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/4274923647 learned_addr learned my addr 172.21.15.71:0/4274923647 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): get_auth_request con 0x7f1d600a6950 auth_method 0 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d64e82640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d60139710 0x7f1d60139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5ffff640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1d600a57c0 0x7f1d601ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d64e82640 10 monclient(hunting): get_auth_request con 0x7f1d60139710 auth_method 0 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d64e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d64e82640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d64e82640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5ffff640 10 monclient(hunting): get_auth_request con 0x7f1d600a57c0 auth_method 0 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient(hunting): handle_auth_done global_id 74972 payload 824 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1d600a57c0 msgr2=0x7f1d601ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f1d600a57c0 0x7f1d601ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d60139710 msgr2=0x7f1d60139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d60139710 0x7f1d60139100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 monclient: found mon.noname-b 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d601254f0 con 0x7f1d600a6950 2024-08-19T11:18:44.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.157+0000 7f1d64e82640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d60139710 0x7f1d60139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5f7fe640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 msgr2=0x7f1d60138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 0x7f1d60138bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d480090b0 tx=0x7f1d480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d48037040 con 0x7f1d600a6950 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: dump: 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.181 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d48003bd0 con 0x7f1d600a6950 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 5 monclient: authenticate success, global_id 74972 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 10 monclient: _renew_subs 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6013a300 con 0x7f1d600a6950 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d48030c20 con 0x7f1d600a6950 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5cff9640 10 monclient: dump: 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.183 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 10 monclient: _renew_subs 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d5e7fc640 4 set_mon_vals no callback set 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.159+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d60126580 con 0x7f1d600a6950 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d668e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d668e5640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 0x7f1d60122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6006a590 con 0x7f1d60124d80 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 0x7f1d60122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5f7fe640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 0x7f1d60138bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d480090b0 tx=0x7f1d480046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f1d48071dd0 osd_map(229..229 src has 1..229) 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient: get_auth_request con 0x7f1d60124d80 auth_method 0 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1d48030340 con 0x7f1d600a6950 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.160+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.161+0000 7f1d5cff9640 1 --2- 172.21.15.71:0/4274923647 >> v2:172.21.15.135:6800/726754104 conn(0x7f1d4003ea80 0x7f1d40040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.161+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_done global_id 45462 payload 824 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.161+0000 7f1d5ffff640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d601ce920 con 0x7f1d60124d80 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.161+0000 7f1d64e82640 1 --2- 172.21.15.71:0/4274923647 >> v2:172.21.15.135:6800/726754104 conn(0x7f1d4003ea80 0x7f1d40040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.161+0000 7f1d64e82640 10 monclient: get_auth_request con 0x7f1d4003ea80 auth_method 0 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5ffff640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 msgr2=0x7f1d60122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5ffff640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 0x7f1d60122fa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000f4a0 tx=0x7f1d5000f960 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d50019030 con 0x7f1d60124d80 2024-08-19T11:18:44.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 10 monclient: dump: 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.187 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d64e82640 1 --2- 172.21.15.71:0/4274923647 >> v2:172.21.15.135:6800/726754104 conn(0x7f1d4003ea80 0x7f1d40040f40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d60074f90 tx=0x7f1d5800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1d50014880 con 0x7f1d60124d80 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 msgr2=0x7f1d60122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 0x7f1d60122fa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000f4a0 tx=0x7f1d5000f960 comp rx=0 tx=0).stop 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 msgr2=0x7f1d60122fa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.163+0000 7f1d5cff9640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d60124d80 0x7f1d60122fa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.169+0000 7f1d668e5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:44.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.169+0000 7f1d668e5640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 0x7f1d6002d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.169+0000 7f1d668e5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.169+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1d60076c60 con 0x7f1d6002d1c0 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 0x7f1d6002d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient: get_auth_request con 0x7f1d6002d1c0 auth_method 0 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 10 monclient(hunting): handle_auth_done global_id 45471 payload 824 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.170+0000 7f1d5ffff640 1 -- 172.21.15.71:0/4274923647 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d600a2070 con 0x7f1d6002d1c0 2024-08-19T11:18:44.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.172+0000 7f1d5ffff640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 msgr2=0x7f1d6002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.172+0000 7f1d5ffff640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 0x7f1d6002d5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000f4a0 tx=0x7f1d500046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.172+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1d50015e50 con 0x7f1d6002d1c0 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.172+0000 7f1d5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.172+0000 7f1d5cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.172+0000 7f1d5cff9640 10 monclient: dump: 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.190 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f1d50004050 con 0x7f1d6002d1c0 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 msgr2=0x7f1d6002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 0x7f1d6002d5d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000f4a0 tx=0x7f1d500046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 msgr2=0x7f1d6002d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1d6002d1c0 0x7f1d6002d5d0 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000f4a0 tx=0x7f1d500046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 293194, 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:44.192 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:44.193 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.194 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.195 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:44.196 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.197 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:44.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:44.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:44.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:44.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:44.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.215 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:44.216 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 >> v2:172.21.15.135:6800/726754104 conn(0x7f1d4003ea80 msgr2=0x7f1d40040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 --2- 172.21.15.71:0/4274923647 >> v2:172.21.15.135:6800/726754104 conn(0x7f1d4003ea80 0x7f1d40040f40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d60074f90 tx=0x7f1d5800b040 comp rx=0 tx=0).stop 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 10 monclient: shutdown 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 msgr2=0x7f1d60138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 --2- 172.21.15.71:0/4274923647 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d600a6950 0x7f1d60138bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d480090b0 tx=0x7f1d480046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d64e82640 1 -- 172.21.15.71:0/4274923647 reap_dead start 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d5cff9640 1 -- 172.21.15.71:0/4274923647 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(229..229 src has 1..229) ==== 3506+0+0 (unknown 0 0 0) 0x7f1d48071dd0 con 0x7f1d600a6950 2024-08-19T11:18:44.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d64e82640 1 -- 172.21.15.71:0/4274923647 reap_dead start 2024-08-19T11:18:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 shutdown_connections 2024-08-19T11:18:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 >> 172.21.15.71:0/4274923647 conn(0x7f1d600abf50 msgr2=0x7f1d600aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 shutdown_connections 2024-08-19T11:18:44.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.173+0000 7f1d668e5640 1 -- 172.21.15.71:0/4274923647 wait complete. 2024-08-19T11:18:44.219 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:44.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-19T11:18:44.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.317+0000 7f3b280bc640 10 monclient: get_monmap_and_config 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.317+0000 7f3b280bc640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.317+0000 7f3b280bc640 10 monclient: monmap: 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:44.317814+0000 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:44.317814+0000 2024-08-19T11:18:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:44.319 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.317+0000 7f3b280bc640 1 Processor -- start 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 -- start start 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient: init 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient: _add_conns ranks=[10,6,7,4,3,1,8,0,5,9,2] 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b200a6a30 0x7f3b200a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): picked mon.noname-f con 0x7f3b200a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b200a6e10 0x7f3b200a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): picked mon.noname-d con 0x7f3b200a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b201397f0 0x7f3b20139c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): picked mon.noname-i con 0x7f3b201397f0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3b200a2fc0 con 0x7f3b200a6a30 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b200a63f0 con 0x7f3b200a6e10 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3b200a5000 con 0x7f3b201397f0 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b280bc640 10 monclient(hunting): authenticate will time out at 1182.359536s 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25657640 1 -- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b200a6e10 msgr2=0x7f3b200a7230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3303/0 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25657640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b200a6e10 0x7f3b200a7230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b200a6a30 0x7f3b200a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b201397f0 0x7f3b20139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b201397f0 0x7f3b20139c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:51398/0 (socket says 172.21.15.71:51398) 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 1 -- 172.21.15.71:0/3602269727 learned_addr learned my addr 172.21.15.71:0/3602269727 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3b200a6a30 0x7f3b200a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:38484/0 (socket says 172.21.15.71:38484) 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): get_auth_request con 0x7f3b201397f0 auth_method 0 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): get_auth_request con 0x7f3b200a6a30 auth_method 0 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b26659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 10 monclient(hunting): handle_auth_done global_id 84691 payload 274 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 1 -- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b201397f0 msgr2=0x7f3b20139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.318+0000 7f3b25e58640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b201397f0 0x7f3b20139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 1 -- 172.21.15.71:0/3602269727 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b200a6e10 msgr2=0x7f3b200a7230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b200a6e10 0x7f3b200a7230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 1 monclient: found mon.noname-f 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:18:44.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.319+0000 7f3b25e58640 1 -- 172.21.15.71:0/3602269727 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b200a8590 con 0x7f3b200a6a30 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.321+0000 7f3b25e58640 1 -- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b200a6a30 msgr2=0x7f3b200a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.321+0000 7f3b25e58640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b200a6a30 0x7f3b200a5850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0097a0 tx=0x7f3b1c029fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1465f6de12ff4e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 1 -- 172.21.15.71:0/3602269727 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b1c037070 con 0x7f3b200a6a30 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: dump: 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.333 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 1 -- 172.21.15.71:0/3602269727 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1c02ad40 con 0x7f3b200a6a30 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 5 monclient: authenticate success, global_id 84691 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 1 -- 172.21.15.71:0/3602269727 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b1c030c20 con 0x7f3b200a6a30 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 4 set_mon_vals no callback set 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b24e56640 10 monclient: dump: 2024-08-19T11:18:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 10 monclient: shutdown 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 -- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b200a6a30 msgr2=0x7f3b200a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b200a6a30 0x7f3b200a5850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0097a0 tx=0x7f3b1c029fe0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 -- 172.21.15.71:0/3602269727 shutdown_connections 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b201397f0 0x7f3b20139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b200a6e10 0x7f3b200a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 --2- 172.21.15.71:0/3602269727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b200a6a30 0x7f3b200a5850 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 -- 172.21.15.71:0/3602269727 >> 172.21.15.71:0/3602269727 conn(0x7f3b200ac030 msgr2=0x7f3b200ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 -- 172.21.15.71:0/3602269727 shutdown_connections 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.322+0000 7f3b280bc640 1 -- 172.21.15.71:0/3602269727 wait complete. 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.323+0000 7f3b280bc640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.323+0000 7f3b280bc640 10 monclient: monmap: 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.338 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.323+0000 7f3b280bc640 1 Processor -- start 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.323+0000 7f3b280bc640 1 -- start start 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.323+0000 7f3b280bc640 10 monclient: init 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient: _add_conns ranks=[8,2,0,3,5,6,1,4,7] 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b200a6a30 0x7f3b20122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): picked mon.noname-e con 0x7f3b200a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b200a6e10 0x7f3b201232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): picked mon.noname-b con 0x7f3b200a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 0x7f3b20123810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): picked mon.noname-a con 0x7f3b201397f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2013a1c0 con 0x7f3b201397f0 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b200a7770 con 0x7f3b200a6e10 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3b2013a340 con 0x7f3b200a6a30 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b280bc640 10 monclient(hunting): authenticate will time out at 1182.365174s 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b200a6a30 0x7f3b20122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b200a6a30 0x7f3b20122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:53180/0 (socket says 172.21.15.71:53180) 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b200a6e10 0x7f3b201232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 0x7f3b20123810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 1 -- 172.21.15.71:0/937233640 learned_addr learned my addr 172.21.15.71:0/937233640 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): get_auth_request con 0x7f3b200a6a30 auth_method 0 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): get_auth_request con 0x7f3b201397f0 auth_method 0 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): get_auth_request con 0x7f3b200a6e10 auth_method 0 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25657640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient(hunting): handle_auth_done global_id 75060 payload 824 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b200a6a30 msgr2=0x7f3b20122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b200a6a30 0x7f3b20122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b200a6e10 msgr2=0x7f3b201232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b200a6e10 0x7f3b201232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 monclient: found mon.noname-a 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b26659640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b20126be0 con 0x7f3b201397f0 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.324+0000 7f3b25e58640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3b200a6a30 0x7f3b20122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.326+0000 7f3b26659640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 msgr2=0x7f3b20123810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.326+0000 7f3b26659640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 0x7f3b20123810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800ebd0 tx=0x7f3b1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.326+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b18003990 con 0x7f3b201397f0 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: dump: 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.344 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b18003b70 con 0x7f3b201397f0 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 5 monclient: authenticate success, global_id 75060 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 10 monclient: _renew_subs 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b200a5a00 con 0x7f3b201397f0 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b18003d20 con 0x7f3b201397f0 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b167fc640 10 monclient: dump: 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b17fff640 4 set_mon_vals no callback set 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 10 monclient: _renew_subs 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b20124880 con 0x7f3b201397f0 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 0x7f3b20063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.327+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3b20076c60 con 0x7f3b2002e340 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 0x7f3b20063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b26659640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 0x7f3b20123810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800ebd0 tx=0x7f3b1800c490 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f3b18051e00 osd_map(229..229 src has 1..229) 2024-08-19T11:18:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient: get_auth_request con 0x7f3b2002e340 auth_method 0 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3b18005d10 con 0x7f3b201397f0 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b167fc640 1 --2- 172.21.15.71:0/937233640 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b0403e9b0 0x7f3b04040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 10 monclient(hunting): handle_auth_done global_id 45644 payload 824 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25e58640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b200a2120 con 0x7f3b2002e340 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25657640 1 --2- 172.21.15.71:0/937233640 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b0403e9b0 0x7f3b04040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.328+0000 7f3b25657640 10 monclient: get_auth_request con 0x7f3b0403e9b0 auth_method 0 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.330+0000 7f3b25e58640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 msgr2=0x7f3b20063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.330+0000 7f3b25e58640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 0x7f3b20063a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0096f0 tx=0x7f3b1c0046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b1c037040 con 0x7f3b2002e340 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 10 monclient: dump: 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b25657640 1 --2- 172.21.15.71:0/937233640 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b0403e9b0 0x7f3b04040e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3b201244f0 tx=0x7f3b100090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3b1c032440 con 0x7f3b2002e340 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 msgr2=0x7f3b20063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 0x7f3b20063a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0096f0 tx=0x7f3b1c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 msgr2=0x7f3b20063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.331+0000 7f3b167fc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b2002e340 0x7f3b20063a80 secure :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0096f0 tx=0x7f3b1c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b280bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:44.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b280bc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 0x7f3b201d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b280bc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3b2002e720 con 0x7f3b20063fc0 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 0x7f3b201d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient: get_auth_request con 0x7f3b20063fc0 auth_method 0 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 10 monclient(hunting): handle_auth_done global_id 45653 payload 824 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.337+0000 7f3b25e58640 1 -- 172.21.15.71:0/937233640 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b200a7210 con 0x7f3b20063fc0 2024-08-19T11:18:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b25e58640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 msgr2=0x7f3b201d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b25e58640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 0x7f3b201d8a70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3b20074670 tx=0x7f3b1c008030 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b1c037040 con 0x7f3b20063fc0 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 10 monclient: dump: 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f3b1c03d860 con 0x7f3b20063fc0 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 msgr2=0x7f3b201d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 0x7f3b201d8a70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3b20074670 tx=0x7f3b1c008030 comp rx=0 tx=0).stop 2024-08-19T11:18:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 msgr2=0x7f3b201d8a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b20063fc0 0x7f3b201d8a70 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3b20074670 tx=0x7f3b1c008030 comp rx=0 tx=0).stop 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 293362, 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:44.356 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.357 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:44.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:44.360 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.361 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:44.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.367 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.369 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:44.374 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:44.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.380 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.381 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.382 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:18:44.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.383 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:44.383 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b0403e9b0 msgr2=0x7f3b04040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 --2- 172.21.15.71:0/937233640 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b0403e9b0 0x7f3b04040e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3b201244f0 tx=0x7f3b100090e0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 10 monclient: shutdown 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 msgr2=0x7f3b20123810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 0x7f3b20123810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800ebd0 tx=0x7f3b1800c490 comp rx=0 tx=0).stop 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b26659640 1 -- 172.21.15.71:0/937233640 reap_dead start 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b167fc640 1 -- 172.21.15.71:0/937233640 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 3506+0+0 (unknown 0 0 0) 0x7f3b18051e00 con 0x7f3b201397f0 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 shutdown_connections 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 --2- 172.21.15.71:0/937233640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b201397f0 0x7f3b20123810 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.340+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 >> 172.21.15.71:0/937233640 conn(0x7f3b200ac030 msgr2=0x7f3b2009c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.341+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 shutdown_connections 2024-08-19T11:18:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.341+0000 7f3b280bc640 1 -- 172.21.15.71:0/937233640 wait complete. 2024-08-19T11:18:44.386 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:44.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-19T11:18:44.386 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:18:44.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.483+0000 7f6ecdc32640 10 monclient: get_monmap_and_config 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.483+0000 7f6ecdc32640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.483+0000 7f6ecdc32640 10 monclient: monmap: 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:18:44.484310+0000 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:18:44.484310+0000 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:18:44.485 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:18:44.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 Processor -- start 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 -- start start 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient: init 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient: _add_conns ranks=[1,3,9,7,4,10,2,0,6,5,8] 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6ec80a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a57c0 0x7f6ec813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): picked mon.noname-g con 0x7f6ec80a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ec80a7440 0x7f6ec81410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): picked mon.noname-a con 0x7f6ec80a7440 addr v2:172.21.15.71:3300/0 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec80a6380 con 0x7f6ec80a6950 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec80a5020 con 0x7f6ec80a7440 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80a7d40 con 0x7f6ec80a57c0 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.484+0000 7f6ecdc32640 10 monclient(hunting): authenticate will time out at 1182.525997s 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ec80a7440 0x7f6ec81410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ec80a7440 0x7f6ec81410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54544/0 (socket says 172.21.15.71:54544) 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 -- 172.21.15.71:0/119848076 learned_addr learned my addr 172.21.15.71:0/119848076 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request con 0x7f6ec80a7440 auth_method 0 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 1 --2- 172.21.15.71:0/119848076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a57c0 0x7f6ec813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): get_auth_request con 0x7f6ec80a57c0 auth_method 0 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_done global_id 75069 payload 274 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 -- 172.21.15.71:0/119848076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a57c0 msgr2=0x7f6ec813eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 --2- 172.21.15.71:0/119848076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a57c0 0x7f6ec813eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 -- 172.21.15.71:0/119848076 >> v1:172.21.15.135:6789/0 conn(0x7f6ec80a6950 legacy=0x7f6ec80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 monclient: found mon.noname-a 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.485+0000 7f6ec7fff640 1 -- 172.21.15.71:0/119848076 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80a3650 con 0x7f6ec80a7440 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec7fff640 1 -- 172.21.15.71:0/119848076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ec80a7440 msgr2=0x7f6ec81410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec7fff640 1 --2- 172.21.15.71:0/119848076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ec80a7440 0x7f6ec81410b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec002a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f476bcfb70d915 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 1 -- 172.21.15.71:0/119848076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ec0036070 con 0x7f6ec80a7440 2024-08-19T11:18:44.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: dump: 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 1 -- 172.21.15.71:0/119848076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0007a70 con 0x7f6ec80a7440 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ecdc32640 5 monclient: authenticate success, global_id 75069 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ecdc32640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 1 -- 172.21.15.71:0/119848076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ec0007c60 con 0x7f6ec80a7440 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ecdc32640 10 monclient: get_monmap_and_config success 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ecdc32640 4 set_mon_vals no callback set 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.488+0000 7f6ec67fc640 10 monclient: dump: 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 10 monclient: shutdown 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 -- 172.21.15.71:0/119848076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ec80a7440 msgr2=0x7f6ec81410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/119848076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ec80a7440 0x7f6ec81410b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec002a580 comp rx=0 tx=0).stop 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 -- 172.21.15.71:0/119848076 shutdown_connections 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/119848076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ec80a7440 0x7f6ec81410b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/119848076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a57c0 0x7f6ec813eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 -- 172.21.15.71:0/119848076 >> 172.21.15.71:0/119848076 conn(0x7f6ec80abf50 msgr2=0x7f6ec80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 -- 172.21.15.71:0/119848076 shutdown_connections 2024-08-19T11:18:44.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 1 -- 172.21.15.71:0/119848076 wait complete. 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 10 monclient: build_initial_monmap 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.489+0000 7f6ecdc32640 10 monclient: monmap: 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.504 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 1 Processor -- start 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 1 -- start start 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 10 monclient: init 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 10 monclient: _reopen_session rank -1 2024-08-19T11:18:44.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 10 monclient: _add_conns ranks=[5,3,7,4,1,0,6,8,2] 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 0x7f6ec8128a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 10 monclient(hunting): picked mon.noname-h con 0x7f6ec80a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a6950 0x7f6ec81ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.490+0000 7f6ecdc32640 10 monclient(hunting): picked mon.noname-g con 0x7f6ec80a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec80a7440 0x7f6ec8126590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 10 monclient(hunting): picked mon.noname-i con 0x7f6ec80a7440 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80a8700 con 0x7f6ec80a6950 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f6ec80a84c0 con 0x7f6ec80a57c0 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6ec81415f0 con 0x7f6ec80a7440 2024-08-19T11:18:44.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 10 monclient(hunting): _renew_subs 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ecdc32640 10 monclient(hunting): authenticate will time out at 1182.532038s 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 0x7f6ec8128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 0x7f6ec8128a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:58852/0 (socket says 172.21.15.71:58852) 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 -- 172.21.15.71:0/697566067 learned_addr learned my addr 172.21.15.71:0/697566067 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): get_auth_request con 0x7f6ec80a57c0 auth_method 0 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec80a7440 0x7f6ec8126590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request con 0x7f6ec80a7440 auth_method 0 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a6950 0x7f6ec81ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): get_auth_request con 0x7f6ec80a6950 auth_method 0 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient(hunting): handle_auth_done global_id 45662 payload 824 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec80a7440 msgr2=0x7f6ec8126590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec80a7440 0x7f6ec8126590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a6950 msgr2=0x7f6ec81ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80a6950 0x7f6ec81ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 monclient: found mon.noname-h 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.491+0000 7f6ec77fe640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec8129f30 con 0x7f6ec80a57c0 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ec77fe640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 msgr2=0x7f6ec8128a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ec77fe640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 0x7f6ec8128a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c430 tx=0x7f6eb800c8f0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6eb8003860 con 0x7f6ec80a57c0 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: dump: 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.510 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: _finish_auth 0 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: _check_auth_tickets 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb8017070 con 0x7f6ec80a57c0 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ecdc32640 5 monclient: authenticate success, global_id 45662 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6eb8011cd0 con 0x7f6ec80a57c0 2024-08-19T11:18:44.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6eaffff640 10 monclient: dump: 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.512 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ecdc32640 10 monclient: _renew_subs 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ecdc32640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ec5ffb640 4 set_mon_vals no callback set 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.493+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec8141280 con 0x7f6ec80a57c0 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 10 monclient: _renew_subs 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec812a210 con 0x7f6ec80a57c0 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 0x7f6ec8126ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6ec806a590 con 0x7f6ec81cf0b0 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ec6ffd640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 0x7f6ec8126ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ec6ffd640 10 monclient: get_auth_request con 0x7f6ec81cf0b0 auth_method 0 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ec6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.494+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6eb80117a0 con 0x7f6ec80a57c0 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_done global_id 84571 payload 824 2024-08-19T11:18:44.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec6ffd640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ec80a93a0 con 0x7f6ec81cf0b0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6eaffff640 1 --2- 172.21.15.71:0/697566067 >> v2:172.21.15.135:6800/726754104 conn(0x7f6eb403ea80 0x7f6eb4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(229..229 src has 1..229) ==== 3506+0+0 (secure 0 0 0) 0x7f6eb80518f0 con 0x7f6ec80a57c0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec7fff640 1 --2- 172.21.15.71:0/697566067 >> v2:172.21.15.135:6800/726754104 conn(0x7f6eb403ea80 0x7f6eb4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.495+0000 7f6ec7fff640 10 monclient: get_auth_request con 0x7f6eb403ea80 auth_method 0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6ec6ffd640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 msgr2=0x7f6ec8126ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6ec6ffd640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 0x7f6ec8126ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8127cb0 tx=0x7f6ebc011d40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ebc019070 con 0x7f6ec81cf0b0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 10 monclient: dump: 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.515 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6ebc00f860 con 0x7f6ec81cf0b0 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6eaffff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.497+0000 7f6ec7fff640 1 --2- 172.21.15.71:0/697566067 >> v2:172.21.15.135:6800/726754104 conn(0x7f6eb403ea80 0x7f6eb4040f40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.498+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 msgr2=0x7f6ec8126ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.498+0000 7f6eaffff640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 0x7f6ec8126ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8127cb0 tx=0x7f6ebc011d40 comp rx=0 tx=0).stop 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.498+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 msgr2=0x7f6ec8126ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.498+0000 7f6eaffff640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec81cf0b0 0x7f6ec8126ad0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8127cb0 tx=0x7f6ebc011d40 comp rx=0 tx=0).stop 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ecdc32640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 0x7f6ec81225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ecdc32640 10 monclient(hunting): start opening mon connection 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6ec81c6480 con 0x7f6ec8127010 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 0x7f6ec81225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient: get_auth_request con 0x7f6ec8127010 auth_method 0 2024-08-19T11:18:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 10 monclient(hunting): handle_auth_done global_id 84580 payload 824 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.504+0000 7f6ec6ffd640 1 -- 172.21.15.71:0/697566067 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ec8127420 con 0x7f6ec8127010 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.506+0000 7f6ec6ffd640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 msgr2=0x7f6ec81225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.506+0000 7f6ec6ffd640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 0x7f6ec81225a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8127cb0 tx=0x7f6ebc0046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6ebc019040 con 0x7f6ec8127010 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 10 monclient: dump: 2024-08-19T11:18:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:18:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f6ebc01e450 con 0x7f6ec8127010 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 msgr2=0x7f6ec81225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 0x7f6ec81225a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8127cb0 tx=0x7f6ebc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 msgr2=0x7f6ec81225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6eaffff640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6ec8127010 0x7f6ec81225a0 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8127cb0 tx=0x7f6ebc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.522 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 174, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 106666, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:18:44.523 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.524 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.525 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:18:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:18:44.527 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.528 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:18:44.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.533 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.535 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:18:44.538 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:18:44.540 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:18:44.543 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.544 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:18:44.545 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:18:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:18:44.546 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:18:44.546 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 >> v2:172.21.15.135:6800/726754104 conn(0x7f6eb403ea80 msgr2=0x7f6eb4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/697566067 >> v2:172.21.15.135:6800/726754104 conn(0x7f6eb403ea80 0x7f6eb4040f40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec0009000 comp rx=0 tx=0).stop 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 10 monclient: shutdown 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 msgr2=0x7f6ec8128a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 --2- 172.21.15.71:0/697566067 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f6ec80a57c0 0x7f6ec8128a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c430 tx=0x7f6eb800c8f0 comp rx=0 tx=0).stop 2024-08-19T11:18:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ec7fff640 1 -- 172.21.15.71:0/697566067 reap_dead start 2024-08-19T11:18:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ec7fff640 1 -- 172.21.15.71:0/697566067 reap_dead start 2024-08-19T11:18:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 shutdown_connections 2024-08-19T11:18:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 >> 172.21.15.71:0/697566067 conn(0x7f6ec80abf50 msgr2=0x7f6ec809d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:18:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 shutdown_connections 2024-08-19T11:18:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:18:44.507+0000 7f6ecdc32640 1 -- 172.21.15.71:0/697566067 wait complete. 2024-08-19T11:18:44.548 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:18:44.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: starting. 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27730 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: created object 0... 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: created object 25... 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: created object 49... 2024-08-19T11:18:46.078 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: finishing. 2024-08-19T11:18:46.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27765]: shutting down. 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27767]: starting. 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27767]: listing objects. 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27767]: listed object 0... 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27767]: listed object 25... 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27767]: saw 50 objects 2024-08-19T11:18:46.272 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27767]: shutting down. 2024-08-19T11:18:46.961 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:46.962 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27766]: starting. 2024-08-19T11:18:46.962 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27766]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27730 2024-08-19T11:18:46.962 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27766]: shutting down. 2024-08-19T11:18:46.963 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:46.963 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:46.963 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:18:46.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:18:50.015 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: starting. 2024-08-19T11:18:50.015 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27834 2024-08-19T11:18:50.015 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: created object 0... 2024-08-19T11:18:50.015 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: created object 25... 2024-08-19T11:18:50.016 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: created object 49... 2024-08-19T11:18:50.016 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: finishing. 2024-08-19T11:18:50.016 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27836]: shutting down. 2024-08-19T11:18:50.933 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27837]: starting. 2024-08-19T11:18:50.933 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27837]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27834 2024-08-19T11:18:50.933 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27837]: shutting down. 2024-08-19T11:18:53.045 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:53.045 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: starting. 2024-08-19T11:18:53.046 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27834 2024-08-19T11:18:53.046 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: created object 0... 2024-08-19T11:18:53.046 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: created object 25... 2024-08-19T11:18:53.046 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: created object 49... 2024-08-19T11:18:53.046 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: finishing. 2024-08-19T11:18:53.046 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27870]: shutting down. 2024-08-19T11:18:53.086 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:53.086 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27872]: starting. 2024-08-19T11:18:53.086 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27872]: listing objects. 2024-08-19T11:18:53.086 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27872]: listed object 0... 2024-08-19T11:18:53.086 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27872]: listed object 25... 2024-08-19T11:18:53.086 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27872]: saw 50 objects 2024-08-19T11:18:53.087 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27872]: shutting down. 2024-08-19T11:18:53.949 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:53.950 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27871]: starting. 2024-08-19T11:18:53.950 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27871]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27834 2024-08-19T11:18:53.950 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27871]: shutting down. 2024-08-19T11:18:53.952 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:53.952 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:53.952 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:18:53.954 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:18:56.868 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: starting. 2024-08-19T11:18:56.868 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27938 2024-08-19T11:18:56.868 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: created object 0... 2024-08-19T11:18:56.868 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: created object 25... 2024-08-19T11:18:56.868 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: created object 49... 2024-08-19T11:18:56.868 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: finishing. 2024-08-19T11:18:56.869 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[27939]: shutting down. 2024-08-19T11:18:57.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27940]: starting. 2024-08-19T11:18:57.769 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27940]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27938 2024-08-19T11:18:57.769 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[27940]: shutting down. 2024-08-19T11:18:59.885 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: starting. 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-27938 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: created object 0... 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: created object 25... 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: created object 49... 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: finishing. 2024-08-19T11:18:59.886 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[27973]: shutting down. 2024-08-19T11:18:59.941 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:18:59.941 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27975]: starting. 2024-08-19T11:18:59.941 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27975]: listing objects. 2024-08-19T11:18:59.942 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27975]: listed object 0... 2024-08-19T11:18:59.942 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27975]: listed object 25... 2024-08-19T11:18:59.942 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27975]: saw 50 objects 2024-08-19T11:18:59.942 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[27975]: shutting down. 2024-08-19T11:19:01.237 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:01.237 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27974]: starting. 2024-08-19T11:19:01.237 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27974]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-27938 2024-08-19T11:19:01.237 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[27974]: shutting down. 2024-08-19T11:19:01.239 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:01.239 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:01.239 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:01.241 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:19:04.036 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: starting. 2024-08-19T11:19:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28041 2024-08-19T11:19:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: created object 0... 2024-08-19T11:19:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: created object 25... 2024-08-19T11:19:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: created object 49... 2024-08-19T11:19:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: finishing. 2024-08-19T11:19:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28042]: shutting down. 2024-08-19T11:19:04.549 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-08-19T11:19:04.549 INFO:tasks.ceph.mon.d:Restarting daemon 2024-08-19T11:19:04.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-08-19T11:19:04.553 INFO:tasks.ceph.mon.d:Started 2024-08-19T11:19:04.553 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:19:04.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:19:04.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.672+0000 7f390495c640 10 monclient: get_monmap_and_config 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.672+0000 7f390495c640 10 monclient: build_initial_monmap 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.672+0000 7f390495c640 10 monclient: monmap: 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:04.674254+0000 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:04.674254+0000 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:04.675 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 Processor -- start 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 -- start start 2024-08-19T11:19:04.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient: init 2024-08-19T11:19:04.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:04.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient: _add_conns ranks=[0,2,6,4,5,8,9,3,10,7,1] 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f39000a57d0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 0x7f39000a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): picked mon.noname-b con 0x7f3900072400 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 0x7f390013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): picked mon.noname-d con 0x7f39000a62c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39000741c0 con 0x7f39000a57d0 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3900072880 con 0x7f3900072400 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f39000a72a0 con 0x7f39000a62c0 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:04.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.673+0000 7f390495c640 10 monclient(hunting): authenticate will time out at 1202.715973s 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 0x7f39000a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fe59c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f39000a57d0 0x7f39000a5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37956/0 (socket says 172.21.15.71:37956) 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fe59c640 1 -- 172.21.15.71:0/378822567 learned_addr learned my addr 172.21.15.71:0/378822567 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): get_auth_request con 0x7f3900072400 auth_method 0 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 0x7f390013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 10 monclient(hunting): get_auth_request con 0x7f39000a62c0 auth_method 0 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:04.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 1 -- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 msgr2=0x7f390013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 1 -- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 msgr2=0x7f390013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 0x7f390013ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fed9d640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 0x7f390013ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient(hunting): handle_auth_done global_id 75053 payload 274 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 1 -- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 msgr2=0x7f390013ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 0x7f390013ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 1 -- 172.21.15.71:0/378822567 >> v1:172.21.15.71:6789/0 conn(0x7f39000a57d0 legacy=0x7f39000a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:04.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 1 monclient: found mon.noname-b 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.674+0000 7f38fdd9b640 1 -- 172.21.15.71:0/378822567 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390013ffa0 con 0x7f3900072400 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fdd9b640 1 -- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 msgr2=0x7f39000a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fdd9b640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 0x7f39000a17d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097d0 tx=0x7f38f4029fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89deacc44cc8959e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 1 -- 172.21.15.71:0/378822567 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38f4037070 con 0x7f3900072400 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: dump: 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.684 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: _finish_auth 0 2024-08-19T11:19:04.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: _check_auth_tickets 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 1 -- 172.21.15.71:0/378822567 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f402ad10 con 0x7f3900072400 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 1 -- 172.21.15.71:0/378822567 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38f4030c20 con 0x7f3900072400 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 5 monclient: authenticate success, global_id 75053 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 4 set_mon_vals no callback set 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f38fd59a640 10 monclient: dump: 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:04.687 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 10 monclient: shutdown 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 1 -- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 msgr2=0x7f39000a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.677+0000 7f390495c640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 0x7f39000a17d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097d0 tx=0x7f38f4029fb0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 1 -- 172.21.15.71:0/378822567 shutdown_connections 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f39000a62c0 0x7f390013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 1 --2- 172.21.15.71:0/378822567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3900072400 0x7f39000a17d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 1 -- 172.21.15.71:0/378822567 >> 172.21.15.71:0/378822567 conn(0x7f39000aa3f0 msgr2=0x7f39000a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 1 -- 172.21.15.71:0/378822567 shutdown_connections 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 1 -- 172.21.15.71:0/378822567 wait complete. 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 10 monclient: build_initial_monmap 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.678+0000 7f390495c640 10 monclient: monmap: 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:04.688 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:04.689 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:04.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 Processor -- start 2024-08-19T11:19:04.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 -- start start 2024-08-19T11:19:04.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient: init 2024-08-19T11:19:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient: _add_conns ranks=[6,5,8,0,7,1,2,4,3] 2024-08-19T11:19:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): picked mon.noname-d con 0x7f3900072400 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f39000a57d0 0x7f39001ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): picked mon.noname-h con 0x7f39000a57d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 0x7f39001cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): picked mon.noname-e con 0x7f39000a62c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f390013f320 con 0x7f39000a57d0 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f390013f1a0 con 0x7f3900072400 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f390013f4a0 con 0x7f39000a62c0 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f390495c640 10 monclient(hunting): authenticate will time out at 1202.721667s 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:49928/0 (socket says 172.21.15.71:49928) 2024-08-19T11:19:04.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 -- 172.21.15.71:0/3881480702 learned_addr learned my addr 172.21.15.71:0/3881480702 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 10 monclient(hunting): get_auth_request con 0x7f3900072400 auth_method 0 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 0x7f39001cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): get_auth_request con 0x7f39000a62c0 auth_method 0 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 -- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 msgr2=0x7f390013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 -- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 msgr2=0x7f390013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:04.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fe59c640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fdd9b640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f39000a57d0 0x7f39001ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fdd9b640 10 monclient(hunting): get_auth_request con 0x7f39000a57d0 auth_method 0 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fdd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.679+0000 7f38fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 10 monclient(hunting): handle_auth_done global_id 94436 payload 824 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 1 -- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 msgr2=0x7f390013e5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 1 -- 172.21.15.71:0/3881480702 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f39000a57d0 msgr2=0x7f39001ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f39000a57d0 0x7f39001ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 1 monclient: found mon.noname-e 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fed9d640 1 -- 172.21.15.71:0/3881480702 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390006f460 con 0x7f39000a62c0 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.680+0000 7f38fdd9b640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f39000a57d0 0x7f39001ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38fed9d640 1 -- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 msgr2=0x7f39001cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38fed9d640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 0x7f39001cea20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007cf0 tx=0x7f38f800e4b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38f80098e0 con 0x7f39000a62c0 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: dump: 2024-08-19T11:19:04.698 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:04.699 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f8014890 con 0x7f39000a62c0 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 5 monclient: authenticate success, global_id 94436 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 10 monclient: _renew_subs 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f38f8013380 con 0x7f39000a62c0 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390013d530 con 0x7f39000a62c0 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:04.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38fcd99640 4 set_mon_vals no callback set 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f38eeffd640 10 monclient: dump: 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:04.701 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 10 monclient: _renew_subs 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.682+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f390013c5d0 con 0x7f39000a62c0 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f390495c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f390495c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f390495c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f38f801b030 con 0x7f39000a62c0 2024-08-19T11:19:04.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39000008d0 con 0x7f39000a62c0 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f38eeffd640 1 --2- 172.21.15.71:0/3881480702 >> v2:172.21.15.135:6800/726754104 conn(0x7f38e003ea80 0x7f38e0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.683+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(246..246 src has 1..246) ==== 3898+0+0 (secure 0 0 0) 0x7f38f8019020 con 0x7f39000a62c0 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.684+0000 7f38fe59c640 1 --2- 172.21.15.71:0/3881480702 >> v2:172.21.15.135:6800/726754104 conn(0x7f38e003ea80 0x7f38e0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.684+0000 7f38fe59c640 10 monclient: get_auth_request con 0x7f38e003ea80 auth_method 0 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.686+0000 7f38fe59c640 1 --2- 172.21.15.71:0/3881480702 >> v2:172.21.15.135:6800/726754104 conn(0x7f38e003ea80 0x7f38e0040f40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f38f0007fd0 tx=0x7f38f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.688+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f38f8022060 con 0x7f39000a62c0 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.688+0000 7f38eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:04.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.688+0000 7f38eeffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.931+0000 7f390495c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:19:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.931+0000 7f390495c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.931+0000 7f390495c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.931+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f39000a17d0 con 0x7f39000a62c0 2024-08-19T11:19:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.932+0000 7f38eeffd640 1 -- 172.21.15.71:0/3881480702 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3188 (secure 0 0 0) 0x7f38f80146b0 con 0x7f39000a62c0 2024-08-19T11:19:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.932+0000 7f38eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.932+0000 7f38eeffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:04.934 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":174,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 >> v2:172.21.15.135:6800/726754104 conn(0x7f38e003ea80 msgr2=0x7f38e0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 --2- 172.21.15.71:0/3881480702 >> v2:172.21.15.135:6800/726754104 conn(0x7f38e003ea80 0x7f38e0040f40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f38f0007fd0 tx=0x7f38f0009040 comp rx=0 tx=0).stop 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 10 monclient: shutdown 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 msgr2=0x7f39001cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 0x7f39001cea20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007cf0 tx=0x7f38f800e4b0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 shutdown_connections 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 --2- 172.21.15.71:0/3881480702 >> v2:172.21.15.135:6800/726754104 conn(0x7f38e003ea80 0x7f38e0040f40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f39000a62c0 0x7f39001cea20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f39000a57d0 0x7f39001ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 --2- 172.21.15.71:0/3881480702 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3900072400 0x7f390013e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 >> 172.21.15.71:0/3881480702 conn(0x7f39000aa3f0 msgr2=0x7f39000a9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 shutdown_connections 2024-08-19T11:19:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:04.934+0000 7f390495c640 1 -- 172.21.15.71:0/3881480702 wait complete. 2024-08-19T11:19:05.910 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28043]: starting. 2024-08-19T11:19:05.910 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28043]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28041 2024-08-19T11:19:05.910 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28043]: shutting down. 2024-08-19T11:19:07.948 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:19:08.026 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:08.026 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: starting. 2024-08-19T11:19:08.026 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28041 2024-08-19T11:19:08.026 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: created object 0... 2024-08-19T11:19:08.026 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: created object 25... 2024-08-19T11:19:08.026 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: created object 49... 2024-08-19T11:19:08.027 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: finishing. 2024-08-19T11:19:08.027 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28076]: shutting down. 2024-08-19T11:19:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.054+0000 7fe841f33640 10 monclient: get_monmap_and_config 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.054+0000 7fe841f33640 10 monclient: build_initial_monmap 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.054+0000 7fe841f33640 10 monclient: monmap: 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:08.055838+0000 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:08.055838+0000 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:08.056 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:08.057 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:08.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 Processor -- start 2024-08-19T11:19:08.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 -- start start 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient: init 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient: _add_conns ranks=[2,0,9,5,7,3,1,10,4,6,8] 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 0x7fe83c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): picked mon.noname-b con 0x7fe83c1399f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe83c139dd0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe83c13a1b0 0x7fe83c0a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): picked mon.noname-a con 0x7fe83c13a1b0 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe83c06f060 con 0x7fe83c139dd0 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe83c06dfc0 con 0x7fe83c13a1b0 2024-08-19T11:19:08.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe83c06f340 con 0x7fe83c1399f0 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe841f33640 10 monclient(hunting): authenticate will time out at 1206.097695s 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 0x7fe83c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe83c13a1b0 0x7fe83c0a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe83c13a1b0 0x7fe83c0a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54322/0 (socket says 172.21.15.71:54322) 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 0x7fe83c0720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52636/0 (socket says 172.21.15.71:52636) 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 1 -- 172.21.15.71:0/4159802116 learned_addr learned my addr 172.21.15.71:0/4159802116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): get_auth_request con 0x7fe83c13a1b0 auth_method 0 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): get_auth_request con 0x7fe83c1399f0 auth_method 0 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:08.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.055+0000 7fe83b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 10 monclient(hunting): handle_auth_done global_id 75150 payload 274 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 1 -- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 msgr2=0x7fe83c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 1 --2- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 0x7fe83c0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 1 -- 172.21.15.71:0/4159802116 >> v1:172.21.15.71:6789/0 conn(0x7fe83c139dd0 legacy=0x7fe83c0a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 1 monclient: found mon.noname-a 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83bfff640 1 -- 172.21.15.71:0/4159802116 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83c06f620 con 0x7fe83c13a1b0 2024-08-19T11:19:08.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.056+0000 7fe83b7fe640 1 --2- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 0x7fe83c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.058+0000 7fe83bfff640 1 -- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 msgr2=0x7fe83c0a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.058+0000 7fe83bfff640 1 --2- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c0a5f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe834009e50 tx=0x7fe83402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b62ac7a690eaa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 1 -- 172.21.15.71:0/4159802116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe834036070 con 0x7fe83c13a1b0 2024-08-19T11:19:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:08.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: dump: 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:08.070 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: _finish_auth 0 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 5 monclient: authenticate success, global_id 75150 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 1 -- 172.21.15.71:0/4159802116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834007a70 con 0x7fe83c13a1b0 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 1 -- 172.21.15.71:0/4159802116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe834007c20 con 0x7fe83c13a1b0 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 4 set_mon_vals no callback set 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe83affd640 10 monclient: dump: 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 10 monclient: shutdown 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 1 -- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 msgr2=0x7fe83c0a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.059+0000 7fe841f33640 1 --2- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c0a5f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe834009e50 tx=0x7fe83402a560 comp rx=0 tx=0).stop 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 -- 172.21.15.71:0/4159802116 shutdown_connections 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 --2- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c0a5f70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 --2- 172.21.15.71:0/4159802116 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe83c1399f0 0x7fe83c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 -- 172.21.15.71:0/4159802116 >> 172.21.15.71:0/4159802116 conn(0x7fe83c0aa480 msgr2=0x7fe83c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 -- 172.21.15.71:0/4159802116 shutdown_connections 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 -- 172.21.15.71:0/4159802116 wait complete. 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 10 monclient: build_initial_monmap 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 10 monclient: monmap: 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:08.074 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.060+0000 7fe841f33640 1 Processor -- start 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 -- start start 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient: init 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient: _add_conns ranks=[5,3,0,7,4,1,8,6,2] 2024-08-19T11:19:08.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe83c1399f0 0x7fe83c1ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): picked mon.noname-h con 0x7fe83c1399f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c139dd0 0x7fe83c1ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): picked mon.noname-g con 0x7fe83c139dd0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c1cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): picked mon.noname-a con 0x7fe83c13a1b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe83c06e860 con 0x7fe83c13a1b0 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe83c06e6e0 con 0x7fe83c139dd0 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe83c0a64b0 con 0x7fe83c1399f0 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe841f33640 10 monclient(hunting): authenticate will time out at 1206.103509s 2024-08-19T11:19:08.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c1cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c1cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54326/0 (socket says 172.21.15.71:54326) 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 -- 172.21.15.71:0/1800715999 learned_addr learned my addr 172.21.15.71:0/1800715999 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): get_auth_request con 0x7fe83c13a1b0 auth_method 0 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe83c1399f0 0x7fe83c1ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe833fff640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c139dd0 0x7fe83c1ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:08.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): get_auth_request con 0x7fe83c1399f0 auth_method 0 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe833fff640 10 monclient(hunting): get_auth_request con 0x7fe83c139dd0 auth_method 0 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe833fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe833fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe833fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient(hunting): handle_auth_done global_id 75159 payload 824 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 -- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe83c1399f0 msgr2=0x7fe83c1ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:08.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe83c1399f0 0x7fe83c1ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 -- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c139dd0 msgr2=0x7fe83c1ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c139dd0 0x7fe83c1ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 monclient: found mon.noname-a 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe83bfff640 1 -- 172.21.15.71:0/1800715999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83c139480 con 0x7fe83c13a1b0 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.061+0000 7fe833fff640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c139dd0 0x7fe83c1ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe83bfff640 1 -- 172.21.15.71:0/1800715999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 msgr2=0x7fe83c1cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe83bfff640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c1cef30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe834009e20 tx=0x7fe834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe83403f030 con 0x7fe83c13a1b0 2024-08-19T11:19:08.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: dump: 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:08.080 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834003ba0 con 0x7fe83c13a1b0 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 5 monclient: authenticate success, global_id 75159 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 10 monclient: _renew_subs 2024-08-19T11:19:08.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83c126cb0 con 0x7fe83c13a1b0 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe834036040 con 0x7fe83c13a1b0 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe838ff9640 10 monclient: dump: 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:08.082 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe83a7fc640 4 set_mon_vals no callback set 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 10 monclient: _renew_subs 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:08.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.064+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe83c127f40 con 0x7fe83c13a1b0 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe834042070 con 0x7fe83c13a1b0 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe841f33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe841f33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe841f33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83c0720d0 con 0x7fe83c13a1b0 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe838ff9640 1 --2- 172.21.15.71:0/1800715999 >> v2:172.21.15.135:6800/726754104 conn(0x7fe81c03eab0 0x7fe81c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(249..249 src has 1..249) ==== 3898+0+0 (secure 0 0 0) 0x7fe834040070 con 0x7fe83c13a1b0 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe83b7fe640 1 --2- 172.21.15.71:0/1800715999 >> v2:172.21.15.135:6800/726754104 conn(0x7fe81c03eab0 0x7fe81c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:08.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.065+0000 7fe83b7fe640 10 monclient: get_auth_request con 0x7fe81c03eab0 auth_method 0 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28078]: starting. 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28078]: listing objects. 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28078]: listed object 0... 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28078]: listed object 25... 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28078]: saw 50 objects 2024-08-19T11:19:08.085 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28078]: shutting down. 2024-08-19T11:19:08.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.068+0000 7fe83b7fe640 1 --2- 172.21.15.71:0/1800715999 >> v2:172.21.15.135:6800/726754104 conn(0x7fe81c03eab0 0x7fe81c040f70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009560 tx=0x7fe82c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:08.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.070+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fe834049020 con 0x7fe83c13a1b0 2024-08-19T11:19:08.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.070+0000 7fe838ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:08.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.070+0000 7fe838ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.315+0000 7fe841f33640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.315+0000 7fe841f33640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.315+0000 7fe841f33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.315+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe83c127a80 con 0x7fe83c13a1b0 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.316+0000 7fe838ff9640 1 -- 172.21.15.71:0/1800715999 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3188 (secure 0 0 0) 0x7fe834070830 con 0x7fe83c13a1b0 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.316+0000 7fe838ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.316+0000 7fe838ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:08.318 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":174,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:19:08.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 >> v2:172.21.15.135:6800/726754104 conn(0x7fe81c03eab0 msgr2=0x7fe81c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:08.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 --2- 172.21.15.71:0/1800715999 >> v2:172.21.15.135:6800/726754104 conn(0x7fe81c03eab0 0x7fe81c040f70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009560 tx=0x7fe82c009190 comp rx=0 tx=0).stop 2024-08-19T11:19:08.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 10 monclient: shutdown 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 msgr2=0x7fe83c1cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c1cef30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe834009e20 tx=0x7fe834004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 shutdown_connections 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 --2- 172.21.15.71:0/1800715999 >> v2:172.21.15.135:6800/726754104 conn(0x7fe81c03eab0 0x7fe81c040f70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe83c13a1b0 0x7fe83c1cef30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe83c139dd0 0x7fe83c1ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 --2- 172.21.15.71:0/1800715999 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe83c1399f0 0x7fe83c1ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 >> 172.21.15.71:0/1800715999 conn(0x7fe83c0aa480 msgr2=0x7fe83c1bfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 shutdown_connections 2024-08-19T11:19:08.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:08.318+0000 7fe841f33640 1 -- 172.21.15.71:0/1800715999 wait complete. 2024-08-19T11:19:08.934 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:08.934 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28077]: starting. 2024-08-19T11:19:08.934 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28077]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28041 2024-08-19T11:19:08.935 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28077]: shutting down. 2024-08-19T11:19:08.935 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:08.936 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:08.936 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:08.938 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:19:11.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:19:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.437+0000 7fefc3b5a640 10 monclient: get_monmap_and_config 2024-08-19T11:19:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.437+0000 7fefc3b5a640 10 monclient: build_initial_monmap 2024-08-19T11:19:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.437+0000 7fefc3b5a640 10 monclient: monmap: 2024-08-19T11:19:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:11.439 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:11.439152+0000 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:11.439152+0000 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:11.440 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:11.441 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:11.441 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 Processor -- start 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 -- start start 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient: init 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient: _add_conns ranks=[3,10,5,6,8,1,4,7,9,2,0] 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 0x7fefbc0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): picked mon.noname-g con 0x7fefbc0a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:11.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 0x7fefbc0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): picked mon.noname-f con 0x7fefbc0a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 0x7fefbc139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): picked mon.noname-h con 0x7fefbc139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fefbc0a4f90 con 0x7fefbc0a6e10 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc0a6380 con 0x7fefbc0a6a30 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fefbc0a49d0 con 0x7fefbc139860 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.438+0000 7fefc3b5a640 10 monclient(hunting): authenticate will time out at 1209.480942s 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 0x7fefbc139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 0x7fefbc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 0x7fefbc139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:48220/0 (socket says 172.21.15.71:48220) 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 0x7fefbc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 0x7fefbc0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:34600/0 (socket says 172.21.15.71:34600) 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 1 -- 172.21.15.71:0/2935537402 learned_addr learned my addr 172.21.15.71:0/2935537402 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): get_auth_request con 0x7fefbc139860 auth_method 0 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): get_auth_request con 0x7fefbc0a6e10 auth_method 0 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): get_auth_request con 0x7fefbc0a6a30 auth_method 0 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient(hunting): handle_auth_done global_id 45579 payload 274 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 -- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 msgr2=0x7fefbc139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 --2- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 0x7fefbc139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 -- 172.21.15.71:0/2935537402 >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 msgr2=0x7fefbc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 --2- 172.21.15.71:0/2935537402 >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 0x7fefbc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient: _finish_hunting 0 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 monclient: found mon.noname-g 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc18f6640 1 -- 172.21.15.71:0/2935537402 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc0a46f0 con 0x7fefbc0a6a30 2024-08-19T11:19:11.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc10f5640 1 --2- 172.21.15.71:0/2935537402 >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 0x7fefbc0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.439+0000 7fefc20f7640 1 --2- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 0x7fefbc139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.442+0000 7fefc18f6640 1 -- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 msgr2=0x7fefbc0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:11.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.442+0000 7fefc18f6640 1 --2- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 0x7fefbc0a57f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fefb80097d0 tx=0x7fefb802a000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=b430a0607822836a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.442+0000 7fefc08f4640 1 -- 172.21.15.71:0/2935537402 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb8037070 con 0x7fefbc0a6a30 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.442+0000 7fefc08f4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: dump: 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.454 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: _finish_auth 0 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: _check_auth_tickets 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 1 -- 172.21.15.71:0/2935537402 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb802ad20 con 0x7fefbc0a6a30 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 1 -- 172.21.15.71:0/2935537402 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefb8030c20 con 0x7fefbc0a6a30 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 5 monclient: authenticate success, global_id 45579 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 4 set_mon_vals no callback set 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc08f4640 10 monclient: dump: 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.456 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.457 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 10 monclient: shutdown 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 msgr2=0x7fefbc0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 0x7fefbc0a57f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fefb80097d0 tx=0x7fefb802a000 comp rx=0 tx=0).stop 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2935537402 shutdown_connections 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fefbc139860 0x7fefbc139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2935537402 >> v2:172.21.15.135:3300/0 conn(0x7fefbc0a6e10 0x7fefbc0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2935537402 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefbc0a6a30 0x7fefbc0a57f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2935537402 >> 172.21.15.71:0/2935537402 conn(0x7fefbc0ac030 msgr2=0x7fefbc0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2935537402 shutdown_connections 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.443+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2935537402 wait complete. 2024-08-19T11:19:11.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.444+0000 7fefc3b5a640 10 monclient: build_initial_monmap 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.444+0000 7fefc3b5a640 10 monclient: monmap: 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:11.459 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.444+0000 7fefc3b5a640 1 Processor -- start 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.444+0000 7fefc3b5a640 1 -- start start 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.444+0000 7fefc3b5a640 10 monclient: init 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient: _add_conns ranks=[4,2,6,1,0,7,8,3,5] 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a6a30 0x7fefbc124cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): picked mon.noname-c con 0x7fefbc0a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 0x7fefbc125210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): picked mon.noname-b con 0x7fefbc0a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc139860 0x7fefbc125750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): picked mon.noname-d con 0x7fefbc139860 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc0a7730 con 0x7fefbc0a6e10 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fefbc13a200 con 0x7fefbc0a6a30 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fefbc127cb0 con 0x7fefbc139860 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc3b5a640 10 monclient(hunting): authenticate will time out at 1209.487435s 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a6a30 0x7fefbc124cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 0x7fefbc125210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a6a30 0x7fefbc124cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:39032/0 (socket says 172.21.15.71:39032) 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 0x7fefbc125210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52662/0 (socket says 172.21.15.71:52662) 2024-08-19T11:19:11.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 1 -- 172.21.15.71:0/2977522395 learned_addr learned my addr 172.21.15.71:0/2977522395 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): get_auth_request con 0x7fefbc0a6a30 auth_method 0 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): get_auth_request con 0x7fefbc0a6e10 auth_method 0 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc139860 0x7fefbc125750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): get_auth_request con 0x7fefbc139860 auth_method 0 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc20f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc18f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient(hunting): handle_auth_done global_id 75089 payload 824 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 -- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc139860 msgr2=0x7fefbc125750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc139860 0x7fefbc125750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 -- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a6a30 msgr2=0x7fefbc124cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a6a30 0x7fefbc124cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient: _finish_hunting 0 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 monclient: found mon.noname-b 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.445+0000 7fefc10f5640 1 -- 172.21.15.71:0/2977522395 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc128b20 con 0x7fefbc0a6e10 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc10f5640 1 -- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 msgr2=0x7fefbc125210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc10f5640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 0x7fefbc125210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefac00e900 tx=0x7fefac00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefac017070 con 0x7fefbc0a6e10 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: dump: 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.465 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 5 monclient: authenticate success, global_id 75089 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefac00cc10 con 0x7fefbc0a6e10 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:11.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fefac00cdc0 con 0x7fefbc0a6e10 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb27fc640 10 monclient: dump: 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.467 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefb37fe640 4 set_mon_vals no callback set 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 10 monclient: _renew_subs 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefbc0a3ed0 con 0x7fefbc0a6e10 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 10 monclient: _renew_subs 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.448+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefbc1267c0 con 0x7fefbc0a6e10 2024-08-19T11:19:11.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fefac01a070 con 0x7fefbc0a6e10 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefc3b5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefc3b5a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefc3b5a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefbc13a560 con 0x7fefbc0a6e10 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefb27fc640 1 --2- 172.21.15.71:0/2977522395 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa003eab0 0x7fefa0040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (secure 0 0 0) 0x7fefac00f040 con 0x7fefbc0a6e10 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefc18f6640 1 --2- 172.21.15.71:0/2977522395 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa003eab0 0x7fefa0040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.449+0000 7fefc18f6640 10 monclient: get_auth_request con 0x7fefa003eab0 auth_method 0 2024-08-19T11:19:11.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.452+0000 7fefc18f6640 1 --2- 172.21.15.71:0/2977522395 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa003eab0 0x7fefa0040f70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fefb8000c00 tx=0x7fefb802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.454+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fefac021070 con 0x7fefbc0a6e10 2024-08-19T11:19:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.454+0000 7fefb27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:11.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.454+0000 7fefb27fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: starting. 2024-08-19T11:19:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28145 2024-08-19T11:19:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: created object 0... 2024-08-19T11:19:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: created object 25... 2024-08-19T11:19:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: created object 49... 2024-08-19T11:19:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: finishing. 2024-08-19T11:19:11.634 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28146]: shutting down. 2024-08-19T11:19:11.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.718+0000 7fefc3b5a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:19:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.719+0000 7fefc3b5a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.719+0000 7fefc3b5a640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.719+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fefbc0a1200 con 0x7fefbc0a6e10 2024-08-19T11:19:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.719+0000 7fefb27fc640 1 -- 172.21.15.71:0/2977522395 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7fefac050a30 con 0x7fefbc0a6e10 2024-08-19T11:19:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.719+0000 7fefb27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:11.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.719+0000 7fefb27fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:11.722 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":176,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:19:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa003eab0 msgr2=0x7fefa0040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2977522395 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa003eab0 0x7fefa0040f70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fefb8000c00 tx=0x7fefb802e000 comp rx=0 tx=0).stop 2024-08-19T11:19:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 10 monclient: shutdown 2024-08-19T11:19:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:11.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 msgr2=0x7fefbc125210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 0x7fefbc125210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefac00e900 tx=0x7fefac00edc0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 shutdown_connections 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2977522395 >> v2:172.21.15.135:6800/726754104 conn(0x7fefa003eab0 0x7fefa0040f70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fefbc139860 0x7fefbc125750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fefbc0a6e10 0x7fefbc125210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 --2- 172.21.15.71:0/2977522395 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fefbc0a6a30 0x7fefbc124cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 >> 172.21.15.71:0/2977522395 conn(0x7fefbc0ac030 msgr2=0x7fefbc1390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 shutdown_connections 2024-08-19T11:19:11.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.721+0000 7fefc3b5a640 1 -- 172.21.15.71:0/2977522395 wait complete. 2024-08-19T11:19:11.733 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:19:11.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:19:11.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:19:11.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.829+0000 7fe030baa640 10 monclient: get_monmap_and_config 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.829+0000 7fe030baa640 10 monclient: build_initial_monmap 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.829+0000 7fe030baa640 10 monclient: monmap: 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:11.831539+0000 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:11.831539+0000 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:11.832 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:11.833 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.830+0000 7fe030baa640 1 Processor -- start 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.830+0000 7fe030baa640 1 -- start start 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.830+0000 7fe030baa640 10 monclient: init 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient: _add_conns ranks=[10,4,2,8,7,0,3,6,5,9,1] 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe02c0a6950 0x7fe02c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): picked mon.noname-f con 0x7fe02c0a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 0x7fe02c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): picked mon.noname-c con 0x7fe02c0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 0x7fe02c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): picked mon.noname-b con 0x7fe02c139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0a5020 con 0x7fe02c0a6950 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c0a77b0 con 0x7fe02c139710 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe02c0a7d40 con 0x7fe02c0a57c0 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe030baa640 10 monclient(hunting): authenticate will time out at 1209.873250s 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 0x7fe02c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 0x7fe02c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 0x7fe02c139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52672/0 (socket says 172.21.15.71:52672) 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 1 -- 172.21.15.71:0/1170419687 learned_addr learned my addr 172.21.15.71:0/1170419687 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:11.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): get_auth_request con 0x7fe02c139710 auth_method 0 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): get_auth_request con 0x7fe02c0a57c0 auth_method 0 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02a59c640 1 --2- 172.21.15.71:0/1170419687 >> v2:172.21.15.135:3300/0 conn(0x7fe02c0a6950 0x7fe02c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02a59c640 10 monclient(hunting): get_auth_request con 0x7fe02c0a6950 auth_method 0 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient(hunting): handle_auth_done global_id 84766 payload 274 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 -- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 msgr2=0x7fe02c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 --2- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 0x7fe02c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 -- 172.21.15.71:0/1170419687 >> v2:172.21.15.135:3300/0 conn(0x7fe02c0a6950 msgr2=0x7fe02c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 --2- 172.21.15.71:0/1170419687 >> v2:172.21.15.135:3300/0 conn(0x7fe02c0a6950 0x7fe02c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:11.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 monclient: found mon.noname-c 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe029d9b640 1 -- 172.21.15.71:0/1170419687 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0a6380 con 0x7fe02c0a57c0 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.831+0000 7fe02ad9d640 1 --2- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 0x7fe02c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe029d9b640 1 -- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 msgr2=0x7fe02c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe029d9b640 1 --2- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 0x7fe02c0a7270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe0200097d0 tx=0x7fe02002a000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=3fe0bacff68f34f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 1 -- 172.21.15.71:0/1170419687 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe020037070 con 0x7fe02c0a57c0 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: dump: 2024-08-19T11:19:11.842 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.843 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: _finish_auth 0 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: _check_auth_tickets 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe030baa640 5 monclient: authenticate success, global_id 84766 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe030baa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 1 -- 172.21.15.71:0/1170419687 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02002ad20 con 0x7fe02c0a57c0 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe030baa640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 1 -- 172.21.15.71:0/1170419687 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe020030c20 con 0x7fe02c0a57c0 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe030baa640 4 set_mon_vals no callback set 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:11.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.834+0000 7fe02959a640 10 monclient: dump: 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.845 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 10 monclient: shutdown 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 -- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 msgr2=0x7fe02c0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 --2- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 0x7fe02c0a7270 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe0200097d0 tx=0x7fe02002a000 comp rx=0 tx=0).stop 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 -- 172.21.15.71:0/1170419687 shutdown_connections 2024-08-19T11:19:11.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 --2- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe02c139710 0x7fe02c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 --2- 172.21.15.71:0/1170419687 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe02c0a57c0 0x7fe02c0a7270 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 --2- 172.21.15.71:0/1170419687 >> v2:172.21.15.135:3300/0 conn(0x7fe02c0a6950 0x7fe02c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 -- 172.21.15.71:0/1170419687 >> 172.21.15.71:0/1170419687 conn(0x7fe02c0abf50 msgr2=0x7fe02c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 -- 172.21.15.71:0/1170419687 shutdown_connections 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.835+0000 7fe030baa640 1 -- 172.21.15.71:0/1170419687 wait complete. 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient: build_initial_monmap 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient: monmap: 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.847 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 Processor -- start 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 -- start start 2024-08-19T11:19:11.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient: init 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient: _add_conns ranks=[8,5,6,1,0,3,7,4,2] 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 0x7fe02c124e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): picked mon.noname-e con 0x7fe02c0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe02c0a6950 0x7fe02c125380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): picked mon.noname-h con 0x7fe02c0a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe02c139710 0x7fe02c1258c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): picked mon.noname-d con 0x7fe02c139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe02c0a84c0 con 0x7fe02c0a6950 2024-08-19T11:19:11.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe02c0a3650 con 0x7fe02c139710 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe02c0a8700 con 0x7fe02c0a57c0 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe030baa640 10 monclient(hunting): authenticate will time out at 1209.878889s 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe02a59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 0x7fe02c124e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe02ad9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe02c139710 0x7fe02c1258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.836+0000 7fe02a59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 0x7fe02c124e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:40686/0 (socket says 172.21.15.71:40686) 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 -- 172.21.15.71:0/307072391 learned_addr learned my addr 172.21.15.71:0/307072391 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): get_auth_request con 0x7fe02c0a57c0 auth_method 0 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): get_auth_request con 0x7fe02c139710 auth_method 0 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe029d9b640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe02c0a6950 0x7fe02c125380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe029d9b640 10 monclient(hunting): get_auth_request con 0x7fe02c0a6950 auth_method 0 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe029d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe029d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe029d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient(hunting): handle_auth_done global_id 94481 payload 824 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe02c139710 msgr2=0x7fe02c1258c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe02c139710 0x7fe02c1258c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe02c0a6950 msgr2=0x7fe02c125380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe02c0a6950 0x7fe02c125380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 monclient: found mon.noname-e 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:11.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02a59c640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c127da0 con 0x7fe02c0a57c0 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe02ad9d640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe02c139710 0x7fe02c1258c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.837+0000 7fe029d9b640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe02c0a6950 0x7fe02c125380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe02a59c640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 msgr2=0x7fe02c124e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe02a59c640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 0x7fe02c124e40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00d830 tx=0x7fe01c00dcf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe01c00bd40 con 0x7fe02c0a57c0 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: dump: 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.860 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: _finish_auth 0 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:11.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 5 monclient: authenticate success, global_id 94481 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01c019070 con 0x7fe02c0a57c0 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe01c0148a0 con 0x7fe02c0a57c0 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 10 monclient: _renew_subs 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c129030 con 0x7fe02c0a57c0 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe028d99640 4 set_mon_vals no callback set 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe01affd640 10 monclient: dump: 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.862 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.863 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 10 monclient: _renew_subs 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.839+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c128930 con 0x7fe02c0a57c0 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe030baa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe030baa640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 0x7fe02c063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c06a590 con 0x7fe02c02e340 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe01c014430 con 0x7fe02c0a57c0 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 0x7fe02c063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient: get_auth_request con 0x7fe02c02e340 auth_method 0 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.840+0000 7fe01affd640 1 --2- 172.21.15.71:0/307072391 >> v2:172.21.15.135:6800/726754104 conn(0x7fe00c03ea80 0x7fe00c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.841+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7fe01c00f040 con 0x7fe02c0a57c0 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.841+0000 7fe029d9b640 10 monclient(hunting): handle_auth_done global_id 75195 payload 824 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.841+0000 7fe029d9b640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe02c13a250 con 0x7fe02c02e340 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.841+0000 7fe02ad9d640 1 --2- 172.21.15.71:0/307072391 >> v2:172.21.15.135:6800/726754104 conn(0x7fe00c03ea80 0x7fe00c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.841+0000 7fe02ad9d640 10 monclient: get_auth_request con 0x7fe00c03ea80 auth_method 0 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe029d9b640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 msgr2=0x7fe02c063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe029d9b640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 0x7fe02c063a80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe020034000 tx=0x7fe0200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe020037040 con 0x7fe02c02e340 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:11.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 10 monclient: dump: 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.866 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe02ad9d640 1 --2- 172.21.15.71:0/307072391 >> v2:172.21.15.135:6800/726754104 conn(0x7fe00c03ea80 0x7fe00c040f40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe0240072e0 tx=0x7fe02400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe02002ad20 con 0x7fe02c02e340 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 msgr2=0x7fe02c063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 0x7fe02c063a80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe020034000 tx=0x7fe0200046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 msgr2=0x7fe02c063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.843+0000 7fe01affd640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c02e340 0x7fe02c063a80 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe020034000 tx=0x7fe0200046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.849+0000 7fe030baa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.849+0000 7fe030baa640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 0x7fe02c1d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.849+0000 7fe030baa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.849+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c076c60 con 0x7fe02c063fc0 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 0x7fe02c1d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient: get_auth_request con 0x7fe02c063fc0 auth_method 0 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 10 monclient(hunting): handle_auth_done global_id 75204 payload 824 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.850+0000 7fe029d9b640 1 -- 172.21.15.71:0/307072391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe02c02e720 con 0x7fe02c063fc0 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe029d9b640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 msgr2=0x7fe02c1d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe029d9b640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 0x7fe02c1d8990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe0200096f0 tx=0x7fe020009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe020047db0 con 0x7fe02c063fc0 2024-08-19T11:19:11.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 10 monclient: dump: 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:11.869 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7fe020047db0 con 0x7fe02c063fc0 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 msgr2=0x7fe02c1d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 0x7fe02c1d8990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe0200096f0 tx=0x7fe020009190 comp rx=0 tx=0).stop 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 msgr2=0x7fe02c1d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:11.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.852+0000 7fe01affd640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe02c063fc0 0x7fe02c1d8990 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe0200096f0 tx=0x7fe020009190 comp rx=0 tx=0).stop 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 200885, 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:11.871 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:11.872 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:11.873 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:11.874 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:11.894 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 >> v2:172.21.15.135:6800/726754104 conn(0x7fe00c03ea80 msgr2=0x7fe00c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 --2- 172.21.15.71:0/307072391 >> v2:172.21.15.135:6800/726754104 conn(0x7fe00c03ea80 0x7fe00c040f40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe0240072e0 tx=0x7fe02400b040 comp rx=0 tx=0).stop 2024-08-19T11:19:11.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 10 monclient: shutdown 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 msgr2=0x7fe02c124e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 --2- 172.21.15.71:0/307072391 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe02c0a57c0 0x7fe02c124e40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00d830 tx=0x7fe01c00dcf0 comp rx=0 tx=0).stop 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe02ad9d640 1 -- 172.21.15.71:0/307072391 reap_dead start 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe02ad9d640 1 -- 172.21.15.71:0/307072391 reap_dead start 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 shutdown_connections 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 >> 172.21.15.71:0/307072391 conn(0x7fe02c0abf50 msgr2=0x7fe02c0aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 shutdown_connections 2024-08-19T11:19:11.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.853+0000 7fe030baa640 1 -- 172.21.15.71:0/307072391 wait complete. 2024-08-19T11:19:11.896 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:11.897 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:19:11.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:19:11.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.993+0000 7fd506b8f640 10 monclient: get_monmap_and_config 2024-08-19T11:19:11.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.993+0000 7fd506b8f640 10 monclient: build_initial_monmap 2024-08-19T11:19:11.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.993+0000 7fd506b8f640 10 monclient: monmap: 2024-08-19T11:19:11.995 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:11.995 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:11.995215+0000 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:11.995215+0000 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:11.997 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 Processor -- start 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 -- start start 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient: init 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient: _add_conns ranks=[9,2,8,10,1,6,5,7,3,0,4] 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5000a6950 0x7fd5000a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): picked mon.noname-a con 0x7fd5000a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5000a57c0 0x7fd5000a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): picked mon.noname-b con 0x7fd5000a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): picked mon.noname-e con 0x7fd500139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fd5000a5020 con 0x7fd5000a6950 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd5000a77b0 con 0x7fd5000a57c0 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd5000a7d40 con 0x7fd500139710 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.994+0000 7fd506b8f640 10 monclient(hunting): authenticate will time out at 1210.036960s 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5000a6950 0x7fd5000a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5000a57c0 0x7fd5000a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5000a6950 0x7fd5000a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54394/0 (socket says 172.21.15.71:54394) 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 -- 172.21.15.71:0/3616152212 learned_addr learned my addr 172.21.15.71:0/3616152212 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): get_auth_request con 0x7fd5000a6950 auth_method 0 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): get_auth_request con 0x7fd5000a57c0 auth_method 0 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): get_auth_request con 0x7fd500139710 auth_method 0 2024-08-19T11:19:12.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient(hunting): handle_auth_done global_id 75213 payload 274 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 -- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 msgr2=0x7fd500139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 -- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5000a57c0 msgr2=0x7fd5000a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5000a57c0 0x7fd5000a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 monclient: found mon.noname-a 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50492b640 1 -- 172.21.15.71:0/3616152212 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5000a6380 con 0x7fd5000a6950 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd4f7fff640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5000a57c0 0x7fd5000a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.995+0000 7fd50512c640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd50492b640 1 -- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 msgr2=0x7fd5000a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd50492b640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd5000a6d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0098a0 tx=0x7fd4fc02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b4af5d13f9a8e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 1 -- 172.21.15.71:0/3616152212 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd4fc037070 con 0x7fd5000a6950 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: dump: 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.011 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.012 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 5 monclient: authenticate success, global_id 75213 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 1 -- 172.21.15.71:0/3616152212 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc02adf0 con 0x7fd5000a6950 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 1 -- 172.21.15.71:0/3616152212 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd4fc030c20 con 0x7fd5000a6950 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 4 set_mon_vals no callback set 2024-08-19T11:19:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd4f77fe640 10 monclient: dump: 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 10 monclient: shutdown 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 -- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 msgr2=0x7fd5000a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd5000a6d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0098a0 tx=0x7fd4fc02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 -- 172.21.15.71:0/3616152212 shutdown_connections 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5000a57c0 0x7fd5000a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 --2- 172.21.15.71:0/3616152212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd5000a6d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 -- 172.21.15.71:0/3616152212 >> 172.21.15.71:0/3616152212 conn(0x7fd5000abf50 msgr2=0x7fd5000ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 -- 172.21.15.71:0/3616152212 shutdown_connections 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.998+0000 7fd506b8f640 1 -- 172.21.15.71:0/3616152212 wait complete. 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.999+0000 7fd506b8f640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.999+0000 7fd506b8f640 10 monclient: monmap: 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.016 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.999+0000 7fd506b8f640 1 Processor -- start 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.999+0000 7fd506b8f640 1 -- start start 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:11.999+0000 7fd506b8f640 10 monclient: init 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient: _add_conns ranks=[3,0,8,5,7,2,1,4,6] 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5000a57c0 0x7fd5001ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): picked mon.noname-g con 0x7fd5000a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd500138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): picked mon.noname-a con 0x7fd5000a6950 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): picked mon.noname-e con 0x7fd500139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5000a84c0 con 0x7fd5000a6950 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd5000a3650 con 0x7fd5000a57c0 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd5000a8700 con 0x7fd500139710 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd506b8f640 10 monclient(hunting): authenticate will time out at 1210.042435s 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd500138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd500138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54402/0 (socket says 172.21.15.71:54402) 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): get_auth_request con 0x7fd500139710 auth_method 0 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 1 -- 172.21.15.71:0/450326300 learned_addr learned my addr 172.21.15.71:0/450326300 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): get_auth_request con 0x7fd5000a6950 auth_method 0 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50492b640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5000a57c0 0x7fd5001ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50492b640 10 monclient(hunting): get_auth_request con 0x7fd5000a57c0 auth_method 0 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50492b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50492b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50492b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient(hunting): handle_auth_done global_id 94499 payload 824 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5000a57c0 msgr2=0x7fd5001ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5000a57c0 0x7fd5001ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 msgr2=0x7fd500138860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd500138860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 monclient: found mon.noname-e 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd50512c640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd500126240 con 0x7fd500139710 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.000+0000 7fd4f7fff640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5000a6950 0x7fd500138860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd50512c640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 msgr2=0x7fd500138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd50512c640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500138da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009db0 tx=0x7fd4f800c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd4f8018030 con 0x7fd500139710 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: dump: 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.022 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 5 monclient: authenticate success, global_id 94499 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80148f0 con 0x7fd500139710 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd4f80133e0 con 0x7fd500139710 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 10 monclient: _renew_subs 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5000a1d20 con 0x7fd500139710 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f6ffd640 4 set_mon_vals no callback set 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd4f57fa640 10 monclient: dump: 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 10 monclient: _renew_subs 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fd500124b50 con 0x7fd500139710 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.003+0000 7fd506b8f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd506b8f640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 0x7fd50002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd500076c60 con 0x7fd500122d90 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 0x7fd50002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient: get_auth_request con 0x7fd500122d90 auth_method 0 2024-08-19T11:19:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd4f801b070 con 0x7fd500139710 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 10 monclient(hunting): handle_auth_done global_id 75116 payload 824 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd50492b640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5000a22f0 con 0x7fd500122d90 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd4f57fa640 1 --2- 172.21.15.71:0/450326300 >> v2:172.21.15.135:6800/726754104 conn(0x7fd4ec03ea80 0x7fd4ec040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7fd4f8019070 con 0x7fd500139710 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd4f7fff640 1 --2- 172.21.15.71:0/450326300 >> v2:172.21.15.135:6800/726754104 conn(0x7fd4ec03ea80 0x7fd4ec040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.004+0000 7fd4f7fff640 10 monclient: get_auth_request con 0x7fd4ec03ea80 auth_method 0 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd50492b640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 msgr2=0x7fd50002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd50492b640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 0x7fd50002d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd4fc041070 con 0x7fd500122d90 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 10 monclient: dump: 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd4fc003820 con 0x7fd500122d90 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 msgr2=0x7fd50002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 0x7fd50002d1c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.006+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 msgr2=0x7fd50002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.007+0000 7fd4f57fa640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500122d90 0x7fd50002d1c0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.007+0000 7fd4f7fff640 1 --2- 172.21.15.71:0/450326300 >> v2:172.21.15.135:6800/726754104 conn(0x7fd4ec03ea80 0x7fd4ec040f40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd500125a50 tx=0x7fd4f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd506b8f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:12.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd506b8f640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 0x7fd50002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd506b8f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd5000a6d30 con 0x7fd500123170 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 0x7fd50002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient: get_auth_request con 0x7fd500123170 auth_method 0 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 10 monclient(hunting): handle_auth_done global_id 75125 payload 824 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.013+0000 7fd50492b640 1 -- 172.21.15.71:0/450326300 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd500123ee0 con 0x7fd500123170 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd50492b640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 msgr2=0x7fd50002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd50492b640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 0x7fd50002d700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0097c0 tx=0x7fd4fc009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd4fc037040 con 0x7fd500123170 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 10 monclient: dump: 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.032 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7fd4fc047ba0 con 0x7fd500123170 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 msgr2=0x7fd50002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 0x7fd50002d700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0097c0 tx=0x7fd4fc009240 comp rx=0 tx=0).stop 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 msgr2=0x7fd50002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.015+0000 7fd4f57fa640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd500123170 0x7fd50002d700 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0097c0 tx=0x7fd4fc009240 comp rx=0 tx=0).stop 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 201047, 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:12.034 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.035 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.036 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:12.037 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:12.038 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.039 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.042 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.043 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.046 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:12.049 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.050 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.051 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:12.052 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.054 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:12.055 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.057 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:12.057 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 >> v2:172.21.15.135:6800/726754104 conn(0x7fd4ec03ea80 msgr2=0x7fd4ec040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 --2- 172.21.15.71:0/450326300 >> v2:172.21.15.135:6800/726754104 conn(0x7fd4ec03ea80 0x7fd4ec040f40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd500125a50 tx=0x7fd4f0009190 comp rx=0 tx=0).stop 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 10 monclient: shutdown 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 msgr2=0x7fd500138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 --2- 172.21.15.71:0/450326300 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd500139710 0x7fd500138da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009db0 tx=0x7fd4f800c490 comp rx=0 tx=0).stop 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd50512c640 1 -- 172.21.15.71:0/450326300 reap_dead start 2024-08-19T11:19:12.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd50512c640 1 -- 172.21.15.71:0/450326300 reap_dead start 2024-08-19T11:19:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 shutdown_connections 2024-08-19T11:19:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 >> 172.21.15.71:0/450326300 conn(0x7fd5000abf50 msgr2=0x7fd5000aa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 shutdown_connections 2024-08-19T11:19:12.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.016+0000 7fd506b8f640 1 -- 172.21.15.71:0/450326300 wait complete. 2024-08-19T11:19:12.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:12.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:19:12.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:19:12.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.155+0000 7fa809b81640 10 monclient: get_monmap_and_config 2024-08-19T11:19:12.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.155+0000 7fa809b81640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.155+0000 7fa809b81640 10 monclient: monmap: 2024-08-19T11:19:12.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:12.157179+0000 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:12.157179+0000 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.159 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.159 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:12.159 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:12.159 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 Processor -- start 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 -- start start 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient: init 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient: _add_conns ranks=[0,8,9,4,7,2,10,3,5,6,1] 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa8040a57d0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 0x7fa8040a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): picked mon.noname-e con 0x7fa8040a62c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 0x7fa80413edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): picked mon.noname-a con 0x7fa80413c9d0 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8040728a0 con 0x7fa8040a57d0 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa8040a41b0 con 0x7fa80413c9d0 2024-08-19T11:19:12.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa804072620 con 0x7fa8040a62c0 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa809b81640 10 monclient(hunting): authenticate will time out at 1210.198816s 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 0x7fa80413edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 0x7fa80413edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54412/0 (socket says 172.21.15.71:54412) 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 1 -- 172.21.15.71:0/1133741633 learned_addr learned my addr 172.21.15.71:0/1133741633 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 10 monclient(hunting): get_auth_request con 0x7fa80413c9d0 auth_method 0 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa802ffd640 1 --2- 172.21.15.71:0/1133741633 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 0x7fa8040a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa803fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa8037fe640 1 --1- 172.21.15.71:0/1133741633 >> v1:172.21.15.71:6789/0 conn(0x7fa8040a57d0 0x7fa8040a5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52392/0 (socket says 172.21.15.71:52392) 2024-08-19T11:19:12.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa802ffd640 10 monclient(hunting): get_auth_request con 0x7fa8040a62c0 auth_method 0 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa802ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa802ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.156+0000 7fa802ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa803fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa803fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa803fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 10 monclient(hunting): handle_auth_done global_id 94508 payload 274 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 1 -- 172.21.15.71:0/1133741633 >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 msgr2=0x7fa80413edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 1 --2- 172.21.15.71:0/1133741633 >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 0x7fa80413edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 1 -- 172.21.15.71:0/1133741633 >> v1:172.21.15.71:6789/0 conn(0x7fa8040a57d0 legacy=0x7fa8040a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 1 monclient: found mon.noname-e 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa802ffd640 1 -- 172.21.15.71:0/1133741633 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa804073940 con 0x7fa8040a62c0 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.157+0000 7fa803fff640 1 --2- 172.21.15.71:0/1133741633 >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 0x7fa80413edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.159+0000 7fa802ffd640 1 -- 172.21.15.71:0/1133741633 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 msgr2=0x7fa8040a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa802ffd640 1 --2- 172.21.15.71:0/1133741633 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 0x7fa8040a1780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097a0 tx=0x7fa7f802a050 comp rx=0 tx=0).ready entity=mon.8 client_cookie=72b2d583aaf5c068 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 1 -- 172.21.15.71:0/1133741633 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7f8037070 con 0x7fa8040a62c0 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: dump: 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.167 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 1 -- 172.21.15.71:0/1133741633 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f802adb0 con 0x7fa8040a62c0 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 5 monclient: authenticate success, global_id 94508 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 1 -- 172.21.15.71:0/1133741633 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7f8030c20 con 0x7fa8040a62c0 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 4 set_mon_vals no callback set 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa8027fc640 10 monclient: dump: 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 10 monclient: shutdown 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 -- 172.21.15.71:0/1133741633 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 msgr2=0x7fa8040a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 --2- 172.21.15.71:0/1133741633 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 0x7fa8040a1780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80097a0 tx=0x7fa7f802a050 comp rx=0 tx=0).stop 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 -- 172.21.15.71:0/1133741633 shutdown_connections 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 --2- 172.21.15.71:0/1133741633 >> v2:172.21.15.71:3300/0 conn(0x7fa80413c9d0 0x7fa80413edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 --2- 172.21.15.71:0/1133741633 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa8040a62c0 0x7fa8040a1780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 -- 172.21.15.71:0/1133741633 >> 172.21.15.71:0/1133741633 conn(0x7fa8040aa3f0 msgr2=0x7fa8040a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 -- 172.21.15.71:0/1133741633 shutdown_connections 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.160+0000 7fa809b81640 1 -- 172.21.15.71:0/1133741633 wait complete. 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.161+0000 7fa809b81640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.161+0000 7fa809b81640 10 monclient: monmap: 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.161+0000 7fa809b81640 1 Processor -- start 2024-08-19T11:19:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.161+0000 7fa809b81640 1 -- start start 2024-08-19T11:19:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.161+0000 7fa809b81640 10 monclient: init 2024-08-19T11:19:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient: _add_conns ranks=[7,1,6,4,5,8,3,2,0] 2024-08-19T11:19:12.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8040a57d0 0x7fa8041cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): picked mon.noname-i con 0x7fa8040a57d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8040a62c0 0x7fa8041cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): picked mon.noname-f con 0x7fa8040a62c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 0x7fa8041ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): picked mon.noname-d con 0x7fa80413c9d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa80413f480 con 0x7fa8040a62c0 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa80413f300 con 0x7fa80413c9d0 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa80413f600 con 0x7fa8040a57d0 2024-08-19T11:19:12.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa809b81640 10 monclient(hunting): authenticate will time out at 1210.204349s 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 0x7fa8041ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 0x7fa8041ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58300/0 (socket says 172.21.15.71:58300) 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 learned_addr learned my addr 172.21.15.71:0/3387074728 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): get_auth_request con 0x7fa80413c9d0 auth_method 0 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa802ffd640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8040a62c0 0x7fa8041cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa8037fe640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8040a57d0 0x7fa8041cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa802ffd640 10 monclient(hunting): get_auth_request con 0x7fa8040a62c0 auth_method 0 2024-08-19T11:19:12.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa802ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa802ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa802ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient(hunting): handle_auth_done global_id 104127 payload 824 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8040a57d0 msgr2=0x7fa8041cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8040a57d0 0x7fa8041cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8040a62c0 msgr2=0x7fa8041cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8040a62c0 0x7fa8041cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 monclient: found mon.noname-d 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa804124f10 con 0x7fa80413c9d0 2024-08-19T11:19:12.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa8037fe640 10 monclient: get_auth_request con 0x7fa8040a57d0 auth_method 0 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.162+0000 7fa8037fe640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa8040a57d0 0x7fa8041cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 msgr2=0x7fa8041ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa803fff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 0x7fa8041ccf90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00efc0 tx=0x7fa7fc00c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7fc003e00 con 0x7fa80413c9d0 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: dump: 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.181 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc00cd30 con 0x7fa80413c9d0 2024-08-19T11:19:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 5 monclient: authenticate success, global_id 104127 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 10 monclient: _renew_subs 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80413ee20 con 0x7fa80413c9d0 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7fc0044a0 con 0x7fa80413c9d0 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa7ebfff640 10 monclient: dump: 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.183 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 10 monclient: _renew_subs 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa804122bb0 con 0x7fa80413c9d0 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.165+0000 7fa801ffb640 4 set_mon_vals no callback set 2024-08-19T11:19:12.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa809b81640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa809b81640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 0x7fa804121970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa804076c60 con 0x7fa804124790 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa7fc012050 con 0x7fa80413c9d0 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 0x7fa804121970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient: get_auth_request con 0x7fa804124790 auth_method 0 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa7ebfff640 1 --2- 172.21.15.71:0/3387074728 >> v2:172.21.15.135:6800/726754104 conn(0x7fa7f003ea80 0x7fa7f0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 10 monclient(hunting): handle_auth_done global_id 84775 payload 824 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7fa7fc052070 con 0x7fa80413c9d0 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa8037fe640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa804124b70 con 0x7fa804124790 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa802ffd640 1 --2- 172.21.15.71:0/3387074728 >> v2:172.21.15.135:6800/726754104 conn(0x7fa7f003ea80 0x7fa7f0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.166+0000 7fa802ffd640 10 monclient: get_auth_request con 0x7fa7f003ea80 auth_method 0 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.168+0000 7fa8037fe640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 msgr2=0x7fa804121970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.168+0000 7fa8037fe640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 0x7fa804121970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d4c0 tx=0x7fa7f400d980 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.168+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7f40074e0 con 0x7fa804124790 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.168+0000 7fa7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.168+0000 7fa7ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.168+0000 7fa7ebfff640 10 monclient: dump: 2024-08-19T11:19:12.186 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.187 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.188 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa7f4017070 con 0x7fa804124790 2024-08-19T11:19:12.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 msgr2=0x7fa804121970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 0x7fa804121970 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d4c0 tx=0x7fa7f400d980 comp rx=0 tx=0).stop 2024-08-19T11:19:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 msgr2=0x7fa804121970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa7ebfff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa804124790 0x7fa804121970 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d4c0 tx=0x7fa7f400d980 comp rx=0 tx=0).stop 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.169+0000 7fa802ffd640 1 --2- 172.21.15.71:0/3387074728 >> v2:172.21.15.135:6800/726754104 conn(0x7fa7f003ea80 0x7fa7f0040f40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa8040aae80 tx=0x7fa7f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.174+0000 7fa809b81640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa809b81640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 0x7fa80402d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa809b81640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa8040a1780 con 0x7fa80402d1c0 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 0x7fa80402d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient: get_auth_request con 0x7fa80402d1c0 auth_method 0 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 10 monclient(hunting): handle_auth_done global_id 84784 payload 824 2024-08-19T11:19:12.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.175+0000 7fa8037fe640 1 -- 172.21.15.71:0/3387074728 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa80409e100 con 0x7fa80402d1c0 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa8037fe640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 msgr2=0x7fa80402d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa8037fe640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 0x7fa80402d5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d4c0 tx=0x7fa7f4004930 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa7f401cbe0 con 0x7fa80402d1c0 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 10 monclient: dump: 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.192 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fa7f4012410 con 0x7fa80402d1c0 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:12.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 msgr2=0x7fa80402d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 0x7fa80402d5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d4c0 tx=0x7fa7f4004930 comp rx=0 tx=0).stop 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 msgr2=0x7fa80402d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.177+0000 7fa7ebfff640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa80402d1c0 0x7fa80402d5a0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d4c0 tx=0x7fa7f4004930 comp rx=0 tx=0).stop 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:12.194 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 134324, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:12.195 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:12.198 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.199 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:12.205 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:12.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.211 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:12.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:12.215 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:12.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:12.217 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:12.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 >> v2:172.21.15.135:6800/726754104 conn(0x7fa7f003ea80 msgr2=0x7fa7f0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 --2- 172.21.15.71:0/3387074728 >> v2:172.21.15.135:6800/726754104 conn(0x7fa7f003ea80 0x7fa7f0040f40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa8040aae80 tx=0x7fa7f802e000 comp rx=0 tx=0).stop 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 10 monclient: shutdown 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 msgr2=0x7fa8041ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 --2- 172.21.15.71:0/3387074728 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa80413c9d0 0x7fa8041ccf90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00efc0 tx=0x7fa7fc00c490 comp rx=0 tx=0).stop 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 reap_dead start 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa803fff640 1 -- 172.21.15.71:0/3387074728 reap_dead start 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 shutdown_connections 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 >> 172.21.15.71:0/3387074728 conn(0x7fa8040aa3f0 msgr2=0x7fa8040a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 shutdown_connections 2024-08-19T11:19:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.178+0000 7fa809b81640 1 -- 172.21.15.71:0/3387074728 wait complete. 2024-08-19T11:19:12.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:12.220 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:19:12.220 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.317+0000 7f2478cba640 10 monclient: get_monmap_and_config 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.317+0000 7f2478cba640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.317+0000 7f2478cba640 10 monclient: monmap: 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:12.318766+0000 2024-08-19T11:19:12.319 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:12.318766+0000 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:12.320 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.317+0000 7f2478cba640 1 Processor -- start 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.317+0000 7f2478cba640 1 -- start start 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.317+0000 7f2478cba640 10 monclient: init 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient: _add_conns ranks=[0,1,6,8,10,3,2,9,5,4,7] 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f24740a47c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f24740a52b0 addr v1:172.21.15.135:6789/0 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient(hunting): picked mon.noname-d con 0x7f247413d150 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740743e0 con 0x7f24740a47c0 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740a0650 con 0x7f24740a52b0 2024-08-19T11:19:12.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f24740a2650 con 0x7f247413d150 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2478cba640 10 monclient(hunting): authenticate will time out at 1210.360289s 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f247259c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f24740a47c0 0x7f24740a4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52400/0 (socket says 172.21.15.71:52400) 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f247259c640 1 -- 172.21.15.71:0/417884863 learned_addr learned my addr 172.21.15.71:0/417884863 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): get_auth_request con 0x7f247413d150 auth_method 0 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient(hunting): handle_auth_done global_id 104136 payload 274 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 1 -- 172.21.15.71:0/417884863 >> v1:172.21.15.135:6789/0 conn(0x7f24740a52b0 legacy=0x7f247413ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 1 -- 172.21.15.71:0/417884863 >> v1:172.21.15.71:6789/0 conn(0x7f24740a47c0 legacy=0x7f24740a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 1 monclient: found mon.noname-d 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.318+0000 7f2472d9d640 1 -- 172.21.15.71:0/417884863 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24740a62f0 con 0x7f247413d150 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2472d9d640 1 -- 172.21.15.71:0/417884863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 msgr2=0x7f247413f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2472d9d640 1 --2- 172.21.15.71:0/417884863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413f540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f246c009d90 tx=0x7f246c02a430 comp rx=0 tx=0).ready entity=mon.6 client_cookie=effd1a27e38fcfde server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 1 -- 172.21.15.71:0/417884863 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f246c007ca0 con 0x7f247413d150 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: dump: 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.333 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2478cba640 5 monclient: authenticate success, global_id 104136 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 1 -- 172.21.15.71:0/417884863 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c031400 con 0x7f247413d150 2024-08-19T11:19:12.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2478cba640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 1 -- 172.21.15.71:0/417884863 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f246c007e60 con 0x7f247413d150 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2478cba640 4 set_mon_vals no callback set 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.321+0000 7f2471d9b640 10 monclient: dump: 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.335 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 10 monclient: shutdown 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 -- 172.21.15.71:0/417884863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 msgr2=0x7f247413f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 --2- 172.21.15.71:0/417884863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413f540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f246c009d90 tx=0x7f246c02a430 comp rx=0 tx=0).stop 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 -- 172.21.15.71:0/417884863 shutdown_connections 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 --2- 172.21.15.71:0/417884863 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413f540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 -- 172.21.15.71:0/417884863 >> 172.21.15.71:0/417884863 conn(0x7f24740a9470 msgr2=0x7f24740a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 -- 172.21.15.71:0/417884863 shutdown_connections 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.322+0000 7f2478cba640 1 -- 172.21.15.71:0/417884863 wait complete. 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.323+0000 7f2478cba640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.323+0000 7f2478cba640 10 monclient: monmap: 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.337 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.323+0000 7f2478cba640 1 Processor -- start 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.323+0000 7f2478cba640 1 -- start start 2024-08-19T11:19:12.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.323+0000 7f2478cba640 10 monclient: init 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient: _add_conns ranks=[0,3,6,4,8,1,5,7,2] 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 0x7f24741ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): picked mon.noname-a con 0x7f24740a47c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24740a52b0 0x7f247413c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): picked mon.noname-g con 0x7f24740a52b0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): picked mon.noname-d con 0x7f247413d150 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24740a3030 con 0x7f24740a47c0 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f24740a0990 con 0x7f24740a52b0 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f24740a31b0 con 0x7f247413d150 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2478cba640 10 monclient(hunting): authenticate will time out at 1210.366110s 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 0x7f24741ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 0x7f24741ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54426/0 (socket says 172.21.15.71:54426) 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58320/0 (socket says 172.21.15.71:58320) 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 -- 172.21.15.71:0/4197543487 learned_addr learned my addr 172.21.15.71:0/4197543487 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): get_auth_request con 0x7f24740a47c0 auth_method 0 2024-08-19T11:19:12.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): get_auth_request con 0x7f247413d150 auth_method 0 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2469d9b640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24740a52b0 0x7f247413c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2469d9b640 10 monclient(hunting): get_auth_request con 0x7f24740a52b0 auth_method 0 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2469d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2469d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2469d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient(hunting): handle_auth_done global_id 75240 payload 824 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 msgr2=0x7f247413c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24740a52b0 msgr2=0x7f247413c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24740a52b0 0x7f247413c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 monclient: found mon.noname-a 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:12.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f247259c640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247412a290 con 0x7f24740a47c0 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.324+0000 7f2472d9d640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f247413d150 0x7f247413c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f247259c640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 msgr2=0x7f24741ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f247259c640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 0x7f24741ce8c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f246400c460 tx=0x7f246400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2464005cf0 con 0x7f24740a47c0 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: dump: 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.343 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f2478cba640 5 monclient: authenticate success, global_id 75240 2024-08-19T11:19:12.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640074e0 con 0x7f24740a47c0 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2464007690 con 0x7f24740a47c0 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f246b7fe640 10 monclient: dump: 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.345 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f247159a640 4 set_mon_vals no callback set 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f2478cba640 10 monclient: _renew_subs 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f2478cba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.326+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247409e3d0 con 0x7f24740a47c0 2024-08-19T11:19:12.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 10 monclient: _renew_subs 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2474129330 con 0x7f24740a47c0 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2464007070 con 0x7f24740a47c0 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 0x7f247402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.327+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f247406a590 con 0x7f24741cbb00 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 0x7f247402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f246b7fe640 1 --2- 172.21.15.71:0/4197543487 >> v2:172.21.15.135:6800/726754104 conn(0x7f245403eab0 0x7f2454040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient: get_auth_request con 0x7f24741cbb00 auth_method 0 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7f24640518e0 con 0x7f24740a47c0 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 10 monclient(hunting): handle_auth_done global_id 104154 payload 824 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2469d9b640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f247413cc10 con 0x7f24741cbb00 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2472d9d640 1 --2- 172.21.15.71:0/4197543487 >> v2:172.21.15.135:6800/726754104 conn(0x7f245403eab0 0x7f2454040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.328+0000 7f2472d9d640 10 monclient: get_auth_request con 0x7f245403eab0 auth_method 0 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f2469d9b640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 msgr2=0x7f247402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f2469d9b640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 0x7f247402d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f247409c9f0 tx=0x7f245c00e960 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f245c006c40 con 0x7f24741cbb00 2024-08-19T11:19:12.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 10 monclient: dump: 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.349 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f2472d9d640 1 --2- 172.21.15.71:0/4197543487 >> v2:172.21.15.135:6800/726754104 conn(0x7f245403eab0 0x7f2454040f70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f246c034000 tx=0x7f246c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f245c007450 con 0x7f24741cbb00 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 msgr2=0x7f247402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 0x7f247402d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f247409c9f0 tx=0x7f245c00e960 comp rx=0 tx=0).stop 2024-08-19T11:19:12.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 msgr2=0x7f247402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.330+0000 7f246b7fe640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbb00 0x7f247402d1c0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f247409c9f0 tx=0x7f245c00e960 comp rx=0 tx=0).stop 2024-08-19T11:19:12.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.336+0000 7f2478cba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:12.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.336+0000 7f2478cba640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 0x7f247402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2478cba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2474076c60 con 0x7f24741cbee0 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 0x7f247402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient: get_auth_request con 0x7f24741cbee0 auth_method 0 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 10 monclient(hunting): handle_auth_done global_id 104163 payload 824 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.337+0000 7f2469d9b640 1 -- 172.21.15.71:0/4197543487 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f247409f1c0 con 0x7f24741cbee0 2024-08-19T11:19:12.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f2469d9b640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 msgr2=0x7f247402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f2469d9b640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 0x7f247402d700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f247409c9f0 tx=0x7f245c003760 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f245c01ebd0 con 0x7f24741cbee0 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 10 monclient: dump: 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.354 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9266 (secure 0 0 0) 0x7f245c01e760 con 0x7f24741cbee0 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 msgr2=0x7f247402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 0x7f247402d700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f247409c9f0 tx=0x7f245c003760 comp rx=0 tx=0).stop 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 msgr2=0x7f247402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.339+0000 7f246b7fe640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f24741cbee0 0x7f247402d700 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f247409c9f0 tx=0x7f245c003760 comp rx=0 tx=0).stop 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 7687, 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:12.356 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:12.358 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:12.359 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:12.360 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.361 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:12.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.363 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.365 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.368 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.369 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.370 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.372 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.375 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.378 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.379 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:12.379 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 >> v2:172.21.15.135:6800/726754104 conn(0x7f245403eab0 msgr2=0x7f2454040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 --2- 172.21.15.71:0/4197543487 >> v2:172.21.15.135:6800/726754104 conn(0x7f245403eab0 0x7f2454040f70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f246c034000 tx=0x7f246c02f000 comp rx=0 tx=0).stop 2024-08-19T11:19:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 10 monclient: shutdown 2024-08-19T11:19:12.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 msgr2=0x7f24741ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 0x7f24741ce8c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f246400c460 tx=0x7f246400c920 comp rx=0 tx=0).stop 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2472d9d640 1 -- 172.21.15.71:0/4197543487 reap_dead start 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 shutdown_connections 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 --2- 172.21.15.71:0/4197543487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24740a47c0 0x7f24741ce8c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 >> 172.21.15.71:0/4197543487 conn(0x7f24740a9470 msgr2=0x7f2474072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 shutdown_connections 2024-08-19T11:19:12.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.340+0000 7f2478cba640 1 -- 172.21.15.71:0/4197543487 wait complete. 2024-08-19T11:19:12.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:12.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:19:12.382 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:19:12.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.477+0000 7fced2141640 10 monclient: get_monmap_and_config 2024-08-19T11:19:12.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.477+0000 7fced2141640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.477+0000 7fced2141640 10 monclient: monmap: 2024-08-19T11:19:12.479 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:12.479237+0000 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:12.479237+0000 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.480 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:12.481 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:12.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.478+0000 7fced2141640 1 Processor -- start 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.478+0000 7fced2141640 1 -- start start 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.478+0000 7fced2141640 10 monclient: init 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.478+0000 7fced2141640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient: _add_conns ranks=[10,2,7,6,1,5,0,4,8,3,9] 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcecc0a3d80 0x7fcecc0a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): picked mon.noname-f con 0x7fcecc0a3d80 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:12.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 0x7fcecc0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): picked mon.noname-b con 0x7fcecc0a2550 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcecc09b150 0x7fcecc09b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): picked mon.noname-i con 0x7fcecc09b150 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fcecc0a4be0 con 0x7fcecc0a3d80 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc0a1b70 con 0x7fcecc0a2550 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fcecc0a1890 con 0x7fcecc09b150 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fced2141640 10 monclient(hunting): authenticate will time out at 1210.521108s 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 0x7fcecc0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 0x7fcecc0a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52696/0 (socket says 172.21.15.71:52696) 2024-08-19T11:19:12.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 -- 172.21.15.71:0/1588323449 learned_addr learned my addr 172.21.15.71:0/1588323449 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): get_auth_request con 0x7fcecc0a2550 auth_method 0 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient(hunting): handle_auth_done global_id 75134 payload 274 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcecbfff640 1 --2- 172.21.15.71:0/1588323449 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcecc09b150 0x7fcecc09b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcecb7fe640 1 --2- 172.21.15.71:0/1588323449 >> v2:172.21.15.135:3300/0 conn(0x7fcecc0a3d80 0x7fcecc0a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 -- 172.21.15.71:0/1588323449 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcecc09b150 msgr2=0x7fcecc09b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 --2- 172.21.15.71:0/1588323449 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcecc09b150 0x7fcecc09b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 -- 172.21.15.71:0/1588323449 >> v2:172.21.15.135:3300/0 conn(0x7fcecc0a3d80 msgr2=0x7fcecc0a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 --2- 172.21.15.71:0/1588323449 >> v2:172.21.15.135:3300/0 conn(0x7fcecc0a3d80 0x7fcecc0a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 monclient: found mon.noname-b 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.479+0000 7fcec3fff640 1 -- 172.21.15.71:0/1588323449 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc0692c0 con 0x7fcecc0a2550 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcec3fff640 1 -- 172.21.15.71:0/1588323449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 msgr2=0x7fcecc0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcec3fff640 1 --2- 172.21.15.71:0/1588323449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 0x7fcecc0a46a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009870 tx=0x7fceb402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a32b70a8653a50f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 1 -- 172.21.15.71:0/1588323449 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fceb4037070 con 0x7fcecc0a2550 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: dump: 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.492 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fced2141640 5 monclient: authenticate success, global_id 75134 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fced2141640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 1 -- 172.21.15.71:0/1588323449 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb40307b0 con 0x7fcecc0a2550 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fced2141640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fced2141640 4 set_mon_vals no callback set 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 1 -- 172.21.15.71:0/1588323449 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fceb4030e50 con 0x7fcecc0a2550 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.482+0000 7fcecaffd640 10 monclient: dump: 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.495 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 10 monclient: shutdown 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 -- 172.21.15.71:0/1588323449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 msgr2=0x7fcecc0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 --2- 172.21.15.71:0/1588323449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 0x7fcecc0a46a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009870 tx=0x7fceb402a130 comp rx=0 tx=0).stop 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 -- 172.21.15.71:0/1588323449 shutdown_connections 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 --2- 172.21.15.71:0/1588323449 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fcecc09b150 0x7fcecc09b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 --2- 172.21.15.71:0/1588323449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc0a2550 0x7fcecc0a46a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 --2- 172.21.15.71:0/1588323449 >> v2:172.21.15.135:3300/0 conn(0x7fcecc0a3d80 0x7fcecc0a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 -- 172.21.15.71:0/1588323449 >> 172.21.15.71:0/1588323449 conn(0x7fcecc0a4e70 msgr2=0x7fcecc0a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 -- 172.21.15.71:0/1588323449 shutdown_connections 2024-08-19T11:19:12.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 1 -- 172.21.15.71:0/1588323449 wait complete. 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.483+0000 7fced2141640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient: monmap: 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.497 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 Processor -- start 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 -- start start 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient: init 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient: _add_conns ranks=[2,4,3,8,6,1,0,5,7] 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 0x7fcecc1cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): picked mon.noname-b con 0x7fcecc09b150 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcecc0a2550 0x7fcecc136a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): picked mon.noname-c con 0x7fcecc0a2550 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcecc0a3d80 0x7fcecc136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): picked mon.noname-g con 0x7fcecc0a3d80 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc09bc90 con 0x7fcecc09b150 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc09bb10 con 0x7fcecc0a3d80 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcecc09be10 con 0x7fcecc0a2550 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fced2141640 10 monclient(hunting): authenticate will time out at 1210.526824s 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 0x7fcecc1cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 0x7fcecc1cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52708/0 (socket says 172.21.15.71:52708) 2024-08-19T11:19:12.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 1 -- 172.21.15.71:0/2021941929 learned_addr learned my addr 172.21.15.71:0/2021941929 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 10 monclient(hunting): get_auth_request con 0x7fcecc09b150 auth_method 0 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcecb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcec3fff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcecc0a2550 0x7fcecc136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcec3fff640 10 monclient(hunting): get_auth_request con 0x7fcecc0a2550 auth_method 0 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcec3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcec3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.484+0000 7fcec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcecc0a3d80 0x7fcecc136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): get_auth_request con 0x7fcecc0a3d80 auth_method 0 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 10 monclient(hunting): handle_auth_done global_id 75143 payload 824 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcecc0a2550 msgr2=0x7fcecc136a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcecc0a2550 0x7fcecc136a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcecc0a3d80 msgr2=0x7fcecc136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcecc0a3d80 0x7fcecc136f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 1 monclient: found mon.noname-b 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcecb7fe640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc1303b0 con 0x7fcecc09b150 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.485+0000 7fcec3fff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcecc0a2550 0x7fcecc136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcecb7fe640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 msgr2=0x7fcecc1cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcecb7fe640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 0x7fcecc1cc230 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c7f0 tx=0x7fcebc00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcebc015070 con 0x7fcecc09b150 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: dump: 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.503 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 5 monclient: authenticate success, global_id 75143 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc007ca0 con 0x7fcecc09b150 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcebc007e50 con 0x7fcecc09b150 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fcec8ff9640 10 monclient: dump: 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.505 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 10 monclient: _renew_subs 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fceca7fc640 4 set_mon_vals no callback set 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc1314d0 con 0x7fcecc09b150 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 10 monclient: _renew_subs 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.487+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc1cc770 con 0x7fcecc09b150 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fced2141640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fced2141640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 0x7fcecc12dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcecc0a6470 con 0x7fcecc12d810 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 0x7fcecc12dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient: get_auth_request con 0x7fcecc12d810 auth_method 0 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcebc007830 con 0x7fcecc09b150 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 10 monclient(hunting): handle_auth_done global_id 94517 payload 824 2024-08-19T11:19:12.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec8ff9640 1 --2- 172.21.15.71:0/2021941929 >> v2:172.21.15.135:6800/726754104 conn(0x7fceac03ec20 0x7fceac0410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec3fff640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcecc0a7840 con 0x7fcecc12d810 2024-08-19T11:19:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.488+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7fcebc0518e0 con 0x7fcecc09b150 2024-08-19T11:19:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.489+0000 7fcecbfff640 1 --2- 172.21.15.71:0/2021941929 >> v2:172.21.15.135:6800/726754104 conn(0x7fceac03ec20 0x7fceac0410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.489+0000 7fcecbfff640 10 monclient: get_auth_request con 0x7fceac03ec20 auth_method 0 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec3fff640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 msgr2=0x7fcecc12dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec3fff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 0x7fcecc12dbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcecc06df20 tx=0x7fceb40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fceb4037040 con 0x7fcecc12d810 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 10 monclient: dump: 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.510 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.511 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fceb4030cb0 con 0x7fcecc12d810 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 msgr2=0x7fcecc12dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 0x7fcecc12dbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcecc06df20 tx=0x7fceb40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 msgr2=0x7fcecc12dbf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcec8ff9640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12d810 0x7fcecc12dbf0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcecc06df20 tx=0x7fceb40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.491+0000 7fcecbfff640 1 --2- 172.21.15.71:0/2021941929 >> v2:172.21.15.135:6800/726754104 conn(0x7fceac03ec20 0x7fceac0410e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcecc1319c0 tx=0x7fcec40076f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fced2141640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fced2141640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 0x7fcecc070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fced2141640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcecc076c60 con 0x7fcecc12e130 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 0x7fcecc070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient: get_auth_request con 0x7fcecc12e130 auth_method 0 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 10 monclient(hunting): handle_auth_done global_id 94526 payload 824 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.497+0000 7fcec3fff640 1 -- 172.21.15.71:0/2021941929 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcecc06e5a0 con 0x7fcecc12e130 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec3fff640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 msgr2=0x7fcecc070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec3fff640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 0x7fcecc070d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb4009240 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fceb4047c10 con 0x7fcecc12e130 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:12.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 10 monclient: dump: 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.514 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fceb4047c10 con 0x7fcecc12e130 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 msgr2=0x7fcecc070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 0x7fcecc070d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb4009240 comp rx=0 tx=0).stop 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 msgr2=0x7fcecc070d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcec8ff9640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcecc12e130 0x7fcecc070d90 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097c0 tx=0x7fceb4009240 comp rx=0 tx=0).stop 2024-08-19T11:19:12.515 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 64197, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:12.516 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.517 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:12.519 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.520 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:12.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.523 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:12.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.528 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:12.530 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:12.539 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:12.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 >> v2:172.21.15.135:6800/726754104 conn(0x7fceac03ec20 msgr2=0x7fceac0410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 --2- 172.21.15.71:0/2021941929 >> v2:172.21.15.135:6800/726754104 conn(0x7fceac03ec20 0x7fceac0410e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcecc1319c0 tx=0x7fcec40076f0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 10 monclient: shutdown 2024-08-19T11:19:12.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 msgr2=0x7fcecc1cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 --2- 172.21.15.71:0/2021941929 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcecc09b150 0x7fcecc1cc230 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00c7f0 tx=0x7fcebc00ccb0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcecbfff640 1 -- 172.21.15.71:0/2021941929 reap_dead start 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fcecbfff640 1 -- 172.21.15.71:0/2021941929 reap_dead start 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 shutdown_connections 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 >> 172.21.15.71:0/2021941929 conn(0x7fcecc0a4e70 msgr2=0x7fcecc1bc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 shutdown_connections 2024-08-19T11:19:12.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.500+0000 7fced2141640 1 -- 172.21.15.71:0/2021941929 wait complete. 2024-08-19T11:19:12.541 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:12.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:19:12.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:19:12.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.638+0000 7f953c15c640 10 monclient: get_monmap_and_config 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.638+0000 7f953c15c640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.638+0000 7f953c15c640 10 monclient: monmap: 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:12.639661+0000 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:12.639661+0000 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.640 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:12.641 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.638+0000 7f953c15c640 1 Processor -- start 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.638+0000 7f953c15c640 1 -- start start 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.638+0000 7f953c15c640 10 monclient: init 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient: _add_conns ranks=[8,10,2,7,3,0,5,6,4,9,1] 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 0x7f95340a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): picked mon.noname-e con 0x7f95340a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95340a57c0 0x7f95340a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): picked mon.noname-f con 0x7f95340a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 0x7f9534139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): picked mon.noname-b con 0x7f9534139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f95340a5020 con 0x7f95340a57c0 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f95340a77b0 con 0x7f9534139710 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f95340a7d40 con 0x7f95340a6950 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953c15c640 10 monclient(hunting): authenticate will time out at 1210.681479s 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 0x7f95340a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 0x7f95340a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:40722/0 (socket says 172.21.15.71:40722) 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 0x7f9534139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 1 -- 172.21.15.71:0/2188955905 learned_addr learned my addr 172.21.15.71:0/2188955905 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): get_auth_request con 0x7f95340a6950 auth_method 0 2024-08-19T11:19:12.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): get_auth_request con 0x7f9534139710 auth_method 0 2024-08-19T11:19:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f95396f7640 1 --2- 172.21.15.71:0/2188955905 >> v2:172.21.15.135:3300/0 conn(0x7f95340a57c0 0x7f95340a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f95396f7640 10 monclient(hunting): get_auth_request con 0x7f95340a57c0 auth_method 0 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f95396f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f95396f7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f95396f7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient(hunting): handle_auth_done global_id 75152 payload 274 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 -- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 msgr2=0x7f95340a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 --2- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 0x7f95340a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 -- 172.21.15.71:0/2188955905 >> v2:172.21.15.135:3300/0 conn(0x7f95340a57c0 msgr2=0x7f95340a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 --2- 172.21.15.71:0/2188955905 >> v2:172.21.15.135:3300/0 conn(0x7f95340a57c0 0x7f95340a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 monclient: found mon.noname-b 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f953a6f9640 1 -- 172.21.15.71:0/2188955905 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95340a6380 con 0x7f9534139710 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f95396f7640 1 --2- 172.21.15.71:0/2188955905 >> v2:172.21.15.135:3300/0 conn(0x7f95340a57c0 0x7f95340a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.639+0000 7f9539ef8640 1 --2- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 0x7f95340a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f953a6f9640 1 -- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 msgr2=0x7f9534139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f953a6f9640 1 --2- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 0x7f9534139b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f952c009df0 tx=0x7f952c02a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f745c044ab90b2b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 1 -- 172.21.15.71:0/2188955905 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f952c007bc0 con 0x7f9534139710 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: dump: 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.651 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f953c15c640 5 monclient: authenticate success, global_id 75152 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 1 -- 172.21.15.71:0/2188955905 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952c007d80 con 0x7f9534139710 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f953c15c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f953c15c640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f953c15c640 4 set_mon_vals no callback set 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 1 -- 172.21.15.71:0/2188955905 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f952c031870 con 0x7f9534139710 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.642+0000 7f9538ef6640 10 monclient: dump: 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.653 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 10 monclient: shutdown 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 -- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 msgr2=0x7f9534139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 --2- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 0x7f9534139b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f952c009df0 tx=0x7f952c02a500 comp rx=0 tx=0).stop 2024-08-19T11:19:12.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 -- 172.21.15.71:0/2188955905 shutdown_connections 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 --2- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9534139710 0x7f9534139b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 --2- 172.21.15.71:0/2188955905 >> v2:172.21.15.135:3300/0 conn(0x7f95340a57c0 0x7f95340a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 --2- 172.21.15.71:0/2188955905 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a6950 0x7f95340a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 -- 172.21.15.71:0/2188955905 >> 172.21.15.71:0/2188955905 conn(0x7f95340abf50 msgr2=0x7f95340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 -- 172.21.15.71:0/2188955905 shutdown_connections 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.643+0000 7f953c15c640 1 -- 172.21.15.71:0/2188955905 wait complete. 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient: monmap: 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.655 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.656 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 Processor -- start 2024-08-19T11:19:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 -- start start 2024-08-19T11:19:12.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient: init 2024-08-19T11:19:12.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient: _add_conns ranks=[8,5,0,4,7,2,3,6,1] 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 0x7f95341ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): picked mon.noname-e con 0x7f95340a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f95340a6950 0x7f9534138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): picked mon.noname-h con 0x7f95340a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9534139710 0x7f95341225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): picked mon.noname-a con 0x7f9534139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95340a84c0 con 0x7f9534139710 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f95340a3650 con 0x7f95340a6950 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f95340a8700 con 0x7f95340a57c0 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.644+0000 7f953c15c640 10 monclient(hunting): authenticate will time out at 1210.686937s 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 0x7f95341ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9534139710 0x7f95341225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 0x7f95341ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:40730/0 (socket says 172.21.15.71:40730) 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 -- 172.21.15.71:0/4286876360 learned_addr learned my addr 172.21.15.71:0/4286876360 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): get_auth_request con 0x7f95340a57c0 auth_method 0 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): get_auth_request con 0x7f9534139710 auth_method 0 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient(hunting): handle_auth_done global_id 94544 payload 824 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f95396f7640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f95340a6950 0x7f9534138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f95340a6950 msgr2=0x7f9534138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f95340a6950 0x7f9534138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9534139710 msgr2=0x7f95341225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9534139710 0x7f95341225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 monclient: found mon.noname-e 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f9539ef8640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953413a2a0 con 0x7f95340a57c0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f95396f7640 10 monclient: get_auth_request con 0x7f95340a6950 auth_method 0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f95396f7640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f95340a6950 0x7f9534138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.645+0000 7f953a6f9640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9534139710 0x7f95341225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f9539ef8640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 msgr2=0x7f95341ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f9539ef8640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 0x7f95341ce190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f953000e9d0 tx=0x7f953000ee90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9530017070 con 0x7f95340a57c0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:12.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: dump: 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.668 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953000cc70 con 0x7f95340a57c0 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 5 monclient: authenticate success, global_id 94544 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 10 monclient: _renew_subs 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9534124fb0 con 0x7f95340a57c0 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f953000ce20 con 0x7f95340a57c0 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952a7fc640 10 monclient: dump: 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 10 monclient: _renew_subs 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f952bfff640 4 set_mon_vals no callback set 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.647+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9534126300 con 0x7f95340a57c0 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f953c15c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f953c15c640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 0x7f953402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9534076c60 con 0x7f9534138fb0 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f953001a070 con 0x7f95340a57c0 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f952a7fc640 1 --2- 172.21.15.71:0/4286876360 >> v2:172.21.15.135:6800/726754104 conn(0x7f951803eab0 0x7f9518040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f95396f7640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 0x7f953402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f95396f7640 10 monclient: get_auth_request con 0x7f9534138fb0 auth_method 0 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f95396f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f95396f7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f95396f7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.648+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7f953000f040 con 0x7f95340a57c0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f95396f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f95396f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f95396f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f953a6f9640 1 --2- 172.21.15.71:0/4286876360 >> v2:172.21.15.135:6800/726754104 conn(0x7f951803eab0 0x7f9518040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f953a6f9640 10 monclient: get_auth_request con 0x7f951803eab0 auth_method 0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f95396f7640 10 monclient(hunting): handle_auth_done global_id 84835 payload 824 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.649+0000 7f95396f7640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95340a6d30 con 0x7f9534138fb0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f95396f7640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 msgr2=0x7f953402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f95396f7640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 0x7f953402d1c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9534123be0 tx=0x7f952400f910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f953a6f9640 1 --2- 172.21.15.71:0/4286876360 >> v2:172.21.15.135:6800/726754104 conn(0x7f951803eab0 0x7f9518040f70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f952c034000 tx=0x7f952c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9524018070 con 0x7f9534138fb0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f952a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f952a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.651+0000 7f952a7fc640 10 monclient: dump: 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.674 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9524014980 con 0x7f9534138fb0 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 msgr2=0x7f953402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 0x7f953402d1c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9534123be0 tx=0x7f952400f910 comp rx=0 tx=0).stop 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 msgr2=0x7f953402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.652+0000 7f952a7fc640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534138fb0 0x7f953402d1c0 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9534123be0 tx=0x7f952400f910 comp rx=0 tx=0).stop 2024-08-19T11:19:12.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f953c15c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f953c15c640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 0x7f953402db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f953c15c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f953409e100 con 0x7f953402d700 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 0x7f953402db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient: get_auth_request con 0x7f953402d700 auth_method 0 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 10 monclient(hunting): handle_auth_done global_id 84844 payload 824 2024-08-19T11:19:12.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.658+0000 7f95396f7640 1 -- 172.21.15.71:0/4286876360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f95341ce6d0 con 0x7f953402d700 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f95396f7640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 msgr2=0x7f953402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f95396f7640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 0x7f953402db10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9534123be0 tx=0x7f95240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f952401dd30 con 0x7f953402d700 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 10 monclient: dump: 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.677 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f95240133e0 con 0x7f953402d700 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:12.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 msgr2=0x7f953402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 0x7f953402db10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9534123be0 tx=0x7f95240046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 msgr2=0x7f953402db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.661+0000 7f952a7fc640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f953402d700 0x7f953402db10 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9534123be0 tx=0x7f95240046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:12.679 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 134823, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:19:12.680 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.681 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.690 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.693 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:12.702 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 >> v2:172.21.15.135:6800/726754104 conn(0x7f951803eab0 msgr2=0x7f9518040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 --2- 172.21.15.71:0/4286876360 >> v2:172.21.15.135:6800/726754104 conn(0x7f951803eab0 0x7f9518040f70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f952c034000 tx=0x7f952c02f000 comp rx=0 tx=0).stop 2024-08-19T11:19:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 10 monclient: shutdown 2024-08-19T11:19:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 msgr2=0x7f95341ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 --2- 172.21.15.71:0/4286876360 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f95340a57c0 0x7f95341ce190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f953000e9d0 tx=0x7f953000ee90 comp rx=0 tx=0).stop 2024-08-19T11:19:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953a6f9640 1 -- 172.21.15.71:0/4286876360 reap_dead start 2024-08-19T11:19:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953a6f9640 1 -- 172.21.15.71:0/4286876360 reap_dead start 2024-08-19T11:19:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 shutdown_connections 2024-08-19T11:19:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 >> 172.21.15.71:0/4286876360 conn(0x7f95340abf50 msgr2=0x7f95340aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 shutdown_connections 2024-08-19T11:19:12.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.662+0000 7f953c15c640 1 -- 172.21.15.71:0/4286876360 wait complete. 2024-08-19T11:19:12.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:12.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:19:12.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:19:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.801+0000 7f8c64cee640 10 monclient: get_monmap_and_config 2024-08-19T11:19:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.801+0000 7f8c64cee640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.801+0000 7f8c64cee640 10 monclient: monmap: 2024-08-19T11:19:12.803 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:12.803176+0000 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:12.803176+0000 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.804 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:12.805 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:12.805 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 Processor -- start 2024-08-19T11:19:12.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 -- start start 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient: init 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient: _add_conns ranks=[6,9,10,2,3,4,0,8,7,1,5] 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 0x7f8c600a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): picked mon.noname-d con 0x7f8c600a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8c600a57c0 0x7f8c600a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): picked mon.noname-a con 0x7f8c600a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c60139710 0x7f8c60139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): picked mon.noname-f con 0x7f8c60139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8c600a5020 con 0x7f8c600a57c0 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8c600a77b0 con 0x7f8c60139710 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f8c600a7d40 con 0x7f8c600a6950 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c64cee640 10 monclient(hunting): authenticate will time out at 1210.844786s 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 0x7f8c600a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5dd9b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8c600a57c0 0x7f8c600a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 0x7f8c600a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:58342/0 (socket says 172.21.15.71:58342) 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 1 -- 172.21.15.71:0/2759878058 learned_addr learned my addr 172.21.15.71:0/2759878058 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5dd9b640 10 monclient(hunting): get_auth_request con 0x7f8c600a57c0 auth_method 0 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 10 monclient(hunting): get_auth_request con 0x7f8c600a6950 auth_method 0 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.802+0000 7f8c5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5ed9d640 1 --2- 172.21.15.71:0/2759878058 >> v2:172.21.15.135:3300/0 conn(0x7f8c60139710 0x7f8c60139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_done global_id 75258 payload 274 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 msgr2=0x7f8c600a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 1 --2- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 0x7f8c600a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/2759878058 >> v2:172.21.15.135:3300/0 conn(0x7f8c60139710 msgr2=0x7f8c60139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 1 --2- 172.21.15.71:0/2759878058 >> v2:172.21.15.135:3300/0 conn(0x7f8c60139710 0x7f8c60139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 1 monclient: found mon.noname-a 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/2759878058 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c600a6380 con 0x7f8c600a57c0 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.803+0000 7f8c5e59c640 1 --2- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 0x7f8c600a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.805+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c600a57c0 msgr2=0x7f8c600a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.805+0000 7f8c5dd9b640 1 --2- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c600a57c0 0x7f8c600a7270 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8c6006c930 tx=0x7f8c5402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c1de88a8ed8952 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 1 -- 172.21.15.71:0/2759878058 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c54037070 con 0x7f8c600a57c0 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: dump: 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.813 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 1 -- 172.21.15.71:0/2759878058 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5402ad30 con 0x7f8c600a57c0 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 5 monclient: authenticate success, global_id 75258 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 1 -- 172.21.15.71:0/2759878058 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c54030c20 con 0x7f8c600a57c0 2024-08-19T11:19:12.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 4 set_mon_vals no callback set 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c5d59a640 10 monclient: dump: 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.815 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 10 monclient: shutdown 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 -- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c600a57c0 msgr2=0x7f8c600a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 --2- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c600a57c0 0x7f8c600a7270 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8c6006c930 tx=0x7f8c5402a010 comp rx=0 tx=0).stop 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 -- 172.21.15.71:0/2759878058 shutdown_connections 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 --2- 172.21.15.71:0/2759878058 >> v2:172.21.15.135:3300/0 conn(0x7f8c60139710 0x7f8c60139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 --2- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8c600a57c0 0x7f8c600a7270 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 --2- 172.21.15.71:0/2759878058 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c600a6950 0x7f8c600a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 -- 172.21.15.71:0/2759878058 >> 172.21.15.71:0/2759878058 conn(0x7f8c600abf50 msgr2=0x7f8c600ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 -- 172.21.15.71:0/2759878058 shutdown_connections 2024-08-19T11:19:12.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.806+0000 7f8c64cee640 1 -- 172.21.15.71:0/2759878058 wait complete. 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.807+0000 7f8c64cee640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.807+0000 7f8c64cee640 10 monclient: monmap: 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.807+0000 7f8c64cee640 1 Processor -- start 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 -- start start 2024-08-19T11:19:12.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient: init 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient: _add_conns ranks=[5,2,4,0,1,3,6,7,8] 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c600a57c0 0x7f8c601ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): picked mon.noname-h con 0x7f8c600a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 0x7f8c60138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): picked mon.noname-b con 0x7f8c600a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8c60139710 0x7f8c60138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): picked mon.noname-c con 0x7f8c60139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8c600a84c0 con 0x7f8c600a6950 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f8c600a3650 con 0x7f8c60139710 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8c600a8700 con 0x7f8c600a57c0 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c64cee640 10 monclient(hunting): authenticate will time out at 1210.850472s 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 0x7f8c60138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8c60139710 0x7f8c60138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 0x7f8c60138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52716/0 (socket says 172.21.15.71:52716) 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/3651711486 learned_addr learned my addr 172.21.15.71:0/3651711486 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): get_auth_request con 0x7f8c600a6950 auth_method 0 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): get_auth_request con 0x7f8c60139710 auth_method 0 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5e59c640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c600a57c0 0x7f8c601ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5e59c640 10 monclient(hunting): get_auth_request con 0x7f8c600a57c0 auth_method 0 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient(hunting): handle_auth_done global_id 75161 payload 824 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c600a57c0 msgr2=0x7f8c601ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c600a57c0 0x7f8c601ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8c60139710 msgr2=0x7f8c60138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8c60139710 0x7f8c60138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 monclient: found mon.noname-b 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60126240 con 0x7f8c600a6950 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.808+0000 7f8c5ed9d640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f8c60139710 0x7f8c60138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c5dd9b640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 msgr2=0x7f8c60138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c5dd9b640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 0x7f8c60138860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c5402a600 tx=0x7f8c540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c54037050 con 0x7f8c600a6950 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: dump: 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.828 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c54043070 con 0x7f8c600a6950 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 5 monclient: authenticate success, global_id 75161 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c5403ed30 con 0x7f8c600a6950 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 10 monclient: _renew_subs 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c600a1e20 con 0x7f8c600a6950 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c5cd99640 4 set_mon_vals no callback set 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c4effd640 10 monclient: dump: 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.830 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 10 monclient: _renew_subs 2024-08-19T11:19:12.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.811+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c60124bc0 con 0x7f8c600a6950 2024-08-19T11:19:12.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8c54003ce0 con 0x7f8c600a6950 2024-08-19T11:19:12.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c64cee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c64cee640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 0x7f8c6002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6006a590 con 0x7f8c60122d60 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c4effd640 1 --2- 172.21.15.71:0/3651711486 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4003ea80 0x7f8c40040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7f8c540724b0 con 0x7f8c600a6950 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 0x7f8c6002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient: get_auth_request con 0x7f8c60122d60 auth_method 0 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5ed9d640 1 --2- 172.21.15.71:0/3651711486 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4003ea80 0x7f8c40040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5ed9d640 10 monclient: get_auth_request con 0x7f8c4003ea80 auth_method 0 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_done global_id 45615 payload 824 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.812+0000 7f8c5e59c640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c600a6d30 con 0x7f8c60122d60 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c5ed9d640 1 --2- 172.21.15.71:0/3651711486 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4003ea80 0x7f8c40040f40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800f630 tx=0x7f8c58007650 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c5e59c640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 msgr2=0x7f8c6002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c5e59c640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 0x7f8c6002d1c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c50011590 tx=0x7f8c50011a50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c50015460 con 0x7f8c60122d60 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 10 monclient: dump: 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.835 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8c5000fac0 con 0x7f8c60122d60 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 msgr2=0x7f8c6002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 0x7f8c6002d1c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c50011590 tx=0x7f8c50011a50 comp rx=0 tx=0).stop 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 msgr2=0x7f8c6002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.815+0000 7f8c4effd640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60122d60 0x7f8c6002d1c0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c50011590 tx=0x7f8c50011a50 comp rx=0 tx=0).stop 2024-08-19T11:19:12.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c64cee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:12.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c64cee640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 0x7f8c6002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c64cee640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c60125be0 con 0x7f8c60123140 2024-08-19T11:19:12.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 0x7f8c6002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient: get_auth_request con 0x7f8c60123140 auth_method 0 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 10 monclient(hunting): handle_auth_done global_id 45624 payload 824 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.822+0000 7f8c5e59c640 1 -- 172.21.15.71:0/3651711486 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c6009e100 con 0x7f8c60123140 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c5e59c640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 msgr2=0x7f8c6002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c5e59c640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 0x7f8c6002d700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c50011590 tx=0x7f8c50004730 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c50022570 con 0x7f8c60123140 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 10 monclient: dump: 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.840 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f8c50006460 con 0x7f8c60123140 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 msgr2=0x7f8c6002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 0x7f8c6002d700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c50011590 tx=0x7f8c50004730 comp rx=0 tx=0).stop 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 msgr2=0x7f8c6002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:12.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c4effd640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c60123140 0x7f8c6002d700 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c50011590 tx=0x7f8c50004730 comp rx=0 tx=0).stop 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 321848, 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:12.865 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4003ea80 msgr2=0x7f8c40040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 --2- 172.21.15.71:0/3651711486 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4003ea80 0x7f8c40040f40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800f630 tx=0x7f8c58007650 comp rx=0 tx=0).stop 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 10 monclient: shutdown 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 msgr2=0x7f8c60138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 0x7f8c60138860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c5402a600 tx=0x7f8c540046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c5ed9d640 1 -- 172.21.15.71:0/3651711486 reap_dead start 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 shutdown_connections 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 --2- 172.21.15.71:0/3651711486 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c600a6950 0x7f8c60138860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 >> 172.21.15.71:0/3651711486 conn(0x7f8c600abf50 msgr2=0x7f8c600aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 shutdown_connections 2024-08-19T11:19:12.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.825+0000 7f8c64cee640 1 -- 172.21.15.71:0/3651711486 wait complete. 2024-08-19T11:19:12.868 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:12.868 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:19:12.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:19:12.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.965+0000 7f7aee7d9640 10 monclient: get_monmap_and_config 2024-08-19T11:19:12.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.965+0000 7f7aee7d9640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.965+0000 7f7aee7d9640 10 monclient: monmap: 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:12.966410+0000 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:12.966410+0000 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.967 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.968 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.968 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.968 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.968 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:12.968 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:12.968 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.965+0000 7f7aee7d9640 1 Processor -- start 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.965+0000 7f7aee7d9640 1 -- start start 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.965+0000 7f7aee7d9640 10 monclient: init 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient: _add_conns ranks=[2,0,5,7,1,9,10,3,4,6,8] 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 0x7f7ae80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): picked mon.noname-b con 0x7f7ae80a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7ae80a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a7270 0x7f7ae8139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): picked mon.noname-h con 0x7f7ae80a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae80a6380 con 0x7f7ae80a57c0 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae80a5020 con 0x7f7ae80a6950 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7ae80a7d40 con 0x7f7ae80a7270 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7aee7d9640 10 monclient(hunting): authenticate will time out at 1211.008158s 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 0x7f7ae80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae77fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7ae80a57c0 0x7f7ae8139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52402/0 (socket says 172.21.15.71:52402) 2024-08-19T11:19:12.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 0x7f7ae80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52720/0 (socket says 172.21.15.71:52720) 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae77fe640 1 -- 172.21.15.71:0/1487913177 learned_addr learned my addr 172.21.15.71:0/1487913177 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): get_auth_request con 0x7f7ae80a6950 auth_method 0 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_done global_id 75170 payload 274 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 -- 172.21.15.71:0/1487913177 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a7270 msgr2=0x7f7ae8139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/1487913177 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a7270 0x7f7ae8139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 -- 172.21.15.71:0/1487913177 >> v1:172.21.15.71:6789/0 conn(0x7f7ae80a57c0 legacy=0x7f7ae8139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 monclient: found mon.noname-b 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.966+0000 7f7ae7fff640 1 -- 172.21.15.71:0/1487913177 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae80a3650 con 0x7f7ae80a6950 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae7fff640 1 -- 172.21.15.71:0/1487913177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 msgr2=0x7f7ae80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/1487913177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 0x7f7ae80a6d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009800 tx=0x7f7ad8029fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afef6d8a6047103 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 1 -- 172.21.15.71:0/1487913177 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad8037070 con 0x7f7ae80a6950 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:12.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: dump: 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.976 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 1 -- 172.21.15.71:0/1487913177 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad802ade0 con 0x7f7ae80a6950 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 5 monclient: authenticate success, global_id 75170 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 1 -- 172.21.15.71:0/1487913177 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad8030c20 con 0x7f7ae80a6950 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 4 set_mon_vals no callback set 2024-08-19T11:19:12.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7ae6ffd640 10 monclient: dump: 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.978 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.979 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 10 monclient: shutdown 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 1 -- 172.21.15.71:0/1487913177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 msgr2=0x7f7ae80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/1487913177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 0x7f7ae80a6d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009800 tx=0x7f7ad8029fe0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.969+0000 7f7aee7d9640 1 -- 172.21.15.71:0/1487913177 shutdown_connections 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/1487913177 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a7270 0x7f7ae8139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/1487913177 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a6950 0x7f7ae80a6d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 1 -- 172.21.15.71:0/1487913177 >> 172.21.15.71:0/1487913177 conn(0x7f7ae80abf50 msgr2=0x7f7ae80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 1 -- 172.21.15.71:0/1487913177 shutdown_connections 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 1 -- 172.21.15.71:0/1487913177 wait complete. 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 10 monclient: build_initial_monmap 2024-08-19T11:19:12.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 10 monclient: monmap: 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:12.981 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:12.982 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.970+0000 7f7aee7d9640 1 Processor -- start 2024-08-19T11:19:12.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 -- start start 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient: init 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient: _add_conns ranks=[5,7,2,4,3,0,6,1,8] 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 0x7f7ae81ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): picked mon.noname-h con 0x7f7ae80a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 0x7f7ae81cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): picked mon.noname-i con 0x7f7ae80a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 0x7f7ae81cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): picked mon.noname-b con 0x7f7ae80a7270 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae80a8700 con 0x7f7ae80a7270 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7ae80a84c0 con 0x7f7ae80a57c0 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7ae80a7690 con 0x7f7ae80a6950 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aee7d9640 10 monclient(hunting): authenticate will time out at 1211.013638s 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aecd76640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 0x7f7ae81cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aecd76640 1 -- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 msgr2=0x7f7ae81cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aecd76640 1 -- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 msgr2=0x7f7ae81cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aecd76640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 0x7f7ae81cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7aecd76640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 0x7f7ae81cf3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 0x7f7ae81ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae77fe640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 0x7f7ae81cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 0x7f7ae81ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:48262/0 (socket says 172.21.15.71:48262) 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae77fe640 1 -- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 msgr2=0x7f7ae81cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae77fe640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 msgr2=0x7f7ae81cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae77fe640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 0x7f7ae81cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.971+0000 7f7ae7fff640 1 -- 172.21.15.71:0/2134834675 learned_addr learned my addr 172.21.15.71:0/2134834675 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): get_auth_request con 0x7f7ae80a57c0 auth_method 0 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae77fe640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 0x7f7ae81cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient(hunting): handle_auth_done global_id 45770 payload 824 2024-08-19T11:19:12.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 msgr2=0x7f7ae81cee80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7ae80a6950 0x7f7ae81cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 msgr2=0x7f7ae81cf3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7ae80a7270 0x7f7ae81cf3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 1 monclient: found mon.noname-h 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.972+0000 7f7ae7fff640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8129d10 con 0x7f7ae80a57c0 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae7fff640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 msgr2=0x7f7ae81ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae7fff640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 0x7f7ae81ce940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80096f0 tx=0x7f7ad80046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad8037050 con 0x7f7ae80a57c0 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: dump: 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.994 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.995 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.995 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.995 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8043070 con 0x7f7ae80a57c0 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7ad803ed30 con 0x7f7ae80a57c0 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae4ff9640 10 monclient: dump: 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.996 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:12.997 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7aee7d9640 5 monclient: authenticate success, global_id 45770 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7aee7d9640 10 monclient: _renew_subs 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7aee7d9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae812afa0 con 0x7f7ae80a57c0 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.974+0000 7f7ae67fc640 4 set_mon_vals no callback set 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 10 monclient: _renew_subs 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae80a2680 con 0x7f7ae80a57c0 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 0x7f7ae8127200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.975+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7ae80a92c0 con 0x7f7ae8126e20 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 0x7f7ae8127200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient: get_auth_request con 0x7f7ae8126e20 auth_method 0 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7ad803e450 con 0x7f7ae80a57c0 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae4ff9640 1 --2- 172.21.15.71:0/2134834675 >> v2:172.21.15.135:6800/726754104 conn(0x7f7ad403ea80 0x7f7ad4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (secure 0 0 0) 0x7f7ad8072720 con 0x7f7ae80a57c0 2024-08-19T11:19:12.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_done global_id 45779 payload 824 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7ae77fe640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ae80a6d30 con 0x7f7ae8126e20 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7aecd76640 1 --2- 172.21.15.71:0/2134834675 >> v2:172.21.15.135:6800/726754104 conn(0x7f7ad403ea80 0x7f7ad4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.976+0000 7f7aecd76640 10 monclient: get_auth_request con 0x7f7ad403ea80 auth_method 0 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.978+0000 7f7ae77fe640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 msgr2=0x7f7ae8127200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.978+0000 7f7ae77fe640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 0x7f7ae8127200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8128e90 tx=0x7f7adc00d810 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.978+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7adc018070 con 0x7f7ae8126e20 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.978+0000 7f7ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.978+0000 7f7ae4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.978+0000 7f7ae4ff9640 10 monclient: dump: 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7aecd76640 1 --2- 172.21.15.71:0/2134834675 >> v2:172.21.15.135:6800/726754104 conn(0x7f7ad403ea80 0x7f7ad4040f40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7ae80a97d0 tx=0x7f7ae0008260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7adc005cf0 con 0x7f7ae8126e20 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 msgr2=0x7f7ae8127200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 0x7f7ae8127200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8128e90 tx=0x7f7adc00d810 comp rx=0 tx=0).stop 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 msgr2=0x7f7ae8127200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.979+0000 7f7ae4ff9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8126e20 0x7f7ae8127200 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8128e90 tx=0x7f7adc00d810 comp rx=0 tx=0).stop 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7aee7d9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 0x7f7ae81225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7aee7d9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7ae8076c60 con 0x7f7ae8127740 2024-08-19T11:19:13.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 0x7f7ae81225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient: get_auth_request con 0x7f7ae8127740 auth_method 0 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 10 monclient(hunting): handle_auth_done global_id 45788 payload 824 2024-08-19T11:19:13.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.986+0000 7f7ae77fe640 1 -- 172.21.15.71:0/2134834675 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ae8128820 con 0x7f7ae8127740 2024-08-19T11:19:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae77fe640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 msgr2=0x7f7ae81225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae77fe640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 0x7f7ae81225a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8128e90 tx=0x7f7adc004940 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7adc018040 con 0x7f7ae8127740 2024-08-19T11:19:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:13.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 10 monclient: dump: 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.005 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f7adc013470 con 0x7f7ae8127740 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 msgr2=0x7f7ae81225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.988+0000 7f7ae4ff9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 0x7f7ae81225a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8128e90 tx=0x7f7adc004940 comp rx=0 tx=0).stop 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7ae4ff9640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 msgr2=0x7f7ae81225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7ae4ff9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae8127740 0x7f7ae81225a0 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8128e90 tx=0x7f7adc004940 comp rx=0 tx=0).stop 2024-08-19T11:19:13.006 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 322012, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:13.007 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:13.008 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:13.009 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:13.010 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:13.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:13.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.015 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:13.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.020 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:13.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:13.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:13.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:13.028 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:13.029 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 >> v2:172.21.15.135:6800/726754104 conn(0x7f7ad403ea80 msgr2=0x7f7ad4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/2134834675 >> v2:172.21.15.135:6800/726754104 conn(0x7f7ad403ea80 0x7f7ad4040f40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7ae80a97d0 tx=0x7f7ae0008260 comp rx=0 tx=0).stop 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 10 monclient: shutdown 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 msgr2=0x7f7ae81ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 --2- 172.21.15.71:0/2134834675 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7ae80a57c0 0x7f7ae81ce940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80096f0 tx=0x7f7ad80046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aecd76640 1 -- 172.21.15.71:0/2134834675 reap_dead start 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aecd76640 1 -- 172.21.15.71:0/2134834675 reap_dead start 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 shutdown_connections 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 >> 172.21.15.71:0/2134834675 conn(0x7f7ae80abf50 msgr2=0x7f7ae80ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 shutdown_connections 2024-08-19T11:19:13.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:12.989+0000 7f7aee7d9640 1 -- 172.21.15.71:0/2134834675 wait complete. 2024-08-19T11:19:13.032 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:13.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:19:13.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:19:13.075 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28147]: starting. 2024-08-19T11:19:13.076 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28147]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28145 2024-08-19T11:19:13.076 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28147]: shutting down. 2024-08-19T11:19:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.136+0000 7f23ea96b640 10 monclient: get_monmap_and_config 2024-08-19T11:19:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.136+0000 7f23ea96b640 10 monclient: build_initial_monmap 2024-08-19T11:19:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.136+0000 7f23ea96b640 10 monclient: monmap: 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:13.137483+0000 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:13.137483+0000 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:13.139 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.136+0000 7f23ea96b640 1 Processor -- start 2024-08-19T11:19:13.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.136+0000 7f23ea96b640 1 -- start start 2024-08-19T11:19:13.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.136+0000 7f23ea96b640 10 monclient: init 2024-08-19T11:19:13.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:13.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient: _add_conns ranks=[4,7,5,6,0,10,2,1,9,8,3] 2024-08-19T11:19:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 0x7f23e40a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): picked mon.noname-c con 0x7f23e40a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e40a57c0 0x7f23e40a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): picked mon.noname-i con 0x7f23e40a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e4139710 0x7f23e4139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): picked mon.noname-h con 0x7f23e4139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f23e40a5020 con 0x7f23e40a6950 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f23e40a77b0 con 0x7f23e4139710 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f23e40a7d40 con 0x7f23e40a57c0 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23ea96b640 10 monclient(hunting): authenticate will time out at 1211.179158s 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 0x7f23e40a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 0x7f23e40a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:39106/0 (socket says 172.21.15.71:39106) 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 -- 172.21.15.71:0/1404562802 learned_addr learned my addr 172.21.15.71:0/1404562802 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): get_auth_request con 0x7f23e40a6950 auth_method 0 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e8f08640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e4139710 0x7f23e4139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e37fe640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e40a57c0 0x7f23e40a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient(hunting): handle_auth_done global_id 84829 payload 274 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 -- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e40a57c0 msgr2=0x7f23e40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e40a57c0 0x7f23e40a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 -- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e4139710 msgr2=0x7f23e4139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:13.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e4139710 0x7f23e4139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:13.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 monclient: found mon.noname-c 2024-08-19T11:19:13.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:13.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:13.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.137+0000 7f23e3fff640 1 -- 172.21.15.71:0/1404562802 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40a6380 con 0x7f23e40a6950 2024-08-19T11:19:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e3fff640 1 -- 172.21.15.71:0/1404562802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 msgr2=0x7f23e40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e3fff640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 0x7f23e40a6d30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098d0 tx=0x7f23d402a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=ade3acd7c544fc59 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 1 -- 172.21.15.71:0/1404562802 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23d4037070 con 0x7f23e40a6950 2024-08-19T11:19:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: dump: 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.153 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 1 -- 172.21.15.71:0/1404562802 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40307b0 con 0x7f23e40a6950 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23ea96b640 5 monclient: authenticate success, global_id 84829 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23ea96b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 1 -- 172.21.15.71:0/1404562802 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23d4030e50 con 0x7f23e40a6950 2024-08-19T11:19:13.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23e2ffd640 10 monclient: dump: 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23ea96b640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.140+0000 7f23ea96b640 4 set_mon_vals no callback set 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 10 monclient: shutdown 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 -- 172.21.15.71:0/1404562802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 msgr2=0x7f23e40a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 0x7f23e40a6d30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098d0 tx=0x7f23d402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 -- 172.21.15.71:0/1404562802 shutdown_connections 2024-08-19T11:19:13.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e4139710 0x7f23e4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e40a57c0 0x7f23e40a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 --2- 172.21.15.71:0/1404562802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f23e40a6950 0x7f23e40a6d30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 -- 172.21.15.71:0/1404562802 >> 172.21.15.71:0/1404562802 conn(0x7f23e40abf50 msgr2=0x7f23e40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 -- 172.21.15.71:0/1404562802 shutdown_connections 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 1 -- 172.21.15.71:0/1404562802 wait complete. 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 10 monclient: build_initial_monmap 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.141+0000 7f23ea96b640 10 monclient: monmap: 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:13.157 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 Processor -- start 2024-08-19T11:19:13.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 -- start start 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient: init 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient: _add_conns ranks=[8,5,6,3,2,1,4,7,0] 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 0x7f23e41ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): picked mon.noname-e con 0x7f23e40a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e40a6950 0x7f23e4138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): picked mon.noname-h con 0x7f23e40a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f23e4139710 0x7f23e4138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): picked mon.noname-d con 0x7f23e4139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f23e40a84c0 con 0x7f23e40a6950 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f23e40a3650 con 0x7f23e4139710 2024-08-19T11:19:13.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f23e40a8700 con 0x7f23e40a57c0 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23ea96b640 10 monclient(hunting): authenticate will time out at 1211.184696s 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 0x7f23e41ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 0x7f23e41ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:40736/0 (socket says 172.21.15.71:40736) 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 1 -- 172.21.15.71:0/2130981187 learned_addr learned my addr 172.21.15.71:0/2130981187 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): get_auth_request con 0x7f23e40a57c0 auth_method 0 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f23e4139710 0x7f23e4138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): get_auth_request con 0x7f23e4139710 auth_method 0 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e8f08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e37fe640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e40a6950 0x7f23e4138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.142+0000 7f23e37fe640 10 monclient(hunting): get_auth_request con 0x7f23e40a6950 auth_method 0 2024-08-19T11:19:13.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 10 monclient(hunting): handle_auth_done global_id 94562 payload 824 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f23e4139710 msgr2=0x7f23e4138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f23e4139710 0x7f23e4138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e40a6950 msgr2=0x7f23e4138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f23e40a6950 0x7f23e4138790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 1 monclient: found mon.noname-e 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e3fff640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e4123df0 con 0x7f23e40a57c0 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.143+0000 7f23e8f08640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f23e4139710 0x7f23e4138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e3fff640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 msgr2=0x7f23e41ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e3fff640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 0x7f23e41ce0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f23d402a0e0 tx=0x7f23d40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23d4037040 con 0x7f23e40a57c0 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: dump: 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.163 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:13.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d4003610 con 0x7f23e40a57c0 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 5 monclient: authenticate success, global_id 94562 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 10 monclient: _renew_subs 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e41ce630 con 0x7f23e40a57c0 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23d4003c30 con 0x7f23e40a57c0 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e0ff9640 10 monclient: dump: 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.165 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 10 monclient: _renew_subs 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e4122780 con 0x7f23e40a57c0 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.145+0000 7f23e27fc640 4 set_mon_vals no callback set 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23ea96b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23ea96b640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 0x7f23e402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f23e406a590 con 0x7f23e4123230 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f23d40037c0 con 0x7f23e40a57c0 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 0x7f23e402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient: get_auth_request con 0x7f23e4123230 auth_method 0 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e0ff9640 1 --2- 172.21.15.71:0/2130981187 >> v2:172.21.15.135:6800/726754104 conn(0x7f23d003ea80 0x7f23d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (secure 0 0 0) 0x7f23d4071e10 con 0x7f23e40a57c0 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 10 monclient(hunting): handle_auth_done global_id 84760 payload 824 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e37fe640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23e40a1f20 con 0x7f23e4123230 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.146+0000 7f23e8f08640 1 --2- 172.21.15.71:0/2130981187 >> v2:172.21.15.135:6800/726754104 conn(0x7f23d003ea80 0x7f23d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.147+0000 7f23e8f08640 10 monclient: get_auth_request con 0x7f23d003ea80 auth_method 0 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e37fe640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 msgr2=0x7f23e402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e37fe640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 0x7f23e402d1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23e40a1970 tx=0x7f23d800ec00 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23d8019020 con 0x7f23e4123230 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 10 monclient: dump: 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.169 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e8f08640 1 --2- 172.21.15.71:0/2130981187 >> v2:172.21.15.135:6800/726754104 conn(0x7f23d003ea80 0x7f23d0040f40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f23e4074f90 tx=0x7f23dc007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f23d800ab70 con 0x7f23e4123230 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 msgr2=0x7f23e402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 0x7f23e402d1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23e40a1970 tx=0x7f23d800ec00 comp rx=0 tx=0).stop 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 msgr2=0x7f23e402d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:13.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.149+0000 7f23e0ff9640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123230 0x7f23e402d1c0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23e40a1970 tx=0x7f23d800ec00 comp rx=0 tx=0).stop 2024-08-19T11:19:13.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23ea96b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:13.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23ea96b640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 0x7f23e402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23ea96b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f23e4076c60 con 0x7f23e4123610 2024-08-19T11:19:13.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 0x7f23e402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient: get_auth_request con 0x7f23e4123610 auth_method 0 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 10 monclient(hunting): handle_auth_done global_id 84769 payload 824 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.156+0000 7f23e37fe640 1 -- 172.21.15.71:0/2130981187 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23e413a400 con 0x7f23e4123610 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e37fe640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 msgr2=0x7f23e402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e37fe640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 0x7f23e402d700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23e40a1970 tx=0x7f23d80046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f23d8019040 con 0x7f23e4123610 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 10 monclient: dump: 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.173 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.174 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f23d8026070 con 0x7f23e4123610 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 msgr2=0x7f23e402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 0x7f23e402d700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23e40a1970 tx=0x7f23d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 msgr2=0x7f23e402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.159+0000 7f23e0ff9640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f23e4123610 0x7f23e402d700 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f23e40a1970 tx=0x7f23d80046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.175 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 135321, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:13.176 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:13.177 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:13.178 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:13.179 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:13.180 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:13.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:13.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:13.185 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.186 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:13.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:13.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:13.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:13.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.197 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:13.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:13.199 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:13.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 >> v2:172.21.15.135:6800/726754104 conn(0x7f23d003ea80 msgr2=0x7f23d0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 --2- 172.21.15.71:0/2130981187 >> v2:172.21.15.135:6800/726754104 conn(0x7f23d003ea80 0x7f23d0040f40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f23e4074f90 tx=0x7f23dc007670 comp rx=0 tx=0).stop 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 10 monclient: shutdown 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 msgr2=0x7f23e41ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 0x7f23e41ce0f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f23d402a0e0 tx=0x7f23d40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23e8f08640 1 -- 172.21.15.71:0/2130981187 reap_dead start 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 shutdown_connections 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 --2- 172.21.15.71:0/2130981187 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f23e40a57c0 0x7f23e41ce0f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 >> 172.21.15.71:0/2130981187 conn(0x7f23e40abf50 msgr2=0x7f23e40aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 shutdown_connections 2024-08-19T11:19:13.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.160+0000 7f23ea96b640 1 -- 172.21.15.71:0/2130981187 wait complete. 2024-08-19T11:19:13.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:13.202 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:19:13.202 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:19:13.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient: get_monmap_and_config 2024-08-19T11:19:13.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient: build_initial_monmap 2024-08-19T11:19:13.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient: monmap: 2024-08-19T11:19:13.299 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:13.299237+0000 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:13.299237+0000 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:13.301 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 Processor -- start 2024-08-19T11:19:13.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 -- start start 2024-08-19T11:19:13.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient: init 2024-08-19T11:19:13.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient: _add_conns ranks=[1,6,2,3,4,8,10,7,5,9,0] 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbc3c0a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbc3c0a6e10 0x7fbc3c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): picked mon.noname-d con 0x7fbc3c0a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 0x7fbc3c140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): picked mon.noname-b con 0x7fbc3c13eb10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc3c0a4f90 con 0x7fbc3c0a6a30 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3c0a3650 con 0x7fbc3c13eb10 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbc3c0a6380 con 0x7fbc3c0a6e10 2024-08-19T11:19:13.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.298+0000 7fbc42714640 10 monclient(hunting): authenticate will time out at 1211.340918s 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 0x7fbc3c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbc3c0a6e10 0x7fbc3c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 0x7fbc3c140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:52738/0 (socket says 172.21.15.71:52738) 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 -- 172.21.15.71:0/3578517213 learned_addr learned my addr 172.21.15.71:0/3578517213 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): get_auth_request con 0x7fbc3c13eb10 auth_method 0 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): get_auth_request con 0x7fbc3c0a6e10 auth_method 0 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_done global_id 75197 payload 274 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 -- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbc3c0a6e10 msgr2=0x7fbc3c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 --2- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbc3c0a6e10 0x7fbc3c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 -- 172.21.15.71:0/3578517213 >> v1:172.21.15.135:6789/0 conn(0x7fbc3c0a6a30 legacy=0x7fbc3c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient: _finish_hunting 0 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 monclient: found mon.noname-b 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:13.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc40cb1640 1 -- 172.21.15.71:0/3578517213 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c0a49d0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.299+0000 7fbc3b7fe640 1 --2- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbc3c0a6e10 0x7fbc3c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc40cb1640 1 -- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 msgr2=0x7fbc3c140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc40cb1640 1 --2- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 0x7fbc3c140f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009eb0 tx=0x7fbc3402a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b757606cb5a7350 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 1 -- 172.21.15.71:0/3578517213 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc34036070 con 0x7fbc3c13eb10 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: dump: 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.311 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: _finish_auth 0 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:13.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 5 monclient: authenticate success, global_id 75197 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 1 -- 172.21.15.71:0/3578517213 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc34007a70 con 0x7fbc3c13eb10 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 4 set_mon_vals no callback set 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 1 -- 172.21.15.71:0/3578517213 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc34007ca0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc3affd640 10 monclient: dump: 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.313 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.314 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 10 monclient: shutdown 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 -- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 msgr2=0x7fbc3c140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 --2- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 0x7fbc3c140f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009eb0 tx=0x7fbc3402a560 comp rx=0 tx=0).stop 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 -- 172.21.15.71:0/3578517213 shutdown_connections 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 --2- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc3c13eb10 0x7fbc3c140f00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 --2- 172.21.15.71:0/3578517213 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbc3c0a6e10 0x7fbc3c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 -- 172.21.15.71:0/3578517213 >> 172.21.15.71:0/3578517213 conn(0x7fbc3c0ac030 msgr2=0x7fbc3c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 -- 172.21.15.71:0/3578517213 shutdown_connections 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.302+0000 7fbc42714640 1 -- 172.21.15.71:0/3578517213 wait complete. 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.303+0000 7fbc42714640 10 monclient: build_initial_monmap 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.303+0000 7fbc42714640 10 monclient: monmap: 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:13.315 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:13.316 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.303+0000 7fbc42714640 1 Processor -- start 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.303+0000 7fbc42714640 1 -- start start 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.303+0000 7fbc42714640 10 monclient: init 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient: _add_conns ranks=[3,0,8,5,7,2,6,4,1] 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc3c0a6a30 0x7fbc3c123bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): picked mon.noname-g con 0x7fbc3c0a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc3c0a6e10 0x7fbc3c125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): picked mon.noname-a con 0x7fbc3c0a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 0x7fbc3c13cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): picked mon.noname-e con 0x7fbc3c13eb10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:13.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c0a7730 con 0x7fbc3c0a6e10 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3c141440 con 0x7fbc3c0a6a30 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbc3c0ac550 con 0x7fbc3c13eb10 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc42714640 10 monclient(hunting): authenticate will time out at 1211.346325s 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 0x7fbc3c13cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc3c0a6e10 0x7fbc3c125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 0x7fbc3c13cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:40738/0 (socket says 172.21.15.71:40738) 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 -- 172.21.15.71:0/329175152 learned_addr learned my addr 172.21.15.71:0/329175152 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): get_auth_request con 0x7fbc3c13eb10 auth_method 0 2024-08-19T11:19:13.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc3c0a6e10 0x7fbc3c125cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54454/0 (socket says 172.21.15.71:54454) 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): get_auth_request con 0x7fbc3c0a6e10 auth_method 0 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc3c0a6a30 0x7fbc3c123bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): get_auth_request con 0x7fbc3c0a6a30 auth_method 0 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:13.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient(hunting): handle_auth_done global_id 94571 payload 824 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 -- 172.21.15.71:0/329175152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc3c0a6a30 msgr2=0x7fbc3c123bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc3c0a6a30 0x7fbc3c123bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 -- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc3c0a6e10 msgr2=0x7fbc3c125cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc3c0a6e10 0x7fbc3c125cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient: _finish_hunting 0 2024-08-19T11:19:13.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 monclient: found mon.noname-e 2024-08-19T11:19:13.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:13.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.304+0000 7fbc40cb1640 1 -- 172.21.15.71:0/329175152 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c1271d0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.306+0000 7fbc40cb1640 1 -- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 msgr2=0x7fbc3c13cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.306+0000 7fbc40cb1640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 0x7fbc3c13cb20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbc34007fd0 tx=0x7fbc34004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc34040020 con 0x7fbc3c13eb10 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: dump: 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.323 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.324 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 5 monclient: authenticate success, global_id 94571 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc34003ba0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc34036040 con 0x7fbc3c13eb10 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 10 monclient: _renew_subs 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c1274b0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc3a7fc640 4 set_mon_vals no callback set 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:13.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc38ff9640 10 monclient: dump: 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:13.326 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 10 monclient: _renew_subs 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.307+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c125150 con 0x7fbc3c13eb10 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbc34043020 con 0x7fbc3c13eb10 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc42714640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc42714640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc42714640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3c0a71f0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc38ff9640 1 --2- 172.21.15.71:0/329175152 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc2803ea80 0x7fbc28040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (secure 0 0 0) 0x7fbc340722b0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc3bfff640 1 --2- 172.21.15.71:0/329175152 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc2803ea80 0x7fbc28040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.308+0000 7fbc3bfff640 10 monclient: get_auth_request con 0x7fbc2803ea80 auth_method 0 2024-08-19T11:19:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.311+0000 7fbc3bfff640 1 --2- 172.21.15.71:0/329175152 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc2803ea80 0x7fbc28040f40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c004f60 tx=0x7fbc2c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.313+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fbc3404a030 con 0x7fbc3c13eb10 2024-08-19T11:19:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.313+0000 7fbc38ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:13.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.313+0000 7fbc38ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:13.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.554+0000 7fbc42714640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:19:13.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.554+0000 7fbc42714640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:19:13.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.554+0000 7fbc42714640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:13.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.554+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fbc3c13db00 con 0x7fbc3c13eb10 2024-08-19T11:19:13.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.556+0000 7fbc38ff9640 1 -- 172.21.15.71:0/329175152 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fbc340711a0 con 0x7fbc3c13eb10 2024-08-19T11:19:13.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.556+0000 7fbc38ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:19:13.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.556+0000 7fbc38ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:13.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.561 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=1909080237,config=2586702516,health=1840432616,kv=3646823213,logm=2201592901}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=11,kv=12,logm=61} crc {auth=2420857248,config=2586702516,health=2729899310,kv=3646823213,logm=3076955890}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=1,health=11,kv=11,logm=59} crc {auth=1912238560,config=1747058506,health=2729899310,kv=1566686170,logm=2953634422}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=17,config=2,health=11,kv=12,logm=58} crc {auth=1522972997,config=2586702516,health=2231261156,kv=2519250839,logm=1486346289}) 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.562 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=1912238560,config=2586702516,health=1840432617,kv=2756804416,logm=1065371744}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=1245210463,config=2586702516,health=11175456,kv=203017765,logm=871269639}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3429786834,config=2586702516,health=3169317743,kv=341690109,logm=3432895247}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=1533921655,config=2586702516,health=1840432616,kv=3646823213,logm=2086393278}) 2024-08-19T11:19:13.563 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.557+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=18,config=2,health=11,kv=12,logm=57} crc {auth=3528693449,config=575665002,health=2610016654,kv=203017765,logm=893257776}) 2024-08-19T11:19:13.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc2803ea80 msgr2=0x7fbc28040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 --2- 172.21.15.71:0/329175152 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc2803ea80 0x7fbc28040f40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c004f60 tx=0x7fbc2c007e30 comp rx=0 tx=0).stop 2024-08-19T11:19:13.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 10 monclient: shutdown 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 msgr2=0x7fbc3c13cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 0x7fbc3c13cb20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbc34007fd0 tx=0x7fbc34004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 shutdown_connections 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 --2- 172.21.15.71:0/329175152 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc2803ea80 0x7fbc28040f40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbc3c13eb10 0x7fbc3c13cb20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc3c0a6e10 0x7fbc3c125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 --2- 172.21.15.71:0/329175152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc3c0a6a30 0x7fbc3c123bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.559+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 >> 172.21.15.71:0/329175152 conn(0x7fbc3c0ac030 msgr2=0x7fbc3c13fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.560+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 shutdown_connections 2024-08-19T11:19:13.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:13.560+0000 7fbc42714640 1 -- 172.21.15.71:0/329175152 wait complete. 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2254544295}) 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1490825348}) 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.582 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1277374703}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4281224079}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=251462749}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4131233636}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1741386172}) 2024-08-19T11:19:13.583 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3094625136}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.560+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=610891565}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2868437856}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3551223530}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3065523052}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.584 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=813621853}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=914157740}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2941537882}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268039990}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2698068617}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.562+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4055589870}) 2024-08-19T11:19:13.585 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.563+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.563+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.563+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2502607927}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.563+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.563+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.563+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2042668061}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1000665658}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2898308674}) 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.586 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2449978952}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2794890068}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1050930346}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203019291}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.564+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1935462655}) 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.587 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=292814065}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1532191366}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2201437880}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3741959647}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.588 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1025968454}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3093025340}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3259754924}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=557599777}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.565+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=16350292}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.566+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.566+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.566+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1628151749}) 2024-08-19T11:19:13.589 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.566+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.566+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.566+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=95221987}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3435921316}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3541772912}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=116019934}) 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.590 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2372785963}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2617382198}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=475622557}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.567+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2178707031}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=906227387}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295367589}) 2024-08-19T11:19:13.591 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165689972}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3187360949}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3573777965}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3227362751}) 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.592 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3041463910}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2123147869}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.568+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1708047039}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2776826813}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2877194241}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3553441304}) 2024-08-19T11:19:13.593 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3551990283}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4087590741}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.569+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1231623524}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1595627062}) 2024-08-19T11:19:13.594 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030255696}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.570+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2916141118}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1093887335}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1497567468}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2166140900}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.595 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2541516679}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1965797659}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1026311192}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4114765576}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2262816271}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.571+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3658665209}) 2024-08-19T11:19:13.596 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2084743284}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1275714519}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3091227971}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3707479234}) 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.597 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3654294053}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1817451894}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1711349639}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=440211867}) 2024-08-19T11:19:13.598 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.572+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2092741374}) 2024-08-19T11:19:13.599 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:19:13.610 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2310825637}) 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2865855953}) 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1130891636}) 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.611 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4079265879}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3389368647}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1391310066}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=969484459}) 2024-08-19T11:19:13.612 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=31417002}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.574+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1505530429}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2452309975}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2669799095}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4642258}) 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.613 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2757166528}) 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2625193325}) 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=974919473}) 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978431358}) 2024-08-19T11:19:13.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1134266613}) 2024-08-19T11:19:13.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.575+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=547183593}) 2024-08-19T11:19:13.617 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.617 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.617 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4259132251}) 2024-08-19T11:19:13.617 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.617 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4058487132}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=379091065}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3304484783}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4169876799}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.618 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3622847555}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2670776096}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=946647057}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.576+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3169772352}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3281351458}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3005278053}) 2024-08-19T11:19:13.619 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758190281}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1787643246}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3305088308}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.577+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3350585372}) 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.620 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4056190194}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=273140931}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.578+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2739469957}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3395929165}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=413354375}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=198403179}) 2024-08-19T11:19:13.621 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=321881933}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2808293780}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2424177379}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=212536134}) 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.622 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794230112}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.579+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3408421416}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2467095435}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1121990618}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447270710}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.623 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3243575065}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2313280630}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=316322561}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3130829014}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=57712054}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.580+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2345707563}) 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.581+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.624 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3810232521}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=609766478}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2532632613}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1017521337}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.625 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4087617045}) 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=390762779}) 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697024950}) 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=631781446}) 2024-08-19T11:19:13.626 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:13.582+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1403521472}) 2024-08-19T11:19:14.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4176579134}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1559991664}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2752687073}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=833582537}) 2024-08-19T11:19:14.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=230298342}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1388587751}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889641401}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=695992391}) 2024-08-19T11:19:14.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.068+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3634179294}) 2024-08-19T11:19:14.088 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=203685021}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3011409914}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630400565}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.089 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=965044139}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1622658669}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=163507165}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=719298862}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3967678272}) 2024-08-19T11:19:14.090 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.085+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1073410932}) 2024-08-19T11:19:14.097 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.094+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.097 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.094+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.097 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.094+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3763924321}) 2024-08-19T11:19:14.097 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.094+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.094+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1665112941}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2165109474}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=509365023}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=592744904}) 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2925768255}) 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=213133195}) 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3389608450}) 2024-08-19T11:19:14.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3870360488}) 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2592031669}) 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=575622734}) 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.292 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2974212595}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=26697304}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1665518336}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4268113976}) 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.293 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325339464}) 2024-08-19T11:19:14.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2450509562}) 2024-08-19T11:19:14.294 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.289+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3322741146}) 2024-08-19T11:19:14.600 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:19:14.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:19:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.699+0000 7f9a16032640 10 monclient: get_monmap_and_config 2024-08-19T11:19:14.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.699+0000 7f9a16032640 10 monclient: build_initial_monmap 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.699+0000 7f9a16032640 10 monclient: monmap: 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:14.700470+0000 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:14.700470+0000 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:14.701 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:14.702 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:14.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:14.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.700+0000 7f9a16032640 1 Processor -- start 2024-08-19T11:19:14.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.700+0000 7f9a16032640 1 -- start start 2024-08-19T11:19:14.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.700+0000 7f9a16032640 10 monclient: init 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient: _add_conns ranks=[9,8,6,7,0,4,10,3,2,5,1] 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a100a6a30 0x7f9a100a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): picked mon.noname-a con 0x7f9a100a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a100a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): picked mon.noname-e con 0x7f9a100a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9a10139860 0x7f9a10139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): picked mon.noname-d con 0x7f9a10139860 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f9a100a4f90 con 0x7f9a100a6a30 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:14.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9a100a6380 con 0x7f9a10139860 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9a100a49d0 con 0x7f9a100a6e10 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a16032640 10 monclient(hunting): authenticate will time out at 1212.742142s 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a100a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a100a6a30 0x7f9a100a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a100a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:40740/0 (socket says 172.21.15.71:40740) 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9a10139860 0x7f9a10139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): get_auth_request con 0x7f9a100a6a30 auth_method 0 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 1 -- 172.21.15.71:0/4047407210 learned_addr learned my addr 172.21.15.71:0/4047407210 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:14.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): get_auth_request con 0x7f9a100a6e10 auth_method 0 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): get_auth_request con 0x7f9a10139860 auth_method 0 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:14.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_done global_id 75276 payload 274 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 -- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 msgr2=0x7f9a100a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a100a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 -- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9a10139860 msgr2=0x7f9a10139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9a10139860 0x7f9a10139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 monclient: found mon.noname-a 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:14.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0f7fe640 1 -- 172.21.15.71:0/4047407210 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a100a46f0 con 0x7f9a100a6a30 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0ffff640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9a10139860 0x7f9a10139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.701+0000 7f9a0effd640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a100a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0f7fe640 1 -- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a100a6a30 msgr2=0x7f9a100a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0f7fe640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a100a6a30 0x7f9a100a57f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a000097d0 tx=0x7f9a0002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc52f3d782ff5b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 1 -- 172.21.15.71:0/4047407210 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a00037070 con 0x7f9a100a6a30 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: dump: 2024-08-19T11:19:14.714 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:14.715 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 1 -- 172.21.15.71:0/4047407210 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0002ad20 con 0x7f9a100a6a30 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a16032640 5 monclient: authenticate success, global_id 75276 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a16032640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:14.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 1 -- 172.21.15.71:0/4047407210 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a00030c20 con 0x7f9a100a6a30 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a16032640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a16032640 4 set_mon_vals no callback set 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.704+0000 7f9a0e7fc640 10 monclient: dump: 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:14.717 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:14.718 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 10 monclient: shutdown 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 -- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a100a6a30 msgr2=0x7f9a100a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a100a6a30 0x7f9a100a57f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a000097d0 tx=0x7f9a0002a000 comp rx=0 tx=0).stop 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 -- 172.21.15.71:0/4047407210 shutdown_connections 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9a10139860 0x7f9a10139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a100a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 --2- 172.21.15.71:0/4047407210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a100a6a30 0x7f9a100a57f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 -- 172.21.15.71:0/4047407210 >> 172.21.15.71:0/4047407210 conn(0x7f9a100ac030 msgr2=0x7f9a100ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 -- 172.21.15.71:0/4047407210 shutdown_connections 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 1 -- 172.21.15.71:0/4047407210 wait complete. 2024-08-19T11:19:14.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 10 monclient: build_initial_monmap 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.705+0000 7f9a16032640 10 monclient: monmap: 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:14.720 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 Processor -- start 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 -- start start 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient: init 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient: _add_conns ranks=[4,8,5,6,0,2,7,1,3] 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9a100a6a30 0x7f9a101ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): picked mon.noname-c con 0x7f9a100a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a101cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): picked mon.noname-e con 0x7f9a100a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9a10139860 0x7f9a10125080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): picked mon.noname-h con 0x7f9a10139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9a100a7730 con 0x7f9a100a6a30 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9a1013a200 con 0x7f9a10139860 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9a100a3f60 con 0x7f9a100a6e10 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a16032640 10 monclient(hunting): authenticate will time out at 1212.747827s 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9a100a6a30 0x7f9a101ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0effd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a101cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9a100a6a30 0x7f9a101ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:39114/0 (socket says 172.21.15.71:39114) 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 1 -- 172.21.15.71:0/2629432215 learned_addr learned my addr 172.21.15.71:0/2629432215 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 10 monclient(hunting): get_auth_request con 0x7f9a100a6a30 auth_method 0 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0effd640 10 monclient(hunting): get_auth_request con 0x7f9a100a6e10 auth_method 0 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.706+0000 7f9a0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:14.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 10 monclient(hunting): handle_auth_done global_id 94589 payload 824 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0ffff640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9a10139860 0x7f9a10125080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 1 -- 172.21.15.71:0/2629432215 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9a10139860 msgr2=0x7f9a10125080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9a10139860 0x7f9a10125080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 1 -- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9a100a6a30 msgr2=0x7f9a101ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9a100a6a30 0x7f9a101ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 10 monclient: _finish_hunting 0 2024-08-19T11:19:14.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 1 monclient: found mon.noname-e 2024-08-19T11:19:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0effd640 1 -- 172.21.15.71:0/2629432215 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a101383b0 con 0x7f9a100a6e10 2024-08-19T11:19:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0ffff640 10 monclient: get_auth_request con 0x7f9a10139860 auth_method 0 2024-08-19T11:19:14.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.707+0000 7f9a0ffff640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9a10139860 0x7f9a10125080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:19:14.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a0effd640 1 -- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 msgr2=0x7f9a101cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:14.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a0effd640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a101cf0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400e900 tx=0x7f9a0400edc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:14.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a040044a0 con 0x7f9a100a6e10 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: dump: 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:14.728 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: _finish_auth 0 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0400cc10 con 0x7f9a100a6e10 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 5 monclient: authenticate success, global_id 94589 2024-08-19T11:19:14.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 10 monclient: _renew_subs 2024-08-19T11:19:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a10128550 con 0x7f9a100a6e10 2024-08-19T11:19:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9a0400cdc0 con 0x7f9a100a6e10 2024-08-19T11:19:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:14.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f99f7fff640 10 monclient: dump: 2024-08-19T11:19:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:14.731 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:14.732 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:14.732 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:14.732 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:14.732 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:14.732 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:14.733 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:14.733 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 10 monclient: _renew_subs 2024-08-19T11:19:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a0dffb640 4 set_mon_vals no callback set 2024-08-19T11:19:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.709+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a10126a90 con 0x7f9a100a6e10 2024-08-19T11:19:14.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9a04004030 con 0x7f9a100a6e10 2024-08-19T11:19:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f9a16032640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f9a16032640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f9a16032640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1013a560 con 0x7f9a100a6e10 2024-08-19T11:19:14.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f99f7fff640 1 --2- 172.21.15.71:0/2629432215 >> v2:172.21.15.135:6800/726754104 conn(0x7f99fc03eab0 0x7f99fc040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:14.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.710+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(254..254 src has 1..254) ==== 3898+0+0 (secure 0 0 0) 0x7f9a0400f040 con 0x7f9a100a6e10 2024-08-19T11:19:14.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.711+0000 7f9a0f7fe640 1 --2- 172.21.15.71:0/2629432215 >> v2:172.21.15.135:6800/726754104 conn(0x7f99fc03eab0 0x7f99fc040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:14.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.711+0000 7f9a0f7fe640 10 monclient: get_auth_request con 0x7f99fc03eab0 auth_method 0 2024-08-19T11:19:14.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.713+0000 7f9a0f7fe640 1 --2- 172.21.15.71:0/2629432215 >> v2:172.21.15.135:6800/726754104 conn(0x7f99fc03eab0 0x7f99fc040f70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9a0002a040 tx=0x7f9a0002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:14.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.715+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9a10128550 con 0x7f9a100a6e10 2024-08-19T11:19:14.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.715+0000 7f99f7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:14.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.715+0000 7f99f7fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=997673642}) 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=744197543}) 2024-08-19T11:19:14.830 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2959602889}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3864142365}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3230863147}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=659351970}) 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.831 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.832 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2575272762}) 2024-08-19T11:19:14.832 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.832 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=989619952}) 2024-08-19T11:19:14.832 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.828+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2454212812}) 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1000865707}) 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2135415465}) 2024-08-19T11:19:14.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2578617142}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2511942889}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3676435613}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=741110659}) 2024-08-19T11:19:14.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1602898925}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2571521403}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.830+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1631389559}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2471256175}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=903301878}) 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=607311731}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=970674094}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2416158196}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.831+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2098977201}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.832+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.832+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.832+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1719366510}) 2024-08-19T11:19:14.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.832+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.832+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=65745391}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.832+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=871227714}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3028151857}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=650652720}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=737922583}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2520592363}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1431018219}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2890382507}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659139724}) 2024-08-19T11:19:14.894 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4056426031}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.833+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=25970542}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=914769596}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2849606802}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1768346748}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.895 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=359906110}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.834+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3361237832}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1995969096}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1495771868}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4152644983}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.835+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1690658619}) 2024-08-19T11:19:14.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=908446354}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=747101797}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2174781027}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2524573419}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3795745629}) 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3365538745}) 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1820901266}) 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1507668812}) 2024-08-19T11:19:14.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.836+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=383773358}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3258304532}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=529757589}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3864042210}) 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3982696898}) 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3249713216}) 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1760138303}) 2024-08-19T11:19:14.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155903614}) 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1958646120}) 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.838+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1407164946}) 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3156407915}) 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=550449129}) 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1837792714}) 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1084997084}) 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2619639393}) 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3149296510}) 2024-08-19T11:19:14.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1823206969}) 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2149883611}) 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.839+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3225930350}) 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=408964129}) 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1118812753}) 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2873440585}) 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2717138807}) 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.840+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=255282447}) 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1676776701}) 2024-08-19T11:19:14.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=563855914}) 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1543515616}) 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.841+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=720032208}) 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2311810842}) 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3003038217}) 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2559126401}) 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2780339082}) 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3341945553}) 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3205944823}) 2024-08-19T11:19:14.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2520737287}) 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652451693}) 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.842+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3480813937}) 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3340707573}) 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=921577223}) 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=498313337}) 2024-08-19T11:19:14.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3913056635}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1386844692}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=785572582}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880918545}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4151421388}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.843+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4175289413}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=107893519}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3312024159}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1465451533}) 2024-08-19T11:19:14.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1797418630}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=807379511}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1150922441}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4053542527}) 2024-08-19T11:19:14.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396755618}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.845+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2798167550}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=995560703}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1107771367}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=907360478}) 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=863526672}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2077457620}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3917236327}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2893962210}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1552941203}) 2024-08-19T11:19:14.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.846+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1773057364}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2592289035}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1093774267}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3335319609}) 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2459219745}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.847+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2817553403}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1057484541}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2499135739}) 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1743375418}) 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.848+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=439100120}) 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1734281910}) 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=565739467}) 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1191896118}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3705932756}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2023357227}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3406227489}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3921120358}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3031509571}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.849+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1222147956}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1549254229}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.850+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2876186787}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3601985087}) 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3189975785}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2038801198}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1534831612}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3026460695}) 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061133004}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.851+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1126835985}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=660013557}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3905115546}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2082414627}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3127718582}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3831075220}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1896429423}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2989833002}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=923953568}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.852+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1417204561}) 2024-08-19T11:19:14.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1264447935}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1003869066}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3318945089}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2200385096}) 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1485992757}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1755706453}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4264651277}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702611498}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2451798866}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2316556337}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3735000276}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3650112495}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1315417323}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3012806549}) 2024-08-19T11:19:14.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=329527343}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1679975308}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896339797}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.855+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1963024071}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3640813128}) 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3293962881}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2659344733}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3439432842}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3748438281}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2043630474}) 2024-08-19T11:19:14.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3595719301}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3393948305}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1269636015}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3188144981}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4282429114}) 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=9936853}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=364825286}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=905402467}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3308739655}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4190569060}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=69450311}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4171127330}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1232785813}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=585547273}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1088136789}) 2024-08-19T11:19:14.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3794107220}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2850318100}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2202807470}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970757484}) 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597094907}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=734886951}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1462506662}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2382142193}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1245823147}) 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1462355167}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2829103020}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=80023114}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28570952}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241951768}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1572323962}) 2024-08-19T11:19:14.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3675138592}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=714174859}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=11782418}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=544752934}) 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1060790072}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3703088791}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1414325886}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722609481}) 2024-08-19T11:19:14.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4150204298}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2721708648}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2151559305}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=437640458}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2928320503}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3127295858}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1962563508}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1110415406}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580862315}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.864+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2054737994}) 2024-08-19T11:19:14.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=434196886}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1367045693}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4136947200}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3726216454}) 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2747185547}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1388399031}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2714929524}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925339024}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.865+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3607247931}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3708697487}) 2024-08-19T11:19:14.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2905657952}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3016255545}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=918122554}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2127517569}) 2024-08-19T11:19:14.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=718367309}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3500078418}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347271840}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.866+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=539417857}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3351779569}) 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1348260720}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.867+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3851854652}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=859415993}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1121419682}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4198385350}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2164897642}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2720337833}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.868+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3945078567}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2700381628}) 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=704516330}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=277737602}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1224129161}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2965716395}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3297108201}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2472063309}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624702716}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.869+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2737477666}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4033374560}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2239109067}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1911400952}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2522764426}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3998443537}) 2024-08-19T11:19:14.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2378011795}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3254918520}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1149007605}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.871+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3081994643}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3960489892}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2872849373}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=460737568}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2165207752}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=726110057}) 2024-08-19T11:19:14.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=899117825}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568997560}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1022184514}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2088234353}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1321482257}) 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.951 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1414043416}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3154721028}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3844865845}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3271455793}) 2024-08-19T11:19:14.952 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3707445657}) 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1775910713}) 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3107052529}) 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3025354589}) 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.953 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=248628542}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4208437632}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=70539212}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=972788631}) 2024-08-19T11:19:14.954 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4063683327}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2683272135}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1600658163}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=149161644}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=350641509}) 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=71071922}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3509332554}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=176710836}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4103348415}) 2024-08-19T11:19:14.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3595849985}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3465121927}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2461727853}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=613257126}) 2024-08-19T11:19:14.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:14.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3668439348}) 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.982+0000 7f9a16032640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.982+0000 7f9a16032640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.982+0000 7f9a16032640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.982+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9a101275f0 con 0x7f9a100a6e10 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.983+0000 7f99f7fff640 1 -- 172.21.15.71:0/2629432215 <== mon.8 v2:172.21.15.71:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f9a04017020 con 0x7f9a100a6e10 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.983+0000 7f99f7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.983+0000 7f99f7fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:14.984 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":176,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:19:14.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 >> v2:172.21.15.135:6800/726754104 conn(0x7f99fc03eab0 msgr2=0x7f99fc040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:14.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 --2- 172.21.15.71:0/2629432215 >> v2:172.21.15.135:6800/726754104 conn(0x7f99fc03eab0 0x7f99fc040f70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9a0002a040 tx=0x7f9a0002e000 comp rx=0 tx=0).stop 2024-08-19T11:19:14.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 10 monclient: shutdown 2024-08-19T11:19:14.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 msgr2=0x7f9a101cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a101cf0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400e900 tx=0x7f9a0400edc0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 shutdown_connections 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 --2- 172.21.15.71:0/2629432215 >> v2:172.21.15.135:6800/726754104 conn(0x7f99fc03eab0 0x7f99fc040f70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9a10139860 0x7f9a10125080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9a100a6e10 0x7f9a101cf0d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 --2- 172.21.15.71:0/2629432215 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9a100a6a30 0x7f9a101ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 >> 172.21.15.71:0/2629432215 conn(0x7f9a100ac030 msgr2=0x7f9a101390b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 shutdown_connections 2024-08-19T11:19:14.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:14.985+0000 7f9a16032640 1 -- 172.21.15.71:0/2629432215 wait complete. 2024-08-19T11:19:14.997 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:19:14.997 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:19:14.997 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:19:14.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3874615845}) 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1025901199}) 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1594271761}) 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=352089407}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1964468134}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2609865370}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4135551647}) 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2982029078}) 2024-08-19T11:19:15.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.062+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3980131837}) 2024-08-19T11:19:15.083 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.083 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.083 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=51082732}) 2024-08-19T11:19:15.083 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.083 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.083 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1680272976}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=492143794}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3254036437}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4203606965}) 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.084 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1375649470}) 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=292844781}) 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1751039145}) 2024-08-19T11:19:15.085 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.080+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=711109926}) 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.104+0000 7fa6ac7b8640 10 monclient: get_monmap_and_config 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.104+0000 7fa6ac7b8640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.104+0000 7fa6ac7b8640 10 monclient: monmap: 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:15.104836+0000 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:15.104836+0000 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.106 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:15.107 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.105+0000 7fa6ac7b8640 1 Processor -- start 2024-08-19T11:19:15.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.105+0000 7fa6ac7b8640 1 -- start start 2024-08-19T11:19:15.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.105+0000 7fa6ac7b8640 10 monclient: init 2024-08-19T11:19:15.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient: _add_conns ranks=[10,6,8,3,4,1,7,2,5,9,0] 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa6a40a3740 0x7fa6a409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): picked mon.noname-f con 0x7fa6a40a3740 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3b20 0x7fa6a40a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): picked mon.noname-d con 0x7fa6a40a3b20 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 0x7fa6a4139960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): picked mon.noname-e con 0x7fa6a4139530 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a409cce0 con 0x7fa6a40a3740 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa6a40a5520 con 0x7fa6a40a3b20 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa6a409e620 con 0x7fa6a4139530 2024-08-19T11:19:15.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.106+0000 7fa6ac7b8640 10 monclient(hunting): authenticate will time out at 1213.147975s 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 0x7fa6a4139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 0x7fa6a4139960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59168/0 (socket says 172.21.15.71:59168) 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 -- 172.21.15.71:0/2736724529 learned_addr learned my addr 172.21.15.71:0/2736724529 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): get_auth_request con 0x7fa6a4139530 auth_method 0 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 1 --2- 172.21.15.71:0/2736724529 >> v2:172.21.15.135:3300/0 conn(0x7fa6a40a3740 0x7fa6a409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): get_auth_request con 0x7fa6a40a3740 auth_method 0 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3b20 0x7fa6a40a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): get_auth_request con 0x7fa6a40a3b20 auth_method 0 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient(hunting): handle_auth_done global_id 94598 payload 274 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 -- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3b20 msgr2=0x7fa6a40a3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3b20 0x7fa6a40a3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 -- 172.21.15.71:0/2736724529 >> v2:172.21.15.135:3300/0 conn(0x7fa6a40a3740 msgr2=0x7fa6a409cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 --2- 172.21.15.71:0/2736724529 >> v2:172.21.15.135:3300/0 conn(0x7fa6a40a3740 0x7fa6a409cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 monclient: found mon.noname-e 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aad55640 1 -- 172.21.15.71:0/2736724529 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a409ca60 con 0x7fa6a4139530 2024-08-19T11:19:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6aa554640 1 --2- 172.21.15.71:0/2736724529 >> v2:172.21.15.135:3300/0 conn(0x7fa6a40a3740 0x7fa6a409cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.107+0000 7fa6a9d53640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3b20 0x7fa6a40a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.111+0000 7fa6aad55640 1 -- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 msgr2=0x7fa6a4139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.111+0000 7fa6aad55640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 0x7fa6a4139960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009e50 tx=0x7fa69c02a550 comp rx=0 tx=0).ready entity=mon.8 client_cookie=d712843d25091f61 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.116 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.116 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.116 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2065105654}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=435879844}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=491351187}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3369631530}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1736245065}) 2024-08-19T11:19:15.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1536262758}) 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=279648457}) 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927294579}) 2024-08-19T11:19:15.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=952168397}) 2024-08-19T11:19:15.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 1 -- 172.21.15.71:0/2736724529 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa69c036070 con 0x7fa6a4139530 2024-08-19T11:19:15.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: dump: 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.120 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 1 -- 172.21.15.71:0/2736724529 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c007a70 con 0x7fa6a4139530 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 1 -- 172.21.15.71:0/2736724529 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa69c007ca0 con 0x7fa6a4139530 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6ac7b8640 5 monclient: authenticate success, global_id 94598 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6ac7b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6ac7b8640 4 set_mon_vals no callback set 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.117+0000 7fa6a9552640 10 monclient: dump: 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.122 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.123 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.124 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.124 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.124 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1687030433}) 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=52206031}) 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3905838577}) 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.125 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=577353862}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3364829748}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2338039297}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=248487644}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2439324532}) 2024-08-19T11:19:15.126 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3255229234}) 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 10 monclient: shutdown 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 msgr2=0x7fa6a4139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 0x7fa6a4139960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009e50 tx=0x7fa69c02a550 comp rx=0 tx=0).stop 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/2736724529 shutdown_connections 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6a4139530 0x7fa6a4139960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/2736724529 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3b20 0x7fa6a40a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/2736724529 >> v2:172.21.15.135:3300/0 conn(0x7fa6a40a3740 0x7fa6a409cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/2736724529 >> 172.21.15.71:0/2736724529 conn(0x7fa6a406ced0 msgr2=0x7fa6a40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/2736724529 shutdown_connections 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.118+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/2736724529 wait complete. 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.119+0000 7fa6ac7b8640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.119+0000 7fa6ac7b8640 10 monclient: monmap: 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:15.131 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.132 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.119+0000 7fa6ac7b8640 1 Processor -- start 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.119+0000 7fa6ac7b8640 1 -- start start 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.119+0000 7fa6ac7b8640 10 monclient: init 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient: _add_conns ranks=[6,4,2,1,5,3,0,7,8] 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3740 0x7fa6a4138750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): picked mon.noname-d con 0x7fa6a40a3740 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa6a40a3b20 0x7fa6a4138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): picked mon.noname-c con 0x7fa6a40a3b20 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6a4139530 0x7fa6a4122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): picked mon.noname-b con 0x7fa6a4139530 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a40a4440 con 0x7fa6a4139530 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa6a4139ea0 con 0x7fa6a40a3b20 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa6a40a72a0 con 0x7fa6a40a3740 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6ac7b8640 10 monclient(hunting): authenticate will time out at 1213.161285s 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3740 0x7fa6a4138750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3740 0x7fa6a4138750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:56088/0 (socket says 172.21.15.71:56088) 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 1 -- 172.21.15.71:0/4258212927 learned_addr learned my addr 172.21.15.71:0/4258212927 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): get_auth_request con 0x7fa6a40a3740 auth_method 0 2024-08-19T11:19:15.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa6a40a3b20 0x7fa6a4138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6a4139530 0x7fa6a4122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): get_auth_request con 0x7fa6a4139530 auth_method 0 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): get_auth_request con 0x7fa6a40a3b20 auth_method 0 2024-08-19T11:19:15.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient(hunting): handle_auth_done global_id 84847 payload 824 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3740 msgr2=0x7fa6a4138750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6a40a3740 0x7fa6a4138750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6a4139530 msgr2=0x7fa6a4122480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6a4139530 0x7fa6a4122480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 monclient: found mon.noname-c 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6a9d53640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4123db0 con 0x7fa6a40a3b20 2024-08-19T11:19:15.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.120+0000 7fa6aad55640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6a4139530 0x7fa6a4122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.121+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.121+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2748444674}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2613800391}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=933673373}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1358919742}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3842067907}) 2024-08-19T11:19:15.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1459116348}) 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3608638129}) 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668911341}) 2024-08-19T11:19:15.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.122+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1680484440}) 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6a9d53640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa6a40a3b20 msgr2=0x7fa6a4138c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6a9d53640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa6a40a3b20 0x7fa6a4138c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa69400e900 tx=0x7fa69400edc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa694017070 con 0x7fa6a40a3b20 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: dump: 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.143 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.144 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 5 monclient: authenticate success, global_id 84847 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 10 monclient: _renew_subs 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a4126110 con 0x7fa6a40a3b20 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69400cc10 con 0x7fa6a40a3b20 2024-08-19T11:19:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 10 monclient: _renew_subs 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a4124af0 con 0x7fa6a40a3b20 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa69400cdc0 con 0x7fa6a40a3b20 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa6a8d51640 4 set_mon_vals no callback set 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.123+0000 7fa69affd640 10 monclient: dump: 2024-08-19T11:19:15.146 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.147 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa6ac7b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa69401a070 con 0x7fa6a40a3b20 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 0x7fa6a41229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a406a590 con 0x7fa6a41ce310 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa69affd640 1 --2- 172.21.15.71:0/4258212927 >> v2:172.21.15.135:6800/726754104 conn(0x7fa68803eab0 0x7fa688040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.124+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(254..254 src has 1..254) ==== 3898+0+0 (secure 0 0 0) 0x7fa69400f040 con 0x7fa6a40a3b20 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 0x7fa6a41229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient: get_auth_request con 0x7fa6a41ce310 auth_method 0 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aad55640 1 --2- 172.21.15.71:0/4258212927 >> v2:172.21.15.135:6800/726754104 conn(0x7fa68803eab0 0x7fa688040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aad55640 10 monclient: get_auth_request con 0x7fa68803eab0 auth_method 0 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 10 monclient(hunting): handle_auth_done global_id 75285 payload 824 2024-08-19T11:19:15.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.125+0000 7fa6aa554640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6a4139940 con 0x7fa6a41ce310 2024-08-19T11:19:15.150 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.127+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.150 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.127+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.150 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.127+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=979766088}) 2024-08-19T11:19:15.150 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.127+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.150 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.127+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.151 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1480751609}) 2024-08-19T11:19:15.151 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.151 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.128+0000 7fa6aa554640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 msgr2=0x7fa6a41229c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.128+0000 7fa6aa554640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 0x7fa6a41229c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00119a0 tx=0x7fa6a0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4192336364}) 2024-08-19T11:19:15.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3776580323}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3587402507}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=575852036}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2771326464}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872752159}) 2024-08-19T11:19:15.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.128+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2072803982}) 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.128+0000 7fa6aad55640 1 --2- 172.21.15.71:0/4258212927 >> v2:172.21.15.135:6800/726754104 conn(0x7fa68803eab0 0x7fa688040f70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa6a406e000 tx=0x7fa69c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.142+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa6a000fe50 con 0x7fa6a41ce310 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.142+0000 7fa69affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.142+0000 7fa69affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.142+0000 7fa69affd640 10 monclient: dump: 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa6a000fe50 con 0x7fa6a41ce310 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 msgr2=0x7fa6a41229c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 0x7fa6a41229c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00119a0 tx=0x7fa6a0011e60 comp rx=0 tx=0).stop 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 msgr2=0x7fa6a41229c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.143+0000 7fa69affd640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a41ce310 0x7fa6a41229c0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00119a0 tx=0x7fa6a0011e60 comp rx=0 tx=0).stop 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6ac7b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 0x7fa6a411e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6ac7b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40a45c0 con 0x7fa6a4122f00 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 0x7fa6a411e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient: get_auth_request con 0x7fa6a4122f00 auth_method 0 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 10 monclient(hunting): handle_auth_done global_id 75294 payload 824 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.150+0000 7fa6aa554640 1 -- 172.21.15.71:0/4258212927 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa6a41232e0 con 0x7fa6a4122f00 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6aa554640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 msgr2=0x7fa6a411e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6aa554640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 0x7fa6a411e380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa6a001c000 tx=0x7fa6a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa6a0014ac0 con 0x7fa6a4122f00 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 10 monclient: dump: 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.161 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7fa6a001d400 con 0x7fa6a4122f00 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 msgr2=0x7fa6a411e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 0x7fa6a411e380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa6a001c000 tx=0x7fa6a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 msgr2=0x7fa6a411e380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa69affd640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6a4122f00 0x7fa6a411e380 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa6a001c000 tx=0x7fa6a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 204186, 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:15.163 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.164 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:15.165 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.166 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:15.167 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.168 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:15.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:15.170 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.174 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:15.175 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.176 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.177 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:15.178 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.181 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:15.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:15.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:15.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:15.187 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 >> v2:172.21.15.135:6800/726754104 conn(0x7fa68803eab0 msgr2=0x7fa688040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/4258212927 >> v2:172.21.15.135:6800/726754104 conn(0x7fa68803eab0 0x7fa688040f70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa6a406e000 tx=0x7fa69c009000 comp rx=0 tx=0).stop 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 10 monclient: shutdown 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa6a40a3b20 msgr2=0x7fa6a4138c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 --2- 172.21.15.71:0/4258212927 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa6a40a3b20 0x7fa6a4138c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa69400e900 tx=0x7fa69400edc0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6aad55640 1 -- 172.21.15.71:0/4258212927 reap_dead start 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6aad55640 1 -- 172.21.15.71:0/4258212927 reap_dead start 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 shutdown_connections 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 >> 172.21.15.71:0/4258212927 conn(0x7fa6a406ced0 msgr2=0x7fa6a40a6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 shutdown_connections 2024-08-19T11:19:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.153+0000 7fa6ac7b8640 1 -- 172.21.15.71:0/4258212927 wait complete. 2024-08-19T11:19:15.190 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:15.190 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:19:15.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:19:15.239 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: starting. 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28145 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: created object 0... 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: created object 25... 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: created object 49... 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: finishing. 2024-08-19T11:19:15.240 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28180]: shutting down. 2024-08-19T11:19:15.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.291+0000 7f26d193a640 10 monclient: get_monmap_and_config 2024-08-19T11:19:15.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.291+0000 7f26d193a640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.291+0000 7f26d193a640 10 monclient: monmap: 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:15.292358+0000 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:15.292358+0000 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.293 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:15.294 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:15.294 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.292+0000 7f26d193a640 1 Processor -- start 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.292+0000 7f26d193a640 1 -- start start 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.292+0000 7f26d193a640 10 monclient: init 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.292+0000 7f26d193a640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.292+0000 7f26d193a640 10 monclient: _add_conns ranks=[0,2,5,9,8,7,6,3,1,4,10] 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.292+0000 7f26d193a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f26cc0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 0x7f26cc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 10 monclient(hunting): picked mon.noname-b con 0x7f26cc0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 10 monclient(hunting): picked mon.noname-h con 0x7f26cc0a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26cc0a6380 con 0x7f26cc0a6950 2024-08-19T11:19:15.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc0a5020 con 0x7f26cc0a57c0 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f26cc0a7d40 con 0x7f26cc0a7440 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26d193a640 10 monclient(hunting): authenticate will time out at 1213.334056s 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26caffd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f26cc0a6950 0x7f26cc0a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43688/0 (socket says 172.21.15.71:43688) 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 0x7f26cc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26caffd640 1 -- 172.21.15.71:0/1248790599 learned_addr learned my addr 172.21.15.71:0/1248790599 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): get_auth_request con 0x7f26cc0a57c0 auth_method 0 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient(hunting): handle_auth_done global_id 75215 payload 274 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 1 -- 172.21.15.71:0/1248790599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 msgr2=0x7f26cc1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1248790599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 1 -- 172.21.15.71:0/1248790599 >> v1:172.21.15.71:6789/0 conn(0x7f26cc0a6950 legacy=0x7f26cc0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 1 monclient: found mon.noname-b 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.293+0000 7f26c3fff640 1 -- 172.21.15.71:0/1248790599 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc0a3650 con 0x7f26cc0a57c0 2024-08-19T11:19:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26c3fff640 1 -- 172.21.15.71:0/1248790599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 msgr2=0x7f26cc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1248790599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 0x7f26cc13eb60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009800 tx=0x7f26b4029fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75df83c1f30a1d3b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 1 -- 172.21.15.71:0/1248790599 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26b4037070 con 0x7f26cc0a57c0 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: dump: 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.305 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26d193a640 5 monclient: authenticate success, global_id 75215 2024-08-19T11:19:15.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26d193a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 1 -- 172.21.15.71:0/1248790599 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b402ade0 con 0x7f26cc0a57c0 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26d193a640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26d193a640 4 set_mon_vals no callback set 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 1 -- 172.21.15.71:0/1248790599 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26b4030c20 con 0x7f26cc0a57c0 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.296+0000 7f26ca7fc640 10 monclient: dump: 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.307 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.308 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 10 monclient: shutdown 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 -- 172.21.15.71:0/1248790599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 msgr2=0x7f26cc13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 --2- 172.21.15.71:0/1248790599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 0x7f26cc13eb60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009800 tx=0x7f26b4029fe0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 -- 172.21.15.71:0/1248790599 shutdown_connections 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 --2- 172.21.15.71:0/1248790599 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 --2- 172.21.15.71:0/1248790599 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc0a57c0 0x7f26cc13eb60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 -- 172.21.15.71:0/1248790599 >> 172.21.15.71:0/1248790599 conn(0x7f26cc0abf50 msgr2=0x7f26cc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 -- 172.21.15.71:0/1248790599 shutdown_connections 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 1 -- 172.21.15.71:0/1248790599 wait complete. 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.297+0000 7f26d193a640 10 monclient: monmap: 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.310 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 Processor -- start 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 -- start start 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient: init 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient: _add_conns ranks=[6,3,5,4,0,1,7,8,2] 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 0x7f26cc128a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): picked mon.noname-d con 0x7f26cc0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0a6950 0x7f26cc1ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): picked mon.noname-g con 0x7f26cc0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc126460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): picked mon.noname-h con 0x7f26cc0a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc0a8700 con 0x7f26cc0a6950 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f26cc0a84c0 con 0x7f26cc0a7440 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f26cc1415f0 con 0x7f26cc0a57c0 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26d193a640 10 monclient(hunting): authenticate will time out at 1213.339549s 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 0x7f26cc128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 0x7f26cc128a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:56096/0 (socket says 172.21.15.71:56096) 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 -- 172.21.15.71:0/1288200272 learned_addr learned my addr 172.21.15.71:0/1288200272 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): get_auth_request con 0x7f26cc0a57c0 auth_method 0 2024-08-19T11:19:15.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0a6950 0x7f26cc1ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): get_auth_request con 0x7f26cc0a6950 auth_method 0 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26cb7fe640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc126460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26cb7fe640 10 monclient(hunting): get_auth_request con 0x7f26cc0a7440 auth_method 0 2024-08-19T11:19:15.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient(hunting): handle_auth_done global_id 104244 payload 824 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 msgr2=0x7f26cc126460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc126460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0a6950 msgr2=0x7f26cc1ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26cc0a6950 0x7f26cc1ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 monclient: found mon.noname-d 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26caffd640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc129410 con 0x7f26cc0a57c0 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.298+0000 7f26cb7fe640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f26cc0a7440 0x7f26cc126460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26caffd640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 msgr2=0x7f26cc128a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26caffd640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 0x7f26cc128a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00c460 tx=0x7f26bc00c920 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26bc005cf0 con 0x7f26cc0a57c0 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: dump: 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.315 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 5 monclient: authenticate success, global_id 104244 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc0074e0 con 0x7f26cc0a57c0 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26bc007690 con 0x7f26cc0a57c0 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 10 monclient: _renew_subs 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26cc1c6480 con 0x7f26cc0a57c0 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c9ffb640 4 set_mon_vals no callback set 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26c8ff9640 10 monclient: dump: 2024-08-19T11:19:15.317 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.318 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 10 monclient: _renew_subs 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.301+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f26cc12a280 con 0x7f26cc0a57c0 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26d193a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26d193a640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 0x7f26cc1269a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc076c60 con 0x7f26cc1cf090 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 0x7f26cc1269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f26bc007070 con 0x7f26cc0a57c0 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient: get_auth_request con 0x7f26cc1cf090 auth_method 0 2024-08-19T11:19:15.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 10 monclient(hunting): handle_auth_done global_id 75224 payload 824 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c8ff9640 1 --2- 172.21.15.71:0/1288200272 >> v2:172.21.15.135:6800/726754104 conn(0x7f26ac03e9b0 0x7f26ac040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c3fff640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26cc129e50 con 0x7f26cc1cf090 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.302+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(255..255 src has 1..255) ==== 3898+0+0 (secure 0 0 0) 0x7f26bc0518e0 con 0x7f26cc0a57c0 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.303+0000 7f26cb7fe640 1 --2- 172.21.15.71:0/1288200272 >> v2:172.21.15.135:6800/726754104 conn(0x7f26ac03e9b0 0x7f26ac040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.303+0000 7f26cb7fe640 10 monclient: get_auth_request con 0x7f26ac03e9b0 auth_method 0 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.304+0000 7f26c3fff640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 msgr2=0x7f26cc1269a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.304+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 0x7f26cc1269a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26b4034000 tx=0x7f26b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.304+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26b4043070 con 0x7f26cc1cf090 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.304+0000 7f26c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 10 monclient: dump: 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.323 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.324 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f26b4038040 con 0x7f26cc1cf090 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 msgr2=0x7f26cc1269a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 0x7f26cc1269a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26b4034000 tx=0x7f26b40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 msgr2=0x7f26cc1269a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26c8ff9640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc1cf090 0x7f26cc1269a0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26b4034000 tx=0x7f26b40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.305+0000 7f26cb7fe640 1 --2- 172.21.15.71:0/1288200272 >> v2:172.21.15.135:6800/726754104 conn(0x7f26ac03e9b0 0x7f26ac040e70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009f20 tx=0x7f26c40094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26d193a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26d193a640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 0x7f26cc1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26d193a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f26cc1272f0 con 0x7f26cc126ee0 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 0x7f26cc1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient: get_auth_request con 0x7f26cc126ee0 auth_method 0 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 10 monclient(hunting): handle_auth_done global_id 75233 payload 824 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.311+0000 7f26c3fff640 1 -- 172.21.15.71:0/1288200272 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f26cc0a6d30 con 0x7f26cc126ee0 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c3fff640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 msgr2=0x7f26cc1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c3fff640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 0x7f26cc1225a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26b402a020 tx=0x7f26b4008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f26b404f070 con 0x7f26cc126ee0 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 10 monclient: dump: 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.327 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f26b40489c0 con 0x7f26cc126ee0 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 msgr2=0x7f26cc1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 0x7f26cc1225a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26b402a020 tx=0x7f26b4008030 comp rx=0 tx=0).stop 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 msgr2=0x7f26cc1225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26c8ff9640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f26cc126ee0 0x7f26cc1225a0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26b402a020 tx=0x7f26b4008030 comp rx=0 tx=0).stop 2024-08-19T11:19:15.328 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 204346, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:15.329 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.330 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.331 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:15.332 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.333 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:15.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.337 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:15.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:15.340 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.341 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.342 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:15.343 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:15.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:15.346 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.347 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.350 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.351 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:15.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.351 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.351 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:15.351 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 >> v2:172.21.15.135:6800/726754104 conn(0x7f26ac03e9b0 msgr2=0x7f26ac040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 --2- 172.21.15.71:0/1288200272 >> v2:172.21.15.135:6800/726754104 conn(0x7f26ac03e9b0 0x7f26ac040e70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009f20 tx=0x7f26c40094f0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 10 monclient: shutdown 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 msgr2=0x7f26cc128a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 --2- 172.21.15.71:0/1288200272 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f26cc0a57c0 0x7f26cc128a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00c460 tx=0x7f26bc00c920 comp rx=0 tx=0).stop 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26cb7fe640 1 -- 172.21.15.71:0/1288200272 reap_dead start 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26cb7fe640 1 -- 172.21.15.71:0/1288200272 reap_dead start 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 shutdown_connections 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 >> 172.21.15.71:0/1288200272 conn(0x7f26cc0abf50 msgr2=0x7f26cc0aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 shutdown_connections 2024-08-19T11:19:15.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.314+0000 7f26d193a640 1 -- 172.21.15.71:0/1288200272 wait complete. 2024-08-19T11:19:15.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:15.354 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:19:15.354 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:19:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.451+0000 7f0a6f34c640 10 monclient: get_monmap_and_config 2024-08-19T11:19:15.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.451+0000 7f0a6f34c640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.451+0000 7f0a6f34c640 10 monclient: monmap: 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:15.452480+0000 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:15.452480+0000 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.453 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:15.454 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:15.454 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.452+0000 7f0a6f34c640 1 Processor -- start 2024-08-19T11:19:15.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.452+0000 7f0a6f34c640 1 -- start start 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.452+0000 7f0a6f34c640 10 monclient: init 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient: _add_conns ranks=[8,2,10,4,3,1,5,6,7,9,0] 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 0x7f0a680a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): picked mon.noname-e con 0x7f0a680a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a680a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): picked mon.noname-b con 0x7f0a680a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0a68139710 0x7f0a68139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): picked mon.noname-f con 0x7f0a68139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0a680a5020 con 0x7f0a68139710 2024-08-19T11:19:15.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0a680a77b0 con 0x7f0a680a57c0 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f0a680a7d40 con 0x7f0a680a6950 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6f34c640 10 monclient(hunting): authenticate will time out at 1213.494129s 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 0x7f0a680a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a680a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 0x7f0a680a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59180/0 (socket says 172.21.15.71:59180) 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a680a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43260/0 (socket says 172.21.15.71:43260) 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 1 -- 172.21.15.71:0/1279957419 learned_addr learned my addr 172.21.15.71:0/1279957419 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): get_auth_request con 0x7f0a680a6950 auth_method 0 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): get_auth_request con 0x7f0a680a57c0 auth_method 0 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/1279957419 >> v2:172.21.15.135:3300/0 conn(0x7f0a68139710 0x7f0a68139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d8e9640 10 monclient(hunting): get_auth_request con 0x7f0a68139710 auth_method 0 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d8e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d8e9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d8e9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_done global_id 75242 payload 274 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 -- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 msgr2=0x7f0a680a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 --2- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 0x7f0a680a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 -- 172.21.15.71:0/1279957419 >> v2:172.21.15.135:3300/0 conn(0x7f0a68139710 msgr2=0x7f0a68139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 --2- 172.21.15.71:0/1279957419 >> v2:172.21.15.135:3300/0 conn(0x7f0a68139710 0x7f0a68139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 monclient: found mon.noname-b 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6c8e7640 1 -- 172.21.15.71:0/1279957419 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a680a6380 con 0x7f0a680a57c0 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.453+0000 7f0a6d0e8640 1 --2- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 0x7f0a680a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6c8e7640 1 -- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 msgr2=0x7f0a680a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6c8e7640 1 --2- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a680a7270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097d0 tx=0x7f0a5c02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ac22ff63ac9e54 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 1 -- 172.21.15.71:0/1279957419 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a5c037070 con 0x7f0a680a57c0 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: dump: 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.463 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 5 monclient: authenticate success, global_id 75242 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 1 -- 172.21.15.71:0/1279957419 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c02ad20 con 0x7f0a680a57c0 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 1 -- 172.21.15.71:0/1279957419 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a5c030c20 con 0x7f0a680a57c0 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 4 set_mon_vals no callback set 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a67fff640 10 monclient: dump: 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.465 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 10 monclient: shutdown 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 1 -- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 msgr2=0x7f0a680a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.456+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a680a7270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c0097d0 tx=0x7f0a5c02a000 comp rx=0 tx=0).stop 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 -- 172.21.15.71:0/1279957419 shutdown_connections 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/1279957419 >> v2:172.21.15.135:3300/0 conn(0x7f0a68139710 0x7f0a68139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a680a7270 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/1279957419 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f0a680a6950 0x7f0a680a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 -- 172.21.15.71:0/1279957419 >> 172.21.15.71:0/1279957419 conn(0x7f0a680abf50 msgr2=0x7f0a680ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 -- 172.21.15.71:0/1279957419 shutdown_connections 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 1 -- 172.21.15.71:0/1279957419 wait complete. 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.457+0000 7f0a6f34c640 10 monclient: monmap: 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:15.467 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 Processor -- start 2024-08-19T11:19:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 -- start start 2024-08-19T11:19:15.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient: init 2024-08-19T11:19:15.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient: _add_conns ranks=[2,6,7,1,0,4,8,3,5] 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a681ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): picked mon.noname-b con 0x7f0a680a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0a680a6950 0x7f0a68138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): picked mon.noname-d con 0x7f0a680a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0a68139710 0x7f0a68122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): picked mon.noname-i con 0x7f0a68139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0a680a84c0 con 0x7f0a680a57c0 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f0a680a3650 con 0x7f0a680a6950 2024-08-19T11:19:15.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0a680a8700 con 0x7f0a68139710 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6f34c640 10 monclient(hunting): authenticate will time out at 1213.499673s 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a681ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a681ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43268/0 (socket says 172.21.15.71:43268) 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0a680a6950 0x7f0a68138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 1 -- 172.21.15.71:0/909169257 learned_addr learned my addr 172.21.15.71:0/909169257 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): get_auth_request con 0x7f0a680a57c0 auth_method 0 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): get_auth_request con 0x7f0a680a6950 auth_method 0 2024-08-19T11:19:15.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6c8e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0a68139710 0x7f0a68122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.458+0000 7f0a6d0e8640 10 monclient(hunting): handle_auth_done global_id 75251 payload 824 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0a68139710 msgr2=0x7f0a68122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0a68139710 0x7f0a68122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0a680a6950 msgr2=0x7f0a68138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0a680a6950 0x7f0a68138bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 1 monclient: found mon.noname-b 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d0e8640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a681262c0 con 0x7f0a680a57c0 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d8e9640 10 monclient: get_auth_request con 0x7f0a68139710 auth_method 0 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0a68139710 0x7f0a68122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.459+0000 7f0a6c8e7640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f0a680a6950 0x7f0a68138bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6d0e8640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 msgr2=0x7f0a681ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6d0e8640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a681ce170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800efc0 tx=0x7f0a5800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a580148f0 con 0x7f0a680a57c0 2024-08-19T11:19:15.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: dump: 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.480 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 5 monclient: authenticate success, global_id 75251 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a58019070 con 0x7f0a680a57c0 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 10 monclient: _renew_subs 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a681265a0 con 0x7f0a680a57c0 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a580073f0 con 0x7f0a680a57c0 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a65ffb640 10 monclient: dump: 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.482 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 10 monclient: _renew_subs 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a680a2350 con 0x7f0a680a57c0 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.461+0000 7f0a677fe640 4 set_mon_vals no callback set 2024-08-19T11:19:15.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0a58005d10 con 0x7f0a680a57c0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a65ffb640 1 --2- 172.21.15.71:0/909169257 >> v2:172.21.15.135:6800/726754104 conn(0x7f0a5403ea80 0x7f0a54040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(255..255 src has 1..255) ==== 3898+0+0 (secure 0 0 0) 0x7f0a58051e60 con 0x7f0a680a57c0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6f34c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 0x7f0a6802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0a6806a590 con 0x7f0a68125ee0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6c8e7640 1 --2- 172.21.15.71:0/909169257 >> v2:172.21.15.135:6800/726754104 conn(0x7f0a5403ea80 0x7f0a54040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6c8e7640 10 monclient: get_auth_request con 0x7f0a5403ea80 auth_method 0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 0x7f0a6802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient: get_auth_request con 0x7f0a68125ee0 auth_method 0 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.462+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.463+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_done global_id 84856 payload 824 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.463+0000 7f0a6d8e9640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a680a6d30 con 0x7f0a68125ee0 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a6c8e7640 1 --2- 172.21.15.71:0/909169257 >> v2:172.21.15.135:6800/726754104 conn(0x7f0a5403ea80 0x7f0a54040f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c031000 tx=0x7f0a5c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a6d8e9640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 msgr2=0x7f0a6802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 0x7f0a6802d1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4e0 tx=0x7f0a6000e9a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a60017020 con 0x7f0a68125ee0 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 10 monclient: dump: 2024-08-19T11:19:15.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0a60004320 con 0x7f0a68125ee0 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 msgr2=0x7f0a6802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 0x7f0a6802d1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4e0 tx=0x7f0a6000e9a0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 msgr2=0x7f0a6802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.465+0000 7f0a65ffb640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a68125ee0 0x7f0a6802d1c0 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4e0 tx=0x7f0a6000e9a0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6f34c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 0x7f0a6802db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6f34c640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0a68124da0 con 0x7f0a6802d700 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 0x7f0a6802db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient: get_auth_request con 0x7f0a6802d700 auth_method 0 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.471+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.472+0000 7f0a6d8e9640 10 monclient(hunting): handle_auth_done global_id 84865 payload 824 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.472+0000 7f0a6d8e9640 1 -- 172.21.15.71:0/909169257 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a6809e100 con 0x7f0a6802d700 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a6d8e9640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 msgr2=0x7f0a6802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a6d8e9640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 0x7f0a6802db10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4e0 tx=0x7f0a600046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0a60017040 con 0x7f0a6802d700 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 10 monclient: dump: 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.489 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f0a60003d30 con 0x7f0a6802d700 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 msgr2=0x7f0a6802db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 0x7f0a6802db10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e4e0 tx=0x7f0a600046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 msgr2=0x7f0a6802db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.474+0000 7f0a65ffb640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0a6802d700 0x7f0a6802db10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 137621, 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:15.491 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.492 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.493 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.494 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:15.495 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.496 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:15.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:15.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.503 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:15.507 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:15.514 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:15.515 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:15.515 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28182]: starting. 2024-08-19T11:19:15.515 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28182]: listing objects. 2024-08-19T11:19:15.516 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28182]: listed object 0... 2024-08-19T11:19:15.516 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28182]: listed object 25... 2024-08-19T11:19:15.516 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28182]: saw 50 objects 2024-08-19T11:19:15.516 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28182]: shutting down. 2024-08-19T11:19:15.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 >> v2:172.21.15.135:6800/726754104 conn(0x7f0a5403ea80 msgr2=0x7f0a54040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/909169257 >> v2:172.21.15.135:6800/726754104 conn(0x7f0a5403ea80 0x7f0a54040f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c031000 tx=0x7f0a5c02e000 comp rx=0 tx=0).stop 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 10 monclient: shutdown 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 msgr2=0x7f0a681ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 --2- 172.21.15.71:0/909169257 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0a680a57c0 0x7f0a681ce170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800efc0 tx=0x7f0a5800c490 comp rx=0 tx=0).stop 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6d8e9640 1 -- 172.21.15.71:0/909169257 reap_dead start 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6d8e9640 1 -- 172.21.15.71:0/909169257 reap_dead start 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 shutdown_connections 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 >> 172.21.15.71:0/909169257 conn(0x7f0a680abf50 msgr2=0x7f0a680aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 shutdown_connections 2024-08-19T11:19:15.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.475+0000 7f0a6f34c640 1 -- 172.21.15.71:0/909169257 wait complete. 2024-08-19T11:19:15.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:15.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:19:15.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:19:15.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.615+0000 7efe513a0640 10 monclient: get_monmap_and_config 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.616+0000 7efe513a0640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.616+0000 7efe513a0640 10 monclient: monmap: 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:15.616661+0000 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:15.616661+0000 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.617 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:15.618 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.616+0000 7efe513a0640 1 Processor -- start 2024-08-19T11:19:15.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.616+0000 7efe513a0640 1 -- start start 2024-08-19T11:19:15.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.616+0000 7efe513a0640 10 monclient: init 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient: _add_conns ranks=[5,6,8,1,10,2,4,3,9,7,0] 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c0a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): picked mon.noname-h con 0x7efe4c0a66d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c0a6ff0 0x7efe4c0a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): picked mon.noname-d con 0x7efe4c0a6ff0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 0x7efe4c139870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): picked mon.noname-e con 0x7efe4c139490 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7efe4c0a2ec0 con 0x7efe4c0a66d0 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7efe4c0a84f0 con 0x7efe4c0a6ff0 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7efe4c0a5570 con 0x7efe4c139490 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe513a0640 10 monclient(hunting): authenticate will time out at 1213.658433s 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 0x7efe4c139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 0x7efe4c139870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59190/0 (socket says 172.21.15.71:59190) 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 -- 172.21.15.71:0/1826809428 learned_addr learned my addr 172.21.15.71:0/1826809428 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): get_auth_request con 0x7efe4c139490 auth_method 0 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c0a6ff0 0x7efe4c0a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): get_auth_request con 0x7efe4c0a6ff0 auth_method 0 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4bfff640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c0a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4bfff640 10 monclient(hunting): get_auth_request con 0x7efe4c0a66d0 auth_method 0 2024-08-19T11:19:15.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient(hunting): handle_auth_done global_id 94616 payload 274 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 -- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c0a6ff0 msgr2=0x7efe4c0a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c0a6ff0 0x7efe4c0a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 -- 172.21.15.71:0/1826809428 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 msgr2=0x7efe4c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c0a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 monclient: found mon.noname-e 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe50b9f640 1 -- 172.21.15.71:0/1826809428 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c0a4d10 con 0x7efe4c139490 2024-08-19T11:19:15.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.617+0000 7efe4b7fe640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c0a6ff0 0x7efe4c0a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe50b9f640 1 -- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 msgr2=0x7efe4c139870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe50b9f640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 0x7efe4c139870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe44009eb0 tx=0x7efe4402a5f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=80d0c968136cbfbd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 1 -- 172.21.15.71:0/1826809428 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe44036070 con 0x7efe4c139490 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: dump: 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.632 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.633 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 1 -- 172.21.15.71:0/1826809428 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe44007a70 con 0x7efe4c139490 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe513a0640 5 monclient: authenticate success, global_id 94616 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe513a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe513a0640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 1 -- 172.21.15.71:0/1826809428 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe44007ca0 con 0x7efe4c139490 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe513a0640 4 set_mon_vals no callback set 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:15.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.620+0000 7efe4affd640 10 monclient: dump: 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.635 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 10 monclient: shutdown 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 -- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 msgr2=0x7efe4c139870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 0x7efe4c139870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe44009eb0 tx=0x7efe4402a5f0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 -- 172.21.15.71:0/1826809428 shutdown_connections 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7efe4c139490 0x7efe4c139870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c0a6ff0 0x7efe4c0a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 --2- 172.21.15.71:0/1826809428 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c0a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 -- 172.21.15.71:0/1826809428 >> 172.21.15.71:0/1826809428 conn(0x7efe4c0abcd0 msgr2=0x7efe4c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 -- 172.21.15.71:0/1826809428 shutdown_connections 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 1 -- 172.21.15.71:0/1826809428 wait complete. 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.621+0000 7efe513a0640 10 monclient: monmap: 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 Processor -- start 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 -- start start 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient: init 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient: _add_conns ranks=[5,0,2,1,6,3,7,8,4] 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c1386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): picked mon.noname-h con 0x7efe4c0a66d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe4c0a6ff0 0x7efe4c138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): picked mon.noname-a con 0x7efe4c0a6ff0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 0x7efe4c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): picked mon.noname-b con 0x7efe4c139490 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c0a33d0 con 0x7efe4c0a6ff0 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c0644e0 con 0x7efe4c139490 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7efe4c0a81e0 con 0x7efe4c0a66d0 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.622+0000 7efe513a0640 10 monclient(hunting): authenticate will time out at 1213.663959s 2024-08-19T11:19:15.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe4c0a6ff0 0x7efe4c138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 0x7efe4c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe4c0a6ff0 0x7efe4c138bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41564/0 (socket says 172.21.15.71:41564) 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 0x7efe4c122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43280/0 (socket says 172.21.15.71:43280) 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 1 -- 172.21.15.71:0/2407771152 learned_addr learned my addr 172.21.15.71:0/2407771152 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): get_auth_request con 0x7efe4c0a6ff0 auth_method 0 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): get_auth_request con 0x7efe4c139490 auth_method 0 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c1386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): get_auth_request con 0x7efe4c0a66d0 auth_method 0 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient(hunting): handle_auth_done global_id 75260 payload 824 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 msgr2=0x7efe4c1386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7efe4c0a66d0 0x7efe4c1386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe4c0a6ff0 msgr2=0x7efe4c138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe4c0a6ff0 0x7efe4c138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 monclient: found mon.noname-b 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe50b9f640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c123d10 con 0x7efe4c139490 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.623+0000 7efe4b7fe640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe4c0a6ff0 0x7efe4c138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe50b9f640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 msgr2=0x7efe4c122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe50b9f640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 0x7efe4c122320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0a56f0 tx=0x7efe44004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe44040030 con 0x7efe4c139490 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: dump: 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe44003ba0 con 0x7efe4c139490 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe44036040 con 0x7efe4c139490 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 5 monclient: authenticate success, global_id 75260 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe48ff9640 10 monclient: dump: 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 10 monclient: _renew_subs 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe4a7fc640 4 set_mon_vals no callback set 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c13a050 con 0x7efe4c139490 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 10 monclient: _renew_subs 2024-08-19T11:19:15.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.625+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c126070 con 0x7efe4c139490 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe513a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe513a0640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 0x7efe4c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7efe4c076c60 con 0x7efe4c1ce020 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7efe44043070 con 0x7efe4c139490 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 0x7efe4c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient: get_auth_request con 0x7efe4c1ce020 auth_method 0 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.626+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.627+0000 7efe48ff9640 1 --2- 172.21.15.71:0/2407771152 >> v2:172.21.15.135:6800/726754104 conn(0x7efe3803e9e0 0x7efe38040ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.627+0000 7efe4bfff640 10 monclient(hunting): handle_auth_done global_id 104271 payload 824 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.627+0000 7efe4bfff640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe4c0a3d60 con 0x7efe4c1ce020 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.627+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(255..255 src has 1..255) ==== 3898+0+0 (secure 0 0 0) 0x7efe44041070 con 0x7efe4c139490 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.627+0000 7efe4b7fe640 1 --2- 172.21.15.71:0/2407771152 >> v2:172.21.15.135:6800/726754104 conn(0x7efe3803e9e0 0x7efe38040ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.627+0000 7efe4b7fe640 10 monclient: get_auth_request con 0x7efe3803e9e0 auth_method 0 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe4bfff640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 msgr2=0x7efe4c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe4bfff640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 0x7efe4c02d1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe3c010780 tx=0x7efe3c010c40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe3c018020 con 0x7efe4c1ce020 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:15.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 10 monclient: dump: 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.649 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efe3c004450 con 0x7efe4c1ce020 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 msgr2=0x7efe4c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 0x7efe4c02d1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe3c010780 tx=0x7efe3c010c40 comp rx=0 tx=0).stop 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 msgr2=0x7efe4c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.629+0000 7efe48ff9640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c1ce020 0x7efe4c02d1c0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe3c010780 tx=0x7efe3c010c40 comp rx=0 tx=0).stop 2024-08-19T11:19:15.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.630+0000 7efe4b7fe640 1 --2- 172.21.15.71:0/2407771152 >> v2:172.21.15.135:6800/726754104 conn(0x7efe3803e9e0 0x7efe38040ea0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efe40009560 tx=0x7efe40009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.635+0000 7efe513a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:15.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.635+0000 7efe513a0640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 0x7efe4c02db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.635+0000 7efe513a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.635+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7efe4c1ce400 con 0x7efe4c02d700 2024-08-19T11:19:15.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 0x7efe4c02db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient: get_auth_request con 0x7efe4c02d700 auth_method 0 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 10 monclient(hunting): handle_auth_done global_id 104280 payload 824 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.636+0000 7efe4bfff640 1 -- 172.21.15.71:0/2407771152 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe4c0a6ab0 con 0x7efe4c02d700 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe4bfff640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 msgr2=0x7efe4c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe4bfff640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 0x7efe4c02db10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe3c010780 tx=0x7efe3c0046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7efe3c018040 con 0x7efe4c02d700 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 10 monclient: dump: 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.654 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7efe3c003610 con 0x7efe4c02d700 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 msgr2=0x7efe4c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 0x7efe4c02db10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe3c010780 tx=0x7efe3c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 msgr2=0x7efe4c02db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.638+0000 7efe48ff9640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7efe4c02d700 0x7efe4c02db10 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe3c010780 tx=0x7efe3c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 10986, 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:15.656 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.657 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:15.658 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.659 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:15.661 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:15.661 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:15.661 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:15.661 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:15.661 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:15.662 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.663 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:15.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:15.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:15.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:15.674 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.677 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:15.681 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:15.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 >> v2:172.21.15.135:6800/726754104 conn(0x7efe3803e9e0 msgr2=0x7efe38040ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 --2- 172.21.15.71:0/2407771152 >> v2:172.21.15.135:6800/726754104 conn(0x7efe3803e9e0 0x7efe38040ea0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efe40009560 tx=0x7efe40009190 comp rx=0 tx=0).stop 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 10 monclient: shutdown 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 msgr2=0x7efe4c122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 --2- 172.21.15.71:0/2407771152 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efe4c139490 0x7efe4c122320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0a56f0 tx=0x7efe44004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe50b9f640 1 -- 172.21.15.71:0/2407771152 reap_dead start 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe50b9f640 1 -- 172.21.15.71:0/2407771152 reap_dead start 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 shutdown_connections 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 >> 172.21.15.71:0/2407771152 conn(0x7efe4c0abcd0 msgr2=0x7efe4c0aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 shutdown_connections 2024-08-19T11:19:15.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.639+0000 7efe513a0640 1 -- 172.21.15.71:0/2407771152 wait complete. 2024-08-19T11:19:15.684 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:15.684 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:19:15.684 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:19:15.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=595256135}) 2024-08-19T11:19:15.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.686 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1703285134}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4075677147}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2996473419}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3076852229}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.687 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1082945458}) 2024-08-19T11:19:15.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2328021570}) 2024-08-19T11:19:15.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2146084116}) 2024-08-19T11:19:15.688 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.664+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=775019912}) 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.785+0000 7f8ff0108640 10 monclient: get_monmap_and_config 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.785+0000 7f8ff0108640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.785+0000 7f8ff0108640 10 monclient: monmap: 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:15.785662+0000 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:15.785662+0000 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:15.786 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:15.787 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.785+0000 7f8ff0108640 1 Processor -- start 2024-08-19T11:19:15.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.785+0000 7f8ff0108640 1 -- start start 2024-08-19T11:19:15.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.785+0000 7f8ff0108640 10 monclient: init 2024-08-19T11:19:15.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient: _add_conns ranks=[0,5,9,7,1,8,3,2,4,10,6] 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8fe80a6a30 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8fe80a7520 0x7f8fe80a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): picked mon.noname-h con 0x7f8fe80a7520 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8fe813ec40 0x7f8fe8141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): picked mon.noname-a con 0x7f8fe813ec40 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe80a2fc0 con 0x7f8fe80a6a30 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe80a63f0 con 0x7f8fe813ec40 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8fe80a5000 con 0x7f8fe80a7520 2024-08-19T11:19:15.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8ff0108640 10 monclient(hunting): authenticate will time out at 1213.827309s 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8fe813ec40 0x7f8fe8141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fedea4640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8fe80a6a30 0x7f8fe80a6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43704/0 (socket says 172.21.15.71:43704) 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fedea4640 1 -- 172.21.15.71:0/3855162199 learned_addr learned my addr 172.21.15.71:0/3855162199 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): get_auth_request con 0x7f8fe813ec40 auth_method 0 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fed6a3640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8fe80a7520 0x7f8fe80a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient(hunting): handle_auth_done global_id 75312 payload 274 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 1 -- 172.21.15.71:0/3855162199 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8fe80a7520 msgr2=0x7f8fe80a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8fe80a7520 0x7f8fe80a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 1 -- 172.21.15.71:0/3855162199 >> v1:172.21.15.71:6789/0 conn(0x7f8fe80a6a30 legacy=0x7f8fe80a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 1 monclient: found mon.noname-a 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fee6a5640 1 -- 172.21.15.71:0/3855162199 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe80a8590 con 0x7f8fe813ec40 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fed6a3640 10 monclient: get_auth_request con 0x7f8fe80a7520 auth_method 0 2024-08-19T11:19:15.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.786+0000 7f8fed6a3640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8fe80a7520 0x7f8fe80a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:19:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fee6a5640 1 -- 172.21.15.71:0/3855162199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fe813ec40 msgr2=0x7f8fe8141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fee6a5640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fe813ec40 0x7f8fe8141030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009d90 tx=0x7f8fe002a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3f709ddef9c627 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 1 -- 172.21.15.71:0/3855162199 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fe0007ca0 con 0x7f8fe813ec40 2024-08-19T11:19:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:15.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: dump: 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.800 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 1 -- 172.21.15.71:0/3855162199 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe0031400 con 0x7f8fe813ec40 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8ff0108640 5 monclient: authenticate success, global_id 75312 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8ff0108640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8ff0108640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 1 -- 172.21.15.71:0/3855162199 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fe0007e60 con 0x7f8fe813ec40 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8ff0108640 4 set_mon_vals no callback set 2024-08-19T11:19:15.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.789+0000 7f8fecea2640 10 monclient: dump: 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.802 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 10 monclient: shutdown 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 -- 172.21.15.71:0/3855162199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fe813ec40 msgr2=0x7f8fe8141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fe813ec40 0x7f8fe8141030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009d90 tx=0x7f8fe002a490 comp rx=0 tx=0).stop 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 -- 172.21.15.71:0/3855162199 shutdown_connections 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fe813ec40 0x7f8fe8141030 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 --2- 172.21.15.71:0/3855162199 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8fe80a7520 0x7f8fe80a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 -- 172.21.15.71:0/3855162199 >> 172.21.15.71:0/3855162199 conn(0x7f8fe80ac030 msgr2=0x7f8fe80ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 -- 172.21.15.71:0/3855162199 shutdown_connections 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 1 -- 172.21.15.71:0/3855162199 wait complete. 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.790+0000 7f8ff0108640 10 monclient: monmap: 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:15.804 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 Processor -- start 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 -- start start 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient: init 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient: _add_conns ranks=[7,8,3,2,6,4,0,5,1] 2024-08-19T11:19:15.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8fe80a6a30 0x7f8fe8123780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): picked mon.noname-i con 0x7f8fe80a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 0x7f8fe8123cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): picked mon.noname-e con 0x7f8fe80a7520 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fe813ec40 0x7f8fe8124200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): picked mon.noname-g con 0x7f8fe813ec40 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe81416f0 con 0x7f8fe813ec40 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8fe8141570 con 0x7f8fe80a6a30 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8fe8141870 con 0x7f8fe80a7520 2024-08-19T11:19:15.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8ff0108640 10 monclient(hunting): authenticate will time out at 1213.832691s 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 0x7f8fe8123cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 0x7f8fe8123cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59194/0 (socket says 172.21.15.71:59194) 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 1 -- 172.21.15.71:0/2625710739 learned_addr learned my addr 172.21.15.71:0/2625710739 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): get_auth_request con 0x7f8fe80a7520 auth_method 0 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.791+0000 7f8fed6a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fedea4640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8fe80a6a30 0x7f8fe8123780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fee6a5640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fe813ec40 0x7f8fe8124200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fedea4640 10 monclient(hunting): get_auth_request con 0x7f8fe80a6a30 auth_method 0 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fedea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fedea4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fedea4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 10 monclient(hunting): handle_auth_done global_id 94625 payload 824 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8fe80a6a30 msgr2=0x7f8fe8123780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8fe80a6a30 0x7f8fe8123780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fe813ec40 msgr2=0x7f8fe8124200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fe813ec40 0x7f8fe8124200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 1 monclient: found mon.noname-e 2024-08-19T11:19:15.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fed6a3640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe8127060 con 0x7f8fe80a7520 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fee6a5640 10 monclient: get_auth_request con 0x7f8fe813ec40 auth_method 0 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.792+0000 7f8fee6a5640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8fe813ec40 0x7f8fe8124200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fed6a3640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 msgr2=0x7f8fe8123cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fed6a3640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 0x7f8fe8123cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c7f0 tx=0x7f8fd800ccb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fd8004030 con 0x7f8fe80a7520 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:15.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: dump: 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.811 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd8004210 con 0x7f8fe80a7520 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 5 monclient: authenticate success, global_id 94625 2024-08-19T11:19:15.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 10 monclient: _renew_subs 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe81267c0 con 0x7f8fe80a7520 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fd80043c0 con 0x7f8fe80a7520 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fde7fc640 10 monclient: dump: 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.813 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.814 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8fdffff640 4 set_mon_vals no callback set 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 10 monclient: _renew_subs 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.794+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe8125a80 con 0x7f8fe80a7520 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8ff0108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8ff0108640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 0x7f8fe809ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8fe806a590 con 0x7f8fe809ea00 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 0x7f8fe809ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient: get_auth_request con 0x7f8fe809ea00 auth_method 0 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8fd8007a40 con 0x7f8fe80a7520 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 10 monclient(hunting): handle_auth_done global_id 94634 payload 824 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fedea4640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fe80a5850 con 0x7f8fe809ea00 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fde7fc640 1 --2- 172.21.15.71:0/2625710739 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fcc03ea80 0x7f8fcc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.795+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(255..255 src has 1..255) ==== 3898+0+0 (secure 0 0 0) 0x7f8fd8051da0 con 0x7f8fe80a7520 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.796+0000 7f8fee6a5640 1 --2- 172.21.15.71:0/2625710739 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fcc03ea80 0x7f8fcc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.796+0000 7f8fee6a5640 10 monclient: get_auth_request con 0x7f8fcc03ea80 auth_method 0 2024-08-19T11:19:15.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.797+0000 7f8fedea4640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 msgr2=0x7f8fe809ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.797+0000 7f8fedea4640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 0x7f8fe809ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e500 tx=0x7f8fe400e9c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fe4004e30 con 0x7f8fe809ea00 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 10 monclient: dump: 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.817 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.818 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8fe4018070 con 0x7f8fe809ea00 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 msgr2=0x7f8fe809ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 0x7f8fe809ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e500 tx=0x7f8fe400e9c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 msgr2=0x7f8fe809ede0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fde7fc640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809ea00 0x7f8fe809ede0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400e500 tx=0x7f8fe400e9c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.798+0000 7f8fee6a5640 1 --2- 172.21.15.71:0/2625710739 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fcc03ea80 0x7f8fcc040f40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0034000 tx=0x7f8fe002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8ff0108640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:15.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8ff0108640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 0x7f8fe81d87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8ff0108640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f8fe8076c60 con 0x7f8fe809f320 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 0x7f8fe81d87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient: get_auth_request con 0x7f8fe809f320 auth_method 0 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 10 monclient(hunting): handle_auth_done global_id 94643 payload 824 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.804+0000 7f8fedea4640 1 -- 172.21.15.71:0/2625710739 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8fe80ac7e0 con 0x7f8fe809f320 2024-08-19T11:19:15.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fedea4640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 msgr2=0x7f8fe81d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fedea4640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 0x7f8fe81d87d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4017000 tx=0x7f8fe4004940 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8fe4006750 con 0x7f8fe809f320 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 10 monclient: dump: 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.823 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f8fe40062e0 con 0x7f8fe809f320 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 msgr2=0x7f8fe81d87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 0x7f8fe81d87d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4017000 tx=0x7f8fe4004940 comp rx=0 tx=0).stop 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 msgr2=0x7f8fe81d87d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fde7fc640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe809f320 0x7f8fe81d87d0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4017000 tx=0x7f8fe4004940 comp rx=0 tx=0).stop 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 67504, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:15.853 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fcc03ea80 msgr2=0x7f8fcc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 --2- 172.21.15.71:0/2625710739 >> v2:172.21.15.135:6800/726754104 conn(0x7f8fcc03ea80 0x7f8fcc040f40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0034000 tx=0x7f8fe002f000 comp rx=0 tx=0).stop 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 10 monclient: shutdown 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 msgr2=0x7f8fe8123cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 --2- 172.21.15.71:0/2625710739 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f8fe80a7520 0x7f8fe8123cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c7f0 tx=0x7f8fd800ccb0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fee6a5640 1 -- 172.21.15.71:0/2625710739 reap_dead start 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8fee6a5640 1 -- 172.21.15.71:0/2625710739 reap_dead start 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 shutdown_connections 2024-08-19T11:19:15.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 >> 172.21.15.71:0/2625710739 conn(0x7f8fe80ac030 msgr2=0x7f8fe813f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 shutdown_connections 2024-08-19T11:19:15.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.807+0000 7f8ff0108640 1 -- 172.21.15.71:0/2625710739 wait complete. 2024-08-19T11:19:15.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:15.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:19:15.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=216690152}) 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2684307320}) 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1388196484}) 2024-08-19T11:19:15.882 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2409849513}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=975816524}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2221472086}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2503457527}) 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.883 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4187319939}) 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.872+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1635693282}) 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2842243803}) 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3945459989}) 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.884 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.873+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1947164774}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3502284835}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3539557881}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1360085504}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.885 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2724818579}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1652336810}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.874+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=247174734}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3258431656}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3159339761}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2534889863}) 2024-08-19T11:19:15.886 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4179356471}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3652485228}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1071308502}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2830448548}) 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.887 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500734806}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.875+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1643787387}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=692394473}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4095229975}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2274131488}) 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.888 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1057157987}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=382444133}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1247328101}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3994725960}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315211543}) 2024-08-19T11:19:15.889 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.876+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1929932700}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1844056916}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2569479063}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3739897741}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1007619298}) 2024-08-19T11:19:15.890 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=365324966}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3923896349}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3166929827}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016763441}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.877+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2254206475}) 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.891 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3491747667}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2762287136}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1423890950}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=689766928}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4225549445}) 2024-08-19T11:19:15.892 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2108211191}) 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1992639264}) 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3605684938}) 2024-08-19T11:19:15.893 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.879+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=216278298}) 2024-08-19T11:19:15.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=73191220}) 2024-08-19T11:19:15.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1458453883}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2370340006}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1719242148}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=588221337}) 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=345418965}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=959209600}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651258288}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.887+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1240929810}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2389564309}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=38265882}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3494411550}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1467830386}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1599165293}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1507920082}) 2024-08-19T11:19:15.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2654490352}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822566244}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.888+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2781091311}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1296480630}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3436672593}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=54744991}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=311543706}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2199314474}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3420504046}) 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978182215}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1606636088}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.889+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1135675584}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=753844142}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3658504439}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=744595086}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2155018451}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3904074417}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=342898964}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=501872245}) 2024-08-19T11:19:15.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627664700}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.891+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1522804453}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2485956865}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3172553679}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3323595913}) 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3171551794}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1577215493}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2910303199}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=360460776}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=798904502}) 2024-08-19T11:19:15.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.892+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=720424101}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2669363212}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3267716498}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=905937578}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2984483417}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=90432411}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3486704235}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4033880597}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3857509433}) 2024-08-19T11:19:15.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.893+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=201634719}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1490793965}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=748170405}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1404216318}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3984906937}) 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3025505472}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2817640813}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=254086381}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3254806095}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.894+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1095148407}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3675503859}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4217892455}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=664355569}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2397643489}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1751236637}) 2024-08-19T11:19:15.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1819040383}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3453628746}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883141979}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.895+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1291475473}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=368232636}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1074690434}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=894562205}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3760123180}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4157087972}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1923091642}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=206691291}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=295625288}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3578868229}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2811022773}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=163094402}) 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1038746538}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2274401685}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=544509029}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2232324893}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=808440575}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3783930213}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.897+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2413925284}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=294831095}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2220205407}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1936737168}) 2024-08-19T11:19:15.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=217462206}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=673517352}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1521004788}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812725901}) 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013600287}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3648305763}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2651067446}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1186526572}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=30581581}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2894447818}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2417630697}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2278468481}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4260684305}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2224066176}) 2024-08-19T11:19:15.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2666008525}) 2024-08-19T11:19:15.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3537242148}) 2024-08-19T11:19:15.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3575990554}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3660095011}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=249847667}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=94781363}) 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2822125412}) 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2003351841}) 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783550885}) 2024-08-19T11:19:15.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:15.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=896358637}) 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.962+0000 7fc86f048640 10 monclient: get_monmap_and_config 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.962+0000 7fc86f048640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.962+0000 7fc86f048640 10 monclient: monmap: 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:15.962715+0000 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:15.962715+0000 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:15.964 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.962+0000 7fc86f048640 1 Processor -- start 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.962+0000 7fc86f048640 1 -- start start 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.962+0000 7fc86f048640 10 monclient: init 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient: _add_conns ranks=[9,8,0,7,5,10,6,1,3,2,4] 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8680a3d80 0x7fc868136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): picked mon.noname-a con 0x7fc8680a3d80 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc868136ab0 0x7fc868136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): picked mon.noname-e con 0x7fc868136ab0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc8680a4160 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:15.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8680a24d0 con 0x7fc8680a4160 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc8680a1fa0 con 0x7fc8680a3d80 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc86809fe70 con 0x7fc868136ab0 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86f048640 10 monclient(hunting): authenticate will time out at 1214.004382s 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc8680a3d80 0x7fc868136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc868136ab0 0x7fc868136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86d5e5640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc8680a4160 0x7fc8680a4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43712/0 (socket says 172.21.15.71:43712) 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86d5e5640 1 -- 172.21.15.71:0/809226041 learned_addr learned my addr 172.21.15.71:0/809226041 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): get_auth_request con 0x7fc868136ab0 auth_method 0 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): get_auth_request con 0x7fc8680a3d80 auth_method 0 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient(hunting): handle_auth_done global_id 75321 payload 274 2024-08-19T11:19:15.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 1 -- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc868136ab0 msgr2=0x7fc868136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 1 --2- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc868136ab0 0x7fc868136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 1 -- 172.21.15.71:0/809226041 >> v1:172.21.15.71:6789/0 conn(0x7fc8680a4160 legacy=0x7fc8680a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 1 monclient: found mon.noname-a 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc86cde4640 1 -- 172.21.15.71:0/809226041 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8680a0b70 con 0x7fc8680a3d80 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.963+0000 7fc867fff640 1 --2- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc868136ab0 0x7fc868136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc86cde4640 1 -- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8680a3d80 msgr2=0x7fc868136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc86cde4640 1 --2- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8680a3d80 0x7fc868136570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009d90 tx=0x7fc85c02a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3826ea8da54733f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 1 -- 172.21.15.71:0/809226041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc85c007bc0 con 0x7fc8680a3d80 2024-08-19T11:19:15.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: dump: 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.977 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 1 -- 172.21.15.71:0/809226041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c007d80 con 0x7fc8680a3d80 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc86f048640 5 monclient: authenticate success, global_id 75321 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc86f048640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:15.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc86f048640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 1 -- 172.21.15.71:0/809226041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc85c031870 con 0x7fc8680a3d80 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc86f048640 4 set_mon_vals no callback set 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.966+0000 7fc8677fe640 10 monclient: dump: 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 10 monclient: shutdown 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 -- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8680a3d80 msgr2=0x7fc868136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 --2- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8680a3d80 0x7fc868136570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009d90 tx=0x7fc85c02a490 comp rx=0 tx=0).stop 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 -- 172.21.15.71:0/809226041 shutdown_connections 2024-08-19T11:19:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 --2- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc868136ab0 0x7fc868136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 --2- 172.21.15.71:0/809226041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8680a3d80 0x7fc868136570 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 -- 172.21.15.71:0/809226041 >> 172.21.15.71:0/809226041 conn(0x7fc8680a91d0 msgr2=0x7fc8680a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 -- 172.21.15.71:0/809226041 shutdown_connections 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.967+0000 7fc86f048640 1 -- 172.21.15.71:0/809226041 wait complete. 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 10 monclient: build_initial_monmap 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 10 monclient: monmap: 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 1 Processor -- start 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 1 -- start start 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 10 monclient: init 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:15.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.968+0000 7fc86f048640 10 monclient: _add_conns ranks=[8,1,3,5,6,0,4,7,2] 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 0x7fc868123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): picked mon.noname-e con 0x7fc8680a3d80 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8680a4160 0x7fc868120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): picked mon.noname-f con 0x7fc8680a4160 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc868136ab0 0x7fc868120fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): picked mon.noname-g con 0x7fc868136ab0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8680a08c0 con 0x7fc8680a4160 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc8681373d0 con 0x7fc868136ab0 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc8680a2ca0 con 0x7fc8680a3d80 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:15.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86f048640 10 monclient(hunting): authenticate will time out at 1214.010080s 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 0x7fc868123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 0x7fc868123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:59220/0 (socket says 172.21.15.71:59220) 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 -- 172.21.15.71:0/1418175786 learned_addr learned my addr 172.21.15.71:0/1418175786 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): get_auth_request con 0x7fc8680a3d80 auth_method 0 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc867fff640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8680a4160 0x7fc868120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86d5e5640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc868136ab0 0x7fc868120fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc867fff640 10 monclient(hunting): get_auth_request con 0x7fc8680a4160 auth_method 0 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc867fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc867fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86d5e5640 10 monclient(hunting): get_auth_request con 0x7fc868136ab0 auth_method 0 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86d5e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86d5e5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86d5e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient(hunting): handle_auth_done global_id 94661 payload 824 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc868136ab0 msgr2=0x7fc868120fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc868136ab0 0x7fc868120fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8680a4160 msgr2=0x7fc868120a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8680a4160 0x7fc868120a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient: _finish_hunting 0 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 monclient: found mon.noname-e 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86cde4640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8680a8410 con 0x7fc8680a3d80 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc86d5e5640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc868136ab0 0x7fc868120fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.969+0000 7fc867fff640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8680a4160 0x7fc868120a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86cde4640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 msgr2=0x7fc868123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86cde4640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 0x7fc868123080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009eb0 tx=0x7fc85c004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc85c0046c0 con 0x7fc8680a3d80 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: dump: 2024-08-19T11:19:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: _finish_auth 0 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: _check_auth_tickets 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 5 monclient: authenticate success, global_id 94661 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c03c420 con 0x7fc8680a3d80 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc85c03ca40 con 0x7fc8680a3d80 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc8657fa640 10 monclient: dump: 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.988 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.989 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 10 monclient: _renew_subs 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc866ffd640 4 set_mon_vals no callback set 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8680a1410 con 0x7fc8680a3d80 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 10 monclient: _renew_subs 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.971+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fc868122520 con 0x7fc8680a3d80 2024-08-19T11:19:15.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc86f048640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc86f048640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 0x7fc868070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc868076c60 con 0x7fc8681214e0 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc85c039040 con 0x7fc8680a3d80 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc867fff640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 0x7fc868070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc867fff640 10 monclient: get_auth_request con 0x7fc8681214e0 auth_method 0 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc867fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc867fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.972+0000 7fc8657fa640 1 --2- 172.21.15.71:0/1418175786 >> v2:172.21.15.135:6800/726754104 conn(0x7fc84c03ea80 0x7fc84c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(255..255 src has 1..255) ==== 3898+0+0 (secure 0 0 0) 0x7fc85c0731b0 con 0x7fc8680a3d80 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc867fff640 10 monclient(hunting): handle_auth_done global_id 84889 payload 824 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc86d5e5640 1 --2- 172.21.15.71:0/1418175786 >> v2:172.21.15.135:6800/726754104 conn(0x7fc84c03ea80 0x7fc84c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc867fff640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8681218c0 con 0x7fc8681214e0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.973+0000 7fc86d5e5640 10 monclient: get_auth_request con 0x7fc84c03ea80 auth_method 0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc867fff640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 msgr2=0x7fc868070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc867fff640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 0x7fc868070e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc868122b90 tx=0x7fc854011e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc86d5e5640 1 --2- 172.21.15.71:0/1418175786 >> v2:172.21.15.135:6800/726754104 conn(0x7fc84c03ea80 0x7fc84c040f40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8600050e0 tx=0x7fc860009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc85401f070 con 0x7fc8681214e0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc8657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc8657fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.975+0000 7fc8657fa640 10 monclient: dump: 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.992 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.993 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc85400fb50 con 0x7fc8681214e0 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 msgr2=0x7fc868070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 0x7fc868070e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc868122b90 tx=0x7fc854011e20 comp rx=0 tx=0).stop 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 msgr2=0x7fc868070e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.976+0000 7fc8657fa640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8681214e0 0x7fc868070e10 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc868122b90 tx=0x7fc854011e20 comp rx=0 tx=0).stop 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc86f048640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc86f048640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 0x7fc868071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc86f048640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc868136570 con 0x7fc868071350 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 0x7fc868071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient: get_auth_request con 0x7fc868071350 auth_method 0 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:15.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 10 monclient(hunting): handle_auth_done global_id 84898 payload 824 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.982+0000 7fc867fff640 1 -- 172.21.15.71:0/1418175786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc868135350 con 0x7fc868071350 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.984+0000 7fc867fff640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 msgr2=0x7fc868071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.984+0000 7fc867fff640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 0x7fc868071760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc854008010 tx=0x7fc8540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc85401f040 con 0x7fc868071350 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 10 monclient: dump: 2024-08-19T11:19:15.997 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:15.998 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fc85402a390 con 0x7fc868071350 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 msgr2=0x7fc868071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 0x7fc868071760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc854008010 tx=0x7fc8540046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 msgr2=0x7fc868071760 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc8657fa640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc868071350 0x7fc868071760 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc854008010 tx=0x7fc8540046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:15.999 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 138145, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:16.000 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.001 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.002 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:16.003 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.004 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:16.005 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.008 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.010 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:16.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:16.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.017 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:16.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.021 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:19:16.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:16.023 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:16.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 >> v2:172.21.15.135:6800/726754104 conn(0x7fc84c03ea80 msgr2=0x7fc84c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 --2- 172.21.15.71:0/1418175786 >> v2:172.21.15.135:6800/726754104 conn(0x7fc84c03ea80 0x7fc84c040f40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8600050e0 tx=0x7fc860009040 comp rx=0 tx=0).stop 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 10 monclient: shutdown 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 msgr2=0x7fc868123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 --2- 172.21.15.71:0/1418175786 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc8680a3d80 0x7fc868123080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009eb0 tx=0x7fc85c004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86d5e5640 1 -- 172.21.15.71:0/1418175786 reap_dead start 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86d5e5640 1 -- 172.21.15.71:0/1418175786 reap_dead start 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 shutdown_connections 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 >> 172.21.15.71:0/1418175786 conn(0x7fc8680a91d0 msgr2=0x7fc868135d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 shutdown_connections 2024-08-19T11:19:16.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:15.985+0000 7fc86f048640 1 -- 172.21.15.71:0/1418175786 wait complete. 2024-08-19T11:19:16.026 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:16.026 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:19:16.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:19:16.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2627593908}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2630914062}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=858680668}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2736096111}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2309357127}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3071240416}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2395938528}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463176264}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.014+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3701481420}) 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2382612254}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2871390864}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3948386430}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2264815672}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=99,mdsmap=1} crc {logm=1349739614,mdsmap=2062244207}) 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=97,mdsmap=3} crc {logm=3685356559,mdsmap=4204236774}) 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2810120897}) 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2457878421}) 2024-08-19T11:19:16.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.022+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4268906251}) 2024-08-19T11:19:16.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=50} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=448270464,mon_config_key=3914589959,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3347225350}) 2024-08-19T11:19:16.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.098 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=3296473344,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3519873590}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=1,mdsmap=2,mgr=7,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=52} crc {logm=1999949807,mdsmap=3140514009,mgr=909229308,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=2720761110,monmap=1080203526,osd_metadata=1098299434,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=293306366}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=2214800810}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=17,monmap=3,osd_metadata=5,osd_snap=1,osdmap=53} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=435353734,mon_config_key=2720761110,monmap=1080203526,osd_metadata=306360182,osd_snap=3823785925,osdmap=3375407071}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=49} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=2913832127}) 2024-08-19T11:19:16.099 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.100 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.100 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=1,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1057647138,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=2073886543,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=2030988187}) 2024-08-19T11:19:16.100 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.100 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=51} crc {logm=1999949807,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=441571492,monmap=2667667542,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=421676469,osdmap=3404083015}) 2024-08-19T11:19:16.100 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.095+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=1,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=50} crc {logm=1999949807,mdsmap=13535970,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2827594037,mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=3252225934,osd_snap=2639422064,osdmap=1768238316}) 2024-08-19T11:19:16.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3031169557}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4117233353}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2725081448}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3545697443}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2853663478}) 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3397752798}) 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.117+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.118+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.118+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=219946016}) 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.118+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.118+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3127541197}) 2024-08-19T11:19:16.121 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.118+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2920768373}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4193185565}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1496646857}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3670484136}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1661034330}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2136615540}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=971695565}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=4276616429}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2325202248}) 2024-08-19T11:19:16.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2888567998}) 2024-08-19T11:19:16.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1461391181}) 2024-08-19T11:19:16.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2146658029}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=340142491}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2274290592}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3790645442}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=873277470}) 2024-08-19T11:19:16.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1093101480}) 2024-08-19T11:19:16.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=260703956}) 2024-08-19T11:19:16.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=679124815}) 2024-08-19T11:19:16.141 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:16.141 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28181]: starting. 2024-08-19T11:19:16.141 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28181]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28145 2024-08-19T11:19:16.141 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28181]: shutting down. 2024-08-19T11:19:16.143 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:16.143 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:16.143 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:16.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:19:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.184+0000 7f91df484640 10 monclient: get_monmap_and_config 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.184+0000 7f91df484640 10 monclient: build_initial_monmap 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.184+0000 7f91df484640 10 monclient: monmap: 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:16.185581+0000 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:16.185581+0000 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:16.187 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.185+0000 7f91df484640 1 Processor -- start 2024-08-19T11:19:16.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.185+0000 7f91df484640 1 -- start start 2024-08-19T11:19:16.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.185+0000 7f91df484640 10 monclient: init 2024-08-19T11:19:16.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient: _add_conns ranks=[3,7,0,5,10,9,1,8,6,2,4] 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a6950 0x7f91d80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): picked mon.noname-g con 0x7f91d80a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 0x7f91d80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): picked mon.noname-i con 0x7f91d80a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91d8139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d80a6380 con 0x7f91d8139710 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91d80a5020 con 0x7f91d80a6950 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f91d80a77b0 con 0x7f91d80a57c0 2024-08-19T11:19:16.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91df484640 10 monclient(hunting): authenticate will time out at 1214.227421s 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dda21640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f91d8139710 0x7f91d8139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43720/0 (socket says 172.21.15.71:43720) 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dda21640 1 -- 172.21.15.71:0/3248768780 learned_addr learned my addr 172.21.15.71:0/3248768780 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a6950 0x7f91d80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 0x7f91d80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): get_auth_request con 0x7f91d80a6950 auth_method 0 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): get_auth_request con 0x7f91d80a57c0 auth_method 0 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient(hunting): handle_auth_done global_id 84805 payload 274 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 1 -- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a6950 msgr2=0x7f91d80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a6950 0x7f91d80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 1 -- 172.21.15.71:0/3248768780 >> v1:172.21.15.71:6789/0 conn(0x7f91d8139710 legacy=0x7f91d8139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient: _finish_hunting 0 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 1 monclient: found mon.noname-i 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:16.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dca1f640 1 -- 172.21.15.71:0/3248768780 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d80a3650 con 0x7f91d80a57c0 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.186+0000 7f91dd220640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a6950 0x7f91d80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.189+0000 7f91dca1f640 1 -- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 msgr2=0x7f91d80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.189+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 0x7f91d80a7270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009800 tx=0x7f91c8029fe0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=71b139f18de3112c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.189+0000 7f91cffff640 1 -- 172.21.15.71:0/3248768780 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91c8037070 con 0x7f91d80a57c0 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.189+0000 7f91cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: dump: 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.198 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: _finish_auth 0 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: _check_auth_tickets 2024-08-19T11:19:16.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 5 monclient: authenticate success, global_id 84805 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 1 -- 172.21.15.71:0/3248768780 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c802ad00 con 0x7f91d80a57c0 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 4 set_mon_vals no callback set 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 1 -- 172.21.15.71:0/3248768780 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91c80307b0 con 0x7f91d80a57c0 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91cffff640 10 monclient: dump: 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.200 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 10 monclient: shutdown 2024-08-19T11:19:16.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 -- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 msgr2=0x7f91d80a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 0x7f91d80a7270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009800 tx=0x7f91c8029fe0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 -- 172.21.15.71:0/3248768780 shutdown_connections 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91d80a57c0 0x7f91d80a7270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 --2- 172.21.15.71:0/3248768780 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a6950 0x7f91d80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 -- 172.21.15.71:0/3248768780 >> 172.21.15.71:0/3248768780 conn(0x7f91d80abf50 msgr2=0x7f91d80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 -- 172.21.15.71:0/3248768780 shutdown_connections 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.190+0000 7f91df484640 1 -- 172.21.15.71:0/3248768780 wait complete. 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.191+0000 7f91df484640 10 monclient: build_initial_monmap 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.191+0000 7f91df484640 10 monclient: monmap: 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:16.202 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:16.203 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.191+0000 7f91df484640 1 Processor -- start 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.191+0000 7f91df484640 1 -- start start 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.191+0000 7f91df484640 10 monclient: init 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient: _add_conns ranks=[2,1,0,6,7,4,8,5,3] 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91d80a57c0 0x7f91d8124fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): picked mon.noname-b con 0x7f91d80a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80a6950 0x7f91d81254e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): picked mon.noname-f con 0x7f91d80a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 0x7f91d8125a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): picked mon.noname-a con 0x7f91d8139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91d80a84c0 con 0x7f91d8139710 2024-08-19T11:19:16.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91d80a7d40 con 0x7f91d80a6950 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91d80a8700 con 0x7f91d80a57c0 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91df484640 10 monclient(hunting): authenticate will time out at 1214.233085s 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91d80a57c0 0x7f91d8124fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 0x7f91d8125a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91d80a57c0 0x7f91d8124fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:43284/0 (socket says 172.21.15.71:43284) 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 1 -- 172.21.15.71:0/3038657560 learned_addr learned my addr 172.21.15.71:0/3038657560 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): get_auth_request con 0x7f91d80a57c0 auth_method 0 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): get_auth_request con 0x7f91d8139710 auth_method 0 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80a6950 0x7f91d81254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dca1f640 10 monclient(hunting): get_auth_request con 0x7f91d80a6950 auth_method 0 2024-08-19T11:19:16.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dca1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dca1f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dca1f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient(hunting): handle_auth_done global_id 75339 payload 824 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91d80a57c0 msgr2=0x7f91d8124fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91d80a57c0 0x7f91d8124fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80a6950 msgr2=0x7f91d81254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80a6950 0x7f91d81254e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient: _finish_hunting 0 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 monclient: found mon.noname-a 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dda21640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d8128c60 con 0x7f91d8139710 2024-08-19T11:19:16.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80a6950 0x7f91d81254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:16.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.192+0000 7f91dd220640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91d80a57c0 0x7f91d8124fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:16.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91dda21640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 msgr2=0x7f91d8125a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91dda21640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 0x7f91d8125a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91d000be10 tx=0x7f91d000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d0011b90 con 0x7f91d8139710 2024-08-19T11:19:16.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:16.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: dump: 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.213 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: _finish_auth 0 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: _check_auth_tickets 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91df484640 5 monclient: authenticate success, global_id 75339 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d0011d70 con 0x7f91d8139710 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91df484640 10 monclient: _renew_subs 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91df484640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d80a1ee0 con 0x7f91d8139710 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:16.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d0013870 con 0x7f91d8139710 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cdffb640 10 monclient: dump: 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.215 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 10 monclient: _renew_subs 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.194+0000 7f91cf7fe640 4 set_mon_vals no callback set 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d8127df0 con 0x7f91d8139710 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 0x7f91d809fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.195+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91d806a590 con 0x7f91d809fa10 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dda21640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 0x7f91d8125a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91d000be10 tx=0x7f91d000bf00 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f91d0013400 mgrmap(e 5) 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f91d0013400 con 0x7f91d8139710 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 0x7f91d809fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient: get_auth_request con 0x7f91d809fa10 auth_method 0 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91cdffb640 1 --2- 172.21.15.71:0/3038657560 >> v2:172.21.15.135:6800/726754104 conn(0x7f91bc03ea80 0x7f91bc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 10 monclient(hunting): handle_auth_done global_id 45687 payload 824 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dd220640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91d80a6d30 con 0x7f91d809fa10 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3038657560 >> v2:172.21.15.135:6800/726754104 conn(0x7f91bc03ea80 0x7f91bc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.196+0000 7f91dca1f640 10 monclient: get_auth_request con 0x7f91bc03ea80 auth_method 0 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.198+0000 7f91dd220640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 msgr2=0x7f91d809fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.198+0000 7f91dd220640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 0x7f91d809fdf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009ed0 tx=0x7f91d400f610 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d4014cd0 con 0x7f91d809fa10 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 10 monclient: dump: 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.218 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.219 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91dca1f640 1 --2- 172.21.15.71:0/3038657560 >> v2:172.21.15.135:6800/726754104 conn(0x7f91bc03ea80 0x7f91bc040f40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f91c8034000 tx=0x7f91c802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f91d4014860 con 0x7f91d809fa10 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 msgr2=0x7f91d809fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 0x7f91d809fdf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009ed0 tx=0x7f91d400f610 comp rx=0 tx=0).stop 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 msgr2=0x7f91d809fdf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.199+0000 7f91cdffb640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d809fa10 0x7f91d809fdf0 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009ed0 tx=0x7f91d400f610 comp rx=0 tx=0).stop 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91df484640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91df484640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 0x7f91d81d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91df484640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91d8076c60 con 0x7f91d80a0330 2024-08-19T11:19:16.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 0x7f91d81d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient: get_auth_request con 0x7f91d80a0330 auth_method 0 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.206+0000 7f91dd220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.207+0000 7f91dd220640 10 monclient(hunting): handle_auth_done global_id 45696 payload 824 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.207+0000 7f91dd220640 1 -- 172.21.15.71:0/3038657560 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f91d81385a0 con 0x7f91d80a0330 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.209+0000 7f91dd220640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 msgr2=0x7f91d81d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.209+0000 7f91dd220640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 0x7f91d81d8990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91d401c000 tx=0x7f91d40046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.209+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91d40044a0 con 0x7f91d80a0330 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.209+0000 7f91cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.209+0000 7f91cdffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.209+0000 7f91cdffb640 10 monclient: dump: 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.222 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f91d4004030 con 0x7f91d80a0330 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 msgr2=0x7f91d81d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 0x7f91d81d8990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91d401c000 tx=0x7f91d40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 msgr2=0x7f91d81d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:16.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d80a0330 0x7f91d81d8990 secure :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91d401c000 tx=0x7f91d40046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 325232, 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:16.228 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:16.247 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:16.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 >> v2:172.21.15.135:6800/726754104 conn(0x7f91bc03ea80 msgr2=0x7f91bc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 --2- 172.21.15.71:0/3038657560 >> v2:172.21.15.135:6800/726754104 conn(0x7f91bc03ea80 0x7f91bc040f40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f91c8034000 tx=0x7f91c802e000 comp rx=0 tx=0).stop 2024-08-19T11:19:16.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 10 monclient: shutdown 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 msgr2=0x7f91d8125a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 --2- 172.21.15.71:0/3038657560 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91d8139710 0x7f91d8125a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91d000be10 tx=0x7f91d000bf00 comp rx=0 tx=0).stop 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91dda21640 1 -- 172.21.15.71:0/3038657560 reap_dead start 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91dda21640 1 -- 172.21.15.71:0/3038657560 reap_dead start 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91cdffb640 1 -- 172.21.15.71:0/3038657560 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(256..256 src has 1..256) ==== 3506+0+0 (unknown 0 0 0) 0x7f91d0052860 con 0x7f91d8139710 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 shutdown_connections 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 >> 172.21.15.71:0/3038657560 conn(0x7f91d80abf50 msgr2=0x7f91d8138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 shutdown_connections 2024-08-19T11:19:16.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.210+0000 7f91df484640 1 -- 172.21.15.71:0/3038657560 wait complete. 2024-08-19T11:19:16.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:16.250 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:19:16.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:19:16.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.386+0000 7fb6c69a0640 10 monclient: get_monmap_and_config 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.386+0000 7fb6c69a0640 10 monclient: build_initial_monmap 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.386+0000 7fb6c69a0640 10 monclient: monmap: 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:16.387521+0000 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:16.387521+0000 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.388 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:16.389 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:16.390 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:16.391 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:16.391 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.387+0000 7fb6c69a0640 1 Processor -- start 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.387+0000 7fb6c69a0640 1 -- start start 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.387+0000 7fb6c69a0640 10 monclient: init 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient: _add_conns ranks=[2,0,4,3,1,5,10,9,7,8,6] 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 0x7fb6c00a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): picked mon.noname-b con 0x7fb6c00a66d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:16.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb6c00a6ff0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): picked mon.noname-c con 0x7fb6c00a73d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c00a84f0 con 0x7fb6c00a6ff0 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c00a2ec0 con 0x7fb6c00a66d0 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb6c00a5570 con 0x7fb6c00a73d0 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c69a0640 10 monclient(hunting): authenticate will time out at 1214.429369s 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c519d640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb6c00a6ff0 0x7fb6c0139490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43732/0 (socket says 172.21.15.71:43732) 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c519d640 1 -- 172.21.15.71:0/47930681 learned_addr learned my addr 172.21.15.71:0/47930681 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 0x7fb6c00a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): get_auth_request con 0x7fb6c00a66d0 auth_method 0 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): get_auth_request con 0x7fb6c00a73d0 auth_method 0 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient(hunting): handle_auth_done global_id 75296 payload 274 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 1 -- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a73d0 msgr2=0x7fb6c0139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0139ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 1 -- 172.21.15.71:0/47930681 >> v1:172.21.15.71:6789/0 conn(0x7fb6c00a6ff0 legacy=0x7fb6c0139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient: _finish_hunting 0 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 1 monclient: found mon.noname-b 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c599e640 1 -- 172.21.15.71:0/47930681 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c00a4d10 con 0x7fb6c00a66d0 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.388+0000 7fb6c619f640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:16.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c599e640 1 -- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 msgr2=0x7fb6c00a6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c599e640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 0x7fb6c00a6ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009dc0 tx=0x7fb6b002a510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904992a75b550b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 1 -- 172.21.15.71:0/47930681 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6b0007bc0 con 0x7fb6c00a66d0 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: dump: 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.403 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: _finish_auth 0 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: _check_auth_tickets 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 1 -- 172.21.15.71:0/47930681 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b0007d80 con 0x7fb6c00a66d0 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c69a0640 5 monclient: authenticate success, global_id 75296 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c69a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:16.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c69a0640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 1 -- 172.21.15.71:0/47930681 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6b0031870 con 0x7fb6c00a66d0 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c69a0640 4 set_mon_vals no callback set 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.391+0000 7fb6c499c640 10 monclient: dump: 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.405 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 10 monclient: shutdown 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 -- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 msgr2=0x7fb6c00a6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 0x7fb6c00a6ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009dc0 tx=0x7fb6b002a510 comp rx=0 tx=0).stop 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 -- 172.21.15.71:0/47930681 shutdown_connections 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/47930681 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6c00a66d0 0x7fb6c00a6ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 -- 172.21.15.71:0/47930681 >> 172.21.15.71:0/47930681 conn(0x7fb6c00abcd0 msgr2=0x7fb6c00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 -- 172.21.15.71:0/47930681 shutdown_connections 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 1 -- 172.21.15.71:0/47930681 wait complete. 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 10 monclient: build_initial_monmap 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.392+0000 7fb6c69a0640 10 monclient: monmap: 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:16.407 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 Processor -- start 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 -- start start 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient: init 2024-08-19T11:19:16.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient: _add_conns ranks=[4,8,5,3,6,1,2,0,7] 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 0x7fb6c0123b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): picked mon.noname-c con 0x7fb6c00a66d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb6c00a6ff0 0x7fb6c01240c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): picked mon.noname-e con 0x7fb6c00a6ff0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0124600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): picked mon.noname-h con 0x7fb6c00a73d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb6c00a33d0 con 0x7fb6c00a66d0 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb6c00644e0 con 0x7fb6c00a73d0 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fb6c00a81e0 con 0x7fb6c00a6ff0 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c69a0640 10 monclient(hunting): authenticate will time out at 1214.434708s 2024-08-19T11:19:16.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 0x7fb6c0123b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 0x7fb6c0123b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:41636/0 (socket says 172.21.15.71:41636) 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 1 -- 172.21.15.71:0/1522026493 learned_addr learned my addr 172.21.15.71:0/1522026493 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): get_auth_request con 0x7fb6c00a66d0 auth_method 0 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb6c00a6ff0 0x7fb6c01240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): get_auth_request con 0x7fb6c00a6ff0 auth_method 0 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c599e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.393+0000 7fb6c619f640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0124600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c619f640 10 monclient(hunting): get_auth_request con 0x7fb6c00a73d0 auth_method 0 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c619f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c619f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c619f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 10 monclient(hunting): handle_auth_done global_id 84892 payload 824 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb6c00a6ff0 msgr2=0x7fb6c01240c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb6c00a6ff0 0x7fb6c01240c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a73d0 msgr2=0x7fb6c0124600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0124600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 10 monclient: _finish_hunting 0 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 1 monclient: found mon.noname-c 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c599e640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c0127c60 con 0x7fb6c00a66d0 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.394+0000 7fb6c619f640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a73d0 0x7fb6c0124600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c599e640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 msgr2=0x7fb6c0123b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c599e640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 0x7fb6c0123b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009d90 tx=0x7fb6b0004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6b0040070 con 0x7fb6c00a66d0 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: dump: 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.412 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.413 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b00046c0 con 0x7fb6c00a66d0 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 5 monclient: authenticate success, global_id 84892 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 10 monclient: _renew_subs 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c0127840 con 0x7fb6c00a66d0 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6b003c890 con 0x7fb6c00a66d0 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:16.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6be7fc640 10 monclient: dump: 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.415 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 10 monclient: _renew_subs 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6bffff640 4 set_mon_vals no callback set 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.396+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01269d0 con 0x7fb6c00a66d0 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c69a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 0x7fb6c009fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb6c0076c60 con 0x7fb6c009f9b0 2024-08-19T11:19:16.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb6b0043070 con 0x7fb6c00a66d0 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 0x7fb6c009fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient: get_auth_request con 0x7fb6c009f9b0 auth_method 0 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6be7fc640 1 --2- 172.21.15.71:0/1522026493 >> v2:172.21.15.135:6800/726754104 conn(0x7fb6ac03ea80 0x7fb6ac040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(256..256 src has 1..256) ==== 3506+0+0 (secure 0 0 0) 0x7fb6b0072f60 con 0x7fb6c00a66d0 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c619f640 1 --2- 172.21.15.71:0/1522026493 >> v2:172.21.15.135:6800/726754104 conn(0x7fb6ac03ea80 0x7fb6ac040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c619f640 10 monclient: get_auth_request con 0x7fb6ac03ea80 auth_method 0 2024-08-19T11:19:16.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.397+0000 7fb6c519d640 10 monclient(hunting): handle_auth_done global_id 45869 payload 824 2024-08-19T11:19:16.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.398+0000 7fb6c519d640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6c0125540 con 0x7fb6c009f9b0 2024-08-19T11:19:16.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6c519d640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 msgr2=0x7fb6c009fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6c519d640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 0x7fb6c009fd90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b40052d0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6c619f640 1 --2- 172.21.15.71:0/1522026493 >> v2:172.21.15.135:6800/726754104 conn(0x7fb6ac03ea80 0x7fb6ac040f40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb6c01252e0 tx=0x7fb6b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6b4013d60 con 0x7fb6c009f9b0 2024-08-19T11:19:16.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 10 monclient: dump: 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.421 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb6b40138f0 con 0x7fb6c009f9b0 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 msgr2=0x7fb6c009fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 0x7fb6c009fd90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b40052d0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 msgr2=0x7fb6c009fd90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.400+0000 7fb6be7fc640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c009f9b0 0x7fb6c009fd90 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b40052d0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.406+0000 7fb6c69a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:16.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.406+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 0x7fb6c01d8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.406+0000 7fb6c69a0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.406+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb6c00a6ab0 con 0x7fb6c00a02d0 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 0x7fb6c01d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient: get_auth_request con 0x7fb6c00a02d0 auth_method 0 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 10 monclient(hunting): handle_auth_done global_id 45878 payload 824 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.407+0000 7fb6c519d640 1 -- 172.21.15.71:0/1522026493 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6c0137180 con 0x7fb6c00a02d0 2024-08-19T11:19:16.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.409+0000 7fb6c519d640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 msgr2=0x7fb6c01d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.409+0000 7fb6c519d640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 0x7fb6c01d8710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4017000 tx=0x7fb6b4004940 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb6b401dc20 con 0x7fb6c00a02d0 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 10 monclient: dump: 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.424 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fb6b401dc20 con 0x7fb6c00a02d0 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 msgr2=0x7fb6c01d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 0x7fb6c01d8710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4017000 tx=0x7fb6b4004940 comp rx=0 tx=0).stop 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 msgr2=0x7fb6c01d8710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6be7fc640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb6c00a02d0 0x7fb6c01d8710 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4017000 tx=0x7fb6b4004940 comp rx=0 tx=0).stop 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 325432, 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:16.426 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 7, 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:16.428 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.431 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.433 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.436 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:16.437 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.438 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:16.439 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.440 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.441 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:16.442 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.443 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.444 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.445 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.447 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.448 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:19:16.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.450 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.450 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:16.450 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 >> v2:172.21.15.135:6800/726754104 conn(0x7fb6ac03ea80 msgr2=0x7fb6ac040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/1522026493 >> v2:172.21.15.135:6800/726754104 conn(0x7fb6ac03ea80 0x7fb6ac040f40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb6c01252e0 tx=0x7fb6b8008040 comp rx=0 tx=0).stop 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 10 monclient: shutdown 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 msgr2=0x7fb6c0123b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 1 --2- 172.21.15.71:0/1522026493 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb6c00a66d0 0x7fb6c0123b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009d90 tx=0x7fb6b0004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:16.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c619f640 1 -- 172.21.15.71:0/1522026493 reap_dead start 2024-08-19T11:19:16.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c619f640 1 -- 172.21.15.71:0/1522026493 reap_dead start 2024-08-19T11:19:16.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 shutdown_connections 2024-08-19T11:19:16.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.410+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 >> 172.21.15.71:0/1522026493 conn(0x7fb6c00abcd0 msgr2=0x7fb6c009d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.411+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 shutdown_connections 2024-08-19T11:19:16.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.411+0000 7fb6c69a0640 1 -- 172.21.15.71:0/1522026493 wait complete. 2024-08-19T11:19:16.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:16.452 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:19:16.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:19:16.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.549+0000 7fbc70830640 10 monclient: get_monmap_and_config 2024-08-19T11:19:16.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.549+0000 7fbc70830640 10 monclient: build_initial_monmap 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.549+0000 7fbc70830640 10 monclient: monmap: 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:16.550399+0000 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:16.550399+0000 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:16.551 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:16.552 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 Processor -- start 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 -- start start 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient: init 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient: _add_conns ranks=[3,5,4,8,9,7,1,6,2,10,0] 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): picked mon.noname-g con 0x7fbc6c0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c0a57c0 0x7fbc6c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): picked mon.noname-h con 0x7fbc6c0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:16.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 0x7fbc6c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): picked mon.noname-c con 0x7fbc6c139710 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c0a5020 con 0x7fbc6c0a6950 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbc6c0a77b0 con 0x7fbc6c139710 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbc6c0a7d40 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.550+0000 7fbc70830640 10 monclient(hunting): authenticate will time out at 1214.591964s 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 0x7fbc6c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 0x7fbc6c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:41644/0 (socket says 172.21.15.71:41644) 2024-08-19T11:19:16.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 1 -- 172.21.15.71:0/1334821709 learned_addr learned my addr 172.21.15.71:0/1334821709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): get_auth_request con 0x7fbc6c0a6950 auth_method 0 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): get_auth_request con 0x7fbc6c139710 auth_method 0 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c0a57c0 0x7fbc6c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): get_auth_request con 0x7fbc6c0a57c0 auth_method 0 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_done global_id 45705 payload 274 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 -- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c0a57c0 msgr2=0x7fbc6c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c0a57c0 0x7fbc6c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 -- 172.21.15.71:0/1334821709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 msgr2=0x7fbc6c139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 0x7fbc6c139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 monclient: found mon.noname-g 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6a59c640 1 -- 172.21.15.71:0/1334821709 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c0a6380 con 0x7fbc6c0a6950 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.551+0000 7fbc6ad9d640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 0x7fbc6c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc6a59c640 1 -- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 msgr2=0x7fbc6c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc6a59c640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c0a6d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009800 tx=0x7fbc5c029fd0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=7b9c4eae3773d0fb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 1 -- 172.21.15.71:0/1334821709 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc5c037070 con 0x7fbc6c0a6950 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: dump: 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.561 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: _finish_auth 0 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 5 monclient: authenticate success, global_id 45705 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 1 -- 172.21.15.71:0/1334821709 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c02acf0 con 0x7fbc6c0a6950 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:16.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 1 -- 172.21.15.71:0/1334821709 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc5c030c20 con 0x7fbc6c0a6950 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 4 set_mon_vals no callback set 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc69d9b640 10 monclient: dump: 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.563 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 10 monclient: shutdown 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 1 -- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 msgr2=0x7fbc6c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.554+0000 7fbc70830640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c0a6d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009800 tx=0x7fbc5c029fd0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 -- 172.21.15.71:0/1334821709 shutdown_connections 2024-08-19T11:19:16.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbc6c139710 0x7fbc6c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c0a57c0 0x7fbc6c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 --2- 172.21.15.71:0/1334821709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c0a6d30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 -- 172.21.15.71:0/1334821709 >> 172.21.15.71:0/1334821709 conn(0x7fbc6c0abf50 msgr2=0x7fbc6c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 -- 172.21.15.71:0/1334821709 shutdown_connections 2024-08-19T11:19:16.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 1 -- 172.21.15.71:0/1334821709 wait complete. 2024-08-19T11:19:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 10 monclient: build_initial_monmap 2024-08-19T11:19:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.555+0000 7fbc70830640 10 monclient: monmap: 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:16.572 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 Processor -- start 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 -- start start 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient: init 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient: _add_conns ranks=[0,2,5,1,8,6,7,4,3] 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 0x7fbc6c1d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): picked mon.noname-a con 0x7fbc6c0a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c1d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): picked mon.noname-b con 0x7fbc6c0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:16.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c139710 0x7fbc6c06fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): picked mon.noname-h con 0x7fbc6c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0a84c0 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c0a3650 con 0x7fbc6c0a6950 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbc6c0a8700 con 0x7fbc6c139710 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc70830640 10 monclient(hunting): authenticate will time out at 1214.597919s 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.556+0000 7fbc6a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 0x7fbc6c1d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c1d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 0x7fbc6c1d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41592/0 (socket says 172.21.15.71:41592) 2024-08-19T11:19:16.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 -- 172.21.15.71:0/3750074592 learned_addr learned my addr 172.21.15.71:0/3750074592 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): get_auth_request con 0x7fbc6c0a57c0 auth_method 0 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): get_auth_request con 0x7fbc6c0a6950 auth_method 0 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c139710 0x7fbc6c06fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): get_auth_request con 0x7fbc6c139710 auth_method 0 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient(hunting): handle_auth_done global_id 75348 payload 824 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c139710 msgr2=0x7fbc6c06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbc6c139710 0x7fbc6c06fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc6c0a6950 msgr2=0x7fbc6c1d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c1d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 monclient: found mon.noname-a 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc6a59c640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c0a2470 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.557+0000 7fbc61d9b640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbc6c0a6950 0x7fbc6c1d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc6a59c640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 msgr2=0x7fbc6c1d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc6a59c640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 0x7fbc6c1d24b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c035040 tx=0x7fbc5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc5c037040 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: dump: 2024-08-19T11:19:16.577 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.578 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 5 monclient: authenticate success, global_id 75348 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c042070 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 10 monclient: _renew_subs 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c073770 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc5c0328b0 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc6959a640 4 set_mon_vals no callback set 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc637fe640 10 monclient: dump: 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.580 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 10 monclient: _renew_subs 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.559+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c071410 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.560+0000 7fbc70830640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.560+0000 7fbc70830640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 0x7fbc6c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.560+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.560+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fbc6c13a400 con 0x7fbc6c1d3120 2024-08-19T11:19:16.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.560+0000 7fbc61d9b640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 0x7fbc6c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient: get_auth_request con 0x7fbc6c1d3120 auth_method 0 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbc5c032440 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_done global_id 84823 payload 824 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc61d9b640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc6c0a6d30 con 0x7fbc6c1d3120 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc637fe640 1 --2- 172.21.15.71:0/3750074592 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc4c03ea80 0x7fbc4c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(256..256 src has 1..256) ==== 3506+0+0 (secure 0 0 0) 0x7fbc5c0717d0 con 0x7fbc6c0a57c0 2024-08-19T11:19:16.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc6ad9d640 1 --2- 172.21.15.71:0/3750074592 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc4c03ea80 0x7fbc4c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.561+0000 7fbc6ad9d640 10 monclient: get_auth_request con 0x7fbc4c03ea80 auth_method 0 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc61d9b640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 msgr2=0x7fbc6c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc61d9b640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 0x7fbc6c02d1c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc54011cf0 tx=0x7fbc5400f610 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc54019070 con 0x7fbc6c1d3120 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc637fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc637fe640 10 monclient: dump: 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.583 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.563+0000 7fbc6ad9d640 1 --2- 172.21.15.71:0/3750074592 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc4c03ea80 0x7fbc4c040f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc640072e0 tx=0x7fbc6400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbc54004240 con 0x7fbc6c1d3120 2024-08-19T11:19:16.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 msgr2=0x7fbc6c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 0x7fbc6c02d1c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc54011cf0 tx=0x7fbc5400f610 comp rx=0 tx=0).stop 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 msgr2=0x7fbc6c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.564+0000 7fbc637fe640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c1d3120 0x7fbc6c02d1c0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc54011cf0 tx=0x7fbc5400f610 comp rx=0 tx=0).stop 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc70830640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc70830640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 0x7fbc6c02db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc70830640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fbc6c076c60 con 0x7fbc6c02d700 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 0x7fbc6c02db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient: get_auth_request con 0x7fbc6c02d700 auth_method 0 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 10 monclient(hunting): handle_auth_done global_id 84832 payload 824 2024-08-19T11:19:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.570+0000 7fbc61d9b640 1 -- 172.21.15.71:0/3750074592 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbc6c09e100 con 0x7fbc6c02d700 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.572+0000 7fbc61d9b640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 msgr2=0x7fbc6c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.572+0000 7fbc61d9b640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 0x7fbc6c02db10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc5401b000 tx=0x7fbc540046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbc54019040 con 0x7fbc6c02d700 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 10 monclient: dump: 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:16.587 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:16.588 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fbc5401e950 con 0x7fbc6c02d700 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 msgr2=0x7fbc6c02db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 0x7fbc6c02db10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc5401b000 tx=0x7fbc540046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 msgr2=0x7fbc6c02db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc637fe640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbc6c02d700 0x7fbc6c02db10 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc5401b000 tx=0x7fbc540046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:16.589 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 176, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 138733, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:19:16.590 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 7, 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.591 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.592 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:16.593 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:16.594 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:16.595 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.596 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:16.598 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:16.601 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:16.602 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.605 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.606 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:16.607 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:16.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:16.612 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:16.613 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:16.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=32} crc {osdmap=636176692}) 2024-08-19T11:19:16.614 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=31} crc {osdmap=3653380199}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=32} crc {osdmap=419486366}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=33} crc {osdmap=4050263282}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=32} crc {osdmap=1445275999}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.615 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=32} crc {osdmap=1503670254}) 2024-08-19T11:19:16.616 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.616 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.616 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=31} crc {osdmap=4145713843}) 2024-08-19T11:19:16.616 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:19:16.616 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=33} crc {osdmap=947378192}) 2024-08-19T11:19:16.616 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:19:16.573+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=31} crc {osdmap=2405483219}) 2024-08-19T11:19:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc4c03ea80 msgr2=0x7fbc4c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 --2- 172.21.15.71:0/3750074592 >> v2:172.21.15.135:6800/726754104 conn(0x7fbc4c03ea80 0x7fbc4c040f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc640072e0 tx=0x7fbc6400b040 comp rx=0 tx=0).stop 2024-08-19T11:19:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 10 monclient: shutdown 2024-08-19T11:19:16.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 msgr2=0x7fbc6c1d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 0x7fbc6c1d24b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c035040 tx=0x7fbc5c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc6ad9d640 1 -- 172.21.15.71:0/3750074592 reap_dead start 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 shutdown_connections 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 --2- 172.21.15.71:0/3750074592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc6c0a57c0 0x7fbc6c1d24b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 >> 172.21.15.71:0/3750074592 conn(0x7fbc6c0abf50 msgr2=0x7fbc6c0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 shutdown_connections 2024-08-19T11:19:16.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:16.573+0000 7fbc70830640 1 -- 172.21.15.71:0/3750074592 wait complete. 2024-08-19T11:19:16.618 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:19:16.619 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e'] 2024-08-19T11:19:16.619 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['d', 'i'] 2024-08-19T11:19:16.619 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-19T11:19:16.619 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-19T11:19:16.619 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-19T11:19:16.619 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:19:16.631 INFO:tasks.ceph.mon.e:Stopped 2024-08-19T11:19:16.631 INFO:tasks.mon_thrash:Sending STOP to mon d 2024-08-19T11:19:16.631 INFO:tasks.ceph.mon.d:Sent signal 19 2024-08-19T11:19:16.631 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-08-19T11:19:16.631 INFO:tasks.ceph.mon.i:Sent signal 19 2024-08-19T11:19:16.632 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:19:31.633 INFO:tasks.mon_thrash:Sending CONT to mon d 2024-08-19T11:19:31.633 INFO:tasks.ceph.mon.d:Sent signal 18 2024-08-19T11:19:31.633 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-08-19T11:19:31.634 INFO:tasks.ceph.mon.i:Sent signal 18 2024-08-19T11:19:31.634 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-19T11:19:31.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.742+0000 7f7607386640 10 monclient: get_monmap_and_config 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.742+0000 7f7607386640 10 monclient: build_initial_monmap 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.743+0000 7f7607386640 10 monclient: monmap: 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:31.743627+0000 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:31.743627+0000 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:31.744 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:31.745 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:31.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.743+0000 7f7607386640 1 Processor -- start 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.743+0000 7f7607386640 1 -- start start 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.743+0000 7f7607386640 10 monclient: init 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient: _add_conns ranks=[3,9,7,6,5,0,4,8,10,1,2] 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): picked mon.noname-g con 0x7f76000a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): picked mon.noname-a con 0x7f76000a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): picked mon.noname-i con 0x7f7600139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:31.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f76000a4f90 con 0x7f76000a6e10 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f76000a6380 con 0x7f76000a6a30 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f76000a49d0 con 0x7f7600139860 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7607386640 10 monclient(hunting): authenticate will time out at 1229.785447s 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46692/0 (socket says 172.21.15.71:46692) 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 learned_addr learned my addr 172.21.15.71:0/1219643246 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f76000a6e10 auth_method 0 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:31.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f76000a6a30 auth_method 0 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f7600139860 auth_method 0 2024-08-19T11:19:31.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605923640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.744+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.745+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:31.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.745+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:31.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f76000a6e10 auth_method 0 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:31.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f76000a6a30 auth_method 0 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:31.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.945+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f7600139860 auth_method 0 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:31.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:31.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:31.946+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f76000a6e10 auth_method 0 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f76000a6a30 auth_method 0 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.346+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f7600139860 auth_method 0 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:32.347+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:19:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:33.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f76000a6a30 auth_method 0 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f76000a6e10 auth_method 0 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:19:33.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:33.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:33.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:33.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.147+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f7600139860 auth_method 0 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:33.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:33.148+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:19:34.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): tick 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 msgr2=0x7f7600139cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7600139860 0x7f7600139cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 msgr2=0x7f76000a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76000a6a30 0x7f76000a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 msgr2=0x7f76000a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.71:3300/0 conn(0x7f76000a6e10 0x7f76000a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient: _add_conns ranks=[2,10,5,0,1,6,4,8] 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f75ec003820 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:34.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): picked mon.noname-f con 0x7f75ec006230 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f75ec008d20 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f76000a4f90 con 0x7f75ec006230 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f76000a6380 con 0x7f75ec003820 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f76000a49d0 con 0x7f75ec008d20 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f75f6ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f75ec003820 auth_method 0 2024-08-19T11:19:34.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.744+0000 7f7605122640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f75ec006230 auth_method 0 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:34.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f75ec008d20 auth_method 0 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:34.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.745+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:34.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.946+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.946+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f75ec003820 auth_method 0 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.946+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.946+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.946+0000 7f7605122640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f75ec008d20 auth_method 0 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:34.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f75ec006230 auth_method 0 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:34.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:19:34.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:34.947+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.348+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f75ec003820 auth_method 0 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:35.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f75ec006230 auth_method 0 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f75ec008d20 auth_method 0 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:19:35.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:19:35.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:35.349+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:19:36.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 10 monclient(hunting): get_auth_request con 0x7f75ec003820 auth_method 0 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605122640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f75ec008d20 auth_method 0 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:36.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f75ec006230 auth_method 0 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:36.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:36.150+0000 7f7604921640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:19:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): tick 2024-08-19T11:19:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:19:37.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 monclient(hunting): continuing hunt 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 msgr2=0x7f75ec00b1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f75ec008d20 0x7f75ec00b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 msgr2=0x7f75ec005c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75ec003820 0x7f75ec005c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 msgr2=0x7f75ec0086c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> v2:172.21.15.135:3300/0 conn(0x7f75ec006230 0x7f75ec0086c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 reap_dead start 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 reap_dead start 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient: _add_conns ranks=[1,0,6,4,8] 2024-08-19T11:19:37.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f75ec0066b0 addr v1:172.21.15.135:6789/0 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f75ec005340 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f75ec00ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): picked mon.noname-d con 0x7f75ec00b160 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76000a46f0 con 0x7f75ec005340 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec005ee0 con 0x7f75ec0066b0 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 1 -- 172.21.15.71:0/1219643246 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f76000a4f90 con 0x7f75ec00b160 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f75f6ffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f75ec00ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f75ec00b160 auth_method 0 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:37.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient(hunting): handle_auth_done global_id 104298 payload 274 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> v1:172.21.15.135:6789/0 conn(0x7f75ec0066b0 legacy=0x7f75ec003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> v1:172.21.15.71:6789/0 conn(0x7f75ec005340 legacy=0x7f75ec0057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient: _finish_hunting 0 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 monclient: found mon.noname-d 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:37.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.745+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec011390 con 0x7f75ec00b160 2024-08-19T11:19:37.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.748+0000 7f7605923640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 msgr2=0x7f75ec00ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:37.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.748+0000 7f7605923640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f75ec00ee30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0034f0 tx=0x7f75f802c1d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=3fdb77714390601c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:37.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 1 -- 172.21.15.71:0/1219643246 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f75f8032070 con 0x7f75ec00b160 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: dump: 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:37.757 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: _finish_auth 0 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: _check_auth_tickets 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 1 -- 172.21.15.71:0/1219643246 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f8036870 con 0x7f75ec00b160 2024-08-19T11:19:37.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f7607386640 5 monclient: authenticate success, global_id 104298 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f7607386640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f7607386640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 1 -- 172.21.15.71:0/1219643246 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f75f80353b0 con 0x7f75ec00b160 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f7607386640 4 set_mon_vals no callback set 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.749+0000 7f75f7fff640 10 monclient: dump: 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.759 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 10 monclient: shutdown 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:37.760 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 -- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 msgr2=0x7f75ec00ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f75ec00ee30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0034f0 tx=0x7f75f802c1d0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 -- 172.21.15.71:0/1219643246 shutdown_connections 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 --2- 172.21.15.71:0/1219643246 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f75ec00ee30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 -- 172.21.15.71:0/1219643246 >> 172.21.15.71:0/1219643246 conn(0x7f76000ac030 msgr2=0x7f76000ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 -- 172.21.15.71:0/1219643246 shutdown_connections 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.750+0000 7f7607386640 1 -- 172.21.15.71:0/1219643246 wait complete. 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.751+0000 7f7607386640 10 monclient: build_initial_monmap 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.751+0000 7f7607386640 10 monclient: monmap: 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:37.761 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.751+0000 7f7607386640 1 Processor -- start 2024-08-19T11:19:37.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.751+0000 7f7607386640 1 -- start start 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.751+0000 7f7607386640 10 monclient: init 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient: _add_conns ranks=[8,4,6,0,7,5,1,3,2] 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75ec005340 0x7f76001cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): picked mon.noname-e con 0x7f75ec005340 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 0x7f7600138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): picked mon.noname-c con 0x7f75ec0066b0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f7600139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): picked mon.noname-d con 0x7f75ec00b160 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f76000a5b80 con 0x7f75ec0066b0 2024-08-19T11:19:37.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f76000a5a00 con 0x7f75ec00b160 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f76000a5d00 con 0x7f75ec005340 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7607386640 10 monclient(hunting): authenticate will time out at 1235.793128s 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605122640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75ec005340 msgr2=0x7f76001cdde0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605122640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75ec005340 0x7f76001cdde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 0x7f7600138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 0x7f7600138b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:43870/0 (socket says 172.21.15.71:43870) 2024-08-19T11:19:37.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 -- 172.21.15.71:0/3270072870 learned_addr learned my addr 172.21.15.71:0/3270072870 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f7600139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): get_auth_request con 0x7f75ec0066b0 auth_method 0 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): get_auth_request con 0x7f75ec00b160 auth_method 0 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:37.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient(hunting): handle_auth_done global_id 84910 payload 824 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 -- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75ec005340 msgr2=0x7f76001cdde0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75ec005340 0x7f76001cdde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 -- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 msgr2=0x7f7600139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f7600139080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient: _finish_hunting 0 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 monclient: found mon.noname-c 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:37.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7604921640 1 -- 172.21.15.71:0/3270072870 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7600125c60 con 0x7f75ec0066b0 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.752+0000 7f7605923640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f7600139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.754+0000 7f7604921640 1 -- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 msgr2=0x7f7600138b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.754+0000 7f7604921640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 0x7f7600138b40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f75f0019fd0 tx=0x7f75f0016c20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f75f0027070 con 0x7f75ec0066b0 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: dump: 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:37.767 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: _finish_auth 0 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 5 monclient: authenticate success, global_id 84910 2024-08-19T11:19:37.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f0016e70 con 0x7f75ec0066b0 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f75f000f040 con 0x7f75ec0066b0 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 10 monclient: _renew_subs 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760013a010 con 0x7f75ec0066b0 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f77fe640 4 set_mon_vals no callback set 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f75f5ffb640 10 monclient: dump: 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:37.769 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:37.770 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:37.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 10 monclient: _renew_subs 2024-08-19T11:19:37.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:37.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.755+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7600126500 con 0x7f75ec0066b0 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.756+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f75f00173e0 con 0x7f75ec0066b0 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.756+0000 7f7607386640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.756+0000 7f7607386640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.756+0000 7f7607386640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.756+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76000a6050 con 0x7f75ec0066b0 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.756+0000 7f75f5ffb640 1 --2- 172.21.15.71:0/3270072870 >> v2:172.21.15.135:6800/726754104 conn(0x7f75ec040ec0 0x7f75ec043380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.757+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(257..257 src has 1..257) ==== 3898+0+0 (secure 0 0 0) 0x7f75f001f070 con 0x7f75ec0066b0 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.757+0000 7f7605122640 1 --2- 172.21.15.71:0/3270072870 >> v2:172.21.15.135:6800/726754104 conn(0x7f75ec040ec0 0x7f75ec043380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:37.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.757+0000 7f7605122640 10 monclient: get_auth_request con 0x7f75ec040ec0 auth_method 0 2024-08-19T11:19:37.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.760+0000 7f7605122640 1 --2- 172.21.15.71:0/3270072870 >> v2:172.21.15.135:6800/726754104 conn(0x7f75ec040ec0 0x7f75ec043380 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f75fc006fd0 tx=0x7f75fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:37.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.762+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f76000a6050 con 0x7f75ec0066b0 2024-08-19T11:19:37.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.762+0000 7f75f5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:37.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:37.762+0000 7f75f5ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:37.929 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: starting. 2024-08-19T11:19:37.929 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28248 2024-08-19T11:19:37.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: created object 0... 2024-08-19T11:19:37.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: created object 25... 2024-08-19T11:19:37.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: created object 49... 2024-08-19T11:19:37.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: finishing. 2024-08-19T11:19:37.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28249]: shutting down. 2024-08-19T11:19:38.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f7607386640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:19:38.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f7607386640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f7607386640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f76000a71f0 con 0x7f75ec0066b0 2024-08-19T11:19:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f75f5ffb640 1 -- 172.21.15.71:0/3270072870 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7f75f0030080 con 0x7f75ec0066b0 2024-08-19T11:19:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f75f5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:19:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.029+0000 7f75f5ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:38.031 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":182,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:19:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.031+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 >> v2:172.21.15.135:6800/726754104 conn(0x7f75ec040ec0 msgr2=0x7f75ec043380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 --2- 172.21.15.71:0/3270072870 >> v2:172.21.15.135:6800/726754104 conn(0x7f75ec040ec0 0x7f75ec043380 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f75fc006fd0 tx=0x7f75fc008040 comp rx=0 tx=0).stop 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 10 monclient: shutdown 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 msgr2=0x7f7600138b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 0x7f7600138b40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f75f0019fd0 tx=0x7f75f0016c20 comp rx=0 tx=0).stop 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 shutdown_connections 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 --2- 172.21.15.71:0/3270072870 >> v2:172.21.15.135:6800/726754104 conn(0x7f75ec040ec0 0x7f75ec043380 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f75ec00b160 0x7f7600139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f75ec0066b0 0x7f7600138b40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 --2- 172.21.15.71:0/3270072870 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f75ec005340 0x7f76001cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 >> 172.21.15.71:0/3270072870 conn(0x7f76000ac030 msgr2=0x7f76000ab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 shutdown_connections 2024-08-19T11:19:38.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.032+0000 7f7607386640 1 -- 172.21.15.71:0/3270072870 wait complete. 2024-08-19T11:19:38.043 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-19T11:19:38.044 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-19T11:19:38.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:19:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.141+0000 7f1302d41640 10 monclient: get_monmap_and_config 2024-08-19T11:19:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.141+0000 7f1302d41640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.141+0000 7f1302d41640 10 monclient: monmap: 2024-08-19T11:19:38.142 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:38.142159+0000 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:38.142159+0000 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.143 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.144 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.144 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:38.144 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:38.144 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 Processor -- start 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 -- start start 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient: init 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient: _add_conns ranks=[8,5,10,4,3,7,0,9,1,6,2] 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc0a6950 0x7f12fc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): picked mon.noname-e con 0x7f12fc0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 0x7f12fc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): picked mon.noname-h con 0x7f12fc0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f12fc139710 0x7f12fc139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): picked mon.noname-f con 0x7f12fc139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f12fc0a5020 con 0x7f12fc139710 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f12fc0a77b0 con 0x7f12fc0a57c0 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f12fc0a7d40 con 0x7f12fc0a6950 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1302d41640 10 monclient(hunting): authenticate will time out at 1236.183790s 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1300add640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc0a6950 msgr2=0x7f12fc0a6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.142+0000 7f1300add640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc0a6950 0x7f12fc0a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 0x7f12fc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f12fc139710 0x7f12fc139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 0x7f12fc0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:42114/0 (socket says 172.21.15.71:42114) 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 1 -- 172.21.15.71:0/2675190070 learned_addr learned my addr 172.21.15.71:0/2675190070 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): get_auth_request con 0x7f12fc0a57c0 auth_method 0 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): get_auth_request con 0x7f12fc139710 auth_method 0 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient(hunting): handle_auth_done global_id 84934 payload 274 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 -- 172.21.15.71:0/2675190070 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc0a6950 msgr2=0x7f12fc0a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc0a6950 0x7f12fc0a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 -- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 msgr2=0x7f12fc0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 0x7f12fc0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 monclient: found mon.noname-f 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:19:38.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f13012de640 1 -- 172.21.15.71:0/2675190070 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc0a6380 con 0x7f12fc139710 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.143+0000 7f12fbfff640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 0x7f12fc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f13012de640 1 -- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc139710 msgr2=0x7f12fc139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f13012de640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc139710 0x7f12fc139b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009dc0 tx=0x7f12f402a500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c835298b15ed37 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 1 -- 172.21.15.71:0/2675190070 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f4007bc0 con 0x7f12fc139710 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: dump: 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.155 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 1 -- 172.21.15.71:0/2675190070 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f4007d80 con 0x7f12fc139710 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 1 -- 172.21.15.71:0/2675190070 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f4031870 con 0x7f12fc139710 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f12fb7fe640 10 monclient: dump: 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 5 monclient: authenticate success, global_id 84934 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 4 set_mon_vals no callback set 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 10 monclient: shutdown 2024-08-19T11:19:38.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 1 -- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc139710 msgr2=0x7f12fc139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.146+0000 7f1302d41640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc139710 0x7f12fc139b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009dc0 tx=0x7f12f402a500 comp rx=0 tx=0).stop 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 -- 172.21.15.71:0/2675190070 shutdown_connections 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc139710 0x7f12fc139b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f12fc0a57c0 0x7f12fc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 --2- 172.21.15.71:0/2675190070 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc0a6950 0x7f12fc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 -- 172.21.15.71:0/2675190070 >> 172.21.15.71:0/2675190070 conn(0x7f12fc0abf50 msgr2=0x7f12fc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 -- 172.21.15.71:0/2675190070 shutdown_connections 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 1 -- 172.21.15.71:0/2675190070 wait complete. 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.147+0000 7f1302d41640 10 monclient: monmap: 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:38.159 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.160 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 Processor -- start 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 -- start start 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient: init 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient: _add_conns ranks=[3,1,8,0,6,7,2,5,4] 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12fc0a57c0 0x7f12fc138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): picked mon.noname-g con 0x7f12fc0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc0a6950 0x7f12fc138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): picked mon.noname-f con 0x7f12fc0a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc139710 0x7f12fc1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): picked mon.noname-e con 0x7f12fc139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc0a84c0 con 0x7f12fc0a6950 2024-08-19T11:19:38.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f12fc0a3650 con 0x7f12fc0a57c0 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f12fc0a8700 con 0x7f12fc139710 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1302d41640 10 monclient(hunting): authenticate will time out at 1236.189733s 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f13012de640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc139710 msgr2=0x7f12fc1225a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f13012de640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc139710 0x7f12fc1225a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.148+0000 7f1300add640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12fc0a57c0 0x7f12fc138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc0a6950 0x7f12fc138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12fc0a57c0 0x7f12fc138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:34940/0 (socket says 172.21.15.71:34940) 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 1 -- 172.21.15.71:0/3239452310 learned_addr learned my addr 172.21.15.71:0/3239452310 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): get_auth_request con 0x7f12fc0a57c0 auth_method 0 2024-08-19T11:19:38.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): get_auth_request con 0x7f12fc0a6950 auth_method 0 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient(hunting): handle_auth_done global_id 84943 payload 824 2024-08-19T11:19:38.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc139710 msgr2=0x7f12fc1225a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f12fc139710 0x7f12fc1225a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12fc0a57c0 msgr2=0x7f12fc138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12fc0a57c0 0x7f12fc138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 monclient: found mon.noname-f 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f12fbfff640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc125b30 con 0x7f12fc0a6950 2024-08-19T11:19:38.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.149+0000 7f1300add640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12fc0a57c0 0x7f12fc138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12fbfff640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc0a6950 msgr2=0x7f12fc138f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12fbfff640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc0a6950 0x7f12fc138f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e900 tx=0x7f12e800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12e80044a0 con 0x7f12fc0a6950 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: dump: 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e800cc10 con 0x7f12fc0a6950 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12e800cdc0 con 0x7f12fc0a6950 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12f97fa640 10 monclient: dump: 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f1302d41640 5 monclient: authenticate success, global_id 84943 2024-08-19T11:19:38.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f12faffd640 4 set_mon_vals no callback set 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f1302d41640 10 monclient: _renew_subs 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f1302d41640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.151+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12fc0a1dd0 con 0x7f12fc0a6950 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 10 monclient: _renew_subs 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12fc124070 con 0x7f12fc0a6950 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 0x7f12fc02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc076c60 con 0x7f12fc1ce4a0 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 0x7f12fc02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient: get_auth_request con 0x7f12fc1ce4a0 auth_method 0 2024-08-19T11:19:38.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f12e8004030 con 0x7f12fc0a6950 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.152+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.153+0000 7f1300add640 10 monclient(hunting): handle_auth_done global_id 75357 payload 824 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.153+0000 7f1300add640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12fc0a6d30 con 0x7f12fc1ce4a0 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.153+0000 7f12f97fa640 1 --2- 172.21.15.71:0/3239452310 >> v2:172.21.15.135:6800/726754104 conn(0x7f12e003ea80 0x7f12e0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.153+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(258..258 src has 1..258) ==== 3898+0+0 (secure 0 0 0) 0x7f12e800f040 con 0x7f12fc0a6950 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.153+0000 7f13012de640 1 --2- 172.21.15.71:0/3239452310 >> v2:172.21.15.135:6800/726754104 conn(0x7f12e003ea80 0x7f12e0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.153+0000 7f13012de640 10 monclient: get_auth_request con 0x7f12e003ea80 auth_method 0 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f1300add640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 msgr2=0x7f12fc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f1300add640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 0x7f12fc02d1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f12f00053c0 tx=0x7f12f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f0016070 con 0x7f12fc1ce4a0 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 10 monclient: dump: 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.175 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f12f000ede0 con 0x7f12fc1ce4a0 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 msgr2=0x7f12fc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 0x7f12fc02d1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f12f00053c0 tx=0x7f12f0005880 comp rx=0 tx=0).stop 2024-08-19T11:19:38.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 msgr2=0x7f12fc02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f12f97fa640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc1ce4a0 0x7f12fc02d1c0 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f12f00053c0 tx=0x7f12f0005880 comp rx=0 tx=0).stop 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.155+0000 7f13012de640 1 --2- 172.21.15.71:0/3239452310 >> v2:172.21.15.135:6800/726754104 conn(0x7f12e003ea80 0x7f12e0040f40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f12fc074f90 tx=0x7f12f402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1302d41640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1302d41640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 0x7f12fc02dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1302d41640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc09e100 con 0x7f12fc02d700 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1300add640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 0x7f12fc02dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1300add640 10 monclient: get_auth_request con 0x7f12fc02d700 auth_method 0 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1300add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1300add640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.161+0000 7f1300add640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.162+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.162+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.162+0000 7f1300add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.162+0000 7f1300add640 10 monclient(hunting): handle_auth_done global_id 75366 payload 824 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.162+0000 7f1300add640 1 -- 172.21.15.71:0/3239452310 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12fc06ca70 con 0x7f12fc02d700 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f1300add640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 msgr2=0x7f12fc02dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f1300add640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 0x7f12fc02dae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f12f0018000 tx=0x7f12f00059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f12f0016040 con 0x7f12fc02d700 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 10 monclient: dump: 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.178 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9426 (secure 0 0 0) 0x7f12f001b660 con 0x7f12fc02d700 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:38.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 msgr2=0x7f12fc02dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 0x7f12fc02dae0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f12f0018000 tx=0x7f12f00059d0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 msgr2=0x7f12fc02dae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.164+0000 7f12f97fa640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12fc02d700 0x7f12fc02dae0 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f12f0018000 tx=0x7f12f00059d0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:38.180 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 227196, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:38.181 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.182 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:38.184 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.185 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:38.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.187 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:38.189 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.192 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:38.194 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.197 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:38.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.201 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.202 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:38.203 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 >> v2:172.21.15.135:6800/726754104 conn(0x7f12e003ea80 msgr2=0x7f12e0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 --2- 172.21.15.71:0/3239452310 >> v2:172.21.15.135:6800/726754104 conn(0x7f12e003ea80 0x7f12e0040f40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f12fc074f90 tx=0x7f12f402f000 comp rx=0 tx=0).stop 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 10 monclient: shutdown 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc0a6950 msgr2=0x7f12fc138f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 --2- 172.21.15.71:0/3239452310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12fc0a6950 0x7f12fc138f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f12e800e900 tx=0x7f12e800edc0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f13012de640 1 -- 172.21.15.71:0/3239452310 reap_dead start 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f13012de640 1 -- 172.21.15.71:0/3239452310 reap_dead start 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 shutdown_connections 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 >> 172.21.15.71:0/3239452310 conn(0x7f12fc0abf50 msgr2=0x7f12fc0aaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 shutdown_connections 2024-08-19T11:19:38.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.165+0000 7f1302d41640 1 -- 172.21.15.71:0/3239452310 wait complete. 2024-08-19T11:19:38.206 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:38.206 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-19T11:19:38.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.304+0000 7f3f3a4cc640 10 monclient: get_monmap_and_config 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.304+0000 7f3f3a4cc640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.304+0000 7f3f3a4cc640 10 monclient: monmap: 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:38.304703+0000 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:38.304703+0000 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:38.305 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:38.306 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.304+0000 7f3f3a4cc640 1 Processor -- start 2024-08-19T11:19:38.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.304+0000 7f3f3a4cc640 1 -- start start 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.304+0000 7f3f3a4cc640 10 monclient: init 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient: _add_conns ranks=[4,0,5,6,9,10,7,1,8,3,2] 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 0x7f3f34136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): picked mon.noname-c con 0x7f3f340a3d80 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3f34136ab0 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3f34136e90 0x7f3f340a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): picked mon.noname-h con 0x7f3f34136e90 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f340a24d0 con 0x7f3f34136ab0 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3f340a1fa0 con 0x7f3f340a3d80 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3f3409fe70 con 0x7f3f34136e90 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f3a4cc640 10 monclient(hunting): authenticate will time out at 1236.346439s 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f337fe640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3f34136ab0 0x7f3f340a4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47018/0 (socket says 172.21.15.71:47018) 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 0x7f3f34136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f337fe640 1 -- 172.21.15.71:0/1575540470 learned_addr learned my addr 172.21.15.71:0/1575540470 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): get_auth_request con 0x7f3f340a3d80 auth_method 0 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f38a69640 1 --2- 172.21.15.71:0/1575540470 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3f34136e90 0x7f3f340a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f38a69640 10 monclient(hunting): get_auth_request con 0x7f3f34136e90 auth_method 0 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f38a69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f38a69640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f38a69640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient(hunting): handle_auth_done global_id 84919 payload 274 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 1 -- 172.21.15.71:0/1575540470 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3f34136e90 msgr2=0x7f3f340a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1575540470 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3f34136e90 0x7f3f340a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 1 -- 172.21.15.71:0/1575540470 >> v1:172.21.15.71:6789/0 conn(0x7f3f34136ab0 legacy=0x7f3f340a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 1 monclient: found mon.noname-c 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:38.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.305+0000 7f3f33fff640 1 -- 172.21.15.71:0/1575540470 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f340a0b70 con 0x7f3f340a3d80 2024-08-19T11:19:38.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f33fff640 1 -- 172.21.15.71:0/1575540470 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 msgr2=0x7f3f34136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1575540470 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 0x7f3f34136570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f240097d0 tx=0x7f3f24029fb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=b6dc463a939f052b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 1 -- 172.21.15.71:0/1575540470 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f24037070 con 0x7f3f340a3d80 2024-08-19T11:19:38.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: dump: 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.319 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 1 -- 172.21.15.71:0/1575540470 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2402ad10 con 0x7f3f340a3d80 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f3a4cc640 5 monclient: authenticate success, global_id 84919 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f3a4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f3a4cc640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:38.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 1 -- 172.21.15.71:0/1575540470 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f24030c20 con 0x7f3f340a3d80 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f3a4cc640 4 set_mon_vals no callback set 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.308+0000 7f3f32ffd640 10 monclient: dump: 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.321 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 10 monclient: shutdown 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1575540470 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 msgr2=0x7f3f34136570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1575540470 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 0x7f3f34136570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f240097d0 tx=0x7f3f24029fb0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1575540470 shutdown_connections 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1575540470 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3f34136e90 0x7f3f340a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1575540470 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3f340a3d80 0x7f3f34136570 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1575540470 >> 172.21.15.71:0/1575540470 conn(0x7f3f340a91d0 msgr2=0x7f3f340a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1575540470 shutdown_connections 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1575540470 wait complete. 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.309+0000 7f3f3a4cc640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.310+0000 7f3f3a4cc640 10 monclient: monmap: 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:38.323 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.310+0000 7f3f3a4cc640 1 Processor -- start 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.310+0000 7f3f3a4cc640 1 -- start start 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.310+0000 7f3f3a4cc640 10 monclient: init 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient: _add_conns ranks=[3,6,1,7,0,8,2,5,4] 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f340a3d80 0x7f3f341cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): picked mon.noname-g con 0x7f3f340a3d80 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 0x7f3f341cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): picked mon.noname-d con 0x7f3f34136ab0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f34136e90 0x7f3f34123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): picked mon.noname-f con 0x7f3f34136e90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340a08c0 con 0x7f3f34136e90 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3f34137340 con 0x7f3f340a3d80 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3f340a2ca0 con 0x7f3f34136ab0 2024-08-19T11:19:38.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f3a4cc640 10 monclient(hunting): authenticate will time out at 1236.352117s 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 0x7f3f341cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 0x7f3f341cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:35090/0 (socket says 172.21.15.71:35090) 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 -- 172.21.15.71:0/1905225098 learned_addr learned my addr 172.21.15.71:0/1905225098 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): get_auth_request con 0x7f3f34136ab0 auth_method 0 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f340a3d80 0x7f3f341cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): get_auth_request con 0x7f3f340a3d80 auth_method 0 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f38a69640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f34136e90 0x7f3f34123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f38a69640 10 monclient(hunting): get_auth_request con 0x7f3f34136e90 auth_method 0 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f38a69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f38a69640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f38a69640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient(hunting): handle_auth_done global_id 104316 payload 824 2024-08-19T11:19:38.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f340a3d80 msgr2=0x7f3f341cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f340a3d80 0x7f3f341cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f34136e90 msgr2=0x7f3f34123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f34136e90 0x7f3f34123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 monclient: found mon.noname-d 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f337fe640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f34124a80 con 0x7f3f34136ab0 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.311+0000 7f3f38a69640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f34136e90 0x7f3f34123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f337fe640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 msgr2=0x7f3f341cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f337fe640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 0x7f3f341cbdd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c460 tx=0x7f3f2800c920 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f28005cf0 con 0x7f3f34136ab0 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 10 monclient: dump: 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f280074e0 con 0x7f3f34136ab0 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f3a4cc640 5 monclient: authenticate success, global_id 104316 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f28007690 con 0x7f3f34136ab0 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f3a4cc640 10 monclient: _renew_subs 2024-08-19T11:19:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f3a4cc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f34126de0 con 0x7f3f34136ab0 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f30ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.313+0000 7f3f327fc640 4 set_mon_vals no callback set 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f30ff9640 10 monclient: dump: 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.331 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 10 monclient: _renew_subs 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341cc310 con 0x7f3f34136ab0 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 0x7f3f34123980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3406a590 con 0x7f3f341235a0 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3f28007070 con 0x7f3f34136ab0 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 0x7f3f34123980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 10 monclient: get_auth_request con 0x7f3f341235a0 auth_method 0 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.314+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f30ff9640 1 --2- 172.21.15.71:0/1905225098 >> v2:172.21.15.135:6800/726754104 conn(0x7f3f2003ea80 0x7f3f20040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f33fff640 10 monclient(hunting): handle_auth_done global_id 75314 payload 824 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(258..258 src has 1..258) ==== 3898+0+0 (secure 0 0 0) 0x7f3f28051970 con 0x7f3f34136ab0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f33fff640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f340a4a60 con 0x7f3f341235a0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f38a69640 1 --2- 172.21.15.71:0/1905225098 >> v2:172.21.15.135:6800/726754104 conn(0x7f3f2003ea80 0x7f3f20040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.315+0000 7f3f38a69640 10 monclient: get_auth_request con 0x7f3f2003ea80 auth_method 0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f33fff640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 msgr2=0x7f3f34123980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 0x7f3f34123980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f340a3450 tx=0x7f3f240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f24041030 con 0x7f3f341235a0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 10 monclient: dump: 2024-08-19T11:19:38.334 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.335 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f38a69640 1 --2- 172.21.15.71:0/1905225098 >> v2:172.21.15.135:6800/726754104 conn(0x7f3f2003ea80 0x7f3f20040f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009fa0 tx=0x7f3f2c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3f24038040 con 0x7f3f341235a0 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 msgr2=0x7f3f34123980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 0x7f3f34123980 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f340a3450 tx=0x7f3f240046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 msgr2=0x7f3f34123980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.317+0000 7f3f30ff9640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f341235a0 0x7f3f34123980 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3f340a3450 tx=0x7f3f240046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f3a4cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 0x7f3f3411f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f3a4cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3f34076c60 con 0x7f3f34123ec0 2024-08-19T11:19:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 0x7f3f3411f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f33fff640 10 monclient: get_auth_request con 0x7f3f34123ec0 auth_method 0 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f33fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.323+0000 7f3f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.324+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.324+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.324+0000 7f3f33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.324+0000 7f3f33fff640 10 monclient(hunting): handle_auth_done global_id 75323 payload 824 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.324+0000 7f3f33fff640 1 -- 172.21.15.71:0/1905225098 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f340a8010 con 0x7f3f34123ec0 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f33fff640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 msgr2=0x7f3f3411f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f33fff640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 0x7f3f3411f400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3f24041000 tx=0x7f3f24008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3f24037070 con 0x7f3f34123ec0 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 10 monclient: dump: 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.340 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9257 (secure 0 0 0) 0x7f3f24032860 con 0x7f3f34123ec0 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 msgr2=0x7f3f3411f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 0x7f3f3411f400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3f24041000 tx=0x7f3f24008030 comp rx=0 tx=0).stop 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 msgr2=0x7f3f3411f400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.326+0000 7f3f30ff9640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3f34123ec0 0x7f3f3411f400 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3f24041000 tx=0x7f3f24008030 comp rx=0 tx=0).stop 2024-08-19T11:19:38.341 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 227357, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:38.366 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:38.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 >> v2:172.21.15.135:6800/726754104 conn(0x7f3f2003ea80 msgr2=0x7f3f20040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1905225098 >> v2:172.21.15.135:6800/726754104 conn(0x7f3f2003ea80 0x7f3f20040f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009fa0 tx=0x7f3f2c00b040 comp rx=0 tx=0).stop 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 10 monclient: shutdown 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 msgr2=0x7f3f341cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 --2- 172.21.15.71:0/1905225098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3f34136ab0 0x7f3f341cbdd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c460 tx=0x7f3f2800c920 comp rx=0 tx=0).stop 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f38a69640 1 -- 172.21.15.71:0/1905225098 reap_dead start 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f38a69640 1 -- 172.21.15.71:0/1905225098 reap_dead start 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 shutdown_connections 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 >> 172.21.15.71:0/1905225098 conn(0x7f3f340a91d0 msgr2=0x7f3f3409ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 shutdown_connections 2024-08-19T11:19:38.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.327+0000 7f3f3a4cc640 1 -- 172.21.15.71:0/1905225098 wait complete. 2024-08-19T11:19:38.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:38.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-19T11:19:38.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.466+0000 7fe264ff4640 10 monclient: get_monmap_and_config 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.466+0000 7fe264ff4640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.466+0000 7fe264ff4640 10 monclient: monmap: 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:38.466873+0000 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:38.466873+0000 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:38.467 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:38.468 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.466+0000 7fe264ff4640 1 Processor -- start 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.466+0000 7fe264ff4640 1 -- start start 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.466+0000 7fe264ff4640 10 monclient: init 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient: _add_conns ranks=[5,0,10,4,8,3,2,7,1,9,6] 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2600a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): picked mon.noname-h con 0x7fe2600a3c30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe2600a4550 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe26013a080 0x7fe260141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): picked mon.noname-f con 0x7fe26013a080 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:38.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2600a13b0 con 0x7fe2600a4550 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe2600a5000 con 0x7fe26013a080 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe2600a0b10 con 0x7fe2600a3c30 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe264ff4640 10 monclient(hunting): authenticate will time out at 1236.508591s 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25dd9b640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe2600a4550 0x7fe260139970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47022/0 (socket says 172.21.15.71:47022) 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25dd9b640 1 -- 172.21.15.71:0/2336723052 learned_addr learned my addr 172.21.15.71:0/2336723052 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2336723052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2600a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): get_auth_request con 0x7fe2600a3c30 auth_method 0 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 1 --2- 172.21.15.71:0/2336723052 >> v2:172.21.15.135:3300/0 conn(0x7fe26013a080 0x7fe260141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): get_auth_request con 0x7fe26013a080 auth_method 0 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 10 monclient(hunting): handle_auth_done global_id 45923 payload 274 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 1 -- 172.21.15.71:0/2336723052 >> v2:172.21.15.135:3300/0 conn(0x7fe26013a080 msgr2=0x7fe260141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2336723052 >> v2:172.21.15.135:3300/0 conn(0x7fe26013a080 0x7fe260141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.467+0000 7fe25e59c640 1 -- 172.21.15.71:0/2336723052 >> v1:172.21.15.71:6789/0 conn(0x7fe2600a4550 legacy=0x7fe260139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.468+0000 7fe25e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.468+0000 7fe25e59c640 1 monclient: found mon.noname-h 2024-08-19T11:19:38.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.468+0000 7fe25e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.468+0000 7fe25e59c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:19:38.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.468+0000 7fe25e59c640 1 -- 172.21.15.71:0/2336723052 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2600a0df0 con 0x7fe2600a3c30 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.470+0000 7fe25e59c640 1 -- 172.21.15.71:0/2336723052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 msgr2=0x7fe2600a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.470+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2336723052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2600a4010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2500097d0 tx=0x7fe25002a000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=9e373129fa1f21f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 1 -- 172.21.15.71:0/2336723052 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe250037070 con 0x7fe2600a3c30 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: dump: 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.481 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 1 -- 172.21.15.71:0/2336723052 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25002ad20 con 0x7fe2600a3c30 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 5 monclient: authenticate success, global_id 45923 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 1 -- 172.21.15.71:0/2336723052 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe250030c20 con 0x7fe2600a3c30 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 4 set_mon_vals no callback set 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe25d59a640 10 monclient: dump: 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.483 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 10 monclient: shutdown 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 -- 172.21.15.71:0/2336723052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 msgr2=0x7fe2600a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2336723052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2600a4010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2500097d0 tx=0x7fe25002a000 comp rx=0 tx=0).stop 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 -- 172.21.15.71:0/2336723052 shutdown_connections 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2336723052 >> v2:172.21.15.135:3300/0 conn(0x7fe26013a080 0x7fe260141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2336723052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2600a4010 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 -- 172.21.15.71:0/2336723052 >> 172.21.15.71:0/2336723052 conn(0x7fe2600a91d0 msgr2=0x7fe2600a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 -- 172.21.15.71:0/2336723052 shutdown_connections 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.471+0000 7fe264ff4640 1 -- 172.21.15.71:0/2336723052 wait complete. 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.472+0000 7fe264ff4640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.472+0000 7fe264ff4640 10 monclient: monmap: 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.472+0000 7fe264ff4640 1 Processor -- start 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.472+0000 7fe264ff4640 1 -- start start 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.472+0000 7fe264ff4640 10 monclient: init 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient: _add_conns ranks=[5,0,8,2,3,1,6,4,7] 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2601cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): picked mon.noname-h con 0x7fe2600a3c30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 0x7fe2601cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): picked mon.noname-a con 0x7fe2600a4550 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe26013a080 0x7fe260125270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): picked mon.noname-e con 0x7fe26013a080 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2600a5570 con 0x7fe2600a4550 2024-08-19T11:19:38.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fe26006cbd0 con 0x7fe2600a3c30 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe2600a4930 con 0x7fe26013a080 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe264ff4640 10 monclient(hunting): authenticate will time out at 1236.514380s 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25ed9d640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe26013a080 msgr2=0x7fe260125270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe26013a080 0x7fe260125270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 0x7fe2601cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 0x7fe2601cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33972/0 (socket says 172.21.15.71:33972) 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 -- 172.21.15.71:0/2310285969 learned_addr learned my addr 172.21.15.71:0/2310285969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): get_auth_request con 0x7fe2600a4550 auth_method 0 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2601cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25e59c640 10 monclient(hunting): get_auth_request con 0x7fe2600a3c30 auth_method 0 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient(hunting): handle_auth_done global_id 75375 payload 824 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe26013a080 msgr2=0x7fe260125270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe26013a080 0x7fe260125270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 msgr2=0x7fe2601cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fe2600a3c30 0x7fe2601cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 monclient: found mon.noname-a 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.473+0000 7fe25dd9b640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe260128990 con 0x7fe2600a4550 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.475+0000 7fe25dd9b640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 msgr2=0x7fe2601cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.475+0000 7fe25dd9b640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 0x7fe2601cf140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe24800c430 tx=0x7fe24800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe248017070 con 0x7fe2600a4550 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: dump: 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.490 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.491 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248005cf0 con 0x7fe2600a4550 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 5 monclient: authenticate success, global_id 75375 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe248007540 con 0x7fe2600a4550 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 10 monclient: _renew_subs 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe260128c70 con 0x7fe2600a4550 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:38.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe25cd99640 4 set_mon_vals no callback set 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe256ffd640 10 monclient: dump: 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.493 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 10 monclient: _renew_subs 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.476+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe260138510 con 0x7fe2600a4550 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe248007070 con 0x7fe2600a4550 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe264ff4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 0x7fe26002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe260076c60 con 0x7fe260125f70 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 0x7fe26002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe256ffd640 1 --2- 172.21.15.71:0/2310285969 >> v2:172.21.15.135:6800/726754104 conn(0x7fe24003ea80 0x7fe240040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient: get_auth_request con 0x7fe260125f70 auth_method 0 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(258..258 src has 1..258) ==== 3898+0+0 (secure 0 0 0) 0x7fe248050ff0 con 0x7fe2600a4550 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25ed9d640 1 --2- 172.21.15.71:0/2310285969 >> v2:172.21.15.135:6800/726754104 conn(0x7fe24003ea80 0x7fe240040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25ed9d640 10 monclient: get_auth_request con 0x7fe24003ea80 auth_method 0 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 10 monclient(hunting): handle_auth_done global_id 84928 payload 824 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.477+0000 7fe25e59c640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2600a5210 con 0x7fe260125f70 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe25e59c640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 msgr2=0x7fe26002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 0x7fe26002d1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe250034000 tx=0x7fe2500046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe250041070 con 0x7fe260125f70 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe256ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe256ffd640 10 monclient: dump: 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.479+0000 7fe25ed9d640 1 --2- 172.21.15.71:0/2310285969 >> v2:172.21.15.135:6800/726754104 conn(0x7fe24003ea80 0x7fe240040f40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe258009ac0 tx=0x7fe25800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe250003a30 con 0x7fe260125f70 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 msgr2=0x7fe26002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 0x7fe26002d1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe250034000 tx=0x7fe2500046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 msgr2=0x7fe26002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.480+0000 7fe256ffd640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260125f70 0x7fe26002d1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe264ff4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:38.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 0x7fe26002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe264ff4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fe260126bf0 con 0x7fe260126350 2024-08-19T11:19:38.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 0x7fe26002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient: get_auth_request con 0x7fe260126350 auth_method 0 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 10 monclient(hunting): handle_auth_done global_id 84937 payload 824 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.486+0000 7fe25e59c640 1 -- 172.21.15.71:0/2310285969 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe26009e100 con 0x7fe260126350 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.488+0000 7fe25e59c640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 msgr2=0x7fe26002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.488+0000 7fe25e59c640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 0x7fe26002d700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe250000c00 tx=0x7fe250008030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.488+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe250054020 con 0x7fe260126350 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.488+0000 7fe256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.488+0000 7fe256ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.488+0000 7fe256ffd640 10 monclient: dump: 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.501 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7fe25003d440 con 0x7fe260126350 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 msgr2=0x7fe26002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 0x7fe26002d700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe250000c00 tx=0x7fe250008030 comp rx=0 tx=0).stop 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 msgr2=0x7fe26002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe256ffd640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fe260126350 0x7fe26002d700 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe250000c00 tx=0x7fe250008030 comp rx=0 tx=0).stop 2024-08-19T11:19:38.502 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 160635, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:38.503 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.504 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.505 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:38.506 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.507 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.508 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.511 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:38.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:38.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.516 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:38.517 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.518 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:38.520 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.523 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.524 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.526 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:38.526 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 >> v2:172.21.15.135:6800/726754104 conn(0x7fe24003ea80 msgr2=0x7fe240040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2310285969 >> v2:172.21.15.135:6800/726754104 conn(0x7fe24003ea80 0x7fe240040f40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe258009ac0 tx=0x7fe25800b040 comp rx=0 tx=0).stop 2024-08-19T11:19:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 10 monclient: shutdown 2024-08-19T11:19:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 msgr2=0x7fe2601cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 --2- 172.21.15.71:0/2310285969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2600a4550 0x7fe2601cf140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe24800c430 tx=0x7fe24800c8f0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe25ed9d640 1 -- 172.21.15.71:0/2310285969 reap_dead start 2024-08-19T11:19:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe25ed9d640 1 -- 172.21.15.71:0/2310285969 reap_dead start 2024-08-19T11:19:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 shutdown_connections 2024-08-19T11:19:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 >> 172.21.15.71:0/2310285969 conn(0x7fe2600a91d0 msgr2=0x7fe2600a6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 shutdown_connections 2024-08-19T11:19:38.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.489+0000 7fe264ff4640 1 -- 172.21.15.71:0/2310285969 wait complete. 2024-08-19T11:19:38.528 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:38.528 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-08-19T11:19:38.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.627+0000 7f38356a1640 10 monclient: get_monmap_and_config 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.627+0000 7f38356a1640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.627+0000 7f38356a1640 10 monclient: monmap: 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:38.627694+0000 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:38.627694+0000 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:38.629 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.627+0000 7f38356a1640 1 Processor -- start 2024-08-19T11:19:38.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.627+0000 7f38356a1640 1 -- start start 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.627+0000 7f38356a1640 10 monclient: init 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient: _add_conns ranks=[5,7,8,3,0,6,2,1,10,9,4] 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 0x7f38300a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): picked mon.noname-h con 0x7f38300a5860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3830072370 0x7f38300a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): picked mon.noname-i con 0x7f3830072370 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3830137610 0x7f3830137a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): picked mon.noname-e con 0x7f3830137610 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f38300a4180 con 0x7f38300a5860 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f38300a66c0 con 0x7f3830072370 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3830074130 con 0x7f3830137610 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f38356a1640 10 monclient(hunting): authenticate will time out at 1236.669182s 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382f7fe640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3830137610 msgr2=0x7f3830137a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382f7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3830137610 0x7f3830137a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3830072370 0x7f38300a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 0x7f38300a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3830072370 0x7f38300a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:50996/0 (socket says 172.21.15.71:50996) 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 1 -- 172.21.15.71:0/1873247780 learned_addr learned my addr 172.21.15.71:0/1873247780 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): get_auth_request con 0x7f38300a5860 auth_method 0 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): get_auth_request con 0x7f3830072370 auth_method 0 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient(hunting): handle_auth_done global_id 45941 payload 274 2024-08-19T11:19:38.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 -- 172.21.15.71:0/1873247780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3830137610 msgr2=0x7f3830137a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3830137610 0x7f3830137a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 -- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3830072370 msgr2=0x7f38300a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3830072370 0x7f38300a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 monclient: found mon.noname-h 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:19:38.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.628+0000 7f382effd640 1 -- 172.21.15.71:0/1873247780 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38300a7390 con 0x7f38300a5860 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.631+0000 7f382effd640 1 -- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 msgr2=0x7f38300a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.631+0000 7f382effd640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 0x7f38300a5c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38280097d0 tx=0x7f3828029fd0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=ede1f18761ed77c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.631+0000 7f382dffb640 1 -- 172.21.15.71:0/1873247780 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3828037070 con 0x7f38300a5860 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.631+0000 7f382dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: dump: 2024-08-19T11:19:38.642 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.643 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 1 -- 172.21.15.71:0/1873247780 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382802ad30 con 0x7f38300a5860 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 1 -- 172.21.15.71:0/1873247780 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3828030c20 con 0x7f38300a5860 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 5 monclient: authenticate success, global_id 45941 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 4 set_mon_vals no callback set 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f382dffb640 10 monclient: dump: 2024-08-19T11:19:38.644 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.645 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 10 monclient: shutdown 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 -- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 msgr2=0x7f38300a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 0x7f38300a5c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38280097d0 tx=0x7f3828029fd0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 -- 172.21.15.71:0/1873247780 shutdown_connections 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3830137610 0x7f3830137a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3830072370 0x7f38300a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 --2- 172.21.15.71:0/1873247780 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f38300a5860 0x7f38300a5c40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 -- 172.21.15.71:0/1873247780 >> 172.21.15.71:0/1873247780 conn(0x7f38300aa480 msgr2=0x7f38300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 -- 172.21.15.71:0/1873247780 shutdown_connections 2024-08-19T11:19:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.632+0000 7f38356a1640 1 -- 172.21.15.71:0/1873247780 wait complete. 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.633+0000 7f38356a1640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.633+0000 7f38356a1640 10 monclient: monmap: 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.647 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.633+0000 7f38356a1640 1 Processor -- start 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.633+0000 7f38356a1640 1 -- start start 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.633+0000 7f38356a1640 10 monclient: init 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient: _add_conns ranks=[4,2,1,3,6,8,5,7,0] 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 0x7f38301ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): picked mon.noname-c con 0x7f3830072370 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38300a5860 0x7f3830136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): picked mon.noname-b con 0x7f38300a5860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3830137610 0x7f3830137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): picked mon.noname-f con 0x7f3830137610 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38300a1880 con 0x7f3830137610 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3830137fd0 con 0x7f38300a5860 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f38301ce7a0 con 0x7f3830072370 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f38356a1640 10 monclient(hunting): authenticate will time out at 1236.675146s 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 0x7f38301ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38300a5860 0x7f3830136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 0x7f38301ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:43894/0 (socket says 172.21.15.71:43894) 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38300a5860 0x7f3830136ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:42924/0 (socket says 172.21.15.71:42924) 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 -- 172.21.15.71:0/195882200 learned_addr learned my addr 172.21.15.71:0/195882200 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): get_auth_request con 0x7f3830072370 auth_method 0 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): get_auth_request con 0x7f38300a5860 auth_method 0 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382f7fe640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3830137610 0x7f3830137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382f7fe640 10 monclient(hunting): get_auth_request con 0x7f3830137610 auth_method 0 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient(hunting): handle_auth_done global_id 84946 payload 824 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38300a5860 msgr2=0x7f3830136ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38300a5860 0x7f3830136ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3830137610 msgr2=0x7f3830137020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3830137610 0x7f3830137020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 monclient: found mon.noname-c 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382effd640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38300a3810 con 0x7f3830072370 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382e7fc640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f38300a5860 0x7f3830136ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.634+0000 7f382f7fe640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3830137610 0x7f3830137020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.636+0000 7f382effd640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 msgr2=0x7f38301ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.636+0000 7f382effd640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 0x7f38301ce260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3828035040 tx=0x7f38280046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3828037050 con 0x7f3830072370 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: dump: 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.652 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.653 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828043070 con 0x7f3830072370 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 5 monclient: authenticate success, global_id 84946 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 10 monclient: _renew_subs 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3830068c00 con 0x7f3830072370 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3828003d60 con 0x7f3830072370 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38177fe640 10 monclient: dump: 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.655 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 10 monclient: _renew_subs 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f38301261e0 con 0x7f3830072370 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.637+0000 7f382cff9640 4 set_mon_vals no callback set 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38356a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38356a1640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 0x7f383006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f38300a1a00 con 0x7f3830124cc0 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3828048460 con 0x7f3830072370 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 0x7f383006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient: get_auth_request con 0x7f3830124cc0 auth_method 0 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38177fe640 1 --2- 172.21.15.71:0/195882200 >> v2:172.21.15.135:6800/726754104 conn(0x7f381c03eab0 0x7f381c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 10 monclient(hunting): handle_auth_done global_id 104325 payload 824 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(258..258 src has 1..258) ==== 3898+0+0 (secure 0 0 0) 0x7f3828072500 con 0x7f3830072370 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382e7fc640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3830138360 con 0x7f3830124cc0 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382f7fe640 1 --2- 172.21.15.71:0/195882200 >> v2:172.21.15.135:6800/726754104 conn(0x7f381c03eab0 0x7f381c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.638+0000 7f382f7fe640 10 monclient: get_auth_request con 0x7f381c03eab0 auth_method 0 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.640+0000 7f382e7fc640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 msgr2=0x7f383006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.640+0000 7f382e7fc640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 0x7f383006d9b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f383006f110 tx=0x7f382400e8c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.640+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3824019020 con 0x7f3830124cc0 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.640+0000 7f38177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.640+0000 7f38177fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.640+0000 7f38177fe640 10 monclient: dump: 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f382f7fe640 1 --2- 172.21.15.71:0/195882200 >> v2:172.21.15.135:6800/726754104 conn(0x7f381c03eab0 0x7f381c040f70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3820006fd0 tx=0x7f3820006ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3824015660 con 0x7f3830124cc0 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 msgr2=0x7f383006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 0x7f383006d9b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f383006f110 tx=0x7f382400e8c0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 msgr2=0x7f383006d9b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.641+0000 7f38177fe640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3830124cc0 0x7f383006d9b0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f383006f110 tx=0x7f382400e8c0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f38356a1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f38356a1640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 0x7f383006e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f38356a1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3830076c60 con 0x7f383006def0 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 0x7f383006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient: get_auth_request con 0x7f383006def0 auth_method 0 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 10 monclient(hunting): handle_auth_done global_id 104334 payload 824 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.647+0000 7f382e7fc640 1 -- 172.21.15.71:0/195882200 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f383006e840 con 0x7f383006def0 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.649+0000 7f382e7fc640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 msgr2=0x7f383006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.649+0000 7f382e7fc640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 0x7f383006e300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f383006f110 tx=0x7f3824004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.649+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3824019070 con 0x7f383006def0 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.649+0000 7f38177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.649+0000 7f38177fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.649+0000 7f38177fe640 10 monclient: dump: 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.663 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7f3824020020 con 0x7f383006def0 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:38.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 msgr2=0x7f383006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 0x7f383006e300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f383006f110 tx=0x7f3824004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 msgr2=0x7f383006e300 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38177fe640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f383006def0 0x7f383006e300 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f383006f110 tx=0x7f3824004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 33997, 2024-08-19T11:19:38.665 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:38.666 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:38.667 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:38.669 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:38.670 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.672 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.677 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:38.678 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:38.680 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.684 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:38.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:38.687 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:38.688 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:38.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:38.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:38.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:38.688 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:38.688 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:38.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 >> v2:172.21.15.135:6800/726754104 conn(0x7f381c03eab0 msgr2=0x7f381c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 --2- 172.21.15.71:0/195882200 >> v2:172.21.15.135:6800/726754104 conn(0x7f381c03eab0 0x7f381c040f70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3820006fd0 tx=0x7f3820006ea0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 10 monclient: shutdown 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 msgr2=0x7f38301ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 --2- 172.21.15.71:0/195882200 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3830072370 0x7f38301ce260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3828035040 tx=0x7f38280046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f382f7fe640 1 -- 172.21.15.71:0/195882200 reap_dead start 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f382f7fe640 1 -- 172.21.15.71:0/195882200 reap_dead start 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 shutdown_connections 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 >> 172.21.15.71:0/195882200 conn(0x7f38300aa480 msgr2=0x7f38300a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 shutdown_connections 2024-08-19T11:19:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.650+0000 7f38356a1640 1 -- 172.21.15.71:0/195882200 wait complete. 2024-08-19T11:19:38.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:38.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-19T11:19:38.691 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.788+0000 7fb37bacc640 10 monclient: get_monmap_and_config 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.788+0000 7fb37bacc640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.788+0000 7fb37bacc640 10 monclient: monmap: 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:38.788856+0000 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:38.788856+0000 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.789 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:38.790 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.788+0000 7fb37bacc640 1 Processor -- start 2024-08-19T11:19:38.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 -- start start 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient: init 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient: _add_conns ranks=[4,5,9,1,6,8,0,3,7,10,2] 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3740a3cb0 0x7fb3740a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): picked mon.noname-c con 0x7fb3740a3cb0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb3740a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): picked mon.noname-h con 0x7fb3740a5020 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb374139970 0x7fb374139de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): picked mon.noname-a con 0x7fb374139970 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fb3740a4b10 con 0x7fb374139970 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb3740a13d0 con 0x7fb3740a3cb0 2024-08-19T11:19:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb374074530 con 0x7fb3740a5020 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37bacc640 10 monclient(hunting): authenticate will time out at 1236.830538s 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb374139970 0x7fb374139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3740a3cb0 0x7fb3740a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb374139970 0x7fb374139de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33974/0 (socket says 172.21.15.71:33974) 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 -- 172.21.15.71:0/3728107333 learned_addr learned my addr 172.21.15.71:0/3728107333 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): get_auth_request con 0x7fb374139970 auth_method 0 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): get_auth_request con 0x7fb3740a3cb0 auth_method 0 2024-08-19T11:19:38.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379067640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb3740a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379067640 10 monclient(hunting): get_auth_request con 0x7fb3740a5020 auth_method 0 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379067640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb379067640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient(hunting): handle_auth_done global_id 75384 payload 274 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 -- 172.21.15.71:0/3728107333 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 msgr2=0x7fb3740a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb3740a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 -- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3740a3cb0 msgr2=0x7fb3740a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3740a3cb0 0x7fb3740a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 monclient: found mon.noname-a 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.789+0000 7fb37a069640 1 -- 172.21.15.71:0/3728107333 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740a4da0 con 0x7fb374139970 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.790+0000 7fb379067640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb3740a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.790+0000 7fb379868640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3740a3cb0 0x7fb3740a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:19:38.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb37a069640 1 -- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb374139970 msgr2=0x7fb374139de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb37a069640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb374139970 0x7fb374139de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009eb0 tx=0x7fb36c02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24abe0fc8dfe4b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 1 -- 172.21.15.71:0/3728107333 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb36c036070 con 0x7fb374139970 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: dump: 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.799 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 1 -- 172.21.15.71:0/3728107333 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c007a70 con 0x7fb374139970 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb37bacc640 5 monclient: authenticate success, global_id 75384 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb37bacc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb37bacc640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 1 -- 172.21.15.71:0/3728107333 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb36c007c60 con 0x7fb374139970 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb37bacc640 4 set_mon_vals no callback set 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.792+0000 7fb378866640 10 monclient: dump: 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.801 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 10 monclient: shutdown 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 -- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb374139970 msgr2=0x7fb374139de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb374139970 0x7fb374139de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009eb0 tx=0x7fb36c02a5b0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 -- 172.21.15.71:0/3728107333 shutdown_connections 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb374139970 0x7fb374139de0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb3740a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 --2- 172.21.15.71:0/3728107333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb3740a3cb0 0x7fb3740a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 -- 172.21.15.71:0/3728107333 >> 172.21.15.71:0/3728107333 conn(0x7fb3740a91d0 msgr2=0x7fb3740a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 -- 172.21.15.71:0/3728107333 shutdown_connections 2024-08-19T11:19:38.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.793+0000 7fb37bacc640 1 -- 172.21.15.71:0/3728107333 wait complete. 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient: build_initial_monmap 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient: monmap: 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:38.804 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:38.805 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:38.805 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:38.805 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:38.805 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 Processor -- start 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 -- start start 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient: init 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient: _add_conns ranks=[7,5,2,3,1,4,6,0,8] 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3740a3cb0 0x7fb374072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): picked mon.noname-i con 0x7fb3740a3cb0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb374138c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): picked mon.noname-h con 0x7fb3740a5020 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 0x7fb374139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): picked mon.noname-b con 0x7fb374139970 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:38.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740a54f0 con 0x7fb374139970 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb37406cb70 con 0x7fb3740a5020 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fb37413a320 con 0x7fb3740a3cb0 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.794+0000 7fb37bacc640 10 monclient(hunting): authenticate will time out at 1236.835947s 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 0x7fb374139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 0x7fb374139140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:42940/0 (socket says 172.21.15.71:42940) 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 learned_addr learned my addr 172.21.15.71:0/2614502262 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): get_auth_request con 0x7fb374139970 auth_method 0 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb374138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3740a3cb0 0x7fb374072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): get_auth_request con 0x7fb3740a5020 auth_method 0 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): get_auth_request con 0x7fb3740a3cb0 auth_method 0 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379067640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient(hunting): handle_auth_done global_id 75341 payload 824 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3740a3cb0 msgr2=0x7fb374072fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb3740a3cb0 0x7fb374072fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 msgr2=0x7fb374138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb3740a5020 0x7fb374138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient: _finish_hunting 0 2024-08-19T11:19:38.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 monclient: found mon.noname-b 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.795+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740a9960 con 0x7fb374139970 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 msgr2=0x7fb374139140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37a069640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 0x7fb374139140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007fd0 tx=0x7fb36c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb36c040020 con 0x7fb374139970 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: dump: 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.816 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:19:38.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 5 monclient: authenticate success, global_id 75341 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c003ba0 con 0x7fb374139970 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb36c036040 con 0x7fb374139970 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 10 monclient: _renew_subs 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb374126000 con 0x7fb374139970 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36bfff640 4 set_mon_vals no callback set 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb36a7fc640 10 monclient: dump: 2024-08-19T11:19:38.818 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.819 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 10 monclient: _renew_subs 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.797+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb374124dc0 con 0x7fb374139970 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb37bacc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb37bacc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 0x7fb374123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb37406a590 con 0x7fb374123810 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb37a069640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 0x7fb374139140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007fd0 tx=0x7fb36c004a40 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fb36c043020 mgrmap(e 5) 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb36c043020 con 0x7fb374139970 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 0x7fb374123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient: get_auth_request con 0x7fb374123810 auth_method 0 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb36a7fc640 1 --2- 172.21.15.71:0/2614502262 >> v2:172.21.15.135:6800/726754104 conn(0x7fb35803eab0 0x7fb358040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.798+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.799+0000 7fb379868640 10 monclient(hunting): handle_auth_done global_id 84979 payload 824 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.799+0000 7fb379868640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb37406d390 con 0x7fb374123810 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.799+0000 7fb379067640 1 --2- 172.21.15.71:0/2614502262 >> v2:172.21.15.135:6800/726754104 conn(0x7fb35803eab0 0x7fb358040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.799+0000 7fb379067640 10 monclient: get_auth_request con 0x7fb35803eab0 auth_method 0 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb379868640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 msgr2=0x7fb374123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 0x7fb374123bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb3640118e0 tx=0x7fb364011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb379067640 1 --2- 172.21.15.71:0/2614502262 >> v2:172.21.15.135:6800/726754104 conn(0x7fb35803eab0 0x7fb358040f70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb3741248d0 tx=0x7fb370008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb3640148b0 con 0x7fb374123810 2024-08-19T11:19:38.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 10 monclient: dump: 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:38.822 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb364014440 con 0x7fb374123810 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 msgr2=0x7fb374123bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.801+0000 7fb36a7fc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 0x7fb374123bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb3640118e0 tx=0x7fb364011da0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.802+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 msgr2=0x7fb374123bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.802+0000 7fb36a7fc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374123810 0x7fb374123bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb37bacc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:38.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb37bacc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb37bacc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb374073b20 con 0x7fb374124130 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 10 monclient: get_auth_request con 0x7fb374124130 auth_method 0 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 msgr2=0x7fb37409d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 msgr2=0x7fb37409d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:19:38.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:38.808+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:38.827 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28250]: starting. 2024-08-19T11:19:38.827 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28250]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28248 2024-08-19T11:19:38.827 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28250]: shutting down. 2024-08-19T11:19:39.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient: get_auth_request con 0x7fb374124130 auth_method 0 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 10 monclient(hunting): handle_auth_done global_id 84997 payload 824 2024-08-19T11:19:39.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.010+0000 7fb379868640 1 -- 172.21.15.71:0/2614502262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3740a85d0 con 0x7fb374124130 2024-08-19T11:19:39.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb379868640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 msgr2=0x7fb37409d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb379868640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb3640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb364022e00 con 0x7fb374124130 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 10 monclient: dump: 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.015 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7fb364022990 con 0x7fb374124130 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 msgr2=0x7fb37409d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb3640046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 msgr2=0x7fb37409d0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.013+0000 7fb36a7fc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb374124130 0x7fb37409d0b0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb3640046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 161174, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.038 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.039 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.041 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:39.041 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 >> v2:172.21.15.135:6800/726754104 conn(0x7fb35803eab0 msgr2=0x7fb358040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 --2- 172.21.15.71:0/2614502262 >> v2:172.21.15.135:6800/726754104 conn(0x7fb35803eab0 0x7fb358040f70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb3741248d0 tx=0x7fb370008040 comp rx=0 tx=0).stop 2024-08-19T11:19:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 10 monclient: shutdown 2024-08-19T11:19:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 msgr2=0x7fb374139140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 --2- 172.21.15.71:0/2614502262 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb374139970 0x7fb374139140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb36c007fd0 tx=0x7fb36c004a40 comp rx=0 tx=0).stop 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 reap_dead start 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37a069640 1 -- 172.21.15.71:0/2614502262 reap_dead start 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb36a7fc640 1 -- 172.21.15.71:0/2614502262 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(258..258 src has 1..258) ==== 3898+0+0 (unknown 0 0 0) 0x7fb36c0723b0 con 0x7fb374139970 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 shutdown_connections 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 >> 172.21.15.71:0/2614502262 conn(0x7fb3740a91d0 msgr2=0x7fb3740a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 shutdown_connections 2024-08-19T11:19:39.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.014+0000 7fb37bacc640 1 -- 172.21.15.71:0/2614502262 wait complete. 2024-08-19T11:19:39.043 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:39.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-19T11:19:39.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:19:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.141+0000 7fe24b1b8640 10 monclient: get_monmap_and_config 2024-08-19T11:19:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.141+0000 7fe24b1b8640 10 monclient: build_initial_monmap 2024-08-19T11:19:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.141+0000 7fe24b1b8640 10 monclient: monmap: 2024-08-19T11:19:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:39.142163+0000 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:39.142163+0000 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:39.144 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 Processor -- start 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 -- start start 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient: init 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient: _add_conns ranks=[7,9,10,5,3,2,8,0,6,4,1] 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2440a6950 0x7fe2440a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): picked mon.noname-i con 0x7fe2440a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2440a57c0 0x7fe2440a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): picked mon.noname-a con 0x7fe2440a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe244139710 0x7fe244139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): picked mon.noname-f con 0x7fe244139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe2440a5020 con 0x7fe2440a57c0 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe2440a77b0 con 0x7fe244139710 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe2440a7d40 con 0x7fe2440a6950 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.142+0000 7fe24b1b8640 10 monclient(hunting): authenticate will time out at 1237.183914s 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2440a57c0 0x7fe2440a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2440a57c0 0x7fe2440a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33982/0 (socket says 172.21.15.71:33982) 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 -- 172.21.15.71:0/2906098674 learned_addr learned my addr 172.21.15.71:0/2906098674 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): get_auth_request con 0x7fe2440a57c0 auth_method 0 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe249755640 1 --2- 172.21.15.71:0/2906098674 >> v2:172.21.15.135:3300/0 conn(0x7fe244139710 0x7fe244139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe248f54640 1 --2- 172.21.15.71:0/2906098674 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2440a6950 0x7fe2440a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe249755640 10 monclient(hunting): get_auth_request con 0x7fe244139710 auth_method 0 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe249755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe249755640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe249755640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe248f54640 10 monclient(hunting): get_auth_request con 0x7fe2440a6950 auth_method 0 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe248f54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe248f54640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe248f54640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient(hunting): handle_auth_done global_id 75411 payload 274 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 -- 172.21.15.71:0/2906098674 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2440a6950 msgr2=0x7fe2440a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 --2- 172.21.15.71:0/2906098674 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2440a6950 0x7fe2440a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 -- 172.21.15.71:0/2906098674 >> v2:172.21.15.135:3300/0 conn(0x7fe244139710 msgr2=0x7fe244139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 --2- 172.21.15.71:0/2906098674 >> v2:172.21.15.135:3300/0 conn(0x7fe244139710 0x7fe244139b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 monclient: found mon.noname-a 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.143+0000 7fe243fff640 1 -- 172.21.15.71:0/2906098674 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440a6380 con 0x7fe2440a57c0 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe243fff640 1 -- 172.21.15.71:0/2906098674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2440a57c0 msgr2=0x7fe2440a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe243fff640 1 --2- 172.21.15.71:0/2906098674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2440a57c0 0x7fe2440a7270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe24406c930 tx=0x7fe22c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4348a159a0717c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 1 -- 172.21.15.71:0/2906098674 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe22c037070 con 0x7fe2440a57c0 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: dump: 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.153 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 1 -- 172.21.15.71:0/2906098674 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22c02ae20 con 0x7fe2440a57c0 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 5 monclient: authenticate success, global_id 75411 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 1 -- 172.21.15.71:0/2906098674 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe22c030c20 con 0x7fe2440a57c0 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 4 set_mon_vals no callback set 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:19:39.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe2437fe640 10 monclient: dump: 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.155 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 10 monclient: shutdown 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 -- 172.21.15.71:0/2906098674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2440a57c0 msgr2=0x7fe2440a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/2906098674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2440a57c0 0x7fe2440a7270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe24406c930 tx=0x7fe22c02a100 comp rx=0 tx=0).stop 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 -- 172.21.15.71:0/2906098674 shutdown_connections 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/2906098674 >> v2:172.21.15.135:3300/0 conn(0x7fe244139710 0x7fe244139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/2906098674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2440a57c0 0x7fe2440a7270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/2906098674 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe2440a6950 0x7fe2440a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 -- 172.21.15.71:0/2906098674 >> 172.21.15.71:0/2906098674 conn(0x7fe2440abf50 msgr2=0x7fe2440ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 -- 172.21.15.71:0/2906098674 shutdown_connections 2024-08-19T11:19:39.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.146+0000 7fe24b1b8640 1 -- 172.21.15.71:0/2906098674 wait complete. 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.147+0000 7fe24b1b8640 10 monclient: build_initial_monmap 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.147+0000 7fe24b1b8640 10 monclient: monmap: 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:39.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.147+0000 7fe24b1b8640 1 Processor -- start 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.147+0000 7fe24b1b8640 1 -- start start 2024-08-19T11:19:39.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.147+0000 7fe24b1b8640 10 monclient: init 2024-08-19T11:19:39.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient: _add_conns ranks=[8,1,6,3,4,2,7,5,0] 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2440a57c0 0x7fe244138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): picked mon.noname-e con 0x7fe2440a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2440a6950 0x7fe2441390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): picked mon.noname-f con 0x7fe2440a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 0x7fe244122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): picked mon.noname-d con 0x7fe244139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440a84c0 con 0x7fe2440a6950 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe2440a3650 con 0x7fe244139710 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe2440a8700 con 0x7fe2440a57c0 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe24b1b8640 10 monclient(hunting): authenticate will time out at 1237.189395s 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe248f54640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2440a57c0 msgr2=0x7fe244138b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe248f54640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2440a57c0 0x7fe244138b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 0x7fe244122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 0x7fe244122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:35118/0 (socket says 172.21.15.71:35118) 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 learned_addr learned my addr 172.21.15.71:0/3503647207 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): get_auth_request con 0x7fe244139710 auth_method 0 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2440a6950 0x7fe2441390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): get_auth_request con 0x7fe2440a6950 auth_method 0 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe243fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient(hunting): handle_auth_done global_id 104361 payload 824 2024-08-19T11:19:39.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2440a57c0 msgr2=0x7fe244138b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe2440a57c0 0x7fe244138b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2440a6950 msgr2=0x7fe2441390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2440a6950 0x7fe2441390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient: _finish_hunting 0 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 monclient: found mon.noname-d 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.148+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2441253e0 con 0x7fe244139710 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 msgr2=0x7fe244122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe249755640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 0x7fe244122890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe23c007e60 tx=0x7fe23c00e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe23c014890 con 0x7fe244139710 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: dump: 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.169 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: _finish_auth 0 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: _check_auth_tickets 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c019070 con 0x7fe244139710 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 5 monclient: authenticate success, global_id 104361 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 10 monclient: _renew_subs 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24413a150 con 0x7fe244139710 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:39.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe23c013380 con 0x7fe244139710 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe2417fa640 10 monclient: dump: 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 10 monclient: _renew_subs 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fe244126520 con 0x7fe244139710 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.151+0000 7fe242ffd640 4 set_mon_vals no callback set 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe24b1b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 0x7fe24402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe244076c60 con 0x7fe2441ce500 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe23c014420 con 0x7fe244139710 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 0x7fe24402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient: get_auth_request con 0x7fe2441ce500 auth_method 0 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe2417fa640 1 --2- 172.21.15.71:0/3503647207 >> v2:172.21.15.135:6800/726754104 conn(0x7fe22403ea80 0x7fe224040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(259..259 src has 1..259) ==== 3506+0+0 (secure 0 0 0) 0x7fe23c052210 con 0x7fe244139710 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe243fff640 1 --2- 172.21.15.71:0/3503647207 >> v2:172.21.15.135:6800/726754104 conn(0x7fe22403ea80 0x7fe224040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe243fff640 10 monclient: get_auth_request con 0x7fe22403ea80 auth_method 0 2024-08-19T11:19:39.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 10 monclient(hunting): handle_auth_done global_id 45750 payload 824 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.152+0000 7fe248f54640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2440a1fa0 con 0x7fe2441ce500 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.154+0000 7fe248f54640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 msgr2=0x7fe24402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.154+0000 7fe248f54640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 0x7fe24402d1c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe23400d4f0 tx=0x7fe23400d9b0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe2340044a0 con 0x7fe2441ce500 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe243fff640 1 --2- 172.21.15.71:0/3503647207 >> v2:172.21.15.135:6800/726754104 conn(0x7fe22403ea80 0x7fe224040f40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe22c034000 tx=0x7fe22c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 10 monclient: dump: 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.174 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe234004030 con 0x7fe2441ce500 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 msgr2=0x7fe24402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 0x7fe24402d1c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe23400d4f0 tx=0x7fe23400d9b0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 msgr2=0x7fe24402d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.155+0000 7fe2417fa640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2441ce500 0x7fe24402d1c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.161+0000 7fe24b1b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.161+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 0x7fe24402db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.161+0000 7fe24b1b8640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.161+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440a6d30 con 0x7fe24402d700 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 0x7fe24402db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient: get_auth_request con 0x7fe24402d700 auth_method 0 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 10 monclient(hunting): handle_auth_done global_id 45759 payload 824 2024-08-19T11:19:39.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.162+0000 7fe248f54640 1 -- 172.21.15.71:0/3503647207 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe24409e100 con 0x7fe24402d700 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.164+0000 7fe248f54640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 msgr2=0x7fe24402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.164+0000 7fe248f54640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 0x7fe24402db10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe23401d450 tx=0x7fe234004730 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe23401dc40 con 0x7fe24402d700 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 10 monclient: dump: 2024-08-19T11:19:39.178 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.179 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7fe23401dc40 con 0x7fe24402d700 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 msgr2=0x7fe24402db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 0x7fe24402db10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe23401d450 tx=0x7fe234004730 comp rx=0 tx=0).stop 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 msgr2=0x7fe24402db10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe2417fa640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe24402d700 0x7fe24402db10 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe23401d450 tx=0x7fe234004730 comp rx=0 tx=0).stop 2024-08-19T11:19:39.180 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 348187, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:39.181 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.183 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:39.184 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.185 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:39.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:39.187 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:39.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.191 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.193 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.196 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.198 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:39.200 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.201 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.202 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.204 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:39.204 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 >> v2:172.21.15.135:6800/726754104 conn(0x7fe22403ea80 msgr2=0x7fe224040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/3503647207 >> v2:172.21.15.135:6800/726754104 conn(0x7fe22403ea80 0x7fe224040f40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe22c034000 tx=0x7fe22c02e000 comp rx=0 tx=0).stop 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 10 monclient: shutdown 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 msgr2=0x7fe244122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 --2- 172.21.15.71:0/3503647207 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe244139710 0x7fe244122890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe23c007e60 tx=0x7fe23c00e4b0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 reap_dead start 2024-08-19T11:19:39.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe249755640 1 -- 172.21.15.71:0/3503647207 reap_dead start 2024-08-19T11:19:39.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 shutdown_connections 2024-08-19T11:19:39.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 >> 172.21.15.71:0/3503647207 conn(0x7fe2440abf50 msgr2=0x7fe2440aa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 shutdown_connections 2024-08-19T11:19:39.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.165+0000 7fe24b1b8640 1 -- 172.21.15.71:0/3503647207 wait complete. 2024-08-19T11:19:39.206 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:39.206 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-19T11:19:39.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:19:39.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.304+0000 7f8c6afb1640 10 monclient: get_monmap_and_config 2024-08-19T11:19:39.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.304+0000 7f8c6afb1640 10 monclient: build_initial_monmap 2024-08-19T11:19:39.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.304+0000 7f8c6afb1640 10 monclient: monmap: 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:39.305393+0000 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:39.305393+0000 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:39.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:39.307 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:39.307 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:39.307 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:39.307 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:39.307 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 Processor -- start 2024-08-19T11:19:39.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 -- start start 2024-08-19T11:19:39.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient: init 2024-08-19T11:19:39.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:39.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient: _add_conns ranks=[2,10,3,5,7,0,8,1,4,6,9] 2024-08-19T11:19:39.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 0x7f8c640a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient(hunting): picked mon.noname-b con 0x7f8c640a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8c640a57c0 0x7f8c640a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient(hunting): picked mon.noname-f con 0x7f8c640a57c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c64139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient(hunting): picked mon.noname-g con 0x7f8c64139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f8c640a5020 con 0x7f8c640a57c0 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8c640a77b0 con 0x7f8c640a6950 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.305+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6afb1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c640a7d40 con 0x7f8c64139710 2024-08-19T11:19:39.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6afb1640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6afb1640 10 monclient(hunting): authenticate will time out at 1237.347013s 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 0x7f8c640a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 0x7f8c640a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:42950/0 (socket says 172.21.15.71:42950) 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 -- 172.21.15.71:0/2889977098 learned_addr learned my addr 172.21.15.71:0/2889977098 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): get_auth_request con 0x7f8c640a6950 auth_method 0 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 1 --2- 172.21.15.71:0/2889977098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c64139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 1 --2- 172.21.15.71:0/2889977098 >> v2:172.21.15.135:3300/0 conn(0x7f8c640a57c0 0x7f8c640a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): get_auth_request con 0x7f8c64139710 auth_method 0 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): get_auth_request con 0x7f8c640a57c0 auth_method 0 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c6954e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_done global_id 75368 payload 274 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 -- 172.21.15.71:0/2889977098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 msgr2=0x7f8c64139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 --2- 172.21.15.71:0/2889977098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c64139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 -- 172.21.15.71:0/2889977098 >> v2:172.21.15.135:3300/0 conn(0x7f8c640a57c0 msgr2=0x7f8c640a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 --2- 172.21.15.71:0/2889977098 >> v2:172.21.15.135:3300/0 conn(0x7f8c640a57c0 0x7f8c640a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient: _finish_hunting 0 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 monclient: found mon.noname-b 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.306+0000 7f8c68d4d640 1 -- 172.21.15.71:0/2889977098 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c640a6380 con 0x7f8c640a6950 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c68d4d640 1 -- 172.21.15.71:0/2889977098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 msgr2=0x7f8c640a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c68d4d640 1 --2- 172.21.15.71:0/2889977098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 0x7f8c640a6d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c580098d0 tx=0x7f8c5802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e56daffc72c6d1f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 1 -- 172.21.15.71:0/2889977098 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c58037070 con 0x7f8c640a6950 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: dump: 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.316 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: _finish_auth 0 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: _check_auth_tickets 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 1 -- 172.21.15.71:0/2889977098 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5802ae20 con 0x7f8c640a6950 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 5 monclient: authenticate success, global_id 75368 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 1 -- 172.21.15.71:0/2889977098 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c58030c20 con 0x7f8c640a6950 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 4 set_mon_vals no callback set 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c637fe640 10 monclient: dump: 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.318 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 10 monclient: shutdown 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 -- 172.21.15.71:0/2889977098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 msgr2=0x7f8c640a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/2889977098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 0x7f8c640a6d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c580098d0 tx=0x7f8c5802a100 comp rx=0 tx=0).stop 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 -- 172.21.15.71:0/2889977098 shutdown_connections 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/2889977098 >> v2:172.21.15.135:3300/0 conn(0x7f8c640a57c0 0x7f8c640a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/2889977098 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c64139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/2889977098 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8c640a6950 0x7f8c640a6d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 -- 172.21.15.71:0/2889977098 >> 172.21.15.71:0/2889977098 conn(0x7f8c640abf50 msgr2=0x7f8c640ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.309+0000 7f8c6afb1640 1 -- 172.21.15.71:0/2889977098 shutdown_connections 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.310+0000 7f8c6afb1640 1 -- 172.21.15.71:0/2889977098 wait complete. 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.310+0000 7f8c6afb1640 10 monclient: build_initial_monmap 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.310+0000 7f8c6afb1640 10 monclient: monmap: 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:39.320 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.310+0000 7f8c6afb1640 1 Processor -- start 2024-08-19T11:19:39.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.310+0000 7f8c6afb1640 1 -- start start 2024-08-19T11:19:39.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.310+0000 7f8c6afb1640 10 monclient: init 2024-08-19T11:19:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient: _add_conns ranks=[6,7,3,0,4,2,8,5,1] 2024-08-19T11:19:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 0x7f8c641ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): picked mon.noname-d con 0x7f8c640a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:19:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8c640a6950 0x7f8c641cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): picked mon.noname-i con 0x7f8c640a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c641cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): picked mon.noname-g con 0x7f8c64139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8c640a84c0 con 0x7f8c64139710 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f8c640a3650 con 0x7f8c640a57c0 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f8c640a8700 con 0x7f8c640a6950 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6afb1640 10 monclient(hunting): authenticate will time out at 1237.352490s 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 0x7f8c641ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 0x7f8c641ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:35130/0 (socket says 172.21.15.71:35130) 2024-08-19T11:19:39.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 -- 172.21.15.71:0/1630684144 learned_addr learned my addr 172.21.15.71:0/1630684144 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): get_auth_request con 0x7f8c640a57c0 auth_method 0 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8c640a6950 0x7f8c641cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6954e640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c641cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): get_auth_request con 0x7f8c640a6950 auth_method 0 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6954e640 10 monclient(hunting): get_auth_request con 0x7f8c64139710 auth_method 0 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6954e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6954e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6954e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient(hunting): handle_auth_done global_id 104370 payload 824 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8c640a6950 msgr2=0x7f8c641cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f8c640a6950 0x7f8c641cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 msgr2=0x7f8c641cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c641cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient: _finish_hunting 0 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 monclient: found mon.noname-d 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c68d4d640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6413a170 con 0x7f8c640a57c0 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.311+0000 7f8c6954e640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8c64139710 0x7f8c641cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c68d4d640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 msgr2=0x7f8c641ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c68d4d640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 0x7f8c641ce940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c580046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c58041020 con 0x7f8c640a57c0 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: dump: 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: _finish_auth 0 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: _check_auth_tickets 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58003d50 con 0x7f8c640a57c0 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 5 monclient: authenticate success, global_id 104370 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 10 monclient: _renew_subs 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c64127d60 con 0x7f8c640a57c0 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c58037040 con 0x7f8c640a57c0 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:19:39.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c617fa640 10 monclient: dump: 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c62ffd640 4 set_mon_vals no callback set 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 10 monclient: _renew_subs 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c64128bd0 con 0x7f8c640a57c0 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 0x7f8c641252f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.314+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8c64128850 con 0x7f8c64124f10 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8c58044020 con 0x7f8c640a57c0 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c617fa640 1 --2- 172.21.15.71:0/1630684144 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4803ea80 0x7f8c48040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(259..259 src has 1..259) ==== 3506+0+0 (secure 0 0 0) 0x7f8c58071c40 con 0x7f8c640a57c0 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 0x7f8c641252f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient: get_auth_request con 0x7f8c64124f10 auth_method 0 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c6954e640 1 --2- 172.21.15.71:0/1630684144 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4803ea80 0x7f8c48040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c6954e640 10 monclient: get_auth_request con 0x7f8c4803ea80 auth_method 0 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 10 monclient(hunting): handle_auth_done global_id 45995 payload 824 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.315+0000 7f8c63fff640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c640a1f70 con 0x7f8c64124f10 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.317+0000 7f8c6954e640 1 --2- 172.21.15.71:0/1630684144 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4803ea80 0x7f8c48040f40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009fd0 tx=0x7f8c5c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.317+0000 7f8c63fff640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 msgr2=0x7f8c641252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.317+0000 7f8c63fff640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 0x7f8c641252f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c500118b0 tx=0x7f8c50011d70 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c50019070 con 0x7f8c64124f10 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 10 monclient: dump: 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.337 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8c5000f890 con 0x7f8c64124f10 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 msgr2=0x7f8c641252f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 0x7f8c641252f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c500118b0 tx=0x7f8c50011d70 comp rx=0 tx=0).stop 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 msgr2=0x7f8c641252f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.318+0000 7f8c617fa640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64124f10 0x7f8c641252f0 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8c500118b0 tx=0x7f8c50011d70 comp rx=0 tx=0).stop 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c6afb1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 0x7f8c6409fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c6afb1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8c64076c60 con 0x7f8c64125830 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 0x7f8c6409fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient: get_auth_request con 0x7f8c64125830 auth_method 0 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.324+0000 7f8c63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.325+0000 7f8c63fff640 10 monclient(hunting): handle_auth_done global_id 46004 payload 824 2024-08-19T11:19:39.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.325+0000 7f8c63fff640 1 -- 172.21.15.71:0/1630684144 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c640a6d30 con 0x7f8c64125830 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c63fff640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 msgr2=0x7f8c6409fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c63fff640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 0x7f8c6409fa10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c500118b0 tx=0x7f8c500046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8c50019040 con 0x7f8c64125830 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 10 monclient: dump: 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.341 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f8c5001e450 con 0x7f8c64125830 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:39.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.327+0000 7f8c617fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 msgr2=0x7f8c6409fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c617fa640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 0x7f8c6409fa10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c500118b0 tx=0x7f8c500046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c617fa640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 msgr2=0x7f8c6409fa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c617fa640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8c64125830 0x7f8c6409fa10 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c500118b0 tx=0x7f8c500046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:39.343 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 348350, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:39.344 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.345 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:39.347 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.350 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.352 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.353 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.355 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:39.364 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.365 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:39.366 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:39.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4803ea80 msgr2=0x7f8c48040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/1630684144 >> v2:172.21.15.135:6800/726754104 conn(0x7f8c4803ea80 0x7f8c48040f40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009fd0 tx=0x7f8c5c00b040 comp rx=0 tx=0).stop 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 10 monclient: shutdown 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 msgr2=0x7f8c641ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 --2- 172.21.15.71:0/1630684144 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f8c640a57c0 0x7f8c641ce940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c580046c0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6954e640 1 -- 172.21.15.71:0/1630684144 reap_dead start 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6954e640 1 -- 172.21.15.71:0/1630684144 reap_dead start 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 shutdown_connections 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 >> 172.21.15.71:0/1630684144 conn(0x7f8c640abf50 msgr2=0x7f8c64138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 shutdown_connections 2024-08-19T11:19:39.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.328+0000 7f8c6afb1640 1 -- 172.21.15.71:0/1630684144 wait complete. 2024-08-19T11:19:39.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:39.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-19T11:19:39.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:19:39.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.466+0000 7f32f286e640 10 monclient: get_monmap_and_config 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.466+0000 7f32f286e640 10 monclient: build_initial_monmap 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.466+0000 7f32f286e640 10 monclient: monmap: 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:19:39.467590+0000 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:19:39.467590+0000 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:19:39.468 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:19:39.469 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.467+0000 7f32f286e640 1 Processor -- start 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.467+0000 7f32f286e640 1 -- start start 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.467+0000 7f32f286e640 10 monclient: init 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient: _add_conns ranks=[0,1,4,8,9,6,2,5,10,7,3] 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f32ec0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f32ec0a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 0x7f32ec142290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient(hunting): picked mon.noname-c con 0x7f32ec0a7440 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec0a6380 con 0x7f32ec0a6950 2024-08-19T11:19:39.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec0a3650 con 0x7f32ec0a57c0 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f32ec0a5020 con 0x7f32ec0a7440 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f286e640 10 monclient(hunting): authenticate will time out at 1237.509321s 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32ebfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f32ec0a6950 0x7f32ec0a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47030/0 (socket says 172.21.15.71:47030) 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32ebfff640 1 -- 172.21.15.71:0/4197818384 learned_addr learned my addr 172.21.15.71:0/4197818384 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 1 --2- 172.21.15.71:0/4197818384 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 0x7f32ec142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): get_auth_request con 0x7f32ec0a7440 auth_method 0 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient(hunting): handle_auth_done global_id 84991 payload 274 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 1 -- 172.21.15.71:0/4197818384 >> v1:172.21.15.135:6789/0 conn(0x7f32ec0a57c0 legacy=0x7f32ec13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 1 -- 172.21.15.71:0/4197818384 >> v1:172.21.15.71:6789/0 conn(0x7f32ec0a6950 legacy=0x7f32ec0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient: _finish_hunting 0 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 1 monclient: found mon.noname-c 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.468+0000 7f32f0e0b640 1 -- 172.21.15.71:0/4197818384 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec0a84c0 con 0x7f32ec0a7440 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32f0e0b640 1 -- 172.21.15.71:0/4197818384 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 msgr2=0x7f32ec142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32f0e0b640 1 --2- 172.21.15.71:0/4197818384 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 0x7f32ec142290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009dc0 tx=0x7f32e402a480 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2cd78a4642107b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 1 -- 172.21.15.71:0/4197818384 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32e4007ca0 con 0x7f32ec0a7440 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: dump: 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.477 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: _finish_auth 0 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: _check_auth_tickets 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 1 -- 172.21.15.71:0/4197818384 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4031400 con 0x7f32ec0a7440 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32f286e640 5 monclient: authenticate success, global_id 84991 2024-08-19T11:19:39.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32f286e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 1 -- 172.21.15.71:0/4197818384 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32e4007e60 con 0x7f32ec0a7440 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32eaffd640 10 monclient: dump: 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.479 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32f286e640 10 monclient: get_monmap_and_config success 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.471+0000 7f32f286e640 4 set_mon_vals no callback set 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 10 monclient: shutdown 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 -- 172.21.15.71:0/4197818384 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 msgr2=0x7f32ec142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 --2- 172.21.15.71:0/4197818384 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 0x7f32ec142290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009dc0 tx=0x7f32e402a480 comp rx=0 tx=0).stop 2024-08-19T11:19:39.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 -- 172.21.15.71:0/4197818384 shutdown_connections 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 --2- 172.21.15.71:0/4197818384 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f32ec0a7440 0x7f32ec142290 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 -- 172.21.15.71:0/4197818384 >> 172.21.15.71:0/4197818384 conn(0x7f32ec0abf50 msgr2=0x7f32ec0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 -- 172.21.15.71:0/4197818384 shutdown_connections 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 1 -- 172.21.15.71:0/4197818384 wait complete. 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 10 monclient: build_initial_monmap 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.472+0000 7f32f286e640 10 monclient: monmap: 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.481 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 Processor -- start 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 -- start start 2024-08-19T11:19:39.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient: init 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient: _reopen_session rank -1 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient: _add_conns ranks=[5,1,8,0,4,6,3,2,7] 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 0x7f32ec12a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): picked mon.noname-h con 0x7f32ec0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32ec0a6950 0x7f32ec1ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): picked mon.noname-f con 0x7f32ec0a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32ec0a7440 0x7f32ec1cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): picked mon.noname-e con 0x7f32ec0a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0a8700 con 0x7f32ec0a6950 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f32ec0a7d40 con 0x7f32ec0a57c0 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f32ec1427d0 con 0x7f32ec0a7440 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): _renew_subs 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f286e640 10 monclient(hunting): authenticate will time out at 1237.514947s 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f0e0b640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32ec0a7440 msgr2=0x7f32ec1cecf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.473+0000 7f32f0e0b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32ec0a7440 0x7f32ec1cecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 0x7f32ec12a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32ec0a6950 0x7f32ec1ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 0x7f32ec12a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:42198/0 (socket says 172.21.15.71:42198) 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 -- 172.21.15.71:0/3298819275 learned_addr learned my addr 172.21.15.71:0/3298819275 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:19:39.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): get_auth_request con 0x7f32ec0a57c0 auth_method 0 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): get_auth_request con 0x7f32ec0a6950 auth_method 0 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient(hunting): handle_auth_done global_id 46013 payload 824 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32ec0a7440 msgr2=0x7f32ec1cecf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f32ec0a7440 0x7f32ec1cecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32ec0a6950 msgr2=0x7f32ec1ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32ec0a6950 0x7f32ec1ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient: _finish_hunting 0 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 monclient: found mon.noname-h 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.474+0000 7f32ebfff640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec129370 con 0x7f32ec0a57c0 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.476+0000 7f32ebfff640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 msgr2=0x7f32ec12a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.476+0000 7f32ebfff640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 0x7f32ec12a6e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c460 tx=0x7f32dc00c920 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32dc005cf0 con 0x7f32ec0a57c0 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: dump: 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0074e0 con 0x7f32ec0a57c0 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32dc007690 con 0x7f32ec0a57c0 2024-08-19T11:19:39.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 5 monclient: authenticate success, global_id 46013 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 10 monclient: _renew_subs 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec129940 con 0x7f32ec0a57c0 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32e8ff9640 10 monclient: dump: 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.495 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32ea7fc640 4 set_mon_vals no callback set 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 10 monclient: _renew_subs 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec12a1e0 con 0x7f32ec0a57c0 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:39.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 0x7f32ec126390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.477+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f32ec076c60 con 0x7f32ec1cf230 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 0x7f32ec126390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient: get_auth_request con 0x7f32ec1cf230 auth_method 0 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f32dc007070 con 0x7f32ec0a57c0 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_done global_id 84904 payload 824 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32eb7fe640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32ec1cf610 con 0x7f32ec1cf230 2024-08-19T11:19:39.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32e8ff9640 1 --2- 172.21.15.71:0/3298819275 >> v2:172.21.15.135:6800/726754104 conn(0x7f32d803ea80 0x7f32d8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(259..259 src has 1..259) ==== 3506+0+0 (secure 0 0 0) 0x7f32dc051660 con 0x7f32ec0a57c0 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32f0e0b640 1 --2- 172.21.15.71:0/3298819275 >> v2:172.21.15.135:6800/726754104 conn(0x7f32d803ea80 0x7f32d8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.478+0000 7f32f0e0b640 10 monclient: get_auth_request con 0x7f32d803ea80 auth_method 0 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.480+0000 7f32eb7fe640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 msgr2=0x7f32ec126390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.480+0000 7f32eb7fe640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 0x7f32ec126390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32ec1284f0 tx=0x7f32e000fc00 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32e0018030 con 0x7f32ec1cf230 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 10 monclient: dump: 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.498 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32f0e0b640 1 --2- 172.21.15.71:0/3298819275 >> v2:172.21.15.135:6800/726754104 conn(0x7f32d803ea80 0x7f32d8040f40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0a2e70 tx=0x7f32e402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f32e000d9b0 con 0x7f32ec1cf230 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 msgr2=0x7f32ec126390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 0x7f32ec126390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32ec1284f0 tx=0x7f32e000fc00 comp rx=0 tx=0).stop 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 msgr2=0x7f32ec126390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.481+0000 7f32e8ff9640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1cf230 0x7f32ec126390 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f32ec1284f0 tx=0x7f32e000fc00 comp rx=0 tx=0).stop 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32f286e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32f286e640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 0x7f32ec126ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32f286e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f32ec127220 con 0x7f32ec1268d0 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 0x7f32ec126ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient: get_auth_request con 0x7f32ec1268d0 auth_method 0 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:19:39.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:19:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:19:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:19:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:19:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.487+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:19:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.488+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_done global_id 84913 payload 824 2024-08-19T11:19:39.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.488+0000 7f32eb7fe640 1 -- 172.21.15.71:0/3298819275 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32ec129db0 con 0x7f32ec1268d0 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.490+0000 7f32eb7fe640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 msgr2=0x7f32ec126ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.490+0000 7f32eb7fe640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 0x7f32ec126ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32ec1284f0 tx=0x7f32e0003760 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.490+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f32e001dbe0 con 0x7f32ec1268d0 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.490+0000 7f32e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.490+0000 7f32e8ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.490+0000 7f32e8ff9640 10 monclient: dump: 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:19:39.502 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:19:39.503 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f32e0003f00 con 0x7f32ec1268d0 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 msgr2=0x7f32ec126ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 0x7f32ec126ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32ec1284f0 tx=0x7f32e0003760 comp rx=0 tx=0).stop 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 msgr2=0x7f32ec126ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32e8ff9640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f32ec1268d0 0x7f32ec126ce0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f32ec1284f0 tx=0x7f32e0003760 comp rx=0 tx=0).stop 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:39.504 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 182, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 161651, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:19:39.505 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.506 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.507 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:19:39.508 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:19:39.509 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.510 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:19:39.513 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:19:39.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.520 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:19:39.525 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.526 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:19:39.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:19:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:19:39.528 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:19:39.528 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:19:39.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 >> v2:172.21.15.135:6800/726754104 conn(0x7f32d803ea80 msgr2=0x7f32d8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 --2- 172.21.15.71:0/3298819275 >> v2:172.21.15.135:6800/726754104 conn(0x7f32d803ea80 0x7f32d8040f40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0a2e70 tx=0x7f32e402f000 comp rx=0 tx=0).stop 2024-08-19T11:19:39.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 10 monclient: shutdown 2024-08-19T11:19:39.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:19:39.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 msgr2=0x7f32ec12a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 --2- 172.21.15.71:0/3298819275 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f32ec0a57c0 0x7f32ec12a6e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c460 tx=0x7f32dc00c920 comp rx=0 tx=0).stop 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f0e0b640 1 -- 172.21.15.71:0/3298819275 reap_dead start 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f0e0b640 1 -- 172.21.15.71:0/3298819275 reap_dead start 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 shutdown_connections 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 >> 172.21.15.71:0/3298819275 conn(0x7f32ec0abf50 msgr2=0x7f32ec09f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 shutdown_connections 2024-08-19T11:19:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:19:39.491+0000 7f32f286e640 1 -- 172.21.15.71:0/3298819275 wait complete. 2024-08-19T11:19:39.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:19:39.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:19:40.957 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: starting. 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28248 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: created object 0... 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: created object 25... 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: created object 49... 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: finishing. 2024-08-19T11:19:40.958 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28283]: shutting down. 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28285]: starting. 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28285]: listing objects. 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28285]: listed object 0... 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28285]: listed object 25... 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28285]: saw 50 objects 2024-08-19T11:19:41.001 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28285]: shutting down. 2024-08-19T11:19:41.858 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:41.858 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28284]: starting. 2024-08-19T11:19:41.858 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28284]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28248 2024-08-19T11:19:41.858 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28284]: shutting down. 2024-08-19T11:19:41.859 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:41.859 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:41.859 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:41.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: starting. 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28351 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: created object 0... 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: created object 25... 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: created object 49... 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: finishing. 2024-08-19T11:19:43.973 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28352]: shutting down. 2024-08-19T11:19:44.878 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28353]: starting. 2024-08-19T11:19:44.878 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28353]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28351 2024-08-19T11:19:44.879 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28353]: shutting down. 2024-08-19T11:19:46.843 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: starting. 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28351 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: created object 0... 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: created object 25... 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: created object 49... 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: finishing. 2024-08-19T11:19:46.844 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28386]: shutting down. 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28388]: starting. 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28388]: listing objects. 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28388]: listed object 0... 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28388]: listed object 25... 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28388]: saw 50 objects 2024-08-19T11:19:46.882 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28388]: shutting down. 2024-08-19T11:19:47.032 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:47.032 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28387]: starting. 2024-08-19T11:19:47.032 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28387]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28351 2024-08-19T11:19:47.032 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28387]: shutting down. 2024-08-19T11:19:47.034 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:47.034 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:47.034 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:47.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: starting. 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28454 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: created object 0... 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: created object 25... 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: created object 49... 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: finishing. 2024-08-19T11:19:49.357 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28455]: shutting down. 2024-08-19T11:19:50.308 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28456]: starting. 2024-08-19T11:19:50.308 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28456]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28454 2024-08-19T11:19:50.308 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28456]: shutting down. 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: starting. 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28454 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: created object 0... 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: created object 25... 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: created object 49... 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: finishing. 2024-08-19T11:19:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28489]: shutting down. 2024-08-19T11:19:52.537 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28491]: starting. 2024-08-19T11:19:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28491]: listing objects. 2024-08-19T11:19:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28491]: listed object 0... 2024-08-19T11:19:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28491]: listed object 25... 2024-08-19T11:19:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28491]: saw 50 objects 2024-08-19T11:19:52.538 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28491]: shutting down. 2024-08-19T11:19:53.399 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:53.399 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28490]: starting. 2024-08-19T11:19:53.399 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28490]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28454 2024-08-19T11:19:53.399 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28490]: shutting down. 2024-08-19T11:19:53.400 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:53.400 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:53.400 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:53.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: starting. 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28557 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: created object 0... 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: created object 25... 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: created object 49... 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: finishing. 2024-08-19T11:19:55.517 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28558]: shutting down. 2024-08-19T11:19:56.034 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28559]: starting. 2024-08-19T11:19:56.034 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28559]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28557 2024-08-19T11:19:56.034 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28559]: shutting down. 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: starting. 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28557 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: created object 0... 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: created object 25... 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: created object 49... 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: finishing. 2024-08-19T11:19:58.410 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28592]: shutting down. 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28594]: starting. 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28594]: listing objects. 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28594]: listed object 0... 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28594]: listed object 25... 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28594]: saw 50 objects 2024-08-19T11:19:58.771 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28594]: shutting down. 2024-08-19T11:19:59.532 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-19T11:19:59.532 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-19T11:19:59.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-19T11:19:59.535 INFO:tasks.ceph.mon.e:Started 2024-08-19T11:19:59.535 INFO:tasks.mon_thrash:Sending STOP to mon d 2024-08-19T11:19:59.536 INFO:tasks.ceph.mon.d:Sent signal 19 2024-08-19T11:19:59.536 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-08-19T11:19:59.536 INFO:tasks.ceph.mon.i:Sent signal 19 2024-08-19T11:19:59.536 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-08-19T11:19:59.723 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:59.723 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28593]: starting. 2024-08-19T11:19:59.723 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28593]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28557 2024-08-19T11:19:59.723 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28593]: shutting down. 2024-08-19T11:19:59.724 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:59.724 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:19:59.724 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:19:59.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:20:14.537 INFO:tasks.mon_thrash:Sending CONT to mon d 2024-08-19T11:20:14.537 INFO:tasks.ceph.mon.d:Sent signal 18 2024-08-19T11:20:14.537 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-08-19T11:20:14.538 INFO:tasks.ceph.mon.i:Sent signal 18 2024-08-19T11:20:14.538 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:20:14.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.650+0000 7f596cd53640 10 monclient: get_monmap_and_config 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.650+0000 7f596cd53640 10 monclient: build_initial_monmap 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.650+0000 7f596cd53640 10 monclient: monmap: 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:14.650893+0000 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:14.650893+0000 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:14.651 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:14.652 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 Processor -- start 2024-08-19T11:20:14.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 -- start start 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient: init 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient: _add_conns ranks=[8,7,5,0,1,2,3,10,9,4,6] 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): picked mon.noname-e con 0x7f59680a3d80 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5968136ab0 0x7f5968136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): picked mon.noname-i con 0x7f5968136ab0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 0x7f59680a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): picked mon.noname-h con 0x7f59680a4160 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f59680a1fa0 con 0x7f59680a4160 2024-08-19T11:20:14.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f596809fe70 con 0x7f5968136ab0 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f59681373d0 con 0x7f59680a3d80 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596cd53640 10 monclient(hunting): authenticate will time out at 1272.692644s 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:41724/0 (socket says 172.21.15.71:41724) 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 -- 172.21.15.71:0/1211653838 learned_addr learned my addr 172.21.15.71:0/1211653838 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 10 monclient(hunting): get_auth_request con 0x7f59680a3d80 auth_method 0 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 -- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 msgr2=0x7f5968136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 -- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 msgr2=0x7f5968136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f596659c640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f595ffff640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5968136ab0 0x7f5968136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 0x7f59680a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f595ffff640 10 monclient(hunting): get_auth_request con 0x7f5968136ab0 auth_method 0 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f595ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f595ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f595ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.651+0000 7f5966d9d640 10 monclient(hunting): get_auth_request con 0x7f59680a4160 auth_method 0 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:14.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f595ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f595ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f595ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient(hunting): handle_auth_done global_id 46112 payload 274 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 1 -- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 msgr2=0x7f5968136570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 1 -- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5968136ab0 msgr2=0x7f5968136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5968136ab0 0x7f5968136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 1 monclient: found mon.noname-h 2024-08-19T11:20:14.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f5966d9d640 1 -- 172.21.15.71:0/1211653838 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59680a0b70 con 0x7f59680a4160 2024-08-19T11:20:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.652+0000 7f595ffff640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5968136ab0 0x7f5968136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5966d9d640 1 -- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 msgr2=0x7f59680a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:14.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 0x7f59680a45e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5960009dc0 tx=0x7f596002a470 comp rx=0 tx=0).ready entity=mon.5 client_cookie=f5be3902e02cd213 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 1 -- 172.21.15.71:0/1211653838 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5960007bc0 con 0x7f59680a4160 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: dump: 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.667 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: _finish_auth 0 2024-08-19T11:20:14.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 1 -- 172.21.15.71:0/1211653838 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5960007d80 con 0x7f59680a4160 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f596cd53640 5 monclient: authenticate success, global_id 46112 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 1 -- 172.21.15.71:0/1211653838 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5960031870 con 0x7f59680a4160 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f596cd53640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f596cd53640 4 set_mon_vals no callback set 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.655+0000 7f5965d9b640 10 monclient: dump: 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 10 monclient: shutdown 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 -- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 msgr2=0x7f59680a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 0x7f59680a45e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5960009dc0 tx=0x7f596002a470 comp rx=0 tx=0).stop 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 -- 172.21.15.71:0/1211653838 shutdown_connections 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f59680a4160 0x7f59680a45e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5968136ab0 0x7f5968136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 --2- 172.21.15.71:0/1211653838 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f59680a3d80 0x7f5968136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 -- 172.21.15.71:0/1211653838 >> 172.21.15.71:0/1211653838 conn(0x7f59680a91d0 msgr2=0x7f59680a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 -- 172.21.15.71:0/1211653838 shutdown_connections 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 1 -- 172.21.15.71:0/1211653838 wait complete. 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 10 monclient: build_initial_monmap 2024-08-19T11:20:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.656+0000 7f596cd53640 10 monclient: monmap: 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:14.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 Processor -- start 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 -- start start 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient: init 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient: _add_conns ranks=[3,1,5,8,0,4,6,2,7] 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59680a3d80 0x7f59681ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): picked mon.noname-g con 0x7f59680a3d80 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 0x7f59681cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): picked mon.noname-f con 0x7f59680a4160 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 0x7f5968126090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): picked mon.noname-h con 0x7f5968136ab0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59680a08c0 con 0x7f59680a4160 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59680a2520 con 0x7f59680a3d80 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f59680a2ca0 con 0x7f5968136ab0 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.657+0000 7f596cd53640 10 monclient(hunting): authenticate will time out at 1272.698763s 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 0x7f5968126090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 0x7f59681cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59680a3d80 0x7f59681ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 0x7f5968126090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:58256/0 (socket says 172.21.15.71:58256) 2024-08-19T11:20:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 0x7f59681cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:32812/0 (socket says 172.21.15.71:32812) 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): get_auth_request con 0x7f59680a3d80 auth_method 0 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 -- 172.21.15.71:0/1826200116 learned_addr learned my addr 172.21.15.71:0/1826200116 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): get_auth_request con 0x7f5968136ab0 auth_method 0 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:14.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): get_auth_request con 0x7f59680a4160 auth_method 0 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:14.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient(hunting): handle_auth_done global_id 46121 payload 824 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 -- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59680a3d80 msgr2=0x7f59681ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59680a3d80 0x7f59681ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 -- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 msgr2=0x7f59681cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 0x7f59681cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 monclient: found mon.noname-h 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f5966d9d640 1 -- 172.21.15.71:0/1826200116 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59680a1750 con 0x7f5968136ab0 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f596659c640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59680a3d80 0x7f59681ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.658+0000 7f595ffff640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 0x7f59681cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f5966d9d640 1 -- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 msgr2=0x7f5968126090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:14.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f5966d9d640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 0x7f5968126090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5960009dc0 tx=0x7f5960004a40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f59600046c0 con 0x7f5968136ab0 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 10 monclient: dump: 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:14.678 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 10 monclient: _finish_auth 0 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.660+0000 7f595effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596003c420 con 0x7f5968136ab0 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f595effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f596003ca40 con 0x7f5968136ab0 2024-08-19T11:20:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f595effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f595effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f595effd640 10 monclient: dump: 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596559a640 4 set_mon_vals no callback set 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 5 monclient: authenticate success, global_id 46121 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 10 monclient: _renew_subs 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59680a00a0 con 0x7f5968136ab0 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 10 monclient: _renew_subs 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.661+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5968129cd0 con 0x7f5968136ab0 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f596cd53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:14.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f596cd53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f596cd53640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5960039040 con 0x7f5968136ab0 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59681371b0 con 0x7f5968136ab0 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f595effd640 1 --2- 172.21.15.71:0/1826200116 >> v2:172.21.15.135:6800/726754104 conn(0x7f594803ea80 0x7f5948040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 5 ==== osd_map(280..280 src has 1..280) ==== 3506+0+0 (secure 0 0 0) 0x7f5960072ff0 con 0x7f5968136ab0 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f596659c640 1 --2- 172.21.15.71:0/1826200116 >> v2:172.21.15.135:6800/726754104 conn(0x7f594803ea80 0x7f5948040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.662+0000 7f596659c640 10 monclient: get_auth_request con 0x7f594803ea80 auth_method 0 2024-08-19T11:20:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.665+0000 7f596659c640 1 --2- 172.21.15.71:0/1826200116 >> v2:172.21.15.135:6800/726754104 conn(0x7f594803ea80 0x7f5948040f40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f5958008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.667+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f5960040030 con 0x7f5968136ab0 2024-08-19T11:20:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.667+0000 7f595effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.667+0000 7f595effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.907+0000 7f596cd53640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:14.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.907+0000 7f596cd53640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.907+0000 7f596cd53640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.135:3302/0 2024-08-19T11:20:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.907+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5968136260 con 0x7f5968136ab0 2024-08-19T11:20:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.908+0000 7f595effd640 1 -- 172.21.15.71:0/1826200116 <== mon.5 v2:172.21.15.135:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3181 (secure 0 0 0) 0x7f596003ce20 con 0x7f5968136ab0 2024-08-19T11:20:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.908+0000 7f595effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:14.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.908+0000 7f595effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:14.909 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":188,"quorum":[0,1,2,3,4,5,7],"quorum_names":["a","f","b","g","c","h","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:14.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 >> v2:172.21.15.135:6800/726754104 conn(0x7f594803ea80 msgr2=0x7f5948040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 --2- 172.21.15.71:0/1826200116 >> v2:172.21.15.135:6800/726754104 conn(0x7f594803ea80 0x7f5948040f40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f595800b310 tx=0x7f5958008040 comp rx=0 tx=0).stop 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 10 monclient: shutdown 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 msgr2=0x7f5968126090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 0x7f5968126090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5960009dc0 tx=0x7f5960004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 shutdown_connections 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 --2- 172.21.15.71:0/1826200116 >> v2:172.21.15.135:6800/726754104 conn(0x7f594803ea80 0x7f5948040f40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5968136ab0 0x7f5968126090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59680a4160 0x7f59681cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 --2- 172.21.15.71:0/1826200116 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59680a3d80 0x7f59681ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 >> 172.21.15.71:0/1826200116 conn(0x7f59680a91d0 msgr2=0x7f596809f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 shutdown_connections 2024-08-19T11:20:14.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:14.910+0000 7f596cd53640 1 -- 172.21.15.71:0/1826200116 wait complete. 2024-08-19T11:20:16.767 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: starting. 2024-08-19T11:20:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28660 2024-08-19T11:20:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: created object 0... 2024-08-19T11:20:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: created object 25... 2024-08-19T11:20:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: created object 49... 2024-08-19T11:20:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: finishing. 2024-08-19T11:20:16.768 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28661]: shutting down. 2024-08-19T11:20:17.665 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28662]: starting. 2024-08-19T11:20:17.665 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28662]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28660 2024-08-19T11:20:17.665 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28662]: shutting down. 2024-08-19T11:20:17.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.031+0000 7f6111a15640 10 monclient: get_monmap_and_config 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.031+0000 7f6111a15640 10 monclient: build_initial_monmap 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.031+0000 7f6111a15640 10 monclient: monmap: 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:18.031876+0000 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:18.031876+0000 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:18.032 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:18.033 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:18.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.031+0000 7f6111a15640 1 Processor -- start 2024-08-19T11:20:18.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.031+0000 7f6111a15640 1 -- start start 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.031+0000 7f6111a15640 10 monclient: init 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient: _add_conns ranks=[1,10,3,5,7,0,9,2,8,6,4] 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f610c06c8a0 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f610c06d390 0x7f610c09d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): picked mon.noname-f con 0x7f610c06d390 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c13c7c0 0x7f610c13ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): picked mon.noname-g con 0x7f610c13c7c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c0a3ff0 con 0x7f610c06c8a0 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:18.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f610c09cb90 con 0x7f610c06d390 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0a5650 con 0x7f610c13c7c0 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f6111a15640 10 monclient(hunting): authenticate will time out at 1276.073531s 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f610c06d390 0x7f610c09d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c13c7c0 0x7f610c13ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610affd640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f610c06c8a0 0x7f610c06cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:46480/0 (socket says 172.21.15.71:46480) 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610affd640 1 -- 172.21.15.71:0/2732487848 learned_addr learned my addr 172.21.15.71:0/2732487848 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): get_auth_request con 0x7f610c06d390 auth_method 0 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:18.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): get_auth_request con 0x7f610c13c7c0 auth_method 0 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.032+0000 7f610b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 10 monclient(hunting): handle_auth_done global_id 85114 payload 274 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 1 -- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c13c7c0 msgr2=0x7f610c13ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:18.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 1 --2- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c13c7c0 0x7f610c13ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 1 -- 172.21.15.71:0/2732487848 >> v1:172.21.15.135:6789/0 conn(0x7f610c06c8a0 legacy=0x7f610c06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 1 monclient: found mon.noname-f 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610a7fc640 1 -- 172.21.15.71:0/2732487848 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c0a2f00 con 0x7f610c06d390 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.033+0000 7f610b7fe640 1 --2- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c13c7c0 0x7f610c13ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.035+0000 7f610a7fc640 1 -- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c06d390 msgr2=0x7f610c09d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.035+0000 7f610a7fc640 1 --2- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c06d390 0x7f610c09d4c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f60f40097a0 tx=0x7f60f4029fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=483aa204e1dcb522 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 1 -- 172.21.15.71:0/2732487848 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60f4037070 con 0x7f610c06d390 2024-08-19T11:20:18.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: dump: 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:18.042 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 1 -- 172.21.15.71:0/2732487848 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f402ad30 con 0x7f610c06d390 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 5 monclient: authenticate success, global_id 85114 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:18.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 1 -- 172.21.15.71:0/2732487848 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60f4030c20 con 0x7f610c06d390 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6109ffb640 10 monclient: dump: 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:18.044 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 4 set_mon_vals no callback set 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 10 monclient: shutdown 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 -- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c06d390 msgr2=0x7f610c09d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 --2- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c06d390 0x7f610c09d4c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f60f40097a0 tx=0x7f60f4029fd0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 -- 172.21.15.71:0/2732487848 shutdown_connections 2024-08-19T11:20:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 --2- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c13c7c0 0x7f610c13ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 --2- 172.21.15.71:0/2732487848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c06d390 0x7f610c09d4c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 -- 172.21.15.71:0/2732487848 >> 172.21.15.71:0/2732487848 conn(0x7f610c0a91d0 msgr2=0x7f610c0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 -- 172.21.15.71:0/2732487848 shutdown_connections 2024-08-19T11:20:18.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.036+0000 7f6111a15640 1 -- 172.21.15.71:0/2732487848 wait complete. 2024-08-19T11:20:18.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.037+0000 7f6111a15640 10 monclient: build_initial_monmap 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.037+0000 7f6111a15640 10 monclient: monmap: 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:18.051 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.037+0000 7f6111a15640 1 Processor -- start 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 -- start start 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient: init 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient: _add_conns ranks=[8,4,2,6,0,1,3,7,5] 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): picked mon.noname-e con 0x7f610c06c8a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:18.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f610c06d390 0x7f610c13b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): picked mon.noname-c con 0x7f610c06d390 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 0x7f610c13bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): picked mon.noname-b con 0x7f610c13c7c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f610c13f0f0 con 0x7f610c13c7c0 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f610c0a3d50 con 0x7f610c06d390 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f610c13f270 con 0x7f610c06c8a0 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f6111a15640 10 monclient(hunting): authenticate will time out at 1276.079652s 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:18.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f610c06d390 0x7f610c13b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:50904/0 (socket says 172.21.15.71:50904) 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 -- 172.21.15.71:0/1486848593 learned_addr learned my addr 172.21.15.71:0/1486848593 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 10 monclient(hunting): get_auth_request con 0x7f610c06c8a0 auth_method 0 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 0x7f610c13bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): get_auth_request con 0x7f610c13c7c0 auth_method 0 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): get_auth_request con 0x7f610c06d390 auth_method 0 2024-08-19T11:20:18.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 -- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 msgr2=0x7f610c1ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 -- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 msgr2=0x7f610c1ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.038+0000 7f610affd640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:18.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 10 monclient(hunting): handle_auth_done global_id 75494 payload 824 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 1 -- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 msgr2=0x7f610c1ce380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 1 -- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f610c06d390 msgr2=0x7f610c13b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f610c06d390 0x7f610c13b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 1 monclient: found mon.noname-b 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610b7fe640 1 -- 172.21.15.71:0/1486848593 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c0a1c10 con 0x7f610c13c7c0 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.039+0000 7f610a7fc640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f610c06d390 0x7f610c13b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f610b7fe640 1 -- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 msgr2=0x7f610c13bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f610b7fe640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 0x7f610c13bdb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00e7d0 tx=0x7f60fc00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:18.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60fc017070 con 0x7f610c13c7c0 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: dump: 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:18.057 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: _finish_auth 0 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 5 monclient: authenticate success, global_id 75494 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc013470 con 0x7f610c13c7c0 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 10 monclient: _renew_subs 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:18.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c126870 con 0x7f610c13c7c0 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f60fc013a90 con 0x7f610c13c7c0 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6103fff640 10 monclient: dump: 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:18.059 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f61097fa640 4 set_mon_vals no callback set 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 10 monclient: _renew_subs 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:18.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.041+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c127a80 con 0x7f610c13c7c0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f60fc013c30 con 0x7f610c13c7c0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6111a15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6111a15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6111a15640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c09d4c0 con 0x7f610c13c7c0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6103fff640 1 --2- 172.21.15.71:0/1486848593 >> v2:172.21.15.135:6800/726754104 conn(0x7f60ec03ea80 0x7f60ec040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.042+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(283..283 src has 1..283) ==== 3506+0+0 (secure 0 0 0) 0x7f60fc00f040 con 0x7f610c13c7c0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.043+0000 7f610affd640 1 --2- 172.21.15.71:0/1486848593 >> v2:172.21.15.135:6800/726754104 conn(0x7f60ec03ea80 0x7f60ec040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.043+0000 7f610affd640 10 monclient: get_auth_request con 0x7f60ec03ea80 auth_method 0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.045+0000 7f610affd640 1 --2- 172.21.15.71:0/1486848593 >> v2:172.21.15.135:6800/726754104 conn(0x7f60ec03ea80 0x7f60ec040f40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f61040052a0 tx=0x7f6104009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.047+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f60fc020070 con 0x7f610c13c7c0 2024-08-19T11:20:18.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.047+0000 7f6103fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:18.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.047+0000 7f6103fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6111a15640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6111a15640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6111a15640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:18.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f610c0a98d0 con 0x7f610c13c7c0 2024-08-19T11:20:18.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6103fff640 1 -- 172.21.15.71:0/1486848593 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3181 (secure 0 0 0) 0x7f60fc050820 con 0x7f610c13c7c0 2024-08-19T11:20:18.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6103fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:18.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.290+0000 7f6103fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:18.292 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":188,"quorum":[0,1,2,3,4,5,7],"quorum_names":["a","f","b","g","c","h","i"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 >> v2:172.21.15.135:6800/726754104 conn(0x7f60ec03ea80 msgr2=0x7f60ec040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 --2- 172.21.15.71:0/1486848593 >> v2:172.21.15.135:6800/726754104 conn(0x7f60ec03ea80 0x7f60ec040f40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f61040052a0 tx=0x7f6104009040 comp rx=0 tx=0).stop 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 10 monclient: shutdown 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 msgr2=0x7f610c13bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 0x7f610c13bdb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00e7d0 tx=0x7f60fc00ec90 comp rx=0 tx=0).stop 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 shutdown_connections 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 --2- 172.21.15.71:0/1486848593 >> v2:172.21.15.135:6800/726754104 conn(0x7f60ec03ea80 0x7f60ec040f40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f610c13c7c0 0x7f610c13bdb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f610c06d390 0x7f610c13b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 --2- 172.21.15.71:0/1486848593 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f610c06c8a0 0x7f610c1ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.292+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 >> 172.21.15.71:0/1486848593 conn(0x7f610c0a91d0 msgr2=0x7f610c09e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.293+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 shutdown_connections 2024-08-19T11:20:18.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:18.293+0000 7f6111a15640 1 -- 172.21.15.71:0/1486848593 wait complete. 2024-08-19T11:20:19.807 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:19.807 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: starting. 2024-08-19T11:20:19.807 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28660 2024-08-19T11:20:19.807 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: created object 0... 2024-08-19T11:20:19.808 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: created object 25... 2024-08-19T11:20:19.808 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: created object 49... 2024-08-19T11:20:19.808 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: finishing. 2024-08-19T11:20:19.808 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28697]: shutting down. 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28699]: starting. 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28699]: listing objects. 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28699]: listed object 0... 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28699]: listed object 25... 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28699]: saw 50 objects 2024-08-19T11:20:19.846 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28699]: shutting down. 2024-08-19T11:20:20.709 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:20.709 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28698]: starting. 2024-08-19T11:20:20.709 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28698]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28660 2024-08-19T11:20:20.709 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28698]: shutting down. 2024-08-19T11:20:20.710 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:20.710 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:20.710 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:20:20.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:20:21.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:21.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.402+0000 7fbd8b7aa640 10 monclient: get_monmap_and_config 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.402+0000 7fbd8b7aa640 10 monclient: build_initial_monmap 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.403+0000 7fbd8b7aa640 10 monclient: monmap: 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:21.403615+0000 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:21.403615+0000 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:21.404 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:21.405 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.403+0000 7fbd8b7aa640 1 Processor -- start 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.403+0000 7fbd8b7aa640 1 -- start start 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.403+0000 7fbd8b7aa640 10 monclient: init 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient: _add_conns ranks=[8,5,10,2,3,9,4,7,6,0,1] 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 0x7fbd840a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): picked mon.noname-e con 0x7fbd840a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6e10 0x7fbd840a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): picked mon.noname-h con 0x7fbd840a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd84139860 0x7fbd84139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): picked mon.noname-f con 0x7fbd84139860 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbd840a4f90 con 0x7fbd84139860 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbd840a6380 con 0x7fbd840a6e10 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbd840a49d0 con 0x7fbd840a6a30 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:21.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd8b7aa640 10 monclient(hunting): authenticate will time out at 1279.445259s 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 0x7fbd840a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 0x7fbd840a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:50928/0 (socket says 172.21.15.71:50928) 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 -- 172.21.15.71:0/2469810812 learned_addr learned my addr 172.21.15.71:0/2469810812 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): get_auth_request con 0x7fbd840a6a30 auth_method 0 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd88d45640 1 --2- 172.21.15.71:0/2469810812 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6e10 0x7fbd840a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd88d45640 10 monclient(hunting): get_auth_request con 0x7fbd840a6e10 auth_method 0 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd88d45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd88d45640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd88d45640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89d47640 1 --2- 172.21.15.71:0/2469810812 >> v2:172.21.15.135:3300/0 conn(0x7fbd84139860 0x7fbd84139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89d47640 10 monclient(hunting): get_auth_request con 0x7fbd84139860 auth_method 0 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89d47640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89d47640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient(hunting): handle_auth_done global_id 114128 payload 274 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 -- 172.21.15.71:0/2469810812 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6e10 msgr2=0x7fbd840a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 --2- 172.21.15.71:0/2469810812 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6e10 0x7fbd840a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 -- 172.21.15.71:0/2469810812 >> v2:172.21.15.135:3300/0 conn(0x7fbd84139860 msgr2=0x7fbd84139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:21.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 --2- 172.21.15.71:0/2469810812 >> v2:172.21.15.135:3300/0 conn(0x7fbd84139860 0x7fbd84139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient: _finish_hunting 0 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 monclient: found mon.noname-e 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.404+0000 7fbd89546640 1 -- 172.21.15.71:0/2469810812 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd840a46f0 con 0x7fbd840a6a30 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd89546640 1 -- 172.21.15.71:0/2469810812 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 msgr2=0x7fbd840a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd89546640 1 --2- 172.21.15.71:0/2469810812 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 0x7fbd840a57f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009870 tx=0x7fbd8002a0a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=cbf7a0c42cdc265d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 1 -- 172.21.15.71:0/2469810812 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd80037070 con 0x7fbd840a6a30 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: dump: 2024-08-19T11:20:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.417 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: _finish_auth 0 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd8b7aa640 5 monclient: authenticate success, global_id 114128 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd8b7aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 1 -- 172.21.15.71:0/2469810812 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8002ae00 con 0x7fbd840a6a30 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd8b7aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd8b7aa640 4 set_mon_vals no callback set 2024-08-19T11:20:21.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 1 -- 172.21.15.71:0/2469810812 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd80030c20 con 0x7fbd840a6a30 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.407+0000 7fbd7bfff640 10 monclient: dump: 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.419 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 10 monclient: shutdown 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/2469810812 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 msgr2=0x7fbd840a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/2469810812 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 0x7fbd840a57f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009870 tx=0x7fbd8002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/2469810812 shutdown_connections 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/2469810812 >> v2:172.21.15.135:3300/0 conn(0x7fbd84139860 0x7fbd84139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/2469810812 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6e10 0x7fbd840a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/2469810812 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbd840a6a30 0x7fbd840a57f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/2469810812 >> 172.21.15.71:0/2469810812 conn(0x7fbd840ac030 msgr2=0x7fbd840ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/2469810812 shutdown_connections 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/2469810812 wait complete. 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 10 monclient: build_initial_monmap 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.408+0000 7fbd8b7aa640 10 monclient: monmap: 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:21.421 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 Processor -- start 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 -- start start 2024-08-19T11:20:21.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient: init 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient: _add_conns ranks=[5,6,4,7,0,1,3,2,8] 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6a30 0x7fbd841ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): picked mon.noname-h con 0x7fbd840a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 0x7fbd84138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): picked mon.noname-d con 0x7fbd840a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd84139860 0x7fbd841391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): picked mon.noname-c con 0x7fbd84139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbd840a7730 con 0x7fbd84139860 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbd8413a1a0 con 0x7fbd840a6a30 2024-08-19T11:20:21.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbd840a3ed0 con 0x7fbd840a6e10 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd8b7aa640 10 monclient(hunting): authenticate will time out at 1279.450716s 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd84139860 0x7fbd841391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 0x7fbd84138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd84139860 0x7fbd841391c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53152/0 (socket says 172.21.15.71:53152) 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): get_auth_request con 0x7fbd840a6e10 auth_method 0 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 1 -- 172.21.15.71:0/3974618556 learned_addr learned my addr 172.21.15.71:0/3974618556 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): get_auth_request con 0x7fbd84139860 auth_method 0 2024-08-19T11:20:21.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd88d45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89d47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.409+0000 7fbd89546640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6a30 0x7fbd841ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd89546640 10 monclient(hunting): get_auth_request con 0x7fbd840a6a30 auth_method 0 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd89546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd89546640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd89546640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 10 monclient(hunting): handle_auth_done global_id 104451 payload 824 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 1 -- 172.21.15.71:0/3974618556 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6a30 msgr2=0x7fbd841ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6a30 0x7fbd841ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 1 -- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd84139860 msgr2=0x7fbd841391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd84139860 0x7fbd841391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 10 monclient: _finish_hunting 0 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 1 monclient: found mon.noname-d 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd88d45640 1 -- 172.21.15.71:0/3974618556 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd84126360 con 0x7fbd840a6e10 2024-08-19T11:20:21.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.410+0000 7fbd89546640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6a30 0x7fbd841ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd88d45640 1 -- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 msgr2=0x7fbd84138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd88d45640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 0x7fbd84138c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400d5f0 tx=0x7fbd7400dab0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd74012c70 con 0x7fbd840a6e10 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: dump: 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd74019070 con 0x7fbd840a6e10 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 5 monclient: authenticate success, global_id 104451 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 10 monclient: _renew_subs 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:21.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd84126640 con 0x7fbd840a6e10 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbd740148a0 con 0x7fbd840a6e10 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd79ffb640 10 monclient: dump: 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd7b7fe640 4 set_mon_vals no callback set 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 10 monclient: _renew_subs 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.412+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd84125da0 con 0x7fbd840a6e10 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbd74014430 con 0x7fbd840a6e10 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd8b7aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd8b7aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd8b7aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8413a530 con 0x7fbd840a6e10 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd79ffb640 1 --2- 172.21.15.71:0/3974618556 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd6803ea80 0x7fbd68040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(287..287 src has 1..287) ==== 3506+0+0 (secure 0 0 0) 0x7fbd7400f040 con 0x7fbd840a6e10 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.413+0000 7fbd89546640 1 --2- 172.21.15.71:0/3974618556 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd6803ea80 0x7fbd68040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.414+0000 7fbd89546640 10 monclient: get_auth_request con 0x7fbd6803ea80 auth_method 0 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.416+0000 7fbd89546640 1 --2- 172.21.15.71:0/3974618556 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd6803ea80 0x7fbd68040f40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbd80034000 tx=0x7fbd8002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.418+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fbd74050fb0 con 0x7fbd840a6e10 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.418+0000 7fbd79ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.418+0000 7fbd79ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:21.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.663+0000 7fbd8b7aa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.663+0000 7fbd8b7aa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.663+0000 7fbd8b7aa640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.663+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbd84125520 con 0x7fbd840a6e10 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.664+0000 7fbd79ffb640 1 -- 172.21.15.71:0/3974618556 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7fbd74014a40 con 0x7fbd840a6e10 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.664+0000 7fbd79ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.664+0000 7fbd79ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:21.665 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":190,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd6803ea80 msgr2=0x7fbd68040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/3974618556 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd6803ea80 0x7fbd68040f40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbd80034000 tx=0x7fbd8002e000 comp rx=0 tx=0).stop 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 10 monclient: shutdown 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 msgr2=0x7fbd84138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 0x7fbd84138c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400d5f0 tx=0x7fbd7400dab0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 shutdown_connections 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/3974618556 >> v2:172.21.15.135:6800/726754104 conn(0x7fbd6803ea80 0x7fbd68040f40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbd84139860 0x7fbd841391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbd840a6e10 0x7fbd84138c80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 --2- 172.21.15.71:0/3974618556 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbd840a6a30 0x7fbd841ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 >> 172.21.15.71:0/3974618556 conn(0x7fbd840ac030 msgr2=0x7fbd841c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:21.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 shutdown_connections 2024-08-19T11:20:21.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.666+0000 7fbd8b7aa640 1 -- 172.21.15.71:0/3974618556 wait complete. 2024-08-19T11:20:21.677 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:20:21.677 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:20:21.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.775+0000 7f825b70b640 10 monclient: get_monmap_and_config 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.775+0000 7f825b70b640 10 monclient: build_initial_monmap 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.775+0000 7f825b70b640 10 monclient: monmap: 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:21.776043+0000 2024-08-19T11:20:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:21.776043+0000 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:21.778 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 Processor -- start 2024-08-19T11:20:21.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 -- start start 2024-08-19T11:20:21.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient: init 2024-08-19T11:20:21.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:21.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient: _add_conns ranks=[3,5,1,0,2,8,9,10,7,6,4] 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f82540a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): picked mon.noname-g con 0x7f82540a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 0x7f82540a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): picked mon.noname-h con 0x7f82540a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f82541397f0 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82540a2fc0 con 0x7f82541397f0 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82540a63f0 con 0x7f82540a6a30 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f82540a5000 con 0x7f82540a6e10 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.776+0000 7f825b70b640 10 monclient(hunting): authenticate will time out at 1279.817800s 2024-08-19T11:20:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f82540a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 0x7f82540a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f82540a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:39394/0 (socket says 172.21.15.71:39394) 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 1 -- 172.21.15.71:0/1038432811 learned_addr learned my addr 172.21.15.71:0/1038432811 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): get_auth_request con 0x7f82540a6a30 auth_method 0 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): get_auth_request con 0x7f82540a6e10 auth_method 0 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient(hunting): handle_auth_done global_id 46193 payload 274 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 1 -- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 msgr2=0x7f82540a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 1 --2- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f82540a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 1 -- 172.21.15.71:0/1038432811 >> v1:172.21.15.135:6789/0 conn(0x7f82541397f0 legacy=0x7f8254139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient: _finish_hunting 0 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 1 monclient: found mon.noname-h 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f8258ca6640 1 -- 172.21.15.71:0/1038432811 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540a8590 con 0x7f82540a6e10 2024-08-19T11:20:21.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.777+0000 7f82594a7640 1 --2- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f82540a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f8258ca6640 1 -- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 msgr2=0x7f82540a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f8258ca6640 1 --2- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 0x7f82540a7230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f82440097d0 tx=0x7f8244029fb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=ad029aa357e51c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 1 -- 172.21.15.71:0/1038432811 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8244037070 con 0x7f82540a6e10 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: dump: 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.789 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.790 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: _finish_auth 0 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 1 -- 172.21.15.71:0/1038432811 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824402ad10 con 0x7f82540a6e10 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 1 -- 172.21.15.71:0/1038432811 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8244030c20 con 0x7f82540a6e10 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f825b70b640 5 monclient: authenticate success, global_id 46193 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f825b70b640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f825b70b640 4 set_mon_vals no callback set 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.780+0000 7f824bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f824bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:21.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f824bfff640 10 monclient: dump: 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 10 monclient: shutdown 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 -- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 msgr2=0x7f82540a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 --2- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 0x7f82540a7230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f82440097d0 tx=0x7f8244029fb0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 -- 172.21.15.71:0/1038432811 shutdown_connections 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 --2- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f82540a6e10 0x7f82540a7230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 --2- 172.21.15.71:0/1038432811 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f82540a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 -- 172.21.15.71:0/1038432811 >> 172.21.15.71:0/1038432811 conn(0x7f82540ac030 msgr2=0x7f82540ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 -- 172.21.15.71:0/1038432811 shutdown_connections 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.781+0000 7f825b70b640 1 -- 172.21.15.71:0/1038432811 wait complete. 2024-08-19T11:20:21.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.782+0000 7f825b70b640 10 monclient: build_initial_monmap 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.782+0000 7f825b70b640 10 monclient: monmap: 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.782+0000 7f825b70b640 1 Processor -- start 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.782+0000 7f825b70b640 1 -- start start 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.782+0000 7f825b70b640 10 monclient: init 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient: _add_conns ranks=[3,1,8,0,7,5,2,6,4] 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f8254124e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): picked mon.noname-g con 0x7f82540a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82540a6e10 0x7f82541253a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): picked mon.noname-f con 0x7f82540a6e10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 0x7f82541258e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): picked mon.noname-e con 0x7f82541397f0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f825413a390 con 0x7f82540a6e10 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f82540a7770 con 0x7f82540a6a30 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f825413a510 con 0x7f82541397f0 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f825b70b640 10 monclient(hunting): authenticate will time out at 1279.824119s 2024-08-19T11:20:21.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 0x7f82541258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 0x7f82541258e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:50930/0 (socket says 172.21.15.71:50930) 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 -- 172.21.15.71:0/2003819458 learned_addr learned my addr 172.21.15.71:0/2003819458 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): get_auth_request con 0x7f82541397f0 auth_method 0 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f8254124e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): get_auth_request con 0x7f82540a6a30 auth_method 0 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82540a6e10 0x7f82541253a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): get_auth_request con 0x7f82540a6e10 auth_method 0 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f82594a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient(hunting): handle_auth_done global_id 114137 payload 824 2024-08-19T11:20:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 msgr2=0x7f8254124e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82540a6a30 0x7f8254124e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82540a6e10 msgr2=0x7f82541253a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82540a6e10 0x7f82541253a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient: _finish_hunting 0 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 monclient: found mon.noname-e 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.783+0000 7f8259ca8640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8254128c30 con 0x7f82541397f0 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.785+0000 7f8259ca8640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 msgr2=0x7f82541258e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.785+0000 7f8259ca8640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 0x7f82541258e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f824c00b9a0 tx=0x7f824c00be60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f824c019070 con 0x7f82541397f0 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: dump: 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c00cbb0 con 0x7f82541397f0 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 5 monclient: authenticate success, global_id 114137 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 10 monclient: _renew_subs 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82540a2100 con 0x7f82541397f0 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f824c00cda0 con 0x7f82541397f0 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f8249ffb640 10 monclient: dump: 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 10 monclient: _renew_subs 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8254127dc0 con 0x7f82541397f0 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.786+0000 7f824b7fe640 4 set_mon_vals no callback set 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f824c01c360 con 0x7f82541397f0 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8249ffb640 1 --2- 172.21.15.71:0/2003819458 >> v2:172.21.15.135:6800/726754104 conn(0x7f823803ea80 0x7f8238040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f825b70b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(287..287 src has 1..287) ==== 3506+0+0 (secure 0 0 0) 0x7f824c051640 con 0x7f82541397f0 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f825b70b640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 0x7f8254063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8254076c60 con 0x7f825402e340 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f82594a7640 1 --2- 172.21.15.71:0/2003819458 >> v2:172.21.15.135:6800/726754104 conn(0x7f823803ea80 0x7f8238040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f82594a7640 10 monclient: get_auth_request con 0x7f823803ea80 auth_method 0 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 0x7f8254063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient: get_auth_request con 0x7f825402e340 auth_method 0 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 10 monclient(hunting): handle_auth_done global_id 75546 payload 824 2024-08-19T11:20:21.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.787+0000 7f8258ca6640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f825402e720 con 0x7f825402e340 2024-08-19T11:20:21.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.789+0000 7f8258ca6640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 msgr2=0x7f8254063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.789+0000 7f8258ca6640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 0x7f8254063a80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8254069de0 tx=0x7f82440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.789+0000 7f82594a7640 1 --2- 172.21.15.71:0/2003819458 >> v2:172.21.15.135:6800/726754104 conn(0x7f823803ea80 0x7f8238040f40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8250006ca0 tx=0x7f8250009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8244041070 con 0x7f825402e340 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 10 monclient: dump: 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.808 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8244038040 con 0x7f825402e340 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 msgr2=0x7f8254063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 0x7f8254063a80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8254069de0 tx=0x7f82440046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 msgr2=0x7f8254063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.790+0000 7f8249ffb640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f825402e340 0x7f8254063a80 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8254069de0 tx=0x7f82440046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f825b70b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f825b70b640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 0x7f82541d8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f825b70b640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f82540a5850 con 0x7f8254063fc0 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 0x7f82541d8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient: get_auth_request con 0x7f8254063fc0 auth_method 0 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 10 monclient(hunting): handle_auth_done global_id 75555 payload 824 2024-08-19T11:20:21.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.796+0000 7f8258ca6640 1 -- 172.21.15.71:0/2003819458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f82540a0aa0 con 0x7f8254063fc0 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8258ca6640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 msgr2=0x7f82541d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8258ca6640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 0x7f82541d8a70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8244037070 con 0x7f8254063fc0 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 10 monclient: dump: 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.811 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.812 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7f8244030550 con 0x7f8254063fc0 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 msgr2=0x7f82541d8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 0x7f82541d8a70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244008030 comp rx=0 tx=0).stop 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 msgr2=0x7f82541d8a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8249ffb640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8254063fc0 0x7f82541d8a70 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244008030 comp rx=0 tx=0).stop 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:21.813 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 270832, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:21.814 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:21.815 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:21.816 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:21.817 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:21.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:21.819 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.821 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.824 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:21.826 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:21.829 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:21.831 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.833 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:21.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:21.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:21.837 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:21.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 >> v2:172.21.15.135:6800/726754104 conn(0x7f823803ea80 msgr2=0x7f8238040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 --2- 172.21.15.71:0/2003819458 >> v2:172.21.15.135:6800/726754104 conn(0x7f823803ea80 0x7f8238040f40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8250006ca0 tx=0x7f8250009240 comp rx=0 tx=0).stop 2024-08-19T11:20:21.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 10 monclient: shutdown 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 msgr2=0x7f82541258e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 0x7f82541258e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f824c00b9a0 tx=0x7f824c00be60 comp rx=0 tx=0).stop 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f8259ca8640 1 -- 172.21.15.71:0/2003819458 reap_dead start 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 shutdown_connections 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 --2- 172.21.15.71:0/2003819458 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f82541397f0 0x7f82541258e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 >> 172.21.15.71:0/2003819458 conn(0x7f82540ac030 msgr2=0x7f8254139060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.799+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 shutdown_connections 2024-08-19T11:20:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.800+0000 7f825b70b640 1 -- 172.21.15.71:0/2003819458 wait complete. 2024-08-19T11:20:21.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:21.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:20:21.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:20:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.938+0000 7f6d258a6640 10 monclient: get_monmap_and_config 2024-08-19T11:20:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.938+0000 7f6d258a6640 10 monclient: build_initial_monmap 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.938+0000 7f6d258a6640 10 monclient: monmap: 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:21.939407+0000 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:21.939407+0000 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:21.940 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:21.941 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:21.941 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:21.941 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:21.941 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:21.941 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:21.941 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 1 Processor -- start 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 1 -- start start 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 10 monclient: init 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 10 monclient: _add_conns ranks=[6,8,7,9,0,5,1,10,2,3,4] 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 0x7f6d200a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 10 monclient(hunting): picked mon.noname-d con 0x7f6d200a57d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:21.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.939+0000 7f6d258a6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 0x7f6d200a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): picked mon.noname-e con 0x7f6d200a5bb0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6d20137580 0x7f6d20137a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): picked mon.noname-i con 0x7f6d20137580 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f6d200a41b0 con 0x7f6d200a57d0 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f6d200728a0 con 0x7f6d20137580 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f6d20072620 con 0x7f6d200a5bb0 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d258a6640 10 monclient(hunting): authenticate will time out at 1279.981052s 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 0x7f6d200a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 0x7f6d200a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 0x7f6d200a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60150/0 (socket says 172.21.15.71:60150) 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 1 -- 172.21.15.71:0/2586871612 learned_addr learned my addr 172.21.15.71:0/2586871612 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): get_auth_request con 0x7f6d200a57d0 auth_method 0 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): get_auth_request con 0x7f6d200a5bb0 auth_method 0 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient(hunting): handle_auth_done global_id 114146 payload 274 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1f7fe640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6d20137580 0x7f6d20137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 -- 172.21.15.71:0/2586871612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6d20137580 msgr2=0x7f6d20137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6d20137580 0x7f6d20137a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 -- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 msgr2=0x7f6d200a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 0x7f6d200a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 monclient: found mon.noname-e 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:21.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d17fff640 1 -- 172.21.15.71:0/2586871612 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20073940 con 0x7f6d200a5bb0 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.940+0000 7f6d1effd640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 0x7f6d200a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d17fff640 1 -- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 msgr2=0x7f6d200a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d17fff640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 0x7f6d200a5fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d080097d0 tx=0x7f6d0802a030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b0d585726104ed2d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 1 -- 172.21.15.71:0/2586871612 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d08037070 con 0x7f6d200a5bb0 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: dump: 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.949 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d258a6640 5 monclient: authenticate success, global_id 114146 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d258a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 1 -- 172.21.15.71:0/2586871612 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0802ad90 con 0x7f6d200a5bb0 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d258a6640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d258a6640 4 set_mon_vals no callback set 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 1 -- 172.21.15.71:0/2586871612 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d08030c20 con 0x7f6d200a5bb0 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.943+0000 7f6d1e7fc640 10 monclient: dump: 2024-08-19T11:20:21.951 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.952 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 10 monclient: shutdown 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 -- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 msgr2=0x7f6d200a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 0x7f6d200a5fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d080097d0 tx=0x7f6d0802a030 comp rx=0 tx=0).stop 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 -- 172.21.15.71:0/2586871612 shutdown_connections 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f6d20137580 0x7f6d20137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f6d200a5bb0 0x7f6d200a5fb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 --2- 172.21.15.71:0/2586871612 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f6d200a57d0 0x7f6d200a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 -- 172.21.15.71:0/2586871612 >> 172.21.15.71:0/2586871612 conn(0x7f6d200aa3f0 msgr2=0x7f6d200a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:21.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 -- 172.21.15.71:0/2586871612 shutdown_connections 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 -- 172.21.15.71:0/2586871612 wait complete. 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 10 monclient: build_initial_monmap 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 10 monclient: monmap: 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:21.954 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:21.955 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:21.955 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.944+0000 7f6d258a6640 1 Processor -- start 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 -- start start 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient: init 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient: _add_conns ranks=[1,0,2,6,4,8,5,3,7] 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d200a57d0 0x7f6d201cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): picked mon.noname-f con 0x7f6d200a57d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 0x7f6d201369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): picked mon.noname-a con 0x7f6d200a5bb0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20137580 0x7f6d201207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): picked mon.noname-b con 0x7f6d20137580 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20137f40 con 0x7f6d200a5bb0 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200a64f0 con 0x7f6d200a57d0 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6d201380c0 con 0x7f6d20137580 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d258a6640 10 monclient(hunting): authenticate will time out at 1279.986496s 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 0x7f6d201369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20137580 0x7f6d201207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 0x7f6d201369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49746/0 (socket says 172.21.15.71:49746) 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 -- 172.21.15.71:0/609821951 learned_addr learned my addr 172.21.15.71:0/609821951 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): get_auth_request con 0x7f6d200a5bb0 auth_method 0 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): get_auth_request con 0x7f6d20137580 auth_method 0 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1effd640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d200a57d0 0x7f6d201cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1effd640 10 monclient(hunting): get_auth_request con 0x7f6d200a57d0 auth_method 0 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient(hunting): handle_auth_done global_id 75564 payload 824 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20137580 msgr2=0x7f6d201207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20137580 0x7f6d201207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d200a57d0 msgr2=0x7f6d201cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d200a57d0 0x7f6d201cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:21.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 monclient: found mon.noname-a 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d17fff640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d201ccf10 con 0x7f6d200a5bb0 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.945+0000 7f6d1f7fe640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20137580 0x7f6d201207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d17fff640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 msgr2=0x7f6d201369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d17fff640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 0x7f6d201369b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d08035040 tx=0x7f6d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d08037040 con 0x7f6d200a5bb0 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: dump: 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.965 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.966 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.967 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: _finish_auth 0 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d08042070 con 0x7f6d200a5bb0 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 5 monclient: authenticate success, global_id 75564 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 10 monclient: _renew_subs 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d201372d0 con 0x7f6d200a5bb0 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d08003bd0 con 0x7f6d200a5bb0 2024-08-19T11:20:21.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1cff9640 10 monclient: dump: 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.969 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d1dffb640 4 set_mon_vals no callback set 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 10 monclient: _renew_subs 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.948+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d20124390 con 0x7f6d200a5bb0 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d258a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6d08032440 con 0x7f6d200a5bb0 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d258a6640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 0x7f6d201210c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6d200a32e0 con 0x7f6d20120ce0 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 0x7f6d201210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient: get_auth_request con 0x7f6d20120ce0 auth_method 0 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1cff9640 1 --2- 172.21.15.71:0/609821951 >> v2:172.21.15.135:6800/726754104 conn(0x7f6d0003ea80 0x7f6d00040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(287..287 src has 1..287) ==== 3506+0+0 (secure 0 0 0) 0x7f6d08071660 con 0x7f6d200a5bb0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 10 monclient(hunting): handle_auth_done global_id 75521 payload 824 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1effd640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d20137a00 con 0x7f6d20120ce0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1f7fe640 1 --2- 172.21.15.71:0/609821951 >> v2:172.21.15.135:6800/726754104 conn(0x7f6d0003ea80 0x7f6d00040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.949+0000 7f6d1f7fe640 10 monclient: get_auth_request con 0x7f6d0003ea80 auth_method 0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.951+0000 7f6d1effd640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 msgr2=0x7f6d201210c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.951+0000 7f6d1effd640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 0x7f6d201210c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6d10011590 tx=0x7f6d10011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d10015460 con 0x7f6d20120ce0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 10 monclient: dump: 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.972 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.973 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6d1000fac0 con 0x7f6d20120ce0 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 msgr2=0x7f6d201210c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 0x7f6d201210c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6d10011590 tx=0x7f6d10011a50 comp rx=0 tx=0).stop 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 msgr2=0x7f6d201210c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1cff9640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d20120ce0 0x7f6d201210c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.952+0000 7f6d1f7fe640 1 --2- 172.21.15.71:0/609821951 >> v2:172.21.15.135:6800/726754104 conn(0x7f6d0003ea80 0x7f6d00040f40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6d20123d00 tx=0x7f6d18007670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d258a6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d258a6640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 0x7f6d2009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d258a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:21.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6d20076c60 con 0x7f6d2009c9f0 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 0x7f6d2009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient: get_auth_request con 0x7f6d2009c9f0 auth_method 0 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 10 monclient(hunting): handle_auth_done global_id 75530 payload 824 2024-08-19T11:20:21.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.958+0000 7f6d1effd640 1 -- 172.21.15.71:0/609821951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6d20121600 con 0x7f6d2009c9f0 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1effd640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 msgr2=0x7f6d2009ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1effd640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 0x7f6d2009ce00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d10011590 tx=0x7f6d100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6d10006780 con 0x7f6d2009c9f0 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 10 monclient: dump: 2024-08-19T11:20:21.976 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:21.977 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f6d10006310 con 0x7f6d2009c9f0 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 msgr2=0x7f6d2009ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 0x7f6d2009ce00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d10011590 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 msgr2=0x7f6d2009ce00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1cff9640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6d2009c9f0 0x7f6d2009ce00 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6d10011590 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:21.978 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 270993, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:21.979 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:21.980 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:21.981 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:21.983 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:21.984 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:21.986 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.990 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.991 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:21.995 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:21.996 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:21.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:21.999 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.001 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:22.002 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 >> v2:172.21.15.135:6800/726754104 conn(0x7f6d0003ea80 msgr2=0x7f6d00040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 --2- 172.21.15.71:0/609821951 >> v2:172.21.15.135:6800/726754104 conn(0x7f6d0003ea80 0x7f6d00040f40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6d20123d00 tx=0x7f6d18007670 comp rx=0 tx=0).stop 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 10 monclient: shutdown 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 msgr2=0x7f6d201369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 --2- 172.21.15.71:0/609821951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d200a5bb0 0x7f6d201369b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d08035040 tx=0x7f6d080046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1f7fe640 1 -- 172.21.15.71:0/609821951 reap_dead start 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d1f7fe640 1 -- 172.21.15.71:0/609821951 reap_dead start 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 shutdown_connections 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 >> 172.21.15.71:0/609821951 conn(0x7f6d200aa3f0 msgr2=0x7f6d200a2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 shutdown_connections 2024-08-19T11:20:22.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:21.961+0000 7f6d258a6640 1 -- 172.21.15.71:0/609821951 wait complete. 2024-08-19T11:20:22.005 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:22.005 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:20:22.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:20:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.108+0000 7f0ff6d0d640 10 monclient: get_monmap_and_config 2024-08-19T11:20:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.108+0000 7f0ff6d0d640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.108+0000 7f0ff6d0d640 10 monclient: monmap: 2024-08-19T11:20:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.109 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:22.109196+0000 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:22.109196+0000 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.110 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:22.111 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:22.111 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 Processor -- start 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 -- start start 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient: init 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient: _add_conns ranks=[1,9,10,7,5,4,0,8,2,3,6] 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0ff00a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ff00a57c0 0x7f0ff013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): picked mon.noname-a con 0x7f0ff00a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ff00a7440 0x7f0ff01410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): picked mon.noname-f con 0x7f0ff00a7440 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff00a6380 con 0x7f0ff00a6950 2024-08-19T11:20:22.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff00a5020 con 0x7f0ff00a57c0 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff00a7d40 con 0x7f0ff00a7440 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.109+0000 7f0ff6d0d640 10 monclient(hunting): authenticate will time out at 1280.150944s 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ff00a57c0 0x7f0ff013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ff00a57c0 0x7f0ff013eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49758/0 (socket says 172.21.15.71:49758) 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 -- 172.21.15.71:0/2631056262 learned_addr learned my addr 172.21.15.71:0/2631056262 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): get_auth_request con 0x7f0ff00a57c0 auth_method 0 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0ff52aa640 1 --2- 172.21.15.71:0/2631056262 >> v2:172.21.15.135:3300/0 conn(0x7f0ff00a7440 0x7f0ff01410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0ff52aa640 10 monclient(hunting): get_auth_request con 0x7f0ff00a7440 auth_method 0 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0ff52aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0ff52aa640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0ff52aa640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient(hunting): handle_auth_done global_id 75573 payload 274 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 -- 172.21.15.71:0/2631056262 >> v2:172.21.15.135:3300/0 conn(0x7f0ff00a7440 msgr2=0x7f0ff01410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 --2- 172.21.15.71:0/2631056262 >> v2:172.21.15.135:3300/0 conn(0x7f0ff00a7440 0x7f0ff01410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 -- 172.21.15.71:0/2631056262 >> v1:172.21.15.135:6789/0 conn(0x7f0ff00a6950 legacy=0x7f0ff00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 monclient: found mon.noname-a 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.110+0000 7f0feffff640 1 -- 172.21.15.71:0/2631056262 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff00a3650 con 0x7f0ff00a57c0 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0feffff640 1 -- 172.21.15.71:0/2631056262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff00a57c0 msgr2=0x7f0ff013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0feffff640 1 --2- 172.21.15.71:0/2631056262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff00a57c0 0x7f0ff013eb60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00acf60 tx=0x7f0fdc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baccc15fc626d28d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 1 -- 172.21.15.71:0/2631056262 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0fdc037070 con 0x7f0ff00a57c0 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: dump: 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.124 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 1 -- 172.21.15.71:0/2631056262 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fdc02ae20 con 0x7f0ff00a57c0 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 5 monclient: authenticate success, global_id 75573 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 1 -- 172.21.15.71:0/2631056262 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0fdc030c20 con 0x7f0ff00a57c0 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 4 set_mon_vals no callback set 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:22.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0fef7fe640 10 monclient: dump: 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.127 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 10 monclient: shutdown 2024-08-19T11:20:22.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2631056262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff00a57c0 msgr2=0x7f0ff013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2631056262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff00a57c0 0x7f0ff013eb60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00acf60 tx=0x7f0fdc02a100 comp rx=0 tx=0).stop 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2631056262 shutdown_connections 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2631056262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ff00a57c0 0x7f0ff013eb60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2631056262 >> v2:172.21.15.135:3300/0 conn(0x7f0ff00a7440 0x7f0ff01410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2631056262 >> 172.21.15.71:0/2631056262 conn(0x7f0ff00abf50 msgr2=0x7f0ff00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2631056262 shutdown_connections 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.113+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2631056262 wait complete. 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.114+0000 7f0ff6d0d640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.114+0000 7f0ff6d0d640 10 monclient: monmap: 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.129 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.130 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.114+0000 7f0ff6d0d640 1 Processor -- start 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.114+0000 7f0ff6d0d640 1 -- start start 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.114+0000 7f0ff6d0d640 10 monclient: init 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient: _add_conns ranks=[5,2,3,6,0,4,7,1,8] 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0ff00a57c0 0x7f0ff0128ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): picked mon.noname-h con 0x7f0ff00a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 0x7f0ff01cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): picked mon.noname-b con 0x7f0ff00a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff00a7440 0x7f0ff01cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): picked mon.noname-g con 0x7f0ff00a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff00a8700 con 0x7f0ff00a6950 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff00a84c0 con 0x7f0ff00a7440 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0ff01415f0 con 0x7f0ff00a57c0 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff6d0d640 10 monclient(hunting): authenticate will time out at 1280.156473s 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 0x7f0ff01cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 0x7f0ff01cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38348/0 (socket says 172.21.15.71:38348) 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 -- 172.21.15.71:0/2636444052 learned_addr learned my addr 172.21.15.71:0/2636444052 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): get_auth_request con 0x7f0ff00a6950 auth_method 0 2024-08-19T11:20:22.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0ff00a57c0 0x7f0ff0128ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff52aa640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff00a7440 0x7f0ff01cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): get_auth_request con 0x7f0ff00a57c0 auth_method 0 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff52aa640 10 monclient(hunting): get_auth_request con 0x7f0ff00a7440 auth_method 0 2024-08-19T11:20:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff52aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff52aa640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff52aa640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient(hunting): handle_auth_done global_id 75539 payload 824 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0ff00a57c0 msgr2=0x7f0ff0128ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f0ff00a57c0 0x7f0ff0128ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff00a7440 msgr2=0x7f0ff01cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff00a7440 0x7f0ff01cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 monclient: found mon.noname-b 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0feffff640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff0129470 con 0x7f0ff00a6950 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.115+0000 7f0ff52aa640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ff00a7440 0x7f0ff01cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0feffff640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 msgr2=0x7f0ff01cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0feffff640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 0x7f0ff01cea80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0090b0 tx=0x7f0fdc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0fdc041020 con 0x7f0ff00a6950 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:22.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: dump: 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.136 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fdc003c50 con 0x7f0ff00a6950 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 5 monclient: authenticate success, global_id 75539 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 10 monclient: _renew_subs 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff0127f80 con 0x7f0ff00a6950 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0fdc037040 con 0x7f0ff00a6950 2024-08-19T11:20:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0fed7fa640 10 monclient: dump: 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.138 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 10 monclient: _renew_subs 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0feeffd640 4 set_mon_vals no callback set 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.118+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff013ff80 con 0x7f0ff00a6950 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff6d0d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 0x7f0ff0126870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0ff0076c60 con 0x7f0ff0126490 2024-08-19T11:20:22.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0fdc044020 con 0x7f0ff00a6950 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 0x7f0ff0126870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient: get_auth_request con 0x7f0ff0126490 auth_method 0 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0fed7fa640 1 --2- 172.21.15.71:0/2636444052 >> v2:172.21.15.135:6800/726754104 conn(0x7f0fd403eab0 0x7f0fd4040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_done global_id 85117 payload 824 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff4aa9640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ff00a92f0 con 0x7f0ff0126490 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(288..288 src has 1..288) ==== 3898+0+0 (secure 0 0 0) 0x7f0fdc071f50 con 0x7f0ff00a6950 2024-08-19T11:20:22.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff52aa640 1 --2- 172.21.15.71:0/2636444052 >> v2:172.21.15.135:6800/726754104 conn(0x7f0fd403eab0 0x7f0fd4040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.119+0000 7f0ff52aa640 10 monclient: get_auth_request con 0x7f0fd403eab0 auth_method 0 2024-08-19T11:20:22.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.121+0000 7f0ff4aa9640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 msgr2=0x7f0ff0126870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.121+0000 7f0ff4aa9640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 0x7f0ff0126870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400f7a0 tx=0x7f0fe400fc60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.121+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0fe4018030 con 0x7f0ff0126490 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.121+0000 7f0fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.121+0000 7f0fed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.121+0000 7f0fed7fa640 10 monclient: dump: 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.144 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0fe400d9b0 con 0x7f0ff0126490 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 msgr2=0x7f0ff0126870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 0x7f0ff0126870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400f7a0 tx=0x7f0fe400fc60 comp rx=0 tx=0).stop 2024-08-19T11:20:22.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 msgr2=0x7f0ff0126870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0fed7fa640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126490 0x7f0ff0126870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.122+0000 7f0ff52aa640 1 --2- 172.21.15.71:0/2636444052 >> v2:172.21.15.135:6800/726754104 conn(0x7f0fd403eab0 0x7f0fd4040f70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009fa0 tx=0x7f0fe800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff6d0d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 0x7f0ff01225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff6d0d640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f0ff00a6d30 con 0x7f0ff0126db0 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 0x7f0ff01225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient: get_auth_request con 0x7f0ff0126db0 auth_method 0 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 10 monclient(hunting): handle_auth_done global_id 85126 payload 824 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.128+0000 7f0ff4aa9640 1 -- 172.21.15.71:0/2636444052 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ff006ca70 con 0x7f0ff0126db0 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.130+0000 7f0ff4aa9640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 msgr2=0x7f0ff01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.130+0000 7f0ff4aa9640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 0x7f0ff01225a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400f7a0 tx=0x7f0fe4003760 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.130+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0fe401de60 con 0x7f0ff0126db0 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.130+0000 7f0fed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.130+0000 7f0fed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.130+0000 7f0fed7fa640 10 monclient: dump: 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.147 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f0fe4003f30 con 0x7f0ff0126db0 2024-08-19T11:20:22.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 msgr2=0x7f0ff01225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 0x7f0ff01225a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400f7a0 tx=0x7f0fe4003760 comp rx=0 tx=0).stop 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 msgr2=0x7f0ff01225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0fed7fa640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f0ff0126db0 0x7f0ff01225a0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400f7a0 tx=0x7f0fe4003760 comp rx=0 tx=0).stop 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.149 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 204277, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:22.150 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.151 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.154 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:22.155 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.158 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.160 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.163 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.168 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.170 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.171 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:22.172 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 >> v2:172.21.15.135:6800/726754104 conn(0x7f0fd403eab0 msgr2=0x7f0fd4040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2636444052 >> v2:172.21.15.135:6800/726754104 conn(0x7f0fd403eab0 0x7f0fd4040f70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009fa0 tx=0x7f0fe800b040 comp rx=0 tx=0).stop 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 10 monclient: shutdown 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 msgr2=0x7f0ff01cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 --2- 172.21.15.71:0/2636444052 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ff00a6950 0x7f0ff01cea80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0090b0 tx=0x7f0fdc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff52aa640 1 -- 172.21.15.71:0/2636444052 reap_dead start 2024-08-19T11:20:22.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff52aa640 1 -- 172.21.15.71:0/2636444052 reap_dead start 2024-08-19T11:20:22.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 shutdown_connections 2024-08-19T11:20:22.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 >> 172.21.15.71:0/2636444052 conn(0x7f0ff00abf50 msgr2=0x7f0ff009f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 shutdown_connections 2024-08-19T11:20:22.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.131+0000 7f0ff6d0d640 1 -- 172.21.15.71:0/2636444052 wait complete. 2024-08-19T11:20:22.175 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:22.175 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:20:22.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:20:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.274+0000 7ff9f54fd640 10 monclient: get_monmap_and_config 2024-08-19T11:20:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.274+0000 7ff9f54fd640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.274+0000 7ff9f54fd640 10 monclient: monmap: 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:22.275431+0000 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:22.275431+0000 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.276 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:22.277 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:22.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 Processor -- start 2024-08-19T11:20:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 -- start start 2024-08-19T11:20:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient: init 2024-08-19T11:20:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient: _add_conns ranks=[9,1,4,8,7,3,10,0,5,2,6] 2024-08-19T11:20:22.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9f00a6950 0x7ff9f00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): picked mon.noname-a con 0x7ff9f00a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff9f00a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): picked mon.noname-c con 0x7ff9f00a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00a6380 con 0x7ff9f00a57c0 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00a5020 con 0x7ff9f00a6950 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff9f00a7d40 con 0x7ff9f00a7270 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.275+0000 7ff9f54fd640 10 monclient(hunting): authenticate will time out at 1280.316913s 2024-08-19T11:20:22.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9f00a6950 0x7ff9f00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9f00a6950 0x7ff9f00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49772/0 (socket says 172.21.15.71:49772) 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 -- 172.21.15.71:0/4003154801 learned_addr learned my addr 172.21.15.71:0/4003154801 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): get_auth_request con 0x7ff9f00a6950 auth_method 0 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): get_auth_request con 0x7ff9f00a7270 auth_method 0 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_done global_id 75582 payload 274 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 -- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 msgr2=0x7ff9f0139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 -- 172.21.15.71:0/4003154801 >> v1:172.21.15.135:6789/0 conn(0x7ff9f00a57c0 legacy=0x7ff9f0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 monclient: found mon.noname-a 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9eeffd640 1 -- 172.21.15.71:0/4003154801 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00a3650 con 0x7ff9f00a6950 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.276+0000 7ff9ef7fe640 1 --2- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9eeffd640 1 -- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9f00a6950 msgr2=0x7ff9f00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9f00a6950 0x7ff9f00a6d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009870 tx=0x7ff9e002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e935d8f9f85132 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 1 -- 172.21.15.71:0/4003154801 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e0037070 con 0x7ff9f00a6950 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: dump: 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.285 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.286 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 1 -- 172.21.15.71:0/4003154801 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e002ae00 con 0x7ff9f00a6950 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 5 monclient: authenticate success, global_id 75582 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:22.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:22.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 1 -- 172.21.15.71:0/4003154801 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e0030c20 con 0x7ff9f00a6950 2024-08-19T11:20:22.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 4 set_mon_vals no callback set 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9edffb640 10 monclient: dump: 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.290 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 10 monclient: shutdown 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 -- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9f00a6950 msgr2=0x7ff9f00a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9f00a6950 0x7ff9f00a6d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009870 tx=0x7ff9e002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 -- 172.21.15.71:0/4003154801 shutdown_connections 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/4003154801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9f00a6950 0x7ff9f00a6d30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 -- 172.21.15.71:0/4003154801 >> 172.21.15.71:0/4003154801 conn(0x7ff9f00abf50 msgr2=0x7ff9f00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 -- 172.21.15.71:0/4003154801 shutdown_connections 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.279+0000 7ff9f54fd640 1 -- 172.21.15.71:0/4003154801 wait complete. 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.280+0000 7ff9f54fd640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.280+0000 7ff9f54fd640 10 monclient: monmap: 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:22.292 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.280+0000 7ff9f54fd640 1 Processor -- start 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.280+0000 7ff9f54fd640 1 -- start start 2024-08-19T11:20:22.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.280+0000 7ff9f54fd640 10 monclient: init 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient: _add_conns ranks=[3,6,4,7,1,0,8,2,5] 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9f00a57c0 0x7ff9f0123da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): picked mon.noname-g con 0x7ff9f00a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f00a6950 0x7ff9f01242e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): picked mon.noname-d con 0x7ff9f00a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:22.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0124820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): picked mon.noname-c con 0x7ff9f00a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00a76c0 con 0x7ff9f00a57c0 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff9f00a84c0 con 0x7ff9f00a7270 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff9f00a8700 con 0x7ff9f00a6950 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9f54fd640 10 monclient(hunting): authenticate will time out at 1280.322363s 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0124820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f00a6950 0x7ff9f01242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0124820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53170/0 (socket says 172.21.15.71:53170) 2024-08-19T11:20:22.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 learned_addr learned my addr 172.21.15.71:0/2017309970 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): get_auth_request con 0x7ff9f00a7270 auth_method 0 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9f00a57c0 0x7ff9f0123da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): get_auth_request con 0x7ff9f00a6950 auth_method 0 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): get_auth_request con 0x7ff9f00a57c0 auth_method 0 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient(hunting): handle_auth_done global_id 85144 payload 824 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f00a6950 msgr2=0x7ff9f01242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f00a6950 0x7ff9f01242e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9f00a57c0 msgr2=0x7ff9f0123da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9f00a57c0 0x7ff9f0123da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 monclient: found mon.noname-c 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.281+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f0127a80 con 0x7ff9f00a7270 2024-08-19T11:20:22.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.283+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 msgr2=0x7ff9f0124820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.283+0000 7ff9ef7fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0124820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009f00 tx=0x7ff9e800c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e8018030 con 0x7ff9f00a7270 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: dump: 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 5 monclient: authenticate success, global_id 85144 2024-08-19T11:20:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e800ce50 con 0x7ff9f00a7270 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 10 monclient: _renew_subs 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f00a9290 con 0x7ff9f00a7270 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e80133e0 con 0x7ff9f00a7270 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9e77fe640 10 monclient: dump: 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.307 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9ed7fa640 4 set_mon_vals no callback set 2024-08-19T11:20:22.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 10 monclient: _renew_subs 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f0125720 con 0x7ff9f00a7270 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 0x7ff9f0063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.284+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff9f0076c60 con 0x7ff9f002e340 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff9e8005d10 con 0x7ff9f00a7270 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 0x7ff9f0063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient: get_auth_request con 0x7ff9f002e340 auth_method 0 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9e77fe640 1 --2- 172.21.15.71:0/2017309970 >> v2:172.21.15.135:6800/726754104 conn(0x7ff9d003e9b0 0x7ff9d0040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_done global_id 104478 payload 824 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9eeffd640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9f002e720 con 0x7ff9f002e340 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(288..288 src has 1..288) ==== 3898+0+0 (secure 0 0 0) 0x7ff9e8019070 con 0x7ff9f00a7270 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9ee7fc640 1 --2- 172.21.15.71:0/2017309970 >> v2:172.21.15.135:6800/726754104 conn(0x7ff9d003e9b0 0x7ff9d0040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.285+0000 7ff9ee7fc640 10 monclient: get_auth_request con 0x7ff9d003e9b0 auth_method 0 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9eeffd640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 msgr2=0x7ff9f0063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 0x7ff9f0063a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0074f90 tx=0x7ff9e00046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e0042070 con 0x7ff9f002e340 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 10 monclient: dump: 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.311 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff9e0003a30 con 0x7ff9f002e340 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 msgr2=0x7ff9f0063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 0x7ff9f0063a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0074f90 tx=0x7ff9e00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 msgr2=0x7ff9f0063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.287+0000 7ff9e77fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f002e340 0x7ff9f0063a80 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0074f90 tx=0x7ff9e00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.288+0000 7ff9ee7fc640 1 --2- 172.21.15.71:0/2017309970 >> v2:172.21.15.135:6800/726754104 conn(0x7ff9d003e9b0 0x7ff9d0040e70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0125d90 tx=0x7ff9d8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9f54fd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 0x7ff9f01d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9f54fd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff9f00a2680 con 0x7ff9f0063fc0 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 0x7ff9f01d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient: get_auth_request con 0x7ff9f0063fc0 auth_method 0 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 10 monclient(hunting): handle_auth_done global_id 104487 payload 824 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.294+0000 7ff9eeffd640 1 -- 172.21.15.71:0/2017309970 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9f00a06c0 con 0x7ff9f0063fc0 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.296+0000 7ff9eeffd640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 msgr2=0x7ff9f01d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.296+0000 7ff9eeffd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 0x7ff9f01d8990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097c0 tx=0x7ff9e0008030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.296+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e0037040 con 0x7ff9f0063fc0 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.296+0000 7ff9e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.296+0000 7ff9e77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.296+0000 7ff9e77fe640 10 monclient: dump: 2024-08-19T11:20:22.314 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7ff9e0047450 con 0x7ff9f0063fc0 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 msgr2=0x7ff9f01d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 0x7ff9f01d8990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097c0 tx=0x7ff9e0008030 comp rx=0 tx=0).stop 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 msgr2=0x7ff9f01d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9e77fe640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff9f0063fc0 0x7ff9f01d8990 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097c0 tx=0x7ff9e0008030 comp rx=0 tx=0).stop 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 77644, 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:22.340 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 >> v2:172.21.15.135:6800/726754104 conn(0x7ff9d003e9b0 msgr2=0x7ff9d0040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/2017309970 >> v2:172.21.15.135:6800/726754104 conn(0x7ff9d003e9b0 0x7ff9d0040e70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0125d90 tx=0x7ff9d8009060 comp rx=0 tx=0).stop 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 10 monclient: shutdown 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 msgr2=0x7ff9f0124820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 --2- 172.21.15.71:0/2017309970 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff9f00a7270 0x7ff9f0124820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009f00 tx=0x7ff9e800c490 comp rx=0 tx=0).stop 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 reap_dead start 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9ef7fe640 1 -- 172.21.15.71:0/2017309970 reap_dead start 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 shutdown_connections 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 >> 172.21.15.71:0/2017309970 conn(0x7ff9f00abf50 msgr2=0x7ff9f009d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 shutdown_connections 2024-08-19T11:20:22.342 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.297+0000 7ff9f54fd640 1 -- 172.21.15.71:0/2017309970 wait complete. 2024-08-19T11:20:22.343 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:22.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:20:22.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.440+0000 7fec57d33640 10 monclient: get_monmap_and_config 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.440+0000 7fec57d33640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.440+0000 7fec57d33640 10 monclient: monmap: 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:22.441504+0000 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:22.441504+0000 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:22.442 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.441+0000 7fec57d33640 1 Processor -- start 2024-08-19T11:20:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.441+0000 7fec57d33640 1 -- start start 2024-08-19T11:20:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.441+0000 7fec57d33640 10 monclient: init 2024-08-19T11:20:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient: _add_conns ranks=[0,4,10,7,6,2,3,8,1,5,9] 2024-08-19T11:20:22.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fec500a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 0x7fec5013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): picked mon.noname-c con 0x7fec500a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fec500a7440 0x7fec501410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): picked mon.noname-f con 0x7fec500a7440 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500a6380 con 0x7fec500a6950 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fec500a5020 con 0x7fec500a7440 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fec500a7d40 con 0x7fec500a57c0 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec57d33640 10 monclient(hunting): authenticate will time out at 1280.483258s 2024-08-19T11:20:22.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 0x7fec5013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec55acf640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fec500a6950 0x7fec500a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43912/0 (socket says 172.21.15.71:43912) 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec55acf640 1 -- 172.21.15.71:0/1664068984 learned_addr learned my addr 172.21.15.71:0/1664068984 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): get_auth_request con 0x7fec500a57c0 auth_method 0 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient(hunting): handle_auth_done global_id 85153 payload 274 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 1 -- 172.21.15.71:0/1664068984 >> v2:172.21.15.135:3300/0 conn(0x7fec500a7440 msgr2=0x7fec501410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 1 --2- 172.21.15.71:0/1664068984 >> v2:172.21.15.135:3300/0 conn(0x7fec500a7440 0x7fec501410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 1 -- 172.21.15.71:0/1664068984 >> v1:172.21.15.71:6789/0 conn(0x7fec500a6950 legacy=0x7fec500a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 1 monclient: found mon.noname-c 2024-08-19T11:20:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:22.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.442+0000 7fec552ce640 1 -- 172.21.15.71:0/1664068984 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500a3650 con 0x7fec500a57c0 2024-08-19T11:20:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec552ce640 1 -- 172.21.15.71:0/1664068984 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 msgr2=0x7fec5013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec552ce640 1 --2- 172.21.15.71:0/1664068984 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 0x7fec5013eb60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec400097d0 tx=0x7fec4002a000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=76c479835efb2c95 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 1 -- 172.21.15.71:0/1664068984 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec40037070 con 0x7fec500a57c0 2024-08-19T11:20:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:22.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: dump: 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.457 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec57d33640 5 monclient: authenticate success, global_id 85153 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec57d33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 1 -- 172.21.15.71:0/1664068984 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4002ae00 con 0x7fec500a57c0 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec57d33640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec57d33640 4 set_mon_vals no callback set 2024-08-19T11:20:22.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 1 -- 172.21.15.71:0/1664068984 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec40030c20 con 0x7fec500a57c0 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.445+0000 7fec54acd640 10 monclient: dump: 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 10 monclient: shutdown 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 -- 172.21.15.71:0/1664068984 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 msgr2=0x7fec5013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 --2- 172.21.15.71:0/1664068984 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 0x7fec5013eb60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec400097d0 tx=0x7fec4002a000 comp rx=0 tx=0).stop 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 -- 172.21.15.71:0/1664068984 shutdown_connections 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 --2- 172.21.15.71:0/1664068984 >> v2:172.21.15.135:3300/0 conn(0x7fec500a7440 0x7fec501410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 --2- 172.21.15.71:0/1664068984 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fec500a57c0 0x7fec5013eb60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 -- 172.21.15.71:0/1664068984 >> 172.21.15.71:0/1664068984 conn(0x7fec500abf50 msgr2=0x7fec500ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 -- 172.21.15.71:0/1664068984 shutdown_connections 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.446+0000 7fec57d33640 1 -- 172.21.15.71:0/1664068984 wait complete. 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient: monmap: 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.461 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 Processor -- start 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 -- start start 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient: init 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient: _add_conns ranks=[8,7,0,4,5,2,3,1,6] 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a57c0 0x7fec501ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): picked mon.noname-e con 0x7fec500a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fec500a6950 0x7fec50139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): picked mon.noname-i con 0x7fec500a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 0x7fec5013ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): picked mon.noname-a con 0x7fec500a7440 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fec500a8700 con 0x7fec500a7440 2024-08-19T11:20:22.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fec500a84c0 con 0x7fec500a6950 2024-08-19T11:20:22.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fec501415f0 con 0x7fec500a57c0 2024-08-19T11:20:22.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec57d33640 10 monclient(hunting): authenticate will time out at 1280.488856s 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec562d0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 0x7fec5013ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec55acf640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a57c0 0x7fec501ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec562d0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 0x7fec5013ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49778/0 (socket says 172.21.15.71:49778) 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec562d0640 1 -- 172.21.15.71:0/584871045 learned_addr learned my addr 172.21.15.71:0/584871045 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec55acf640 10 monclient(hunting): get_auth_request con 0x7fec500a57c0 auth_method 0 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.447+0000 7fec55acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec55acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec55acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): get_auth_request con 0x7fec500a7440 auth_method 0 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fec500a6950 0x7fec50139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): get_auth_request con 0x7fec500a6950 auth_method 0 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec552ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient(hunting): handle_auth_done global_id 75591 payload 824 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a57c0 msgr2=0x7fec501ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a57c0 0x7fec501ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fec500a6950 msgr2=0x7fec50139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fec500a6950 0x7fec50139a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 1 monclient: found mon.noname-a 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec562d0640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec501cf590 con 0x7fec500a7440 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.448+0000 7fec55acf640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a57c0 0x7fec501ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:22.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec562d0640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 msgr2=0x7fec5013ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec562d0640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 0x7fec5013ecf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b970 tx=0x7fec4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec48019070 con 0x7fec500a7440 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: dump: 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.469 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 5 monclient: authenticate success, global_id 75591 2024-08-19T11:20:22.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48007370 con 0x7fec500a7440 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 10 monclient: _renew_subs 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50124140 con 0x7fec500a7440 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec48007990 con 0x7fec500a7440 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec47fff640 4 set_mon_vals no callback set 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec467fc640 10 monclient: dump: 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.471 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.472 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 10 monclient: _renew_subs 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.450+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec500a24c0 con 0x7fec500a7440 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec57d33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec57d33640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 0x7fec5013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fec50076c60 con 0x7fec500a1e00 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 0x7fec5013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient: get_auth_request con 0x7fec500a1e00 auth_method 0 2024-08-19T11:20:22.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fec48006d10 con 0x7fec500a7440 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 10 monclient(hunting): handle_auth_done global_id 114164 payload 824 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec55acf640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec5013a730 con 0x7fec500a1e00 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec467fc640 1 --2- 172.21.15.71:0/584871045 >> v2:172.21.15.135:6800/726754104 conn(0x7fec3403eab0 0x7fec34040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.451+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(288..288 src has 1..288) ==== 3898+0+0 (secure 0 0 0) 0x7fec48051610 con 0x7fec500a7440 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.452+0000 7fec552ce640 1 --2- 172.21.15.71:0/584871045 >> v2:172.21.15.135:6800/726754104 conn(0x7fec3403eab0 0x7fec34040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.452+0000 7fec552ce640 10 monclient: get_auth_request con 0x7fec3403eab0 auth_method 0 2024-08-19T11:20:22.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec55acf640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 msgr2=0x7fec5013f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec55acf640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 0x7fec5013f230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007270 tx=0x7fec4c007730 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec4c017020 con 0x7fec500a1e00 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 10 monclient: dump: 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.475 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fec4c00fd00 con 0x7fec500a1e00 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 msgr2=0x7fec5013f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 0x7fec5013f230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007270 tx=0x7fec4c007730 comp rx=0 tx=0).stop 2024-08-19T11:20:22.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 msgr2=0x7fec5013f230 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec467fc640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec500a1e00 0x7fec5013f230 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fec4c007270 tx=0x7fec4c007730 comp rx=0 tx=0).stop 2024-08-19T11:20:22.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.454+0000 7fec552ce640 1 --2- 172.21.15.71:0/584871045 >> v2:172.21.15.135:6800/726754104 conn(0x7fec3403eab0 0x7fec34040f70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fec400097d0 tx=0x7fec4002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec57d33640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec57d33640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 0x7fec5013f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec57d33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fec500a9420 con 0x7fec50139fb0 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 0x7fec5013f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient: get_auth_request con 0x7fec50139fb0 auth_method 0 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 10 monclient(hunting): handle_auth_done global_id 114173 payload 824 2024-08-19T11:20:22.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.460+0000 7fec55acf640 1 -- 172.21.15.71:0/584871045 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fec500a6d30 con 0x7fec50139fb0 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec55acf640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 msgr2=0x7fec5013f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec55acf640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 0x7fec5013f770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec4c018000 tx=0x7fec4c004940 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fec4c017040 con 0x7fec50139fb0 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 10 monclient: dump: 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.480 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fec4c013b10 con 0x7fec50139fb0 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 msgr2=0x7fec5013f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 0x7fec5013f770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec4c018000 tx=0x7fec4c004940 comp rx=0 tx=0).stop 2024-08-19T11:20:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 msgr2=0x7fec5013f770 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec467fc640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fec50139fb0 0x7fec5013f770 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec4c018000 tx=0x7fec4c004940 comp rx=0 tx=0).stop 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 22835, 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 2, 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:22.483 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:22.484 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:22.485 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:22.486 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.487 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:22.490 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.492 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:22.493 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:22.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.497 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.500 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.503 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:22.504 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:22.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 >> v2:172.21.15.135:6800/726754104 conn(0x7fec3403eab0 msgr2=0x7fec34040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 --2- 172.21.15.71:0/584871045 >> v2:172.21.15.135:6800/726754104 conn(0x7fec3403eab0 0x7fec34040f70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fec400097d0 tx=0x7fec4002e000 comp rx=0 tx=0).stop 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 10 monclient: shutdown 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 msgr2=0x7fec5013ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec562d0640 1 -- 172.21.15.71:0/584871045 reap_dead start 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 0x7fec5013ecf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b970 tx=0x7fec4800be30 comp rx=0 tx=0).stop 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 shutdown_connections 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 --2- 172.21.15.71:0/584871045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec500a7440 0x7fec5013ecf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 >> 172.21.15.71:0/584871045 conn(0x7fec500abf50 msgr2=0x7fec5009f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 shutdown_connections 2024-08-19T11:20:22.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.463+0000 7fec57d33640 1 -- 172.21.15.71:0/584871045 wait complete. 2024-08-19T11:20:22.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:22.507 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:20:22.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:20:22.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.604+0000 7f140e0cc640 10 monclient: get_monmap_and_config 2024-08-19T11:20:22.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.604+0000 7f140e0cc640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.604+0000 7f140e0cc640 10 monclient: monmap: 2024-08-19T11:20:22.606 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.606 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.606 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:22.605265+0000 2024-08-19T11:20:22.606 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:22.605265+0000 2024-08-19T11:20:22.606 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.607 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.607 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:22.607 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:22.607 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:22.608 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 Processor -- start 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 -- start start 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient: init 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient: _add_conns ranks=[7,4,9,8,1,2,6,5,10,0,3] 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f14080a6950 0x7f14080a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): picked mon.noname-i con 0x7f14080a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 0x7f14080a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): picked mon.noname-c con 0x7f14080a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:22.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 0x7f1408139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): picked mon.noname-a con 0x7f1408139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f14080a5020 con 0x7f1408139710 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f14080a77b0 con 0x7f14080a57c0 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f14080a7d40 con 0x7f14080a6950 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.605+0000 7f140e0cc640 10 monclient(hunting): authenticate will time out at 1280.646989s 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 0x7f14080a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 0x7f1408139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 0x7f1408139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49790/0 (socket says 172.21.15.71:49790) 2024-08-19T11:20:22.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 0x7f14080a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:53196/0 (socket says 172.21.15.71:53196) 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 1 -- 172.21.15.71:0/2446295222 learned_addr learned my addr 172.21.15.71:0/2446295222 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): get_auth_request con 0x7f1408139710 auth_method 0 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): get_auth_request con 0x7f14080a57c0 auth_method 0 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f14077fe640 1 --2- 172.21.15.71:0/2446295222 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f14080a6950 0x7f14080a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f14077fe640 10 monclient(hunting): get_auth_request con 0x7f14080a6950 auth_method 0 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f14077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f14077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f14077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient(hunting): handle_auth_done global_id 85162 payload 274 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 -- 172.21.15.71:0/2446295222 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f14080a6950 msgr2=0x7f14080a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 --2- 172.21.15.71:0/2446295222 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f14080a6950 0x7f14080a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 -- 172.21.15.71:0/2446295222 >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 msgr2=0x7f1408139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 --2- 172.21.15.71:0/2446295222 >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 0x7f1408139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 monclient: found mon.noname-c 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1406ffd640 1 -- 172.21.15.71:0/2446295222 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080a6380 con 0x7f14080a57c0 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.606+0000 7f1407fff640 1 --2- 172.21.15.71:0/2446295222 >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 0x7f1408139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f1406ffd640 1 -- 172.21.15.71:0/2446295222 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 msgr2=0x7f14080a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f1406ffd640 1 --2- 172.21.15.71:0/2446295222 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 0x7f14080a7270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0097d0 tx=0x7f13fc02a000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=1b326ebcab3f172f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 1 -- 172.21.15.71:0/2446295222 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13fc037070 con 0x7f14080a57c0 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: dump: 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.624 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.625 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 1 -- 172.21.15.71:0/2446295222 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc02ad20 con 0x7f14080a57c0 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 5 monclient: authenticate success, global_id 85162 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 1 -- 172.21.15.71:0/2446295222 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13fc030c20 con 0x7f14080a57c0 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 4 set_mon_vals no callback set 2024-08-19T11:20:22.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f14067fc640 10 monclient: dump: 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.627 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 10 monclient: shutdown 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 -- 172.21.15.71:0/2446295222 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 msgr2=0x7f14080a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2446295222 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 0x7f14080a7270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0097d0 tx=0x7f13fc02a000 comp rx=0 tx=0).stop 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 -- 172.21.15.71:0/2446295222 shutdown_connections 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2446295222 >> v2:172.21.15.71:3300/0 conn(0x7f1408139710 0x7f1408139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2446295222 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f14080a57c0 0x7f14080a7270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2446295222 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f14080a6950 0x7f14080a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.609+0000 7f140e0cc640 1 -- 172.21.15.71:0/2446295222 >> 172.21.15.71:0/2446295222 conn(0x7f14080abf50 msgr2=0x7f14080ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.610+0000 7f140e0cc640 1 -- 172.21.15.71:0/2446295222 shutdown_connections 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.610+0000 7f140e0cc640 1 -- 172.21.15.71:0/2446295222 wait complete. 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.610+0000 7f140e0cc640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.610+0000 7f140e0cc640 10 monclient: monmap: 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.610+0000 7f140e0cc640 1 Processor -- start 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 -- start start 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient: init 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient: _add_conns ranks=[8,5,6,3,1,2,0,7,4] 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f14080a57c0 0x7f14081ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): picked mon.noname-e con 0x7f14080a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f14080a6950 0x7f1408138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): picked mon.noname-h con 0x7f14080a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 0x7f1408138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): picked mon.noname-d con 0x7f1408139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f14080a84c0 con 0x7f14080a6950 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f14080a3650 con 0x7f1408139710 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f14080a8700 con 0x7f14080a57c0 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f140e0cc640 10 monclient(hunting): authenticate will time out at 1280.652521s 2024-08-19T11:20:22.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f14080a57c0 0x7f14081ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 0x7f1408138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f14080a57c0 0x7f14081ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:50978/0 (socket says 172.21.15.71:50978) 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 0x7f1408138fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60180/0 (socket says 172.21.15.71:60180) 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 1 -- 172.21.15.71:0/2296520098 learned_addr learned my addr 172.21.15.71:0/2296520098 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): get_auth_request con 0x7f14080a57c0 auth_method 0 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): get_auth_request con 0x7f1408139710 auth_method 0 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f14080a6950 0x7f1408138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): get_auth_request con 0x7f14080a6950 auth_method 0 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1406ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient(hunting): handle_auth_done global_id 104496 payload 824 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f14080a57c0 msgr2=0x7f14081ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f14080a57c0 0x7f14081ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f14080a6950 msgr2=0x7f1408138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f14080a6950 0x7f1408138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 monclient: found mon.noname-d 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.611+0000 7f1407fff640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14081247e0 con 0x7f1408139710 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f1407fff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 msgr2=0x7f1408138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f1407fff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 0x7f1408138fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f140000e870 tx=0x7f140000ed30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1400017070 con 0x7f1408139710 2024-08-19T11:20:22.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: dump: 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.635 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1400013470 con 0x7f1408139710 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 5 monclient: authenticate success, global_id 104496 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1400013a90 con 0x7f1408139710 2024-08-19T11:20:22.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f13effff640 10 monclient: dump: 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.637 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f1405ffb640 4 set_mon_vals no callback set 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 10 monclient: _renew_subs 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1408126180 con 0x7f1408139710 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 10 monclient: _renew_subs 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.614+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1408125ea0 con 0x7f1408139710 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f140e0cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 0x7f140802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1408076c60 con 0x7f1408123000 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1400013c30 con 0x7f1408139710 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f13effff640 1 --2- 172.21.15.71:0/2296520098 >> v2:172.21.15.135:6800/726754104 conn(0x7f13f403ea80 0x7f13f4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 0x7f140802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(288..288 src has 1..288) ==== 3898+0+0 (secure 0 0 0) 0x7f140000f040 con 0x7f1408139710 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient: get_auth_request con 0x7f1408123000 auth_method 0 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f1406ffd640 1 --2- 172.21.15.71:0/2296520098 >> v2:172.21.15.135:6800/726754104 conn(0x7f13f403ea80 0x7f13f4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f1406ffd640 10 monclient: get_auth_request con 0x7f13f403ea80 auth_method 0 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 10 monclient(hunting): handle_auth_done global_id 85168 payload 824 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.615+0000 7f14077fe640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1408124e50 con 0x7f1408123000 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f14077fe640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 msgr2=0x7f140802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f14077fe640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 0x7f140802d1c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13f8004980 tx=0x7f13f8007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f1406ffd640 1 --2- 172.21.15.71:0/2296520098 >> v2:172.21.15.135:6800/726754104 conn(0x7f13f403ea80 0x7f13f4040f40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1408074f90 tx=0x7f13fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13f8014c10 con 0x7f1408123000 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 10 monclient: dump: 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.640 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.641 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f13f801a070 con 0x7f1408123000 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 msgr2=0x7f140802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 0x7f140802d1c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13f8004980 tx=0x7f13f8007700 comp rx=0 tx=0).stop 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 msgr2=0x7f140802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.618+0000 7f13effff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1408123000 0x7f140802d1c0 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13f8004980 tx=0x7f13f8007700 comp rx=0 tx=0).stop 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.624+0000 7f140e0cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.624+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 0x7f140802d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.624+0000 7f140e0cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.624+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14080a6d30 con 0x7f14081233e0 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 0x7f140802d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient: get_auth_request con 0x7f14081233e0 auth_method 0 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 10 monclient(hunting): handle_auth_done global_id 85177 payload 824 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.625+0000 7f14077fe640 1 -- 172.21.15.71:0/2296520098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f14080a23a0 con 0x7f14081233e0 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.627+0000 7f14077fe640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 msgr2=0x7f140802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.627+0000 7f14077fe640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 0x7f140802d700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13f8000f80 tx=0x7f13f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f13f8014e20 con 0x7f14081233e0 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 10 monclient: dump: 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.646 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7f13f80149b0 con 0x7f14081233e0 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 msgr2=0x7f140802d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 0x7f140802d700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13f8000f80 tx=0x7f13f8004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 msgr2=0x7f140802d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f13effff640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14081233e0 0x7f140802d700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:22.647 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 204789, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:22.648 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.649 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.650 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:22.651 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.652 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.653 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.654 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.655 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.656 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.658 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:22.659 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.660 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.662 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.663 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.665 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:22.666 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.669 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.671 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.672 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:22.672 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:22.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 >> v2:172.21.15.135:6800/726754104 conn(0x7f13f403ea80 msgr2=0x7f13f4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2296520098 >> v2:172.21.15.135:6800/726754104 conn(0x7f13f403ea80 0x7f13f4040f40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1408074f90 tx=0x7f13fc02e000 comp rx=0 tx=0).stop 2024-08-19T11:20:22.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 10 monclient: shutdown 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 msgr2=0x7f1408138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 1 --2- 172.21.15.71:0/2296520098 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f1408139710 0x7f1408138fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f140000e870 tx=0x7f140000ed30 comp rx=0 tx=0).stop 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f1407fff640 1 -- 172.21.15.71:0/2296520098 reap_dead start 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f1407fff640 1 -- 172.21.15.71:0/2296520098 reap_dead start 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 shutdown_connections 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.628+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 >> 172.21.15.71:0/2296520098 conn(0x7f14080abf50 msgr2=0x7f14080aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.629+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 shutdown_connections 2024-08-19T11:20:22.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.629+0000 7f140e0cc640 1 -- 172.21.15.71:0/2296520098 wait complete. 2024-08-19T11:20:22.675 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:22.675 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:20:22.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:20:22.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.772+0000 7f04a8779640 10 monclient: get_monmap_and_config 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.772+0000 7f04a8779640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.772+0000 7f04a8779640 10 monclient: monmap: 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:22.773351+0000 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:22.773351+0000 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:22.774 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 1 Processor -- start 2024-08-19T11:20:22.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 1 -- start start 2024-08-19T11:20:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 10 monclient: init 2024-08-19T11:20:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 10 monclient: _add_conns ranks=[10,7,2,1,6,8,4,3,9,0,5] 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 0x7f04a00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.773+0000 7f04a8779640 10 monclient(hunting): picked mon.noname-f con 0x7f04a00a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a57c0 0x7f04a00a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): picked mon.noname-i con 0x7f04a00a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 0x7f04a0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): picked mon.noname-b con 0x7f04a0139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f04a00a5020 con 0x7f04a00a6950 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04a00a77b0 con 0x7f04a0139710 2024-08-19T11:20:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f04a00a7d40 con 0x7f04a00a57c0 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a8779640 10 monclient(hunting): authenticate will time out at 1280.815050s 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 0x7f04a0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 0x7f04a0139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38352/0 (socket says 172.21.15.71:38352) 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 -- 172.21.15.71:0/804033352 learned_addr learned my addr 172.21.15.71:0/804033352 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): get_auth_request con 0x7f04a0139710 auth_method 0 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6515640 1 --2- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 0x7f04a00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 1 --2- 172.21.15.71:0/804033352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a57c0 0x7f04a00a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6515640 1 -- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 msgr2=0x7f04a00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6515640 1 -- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 msgr2=0x7f04a00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): get_auth_request con 0x7f04a00a57c0 auth_method 0 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6515640 1 --2- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 0x7f04a00a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6515640 1 --2- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 0x7f04a00a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient(hunting): handle_auth_done global_id 75548 payload 274 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 -- 172.21.15.71:0/804033352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a57c0 msgr2=0x7f04a00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 --2- 172.21.15.71:0/804033352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a57c0 0x7f04a00a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 -- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 msgr2=0x7f04a00a6d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 --2- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 0x7f04a00a6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 monclient: found mon.noname-b 2024-08-19T11:20:22.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.774+0000 7f04a6d16640 1 -- 172.21.15.71:0/804033352 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00a6380 con 0x7f04a0139710 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a6d16640 1 -- 172.21.15.71:0/804033352 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 msgr2=0x7f04a0139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a6d16640 1 --2- 172.21.15.71:0/804033352 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 0x7f04a0139b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0498009eb0 tx=0x7f049802a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f04d9e9d2ec19e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 1 -- 172.21.15.71:0/804033352 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0498036070 con 0x7f04a0139710 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: dump: 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.784 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 1 -- 172.21.15.71:0/804033352 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0498007a70 con 0x7f04a0139710 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a8779640 5 monclient: authenticate success, global_id 75548 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a8779640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a8779640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 1 -- 172.21.15.71:0/804033352 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0498007c20 con 0x7f04a0139710 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a8779640 4 set_mon_vals no callback set 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.777+0000 7f04a5513640 10 monclient: dump: 2024-08-19T11:20:22.786 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.787 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 10 monclient: shutdown 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 -- 172.21.15.71:0/804033352 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 msgr2=0x7f04a0139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 --2- 172.21.15.71:0/804033352 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 0x7f04a0139b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0498009eb0 tx=0x7f049802a5b0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 -- 172.21.15.71:0/804033352 shutdown_connections 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 --2- 172.21.15.71:0/804033352 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a0139710 0x7f04a0139b30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 --2- 172.21.15.71:0/804033352 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a57c0 0x7f04a00a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 --2- 172.21.15.71:0/804033352 >> v2:172.21.15.135:3300/0 conn(0x7f04a00a6950 0x7f04a00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 -- 172.21.15.71:0/804033352 >> 172.21.15.71:0/804033352 conn(0x7f04a00abf50 msgr2=0x7f04a00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 -- 172.21.15.71:0/804033352 shutdown_connections 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 1 -- 172.21.15.71:0/804033352 wait complete. 2024-08-19T11:20:22.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.778+0000 7f04a8779640 10 monclient: monmap: 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.789 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 Processor -- start 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 -- start start 2024-08-19T11:20:22.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient: init 2024-08-19T11:20:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient: _add_conns ranks=[2,7,5,0,8,3,4,6,1] 2024-08-19T11:20:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 0x7f04a01ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): picked mon.noname-b con 0x7f04a00a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a6950 0x7f04a0138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): picked mon.noname-i con 0x7f04a00a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04a0139710 0x7f04a01390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): picked mon.noname-h con 0x7f04a0139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04a00a84c0 con 0x7f04a00a57c0 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f04a00a3650 con 0x7f04a0139710 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f04a00a8700 con 0x7f04a00a6950 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a8779640 10 monclient(hunting): authenticate will time out at 1280.820696s 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 0x7f04a01ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 0x7f04a01ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38356/0 (socket says 172.21.15.71:38356) 2024-08-19T11:20:22.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 1 -- 172.21.15.71:0/1416121008 learned_addr learned my addr 172.21.15.71:0/1416121008 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): get_auth_request con 0x7f04a00a57c0 auth_method 0 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a5d14640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a6950 0x7f04a0138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6d16640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04a0139710 0x7f04a01390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a5d14640 10 monclient(hunting): get_auth_request con 0x7f04a00a6950 auth_method 0 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a5d14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a5d14640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a5d14640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6d16640 10 monclient(hunting): get_auth_request con 0x7f04a0139710 auth_method 0 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6d16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6d16640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.779+0000 7f04a6d16640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6d16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6d16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6d16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 10 monclient(hunting): handle_auth_done global_id 75557 payload 824 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a6950 msgr2=0x7f04a0138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f04a00a6950 0x7f04a0138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04a0139710 msgr2=0x7f04a01390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f04a0139710 0x7f04a01390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 1 monclient: found mon.noname-b 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.780+0000 7f04a6515640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a01256e0 con 0x7f04a00a57c0 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a6515640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 msgr2=0x7f04a01ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a6515640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 0x7f04a01ce340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f049c00c7f0 tx=0x7f049c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f049c015070 con 0x7f04a00a57c0 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: dump: 2024-08-19T11:20:22.802 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.803 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c007ca0 con 0x7f04a00a57c0 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 5 monclient: authenticate success, global_id 75557 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 10 monclient: _renew_subs 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a01cec50 con 0x7f04a00a57c0 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f049c007e50 con 0x7f04a00a57c0 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f0496ffd640 10 monclient: dump: 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.805 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 10 monclient: _renew_subs 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a0126670 con 0x7f04a00a57c0 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.782+0000 7f04a4d12640 4 set_mon_vals no callback set 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a8779640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a8779640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 0x7f04a002d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f04a006a590 con 0x7f04a01cb600 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f049c018070 con 0x7f04a00a57c0 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 0x7f04a002d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient: get_auth_request con 0x7f04a01cb600 auth_method 0 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f0496ffd640 1 --2- 172.21.15.71:0/1416121008 >> v2:172.21.15.135:6800/726754104 conn(0x7f048403ec20 0x7f04840410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(288..288 src has 1..288) ==== 3898+0+0 (secure 0 0 0) 0x7f049c051aa0 con 0x7f04a00a57c0 2024-08-19T11:20:22.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 10 monclient(hunting): handle_auth_done global_id 46002 payload 824 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a5d14640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04a00a1f40 con 0x7f04a01cb600 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a6d16640 1 --2- 172.21.15.71:0/1416121008 >> v2:172.21.15.135:6800/726754104 conn(0x7f048403ec20 0x7f04840410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.783+0000 7f04a6d16640 10 monclient: get_auth_request con 0x7f048403ec20 auth_method 0 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f04a5d14640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 msgr2=0x7f04a002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f04a5d14640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 0x7f04a002d1c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04900118d0 tx=0x7f0490011d90 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0490019070 con 0x7f04a01cb600 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 10 monclient: dump: 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.808 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f04a6d16640 1 --2- 172.21.15.71:0/1416121008 >> v2:172.21.15.135:6800/726754104 conn(0x7f048403ec20 0x7f04840410e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0498030000 tx=0x7f0498009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f049000f830 con 0x7f04a01cb600 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 msgr2=0x7f04a002d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 0x7f04a002d1c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04900118d0 tx=0x7f0490011d90 comp rx=0 tx=0).stop 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 msgr2=0x7f04a002d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.786+0000 7f0496ffd640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb600 0x7f04a002d1c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.792+0000 7f04a8779640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.792+0000 7f04a8779640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 0x7f04a002d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.792+0000 7f04a8779640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.792+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f04a0076c60 con 0x7f04a01cb9e0 2024-08-19T11:20:22.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 0x7f04a002d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient: get_auth_request con 0x7f04a01cb9e0 auth_method 0 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 10 monclient(hunting): handle_auth_done global_id 46011 payload 824 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.793+0000 7f04a5d14640 1 -- 172.21.15.71:0/1416121008 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f04a00a6d30 con 0x7f04a01cb9e0 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.795+0000 7f04a5d14640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 msgr2=0x7f04a002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.795+0000 7f04a5d14640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 0x7f04a002d700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f049001b000 tx=0x7f04900046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.795+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0490019040 con 0x7f04a01cb9e0 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.795+0000 7f0496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.795+0000 7f0496ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.795+0000 7f0496ffd640 10 monclient: dump: 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.812 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f049001e660 con 0x7f04a01cb9e0 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 msgr2=0x7f04a002d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 0x7f04a002d700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f049001b000 tx=0x7f04900046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 msgr2=0x7f04a002d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f0496ffd640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04a01cb9e0 0x7f04a002d700 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f049001b000 tx=0x7f04900046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 391818, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:22.816 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:22.818 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.819 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.821 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.822 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.825 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.827 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.829 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.830 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.832 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.834 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:22.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.837 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:22.838 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:22.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 >> v2:172.21.15.135:6800/726754104 conn(0x7f048403ec20 msgr2=0x7f04840410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 --2- 172.21.15.71:0/1416121008 >> v2:172.21.15.135:6800/726754104 conn(0x7f048403ec20 0x7f04840410e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0498030000 tx=0x7f0498009000 comp rx=0 tx=0).stop 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 10 monclient: shutdown 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 msgr2=0x7f04a01ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 --2- 172.21.15.71:0/1416121008 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04a00a57c0 0x7f04a01ce340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f049c00c7f0 tx=0x7f049c00ccb0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a6d16640 1 -- 172.21.15.71:0/1416121008 reap_dead start 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a6d16640 1 -- 172.21.15.71:0/1416121008 reap_dead start 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 shutdown_connections 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 >> 172.21.15.71:0/1416121008 conn(0x7f04a00abf50 msgr2=0x7f04a00aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 shutdown_connections 2024-08-19T11:20:22.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.796+0000 7f04a8779640 1 -- 172.21.15.71:0/1416121008 wait complete. 2024-08-19T11:20:22.841 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:22.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:20:22.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:20:22.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.939+0000 7f079706e640 10 monclient: get_monmap_and_config 2024-08-19T11:20:22.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.939+0000 7f079706e640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.939+0000 7f079706e640 10 monclient: monmap: 2024-08-19T11:20:22.940 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.940 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.940 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:22.940134+0000 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:22.940134+0000 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:22.942 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:22.942 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 1 Processor -- start 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 1 -- start start 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient: init 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient: _add_conns ranks=[0,5,1,7,2,8,3,10,4,9,6] 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f07900a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 0x7f079013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient(hunting): picked mon.noname-h con 0x7f07900a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f07900a7440 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:22.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07900a6380 con 0x7f07900a6950 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07900a3650 con 0x7f07900a7440 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f07900a5020 con 0x7f07900a57c0 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f079706e640 10 monclient(hunting): authenticate will time out at 1280.981801s 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f0794e0a640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f07900a6950 0x7f07900a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43918/0 (socket says 172.21.15.71:43918) 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.940+0000 7f0794e0a640 1 -- 172.21.15.71:0/3904155454 learned_addr learned my addr 172.21.15.71:0/3904155454 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 1 --2- 172.21.15.71:0/3904155454 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 0x7f079013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): get_auth_request con 0x7f07900a57c0 auth_method 0 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient(hunting): handle_auth_done global_id 46229 payload 274 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 1 -- 172.21.15.71:0/3904155454 >> v1:172.21.15.135:6789/0 conn(0x7f07900a7440 legacy=0x7f07901410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 1 -- 172.21.15.71:0/3904155454 >> v1:172.21.15.71:6789/0 conn(0x7f07900a6950 legacy=0x7f07900a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 1 monclient: found mon.noname-h 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:22.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.941+0000 7f078ffff640 1 -- 172.21.15.71:0/3904155454 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07900a84c0 con 0x7f07900a57c0 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078ffff640 1 -- 172.21.15.71:0/3904155454 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 msgr2=0x7f079013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078ffff640 1 --2- 172.21.15.71:0/3904155454 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 0x7f079013eb60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f07840097d0 tx=0x7f0784029fb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=c7990e350486978c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 1 -- 172.21.15.71:0/3904155454 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0784037070 con 0x7f07900a57c0 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: dump: 2024-08-19T11:20:22.953 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.954 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f079706e640 5 monclient: authenticate success, global_id 46229 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 1 -- 172.21.15.71:0/3904155454 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078402adf0 con 0x7f07900a57c0 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f079706e640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 1 -- 172.21.15.71:0/3904155454 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0784030c20 con 0x7f07900a57c0 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f079706e640 4 set_mon_vals no callback set 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.944+0000 7f078f7fe640 10 monclient: dump: 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.956 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 10 monclient: shutdown 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 -- 172.21.15.71:0/3904155454 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 msgr2=0x7f079013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 --2- 172.21.15.71:0/3904155454 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 0x7f079013eb60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f07840097d0 tx=0x7f0784029fb0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 -- 172.21.15.71:0/3904155454 shutdown_connections 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 --2- 172.21.15.71:0/3904155454 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a57c0 0x7f079013eb60 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f07840097d0 tx=0x7f0784029fb0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 -- 172.21.15.71:0/3904155454 >> 172.21.15.71:0/3904155454 conn(0x7f07900abf50 msgr2=0x7f07900ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 -- 172.21.15.71:0/3904155454 shutdown_connections 2024-08-19T11:20:22.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 1 -- 172.21.15.71:0/3904155454 wait complete. 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 10 monclient: build_initial_monmap 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.945+0000 7f079706e640 10 monclient: monmap: 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:22.958 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 Processor -- start 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 -- start start 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient: init 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient: _add_conns ranks=[1,5,7,3,6,4,0,8,2] 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 0x7f07901ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): picked mon.noname-f con 0x7f07900a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a7440 0x7f0790140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): picked mon.noname-h con 0x7f07900a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0790141130 0x7f079013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): picked mon.noname-i con 0x7f0790141130 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07900a8700 con 0x7f07900a6950 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f07900a7d40 con 0x7f07900a7440 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f07901427d0 con 0x7f0790141130 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.946+0000 7f079706e640 10 monclient(hunting): authenticate will time out at 1280.987954s 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 0x7f07901ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 0x7f07901ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:35312/0 (socket says 172.21.15.71:35312) 2024-08-19T11:20:22.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 -- 172.21.15.71:0/634013657 learned_addr learned my addr 172.21.15.71:0/634013657 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): get_auth_request con 0x7f07900a6950 auth_method 0 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0790141130 0x7f079013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a7440 0x7f0790140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): get_auth_request con 0x7f0790141130 auth_method 0 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): get_auth_request con 0x7f07900a7440 auth_method 0 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f079560b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient(hunting): handle_auth_done global_id 85186 payload 824 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0790141130 msgr2=0x7f079013a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f0790141130 0x7f079013a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a7440 msgr2=0x7f0790140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a7440 0x7f0790140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient: _finish_hunting 0 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 monclient: found mon.noname-f 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f0794e0a640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07900a2710 con 0x7f07900a6950 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.947+0000 7f078ffff640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07900a7440 0x7f0790140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.949+0000 7f0794e0a640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 msgr2=0x7f07901ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.949+0000 7f0794e0a640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 0x7f07901ce740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f078000c460 tx=0x7f078000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0780017070 con 0x7f07900a6950 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: dump: 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.964 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0780005cf0 con 0x7f07900a6950 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 5 monclient: authenticate success, global_id 85186 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0780004b20 con 0x7f07900a6950 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 10 monclient: _renew_subs 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:20:22.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079013e6b0 con 0x7f07900a6950 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078d7fa640 10 monclient: dump: 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.966 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f078effd640 4 set_mon_vals no callback set 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 10 monclient: _renew_subs 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.950+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079013de10 con 0x7f07900a6950 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f079706e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f079706e640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 0x7f079013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f079706e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f0790076c60 con 0x7f079013aee0 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0780007070 con 0x7f07900a6950 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 0x7f079013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient: get_auth_request con 0x7f079013aee0 auth_method 0 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078d7fa640 1 --2- 172.21.15.71:0/634013657 >> v2:172.21.15.135:6800/726754104 conn(0x7f077c03ea80 0x7f077c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(288..288 src has 1..288) ==== 3898+0+0 (secure 0 0 0) 0x7f0780051090 con 0x7f07900a6950 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 10 monclient(hunting): handle_auth_done global_id 46247 payload 824 2024-08-19T11:20:22.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f079560b640 1 --2- 172.21.15.71:0/634013657 >> v2:172.21.15.135:6800/726754104 conn(0x7f077c03ea80 0x7f077c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f078ffff640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07901cec80 con 0x7f079013aee0 2024-08-19T11:20:22.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.951+0000 7f079560b640 10 monclient: get_auth_request con 0x7f077c03ea80 auth_method 0 2024-08-19T11:20:22.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078ffff640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 msgr2=0x7f079013b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078ffff640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 0x7f079013b2c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f07900a2e70 tx=0x7f07840046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f079560b640 1 --2- 172.21.15.71:0/634013657 >> v2:172.21.15.135:6800/726754104 conn(0x7f077c03ea80 0x7f077c040f40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0788009f60 tx=0x7f078800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0784042070 con 0x7f079013aee0 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 10 monclient: dump: 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.972 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f07840043f0 con 0x7f079013aee0 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 msgr2=0x7f079013b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 0x7f079013b2c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f07900a2e70 tx=0x7f07840046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 msgr2=0x7f079013b2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.954+0000 7f078d7fa640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f079013aee0 0x7f079013b2c0 secure :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f07900a2e70 tx=0x7f07840046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.960+0000 7f079706e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.960+0000 7f079706e640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 0x7f0790136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.960+0000 7f079706e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.960+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f079013e330 con 0x7f07901368f0 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 0x7f0790136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient: get_auth_request con 0x7f07901368f0 auth_method 0 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 10 monclient(hunting): handle_auth_done global_id 46256 payload 824 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.961+0000 7f078ffff640 1 -- 172.21.15.71:0/634013657 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f079013b800 con 0x7f07901368f0 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.963+0000 7f078ffff640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 msgr2=0x7f0790136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.963+0000 7f078ffff640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 0x7f0790136cd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f078402a520 tx=0x7f0784008030 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0784037040 con 0x7f07901368f0 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 10 monclient: dump: 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:22.975 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f078403d440 con 0x7f07901368f0 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:22.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 msgr2=0x7f0790136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 0x7f0790136cd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f078402a520 tx=0x7f0784008030 comp rx=0 tx=0).stop 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 msgr2=0x7f0790136cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f078d7fa640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f07901368f0 0x7f0790136cd0 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f078402a520 tx=0x7f0784008030 comp rx=0 tx=0).stop 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 391986, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.978 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.979 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.980 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:22.981 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:22.982 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:22.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:22.984 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.985 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.988 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.991 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.994 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.995 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:22.998 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:22.999 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.000 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.001 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:23.001 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 >> v2:172.21.15.135:6800/726754104 conn(0x7f077c03ea80 msgr2=0x7f077c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079706e640 1 --2- 172.21.15.71:0/634013657 >> v2:172.21.15.135:6800/726754104 conn(0x7f077c03ea80 0x7f077c040f40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0788009f60 tx=0x7f078800d040 comp rx=0 tx=0).stop 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079706e640 10 monclient: shutdown 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079706e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 msgr2=0x7f07901ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079706e640 1 --2- 172.21.15.71:0/634013657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07900a6950 0x7f07901ce740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f078000c460 tx=0x7f078000c920 comp rx=0 tx=0).stop 2024-08-19T11:20:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079560b640 1 -- 172.21.15.71:0/634013657 reap_dead start 2024-08-19T11:20:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.964+0000 7f079560b640 1 -- 172.21.15.71:0/634013657 reap_dead start 2024-08-19T11:20:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.965+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 shutdown_connections 2024-08-19T11:20:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.965+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 >> 172.21.15.71:0/634013657 conn(0x7f07900abf50 msgr2=0x7f07900aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.965+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 shutdown_connections 2024-08-19T11:20:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:22.965+0000 7f079706e640 1 -- 172.21.15.71:0/634013657 wait complete. 2024-08-19T11:20:23.003 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:23.003 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:20:23.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:20:23.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.112+0000 7fa354a15640 10 monclient: get_monmap_and_config 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.112+0000 7fa354a15640 10 monclient: build_initial_monmap 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.112+0000 7fa354a15640 10 monclient: monmap: 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:23.113477+0000 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:23.113477+0000 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:23.114 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:23.115 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.113+0000 7fa354a15640 1 Processor -- start 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.113+0000 7fa354a15640 1 -- start start 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.113+0000 7fa354a15640 10 monclient: init 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient: _add_conns ranks=[3,6,5,9,1,4,0,10,8,2,7] 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): picked mon.noname-g con 0x7fa3480b8670 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa348007e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): picked mon.noname-d con 0x7fa3480b8a50 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa3480b8e90 0x7fa348008380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): picked mon.noname-h con 0x7fa3480b8e90 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa34801ffc0 con 0x7fa3480b8670 2024-08-19T11:20:23.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa348027c20 con 0x7fa3480b8e90 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa348021100 con 0x7fa3480b8a50 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa354a15640 10 monclient(hunting): authenticate will time out at 1281.155575s 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa348007e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa348007e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60190/0 (socket says 172.21.15.71:60190) 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 -- 172.21.15.71:0/672960570 learned_addr learned my addr 172.21.15.71:0/672960570 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): get_auth_request con 0x7fa3480b8a50 auth_method 0 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34f7fe640 10 monclient(hunting): get_auth_request con 0x7fa3480b8670 auth_method 0 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34ffff640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa3480b8e90 0x7fa348008380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient(hunting): handle_auth_done global_id 104505 payload 274 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 -- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa3480b8e90 msgr2=0x7fa348008380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa3480b8e90 0x7fa348008380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 -- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 msgr2=0x7fa3480220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient: _finish_hunting 0 2024-08-19T11:20:23.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 monclient: found mon.noname-d 2024-08-19T11:20:23.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:23.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:23.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34effd640 1 -- 172.21.15.71:0/672960570 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3480213e0 con 0x7fa3480b8a50 2024-08-19T11:20:23.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.114+0000 7fa34ffff640 10 monclient: get_auth_request con 0x7fa3480b8e90 auth_method 0 2024-08-19T11:20:23.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.115+0000 7fa34ffff640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa3480b8e90 0x7fa348008380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:20:23.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.117+0000 7fa34effd640 1 -- 172.21.15.71:0/672960570 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 msgr2=0x7fa348007e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:23.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.117+0000 7fa34effd640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa348007e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098a0 tx=0x7fa33c02a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1dde272b5042f55d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 1 -- 172.21.15.71:0/672960570 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa33c037070 con 0x7fa3480b8a50 2024-08-19T11:20:23.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:23.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: dump: 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.128 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 1 -- 172.21.15.71:0/672960570 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c02ae00 con 0x7fa3480b8a50 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 5 monclient: authenticate success, global_id 104505 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 1 -- 172.21.15.71:0/672960570 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa33c030c20 con 0x7fa3480b8a50 2024-08-19T11:20:23.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 4 set_mon_vals no callback set 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa34e7fc640 10 monclient: dump: 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.130 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 10 monclient: shutdown 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 -- 172.21.15.71:0/672960570 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 msgr2=0x7fa348007e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa348007e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098a0 tx=0x7fa33c02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 -- 172.21.15.71:0/672960570 shutdown_connections 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa3480b8e90 0x7fa348008380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa348007e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 --2- 172.21.15.71:0/672960570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 -- 172.21.15.71:0/672960570 >> 172.21.15.71:0/672960570 conn(0x7fa3480289b0 msgr2=0x7fa348028dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 -- 172.21.15.71:0/672960570 shutdown_connections 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.118+0000 7fa354a15640 1 -- 172.21.15.71:0/672960570 wait complete. 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.119+0000 7fa354a15640 10 monclient: build_initial_monmap 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.119+0000 7fa354a15640 10 monclient: monmap: 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:23.132 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.119+0000 7fa354a15640 1 Processor -- start 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 -- start start 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient: init 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient: _add_conns ranks=[3,6,1,7,4,8,0,5,2] 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): picked mon.noname-g con 0x7fa3480b8670 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa3480a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): picked mon.noname-d con 0x7fa3480b8a50 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3480b8e90 0x7fa3480a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): picked mon.noname-f con 0x7fa3480b8e90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3480088c0 con 0x7fa3480b8e90 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa348022630 con 0x7fa3480b8670 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa348008a40 con 0x7fa3480b8a50 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa354a15640 10 monclient(hunting): authenticate will time out at 1281.161572s 2024-08-19T11:20:23.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa3480a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa3480a2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60200/0 (socket says 172.21.15.71:60200) 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 -- 172.21.15.71:0/4233363699 learned_addr learned my addr 172.21.15.71:0/4233363699 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): get_auth_request con 0x7fa3480b8a50 auth_method 0 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34ffff640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3480b8e90 0x7fa3480a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34ffff640 10 monclient(hunting): get_auth_request con 0x7fa3480b8e90 auth_method 0 2024-08-19T11:20:23.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34f7fe640 10 monclient(hunting): get_auth_request con 0x7fa3480b8670 auth_method 0 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient(hunting): handle_auth_done global_id 104514 payload 824 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 msgr2=0x7fa3480b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3480b8e90 msgr2=0x7fa3480a33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3480b8e90 0x7fa3480a33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient: _finish_hunting 0 2024-08-19T11:20:23.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 monclient: found mon.noname-d 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34effd640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3480a4800 con 0x7fa3480b8a50 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3480b8670 0x7fa3480b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.120+0000 7fa34ffff640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3480b8e90 0x7fa3480a33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa34effd640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 msgr2=0x7fa3480a2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa34effd640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa3480a2ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098a0 tx=0x7fa33c0046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa33c041030 con 0x7fa3480b8a50 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: dump: 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.137 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.138 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: _finish_auth 0 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 5 monclient: authenticate success, global_id 104514 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c003bd0 con 0x7fa3480b8a50 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 10 monclient: _renew_subs 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3480b8140 con 0x7fa3480b8a50 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa33c037040 con 0x7fa3480b8a50 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa33bfff640 10 monclient: dump: 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.140 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa34dffb640 4 set_mon_vals no callback set 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 10 monclient: _renew_subs 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.123+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3480a62c0 con 0x7fa3480b8a50 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa33c044070 con 0x7fa3480b8a50 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa354a15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa354a15640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 0x7fa3480a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa3480042e0 con 0x7fa3480b7930 2024-08-19T11:20:23.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa33bfff640 1 --2- 172.21.15.71:0/4233363699 >> v2:172.21.15.135:6800/726754104 conn(0x7fa33403ea80 0x7fa334040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(289..289 src has 1..289) ==== 3898+0+0 (secure 0 0 0) 0x7fa33c042070 con 0x7fa3480b8a50 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 0x7fa3480a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient: get_auth_request con 0x7fa3480b7930 auth_method 0 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34ffff640 1 --2- 172.21.15.71:0/4233363699 >> v2:172.21.15.135:6800/726754104 conn(0x7fa33403ea80 0x7fa334040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34ffff640 10 monclient: get_auth_request con 0x7fa33403ea80 auth_method 0 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.124+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.125+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_done global_id 85093 payload 824 2024-08-19T11:20:23.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.125+0000 7fa34f7fe640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3480a6500 con 0x7fa3480b7930 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa34ffff640 1 --2- 172.21.15.71:0/4233363699 >> v2:172.21.15.135:6800/726754104 conn(0x7fa33403ea80 0x7fa334040f40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa35006a950 tx=0x7fa350070040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa34f7fe640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 msgr2=0x7fa3480a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 0x7fa3480a3920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa34400f550 tx=0x7fa34400fa10 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa3440044a0 con 0x7fa3480b7930 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa33bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa33bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.127+0000 7fa33bfff640 10 monclient: dump: 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.145 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.146 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa344004030 con 0x7fa3480b7930 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 msgr2=0x7fa3480a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 0x7fa3480a3920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa34400f550 tx=0x7fa34400fa10 comp rx=0 tx=0).stop 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 msgr2=0x7fa3480a3920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.128+0000 7fa33bfff640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480b7930 0x7fa3480a3920 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa34400f550 tx=0x7fa34400fa10 comp rx=0 tx=0).stop 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa354a15640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa354a15640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 0x7fa3480028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa354a15640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa3480220f0 con 0x7fa3480a3e60 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 0x7fa3480028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient: get_auth_request con 0x7fa3480a3e60 auth_method 0 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 10 monclient(hunting): handle_auth_done global_id 85102 payload 824 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.134+0000 7fa34f7fe640 1 -- 172.21.15.71:0/4233363699 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa348022910 con 0x7fa3480a3e60 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa34f7fe640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 msgr2=0x7fa3480028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa34f7fe640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 0x7fa3480028b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa344019000 tx=0x7fa3440046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa34401fc20 con 0x7fa3480a3e60 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 10 monclient: dump: 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.149 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fa34401fc20 con 0x7fa3480a3e60 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 msgr2=0x7fa3480028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 0x7fa3480028b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa344019000 tx=0x7fa3440046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 msgr2=0x7fa3480028b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:23.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.137+0000 7fa33bfff640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3480a3e60 0x7fa3480028b0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa344019000 tx=0x7fa3440046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 205298, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:23.151 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:23.152 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:23.153 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:23.154 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:23.155 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.157 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:23.158 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.161 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.162 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.166 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.170 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:23.171 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:23.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:23.173 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:23.174 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 >> v2:172.21.15.135:6800/726754104 conn(0x7fa33403ea80 msgr2=0x7fa334040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 --2- 172.21.15.71:0/4233363699 >> v2:172.21.15.135:6800/726754104 conn(0x7fa33403ea80 0x7fa334040f40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa35006a950 tx=0x7fa350070040 comp rx=0 tx=0).stop 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 10 monclient: shutdown 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 msgr2=0x7fa3480a2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa3480a2ea0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0098a0 tx=0x7fa33c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa34ffff640 1 -- 172.21.15.71:0/4233363699 reap_dead start 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 shutdown_connections 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 --2- 172.21.15.71:0/4233363699 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa3480b8a50 0x7fa3480a2ea0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 >> 172.21.15.71:0/4233363699 conn(0x7fa3480289b0 msgr2=0x7fa3480bb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 shutdown_connections 2024-08-19T11:20:23.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.138+0000 7fa354a15640 1 -- 172.21.15.71:0/4233363699 wait complete. 2024-08-19T11:20:23.176 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:23.176 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:20:23.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:20:23.192 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: starting. 2024-08-19T11:20:23.192 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28765 2024-08-19T11:20:23.192 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: created object 0... 2024-08-19T11:20:23.192 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: created object 25... 2024-08-19T11:20:23.192 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: created object 49... 2024-08-19T11:20:23.193 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: finishing. 2024-08-19T11:20:23.193 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28766]: shutting down. 2024-08-19T11:20:23.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.273+0000 7f9201ff2640 10 monclient: get_monmap_and_config 2024-08-19T11:20:23.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.273+0000 7f9201ff2640 10 monclient: build_initial_monmap 2024-08-19T11:20:23.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.273+0000 7f9201ff2640 10 monclient: monmap: 2024-08-19T11:20:23.274 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:23.274 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:23.274165+0000 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:23.274165+0000 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:23.275 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:23.276 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:23.276 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:23.276 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 Processor -- start 2024-08-19T11:20:23.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 -- start start 2024-08-19T11:20:23.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient: init 2024-08-19T11:20:23.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:23.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient: _add_conns ranks=[5,7,3,10,4,9,1,6,0,2,8] 2024-08-19T11:20:23.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 0x7f91fc0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): picked mon.noname-h con 0x7f91fc0a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): picked mon.noname-i con 0x7f91fc0a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 0x7f91fc139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): picked mon.noname-g con 0x7f91fc139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc0a4f90 con 0x7f91fc139860 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f91fc0a6380 con 0x7f91fc0a6a30 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f91fc0a49d0 con 0x7f91fc0a6e10 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:23.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.274+0000 7f9201ff2640 10 monclient(hunting): authenticate will time out at 1281.315805s 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 0x7f91fc139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 0x7f91fc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 0x7f91fc0a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:60770/0 (socket says 172.21.15.71:60770) 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 -- 172.21.15.71:0/1860867464 learned_addr learned my addr 172.21.15.71:0/1860867464 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 0x7f91fc139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:39456/0 (socket says 172.21.15.71:39456) 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): get_auth_request con 0x7f91fc0a6a30 auth_method 0 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:54856/0 (socket says 172.21.15.71:54856) 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): get_auth_request con 0x7f91fc139860 auth_method 0 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): get_auth_request con 0x7f91fc0a6e10 auth_method 0 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_done global_id 46265 payload 274 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 -- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 msgr2=0x7f91fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 -- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 msgr2=0x7f91fc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 0x7f91fc139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 monclient: found mon.noname-h 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fb7fe640 1 -- 172.21.15.71:0/1860867464 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0a46f0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.275+0000 7f91fbfff640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 0x7f91fc139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fb7fe640 1 -- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 msgr2=0x7f91fc0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fb7fe640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 0x7f91fc0a57f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f91e40098d0 tx=0x7f91e402a0a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=64e61a54e9fe89aa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 1 -- 172.21.15.71:0/1860867464 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91e4037070 con 0x7f91fc0a6a30 2024-08-19T11:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:23.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: dump: 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.290 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 5 monclient: authenticate success, global_id 46265 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 1 -- 172.21.15.71:0/1860867464 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e402adc0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 1 -- 172.21.15.71:0/1860867464 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91e4030c20 con 0x7f91fc0a6a30 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 4 set_mon_vals no callback set 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f91fa7fc640 10 monclient: dump: 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.292 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 10 monclient: shutdown 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 -- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 msgr2=0x7f91fc0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 0x7f91fc0a57f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f91e40098d0 tx=0x7f91e402a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 -- 172.21.15.71:0/1860867464 shutdown_connections 2024-08-19T11:20:23.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc139860 0x7f91fc139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 --2- 172.21.15.71:0/1860867464 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc0a6a30 0x7f91fc0a57f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.278+0000 7f9201ff2640 1 -- 172.21.15.71:0/1860867464 >> 172.21.15.71:0/1860867464 conn(0x7f91fc0ac030 msgr2=0x7f91fc0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.279+0000 7f9201ff2640 1 -- 172.21.15.71:0/1860867464 shutdown_connections 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.279+0000 7f9201ff2640 1 -- 172.21.15.71:0/1860867464 wait complete. 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.279+0000 7f9201ff2640 10 monclient: build_initial_monmap 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.279+0000 7f9201ff2640 10 monclient: monmap: 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:23.294 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.279+0000 7f9201ff2640 1 Processor -- start 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 -- start start 2024-08-19T11:20:23.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient: init 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient: _add_conns ranks=[3,7,5,6,2,8,4,0,1] 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 0x7f91fc124cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): picked mon.noname-g con 0x7f91fc0a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc125200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): picked mon.noname-i con 0x7f91fc0a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc139860 0x7f91fc125740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): picked mon.noname-h con 0x7f91fc139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc0a7730 con 0x7f91fc0a6a30 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f91fc13a1a0 con 0x7f91fc139860 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:23.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f91fc1377e0 con 0x7f91fc0a6e10 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f9201ff2640 10 monclient(hunting): authenticate will time out at 1281.321540s 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 0x7f91fc124cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc125200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc139860 0x7f91fc125740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 0x7f91fc124cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:39464/0 (socket says 172.21.15.71:39464) 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc125200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:54864/0 (socket says 172.21.15.71:54864) 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 1 -- 172.21.15.71:0/829606978 learned_addr learned my addr 172.21.15.71:0/829606978 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): get_auth_request con 0x7f91fc0a6a30 auth_method 0 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): get_auth_request con 0x7f91fc139860 auth_method 0 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): get_auth_request con 0x7f91fc0a6e10 auth_method 0 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.280+0000 7f91fb7fe640 10 monclient(hunting): handle_auth_done global_id 46047 payload 824 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 1 -- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 msgr2=0x7f91fc125200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc125200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 1 -- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc139860 msgr2=0x7f91fc125740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc139860 0x7f91fc125740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 1 monclient: found mon.noname-g 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.281+0000 7f91fb7fe640 1 -- 172.21.15.71:0/829606978 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc128ad0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91fb7fe640 1 -- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 msgr2=0x7f91fc124cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91fb7fe640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 0x7f91fc124cc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f91e40090b0 tx=0x7f91e40046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91e4037040 con 0x7f91fc0a6a30 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: dump: 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.300 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: _finish_auth 0 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e4003dd0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 5 monclient: authenticate success, global_id 46047 2024-08-19T11:20:23.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f91e40307b0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 10 monclient: _renew_subs 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc139cf0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f9ffb640 4 set_mon_vals no callback set 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f91f3fff640 10 monclient: dump: 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:23.302 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 10 monclient: _renew_subs 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:20:23.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.283+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc126770 con 0x7f91fc0a6a30 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f9201ff2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f91e4044030 con 0x7f91fc0a6a30 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f9201ff2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f9201ff2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc13a500 con 0x7f91fc0a6a30 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f91f3fff640 1 --2- 172.21.15.71:0/829606978 >> v2:172.21.15.135:6800/726754104 conn(0x7f91dc03ea80 0x7f91dc040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.284+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(289..289 src has 1..289) ==== 3898+0+0 (secure 0 0 0) 0x7f91e4042020 con 0x7f91fc0a6a30 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.285+0000 7f91faffd640 1 --2- 172.21.15.71:0/829606978 >> v2:172.21.15.135:6800/726754104 conn(0x7f91dc03ea80 0x7f91dc040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.285+0000 7f91faffd640 10 monclient: get_auth_request con 0x7f91dc03ea80 auth_method 0 2024-08-19T11:20:23.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.287+0000 7f91faffd640 1 --2- 172.21.15.71:0/829606978 >> v2:172.21.15.135:6800/726754104 conn(0x7f91dc03ea80 0x7f91dc040f40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f91fc1263e0 tx=0x7f91ec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.290+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f91e40305d0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.290+0000 7f91f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:23.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.290+0000 7f91f3fff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.534+0000 7f9201ff2640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:20:23.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.534+0000 7f9201ff2640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:20:23.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.534+0000 7f9201ff2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:20:23.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.534+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f91fc0a2280 con 0x7f91fc0a6a30 2024-08-19T11:20:23.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.536+0000 7f91f3fff640 1 -- 172.21.15.71:0/829606978 <== mon.3 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f91e40701c0 con 0x7f91fc0a6a30 2024-08-19T11:20:23.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.536+0000 7f91f3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:20:23.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.536+0000 7f91f3fff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:23.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 >> v2:172.21.15.135:6800/726754104 conn(0x7f91dc03ea80 msgr2=0x7f91dc040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 --2- 172.21.15.71:0/829606978 >> v2:172.21.15.135:6800/726754104 conn(0x7f91dc03ea80 0x7f91dc040f40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f91fc1263e0 tx=0x7f91ec009190 comp rx=0 tx=0).stop 2024-08-19T11:20:23.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 10 monclient: shutdown 2024-08-19T11:20:23.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:23.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 msgr2=0x7f91fc124cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:23.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 0x7f91fc124cc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f91e40090b0 tx=0x7f91e40046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 shutdown_connections 2024-08-19T11:20:23.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 --2- 172.21.15.71:0/829606978 >> v2:172.21.15.135:6800/726754104 conn(0x7f91dc03ea80 0x7f91dc040f40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f91fc139860 0x7f91fc125740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91fc0a6e10 0x7f91fc125200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 --2- 172.21.15.71:0/829606978 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91fc0a6a30 0x7f91fc124cc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:23.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 >> 172.21.15.71:0/829606978 conn(0x7f91fc0ac030 msgr2=0x7f91fc1390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:23.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 shutdown_connections 2024-08-19T11:20:23.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:23.538+0000 7f9201ff2640 1 -- 172.21.15.71:0/829606978 wait complete. 2024-08-19T11:20:23.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=1183447159,config=2586702516,health=864398089,kv=3646823213,logm=4236860599}) 2024-08-19T11:20:23.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=1415047042,config=2586702516,health=864398089,kv=3646823213,logm=3085978903}) 2024-08-19T11:20:23.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=1183447159,config=2586702516,health=864398089,kv=3646823213,logm=2745537672}) 2024-08-19T11:20:23.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=591999140,kv=2519250839,logm=3376096914}) 2024-08-19T11:20:23.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=2664407185,config=575665002,health=999114736,kv=3646823213,logm=844264817}) 2024-08-19T11:20:23.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=18,config=2,health=11,kv=12,logm=57} crc {auth=2681178411,config=2586702516,health=4117162692,kv=3646823213,logm=596975682}) 2024-08-19T11:20:23.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=1183447159,config=1228700967,health=4285973205,kv=1865549309,logm=3637053089}) 2024-08-19T11:20:23.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1183447159,config=2586702516,health=1036649323,kv=3646823213,logm=1513802747}) 2024-08-19T11:20:23.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=1183447159,config=2586702516,health=864398089,kv=3646823213,logm=3194866665}) 2024-08-19T11:20:23.552 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3917447003}) 2024-08-19T11:20:23.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.553 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3707030816}) 2024-08-19T11:20:23.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1880336161}) 2024-08-19T11:20:23.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.554 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2192535993}) 2024-08-19T11:20:23.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3743501276}) 2024-08-19T11:20:23.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1148001053}) 2024-08-19T11:20:23.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1338528237}) 2024-08-19T11:20:23.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=244506505}) 2024-08-19T11:20:23.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.545+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2183215536}) 2024-08-19T11:20:23.558 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:20:23.788 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2069090249}) 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3239303250}) 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=11732088}) 2024-08-19T11:20:23.896 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3888176244}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4215036880}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3933149798}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=173384147}) 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.897 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693152436}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.769+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=147507262}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1468314134}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4118354045}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2147476028}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3557034255}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=503147560}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=61536453}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2189729309}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=514791447}) 2024-08-19T11:20:23.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.770+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1919252083}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=782395962}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1937447582}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2481373057}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1380524852}) 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3346650296}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3632320814}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1143764104}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3004010344}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.771+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=299313470}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2627315899}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1828641517}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1077285225}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4010408112}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.772+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3374816269}) 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=28991223}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=751908563}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347407211}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.773+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=926642440}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=700481344}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.903 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2730577994}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3120362517}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=278022772}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1086908273}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4177802432}) 2024-08-19T11:20:23.904 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3077157067}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167338551}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.774+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3707818540}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2047475543}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2745638317}) 2024-08-19T11:20:23.905 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=737355870}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1113061283}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3758554726}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3604209953}) 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.906 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659161603}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1466309542}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.775+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1467082276}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3336423175}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4010367629}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2866646482}) 2024-08-19T11:20:23.907 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3671217527}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1945889948}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=140547402}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=557925209}) 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.908 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035690579}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.776+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=926615326}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.777+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.777+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.777+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=481768416}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.777+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.777+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.777+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2507839150}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3291909868}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=800863832}) 2024-08-19T11:20:23.909 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1863811323}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2027734549}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3572982827}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3044333980}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.778+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=47633725}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.910 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=919779287}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1899918667}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=867792443}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=382064983}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4263713123}) 2024-08-19T11:20:23.911 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3038492301}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1505997938}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1566175692}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.779+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1730625246}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2223455312}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.912 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3333468799}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4163934050}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3810607965}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1836919419}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3138552441}) 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.913 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2109760517}) 2024-08-19T11:20:23.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=566512186}) 2024-08-19T11:20:23.914 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.780+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4272797167}) 2024-08-19T11:20:23.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1768302037}) 2024-08-19T11:20:23.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2005465884}) 2024-08-19T11:20:23.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4002839061}) 2024-08-19T11:20:23.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1021270702}) 2024-08-19T11:20:23.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1852149980}) 2024-08-19T11:20:23.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2761652436}) 2024-08-19T11:20:23.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1644482163}) 2024-08-19T11:20:23.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243679424}) 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.788+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1948545464}) 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1202620572}) 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1426507412}) 2024-08-19T11:20:23.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=322079936}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=723308553}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3127776307}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=707623673}) 2024-08-19T11:20:23.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4006942844}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848840215}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.789+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2756993185}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1370413801}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3911728232}) 2024-08-19T11:20:23.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188334035}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=645500005}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1579146885}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4158865402}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=973695983}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031370910}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.799+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1764172382}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3184012045}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2140263438}) 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1986042774}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2651657303}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3117678270}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.800+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4263953721}) 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.801+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.801+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.801+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2380809056}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.801+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.801+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046372821}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.801+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1442272444}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3658631790}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=204518751}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4026283324}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1994825160}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.913+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=168817113}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2215058071}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1893855889}) 2024-08-19T11:20:23.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4221646960}) 2024-08-19T11:20:23.940 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=439377680}) 2024-08-19T11:20:23.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1205793310}) 2024-08-19T11:20:23.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4280824647}) 2024-08-19T11:20:23.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2160114051}) 2024-08-19T11:20:23.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4294110017}) 2024-08-19T11:20:23.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1525241050}) 2024-08-19T11:20:23.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=181360437}) 2024-08-19T11:20:23.946 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=643678696}) 2024-08-19T11:20:23.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:23.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=224560787}) 2024-08-19T11:20:23.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:23.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=288798894}) 2024-08-19T11:20:24.101 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.101 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.101 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2916868642}) 2024-08-19T11:20:24.101 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3873927024}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2288133823}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1820608770}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2268299912}) 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.102 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3979209246}) 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3234716780}) 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4168559617}) 2024-08-19T11:20:24.103 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.099+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2123146232}) 2024-08-19T11:20:24.116 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.116 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.116 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3428445032}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=503576504}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630746173}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2124034707}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1591676798}) 2024-08-19T11:20:24.117 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3941540914}) 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2605623848}) 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1115906427}) 2024-08-19T11:20:24.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.114+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=418195760}) 2024-08-19T11:20:24.126 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28767]: starting. 2024-08-19T11:20:24.126 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28767]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28765 2024-08-19T11:20:24.126 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28767]: shutting down. 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3590522977}) 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681487928}) 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.128 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1216252528}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1506280512}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3944422704}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.124+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=20676567}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280710979}) 2024-08-19T11:20:24.129 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.130 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3032172285}) 2024-08-19T11:20:24.130 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.125+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3994079538}) 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3671381431}) 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2080116048}) 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.549 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1878070506}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3374772679}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2440216603}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2291805429}) 2024-08-19T11:20:24.550 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1872764553}) 2024-08-19T11:20:24.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1444856021}) 2024-08-19T11:20:24.551 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.546+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=148900201}) 2024-08-19T11:20:24.559 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:20:24.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:24.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.656+0000 7fe05859f640 10 monclient: get_monmap_and_config 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.656+0000 7fe05859f640 10 monclient: build_initial_monmap 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.656+0000 7fe05859f640 10 monclient: monmap: 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:24.656929+0000 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:24.656929+0000 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:24.658 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.656+0000 7fe05859f640 1 Processor -- start 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.656+0000 7fe05859f640 1 -- start start 2024-08-19T11:20:24.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.656+0000 7fe05859f640 10 monclient: init 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient: _add_conns ranks=[6,9,8,5,0,10,3,7,4,2,1] 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 0x7fe0500a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): picked mon.noname-d con 0x7fe0500a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe0500a6e10 0x7fe0500a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): picked mon.noname-a con 0x7fe0500a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 0x7fe050139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): picked mon.noname-e con 0x7fe050139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:24.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fe0500a4f90 con 0x7fe0500a6e10 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fe0500a6380 con 0x7fe0500a6a30 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fe0500a49d0 con 0x7fe050139860 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05859f640 10 monclient(hunting): authenticate will time out at 1282.698616s 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 0x7fe0500a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe0500a6e10 0x7fe0500a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 0x7fe050139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 0x7fe0500a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:60214/0 (socket says 172.21.15.71:60214) 2024-08-19T11:20:24.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 0x7fe050139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:51008/0 (socket says 172.21.15.71:51008) 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe0500a6e10 0x7fe0500a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49810/0 (socket says 172.21.15.71:49810) 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 1 -- 172.21.15.71:0/2026220310 learned_addr learned my addr 172.21.15.71:0/2026220310 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): get_auth_request con 0x7fe0500a6a30 auth_method 0 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): get_auth_request con 0x7fe050139860 auth_method 0 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): get_auth_request con 0x7fe0500a6e10 auth_method 0 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:24.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe05633b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe056b3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.657+0000 7fe055b3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 10 monclient(hunting): handle_auth_done global_id 104541 payload 274 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 1 -- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 msgr2=0x7fe050139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 1 --2- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 0x7fe050139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 1 -- 172.21.15.71:0/2026220310 >> v2:172.21.15.71:3300/0 conn(0x7fe0500a6e10 msgr2=0x7fe0500a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 1 --2- 172.21.15.71:0/2026220310 >> v2:172.21.15.71:3300/0 conn(0x7fe0500a6e10 0x7fe0500a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 1 monclient: found mon.noname-d 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe05633b640 1 -- 172.21.15.71:0/2026220310 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0500a46f0 con 0x7fe0500a6a30 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.658+0000 7fe056b3c640 1 --2- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 0x7fe050139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.660+0000 7fe05633b640 1 -- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 msgr2=0x7fe0500a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:24.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.660+0000 7fe05633b640 1 --2- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 0x7fe0500a57f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0098a0 tx=0x7fe04c02a0d0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ece9eddc305a1abe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 1 -- 172.21.15.71:0/2026220310 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04c037070 con 0x7fe0500a6a30 2024-08-19T11:20:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: dump: 2024-08-19T11:20:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:24.670 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:24.671 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:24.672 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: _finish_auth 0 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: _check_auth_tickets 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 5 monclient: authenticate success, global_id 104541 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 1 -- 172.21.15.71:0/2026220310 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c02adf0 con 0x7fe0500a6a30 2024-08-19T11:20:24.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 4 set_mon_vals no callback set 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 1 -- 172.21.15.71:0/2026220310 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04c030c20 con 0x7fe0500a6a30 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe055339640 10 monclient: dump: 2024-08-19T11:20:24.674 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:24.675 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:24.676 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:24.677 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 10 monclient: shutdown 2024-08-19T11:20:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:24.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 -- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 msgr2=0x7fe0500a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:24.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 --2- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 0x7fe0500a57f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0098a0 tx=0x7fe04c02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 -- 172.21.15.71:0/2026220310 shutdown_connections 2024-08-19T11:20:24.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 --2- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fe050139860 0x7fe050139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 --2- 172.21.15.71:0/2026220310 >> v2:172.21.15.71:3300/0 conn(0x7fe0500a6e10 0x7fe0500a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 --2- 172.21.15.71:0/2026220310 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fe0500a6a30 0x7fe0500a57f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 -- 172.21.15.71:0/2026220310 >> 172.21.15.71:0/2026220310 conn(0x7fe0500ac030 msgr2=0x7fe0500ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 -- 172.21.15.71:0/2026220310 shutdown_connections 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.661+0000 7fe05859f640 1 -- 172.21.15.71:0/2026220310 wait complete. 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.662+0000 7fe05859f640 10 monclient: build_initial_monmap 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.662+0000 7fe05859f640 10 monclient: monmap: 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:24.679 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.662+0000 7fe05859f640 1 Processor -- start 2024-08-19T11:20:24.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.662+0000 7fe05859f640 1 -- start start 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.662+0000 7fe05859f640 10 monclient: init 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient: _add_conns ranks=[2,3,7,1,5,0,8,4,6] 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 0x7fe0501ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): picked mon.noname-b con 0x7fe0500a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500a6e10 0x7fe0501cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): picked mon.noname-g con 0x7fe0500a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe050139860 0x7fe0501229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): picked mon.noname-i con 0x7fe050139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe0500a7730 con 0x7fe0500a6a30 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe05013a200 con 0x7fe0500a6e10 2024-08-19T11:20:24.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fe0500a2620 con 0x7fe050139860 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05859f640 10 monclient(hunting): authenticate will time out at 1282.704336s 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 0x7fe0501ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 0x7fe0501ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:38372/0 (socket says 172.21.15.71:38372) 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 -- 172.21.15.71:0/3574399491 learned_addr learned my addr 172.21.15.71:0/3574399491 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): get_auth_request con 0x7fe0500a6a30 auth_method 0 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:24.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient(hunting): handle_auth_done global_id 75593 payload 824 2024-08-19T11:20:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 -- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe050139860 msgr2=0x7fe0501229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe050139860 0x7fe0501229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 -- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500a6e10 msgr2=0x7fe0501cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe055b3a640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500a6e10 0x7fe0501cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500a6e10 0x7fe0501cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 monclient: found mon.noname-b 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:24.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.663+0000 7fe05633b640 1 -- 172.21.15.71:0/3574399491 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe050139590 con 0x7fe0500a6a30 2024-08-19T11:20:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.665+0000 7fe05633b640 1 -- 172.21.15.71:0/3574399491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 msgr2=0x7fe0501ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.665+0000 7fe05633b640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 0x7fe0501ce340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0098a0 tx=0x7fe04c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04c037040 con 0x7fe0500a6a30 2024-08-19T11:20:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:24.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: dump: 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:24.689 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: _finish_auth 0 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 5 monclient: authenticate success, global_id 75593 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c042070 con 0x7fe0500a6a30 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 10 monclient: _renew_subs 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe050126650 con 0x7fe0500a6a30 2024-08-19T11:20:24.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fe04c004490 con 0x7fe0500a6a30 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe046ffd640 10 monclient: dump: 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:24.691 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe054b38640 4 set_mon_vals no callback set 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 10 monclient: _renew_subs 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.666+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe050126370 con 0x7fe0500a6a30 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fe04c003bd0 con 0x7fe0500a6a30 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe05859f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:24.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe05859f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe05859f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05013a560 con 0x7fe0500a6a30 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe046ffd640 1 --2- 172.21.15.71:0/3574399491 >> v2:172.21.15.135:6800/726754104 conn(0x7fe03403ea80 0x7fe034040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(290..290 src has 1..290) ==== 3506+0+0 (secure 0 0 0) 0x7fe04c071d70 con 0x7fe0500a6a30 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe055b3a640 1 --2- 172.21.15.71:0/3574399491 >> v2:172.21.15.135:6800/726754104 conn(0x7fe03403ea80 0x7fe034040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.667+0000 7fe055b3a640 10 monclient: get_auth_request con 0x7fe03403ea80 auth_method 0 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.670+0000 7fe055b3a640 1 --2- 172.21.15.71:0/3574399491 >> v2:172.21.15.135:6800/726754104 conn(0x7fe03403ea80 0x7fe034040f40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe050126860 tx=0x7fe040008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.671+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fe04c030340 con 0x7fe0500a6a30 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.671+0000 7fe046ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:24.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.671+0000 7fe046ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:24.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.898 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2169364720}) 2024-08-19T11:20:24.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=709197135}) 2024-08-19T11:20:24.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.899 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=455438900}) 2024-08-19T11:20:24.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2280785618}) 2024-08-19T11:20:24.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.900 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=314670129}) 2024-08-19T11:20:24.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.901 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=775323694}) 2024-08-19T11:20:24.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=138079914}) 2024-08-19T11:20:24.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2981444855}) 2024-08-19T11:20:24.902 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.896+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=158943252}) 2024-08-19T11:20:24.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1528603607}) 2024-08-19T11:20:24.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4150050448}) 2024-08-19T11:20:24.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=643573146}) 2024-08-19T11:20:24.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3197438295}) 2024-08-19T11:20:24.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2101118470}) 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4017640755}) 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1268137200}) 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=700115250}) 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.898+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1700306687}) 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2591110992}) 2024-08-19T11:20:24.927 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=375596650}) 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1872097377}) 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1441392848}) 2024-08-19T11:20:24.928 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3542751367}) 2024-08-19T11:20:24.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.929 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=252952340}) 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1745550152}) 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=940079272}) 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.899+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2449585188}) 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2528627134}) 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1208523297}) 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1431253220}) 2024-08-19T11:20:24.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3116172340}) 2024-08-19T11:20:24.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.932 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.900+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=497654721}) 2024-08-19T11:20:24.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=542368387}) 2024-08-19T11:20:24.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.933 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1198910645}) 2024-08-19T11:20:24.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2136672158}) 2024-08-19T11:20:24.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.901+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=322485798}) 2024-08-19T11:20:24.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.934 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4025733464}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3087751}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=739697426}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.935 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=331153808}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2802345901}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3154933401}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.903+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.903+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745990919}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.903+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.903+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2283027395}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.903+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3985594321}) 2024-08-19T11:20:24.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1311458601}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2715581485}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2515392970}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1755506770}) 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3638348669}) 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=441791782}) 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1980520949}) 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586166768}) 2024-08-19T11:20:24.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.911+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3256227490}) 2024-08-19T11:20:24.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.939 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1131093286}) 2024-08-19T11:20:24.941 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2091016100}) 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=435322586}) 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1821731092}) 2024-08-19T11:20:24.942 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2381209563}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3232781932}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=103324516}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3310697996}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.912+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2605367902}) 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.943 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1565497241}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3315964200}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1574243963}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2713200415}) 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.944 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4198443838}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=478785456}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2280508109}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3556564101}) 2024-08-19T11:20:24.945 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.914+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2017228228}) 2024-08-19T11:20:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe05859f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe05859f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe05859f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:24.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe050139300 con 0x7fe0500a6a30 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3117176625}) 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4193776070}) 2024-08-19T11:20:24.947 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe046ffd640 1 -- 172.21.15.71:0/3574399491 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7fe04c070c60 con 0x7fe0500a6a30 2024-08-19T11:20:24.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe046ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:24.948 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4042348362}) 2024-08-19T11:20:24.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.915+0000 7fe046ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:24.949 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1206010299}) 2024-08-19T11:20:24.950 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.950 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":190,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:24.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1920870639}) 2024-08-19T11:20:24.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3603665821}) 2024-08-19T11:20:24.955 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3372740571}) 2024-08-19T11:20:24.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371496900}) 2024-08-19T11:20:24.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.915+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=345811624}) 2024-08-19T11:20:24.956 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2394608592}) 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=777680722}) 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.958 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3448034058}) 2024-08-19T11:20:24.958 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.958 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.958 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1387072510}) 2024-08-19T11:20:24.958 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.958 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1467894595}) 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3972228881}) 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.959 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=869759160}) 2024-08-19T11:20:24.960 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.960 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2095627928}) 2024-08-19T11:20:24.960 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.917+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2822342536}) 2024-08-19T11:20:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 >> v2:172.21.15.135:6800/726754104 conn(0x7fe03403ea80 msgr2=0x7fe034040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 --2- 172.21.15.71:0/3574399491 >> v2:172.21.15.135:6800/726754104 conn(0x7fe03403ea80 0x7fe034040f40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe050126860 tx=0x7fe040008040 comp rx=0 tx=0).stop 2024-08-19T11:20:24.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 10 monclient: shutdown 2024-08-19T11:20:24.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:24.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 msgr2=0x7fe0501ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:24.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 0x7fe0501ce340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0098a0 tx=0x7fe04c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 shutdown_connections 2024-08-19T11:20:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 --2- 172.21.15.71:0/3574399491 >> v2:172.21.15.135:6800/726754104 conn(0x7fe03403ea80 0x7fe034040f40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fe050139860 0x7fe0501229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0500a6e10 0x7fe0501cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 --2- 172.21.15.71:0/3574399491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0500a6a30 0x7fe0501ce340 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 >> 172.21.15.71:0/3574399491 conn(0x7fe0500ac030 msgr2=0x7fe0501c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 shutdown_connections 2024-08-19T11:20:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:24.918+0000 7fe05859f640 1 -- 172.21.15.71:0/3574399491 wait complete. 2024-08-19T11:20:24.980 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.918+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.980 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.918+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.980 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.918+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1637114715}) 2024-08-19T11:20:24.981 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.918+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.981 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.918+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.981 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.918+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2670051283}) 2024-08-19T11:20:24.981 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.981 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.981 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2396615777}) 2024-08-19T11:20:24.982 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.982 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.982 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2264186879}) 2024-08-19T11:20:24.982 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.982 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.982 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3587475586}) 2024-08-19T11:20:24.983 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.983 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.983 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=544146604}) 2024-08-19T11:20:24.983 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.983 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.984 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=494751433}) 2024-08-19T11:20:24.984 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.984 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1824975369}) 2024-08-19T11:20:24.984 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.919+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=19397990}) 2024-08-19T11:20:24.984 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.984 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1518445843}) 2024-08-19T11:20:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4252660146}) 2024-08-19T11:20:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.985 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2081142113}) 2024-08-19T11:20:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4005379923}) 2024-08-19T11:20:24.986 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=106637720}) 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2874268788}) 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.987 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3241103013}) 2024-08-19T11:20:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2361374908}) 2024-08-19T11:20:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.920+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3159721110}) 2024-08-19T11:20:24.988 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=527648274}) 2024-08-19T11:20:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3714186936}) 2024-08-19T11:20:24.989 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4152643636}) 2024-08-19T11:20:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1072590703}) 2024-08-19T11:20:24.990 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=284234092}) 2024-08-19T11:20:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1028314904}) 2024-08-19T11:20:24.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1525169498}) 2024-08-19T11:20:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833724365}) 2024-08-19T11:20:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.928+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=169170264}) 2024-08-19T11:20:24.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3964065889}) 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1523377201}) 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2388922917}) 2024-08-19T11:20:24.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1313957817}) 2024-08-19T11:20:24.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=188488682}) 2024-08-19T11:20:24.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=650577641}) 2024-08-19T11:20:24.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1344274373}) 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=313291081}) 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.929+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4197857277}) 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1151286044}) 2024-08-19T11:20:24.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3129456690}) 2024-08-19T11:20:24.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1961750958}) 2024-08-19T11:20:24.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=605000698}) 2024-08-19T11:20:24.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=438808199}) 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=532929930}) 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2713909429}) 2024-08-19T11:20:24.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1701278178}) 2024-08-19T11:20:25.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.930+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1408669689}) 2024-08-19T11:20:25.002 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:20:25.002 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-08-19T11:20:25.002 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:20:25.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.931+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3531688438}) 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2877197578}) 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3773327519}) 2024-08-19T11:20:25.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3084939593}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1765604976}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3803492666}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=395513066}) 2024-08-19T11:20:25.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152000782}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.932+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2806881406}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1515726153}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2045376013}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1453672300}) 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3437526520}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.939+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=184016644}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=184811768}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3304065331}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2860721290}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.940+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=702845193}) 2024-08-19T11:20:25.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3462300232}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=986434487}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3027642295}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3709703773}) 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=204039759}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1075719002}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=996039587}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3780216898}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.941+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3769253516}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3469185302}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2070026014}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1428337885}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2146072966}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1785867567}) 2024-08-19T11:20:25.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3469429582}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=490502386}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=819135505}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.942+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=738309822}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1300288406}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2412866918}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406891630}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2320474134}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=500082763}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.943+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=154400457}) 2024-08-19T11:20:25.053 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2374250683}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3711909430}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.944+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2904800955}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4006562703}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3058286694}) 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.054 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=725839214}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2334150020}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2073749299}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3754076330}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.055 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3415308007}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3672256876}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.945+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3228894050}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=138437710}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=127262129}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1800089164}) 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.056 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1295886275}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2524402856}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4290490319}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129412250}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251210453}) 2024-08-19T11:20:25.057 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.946+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3210216764}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1926976607}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1484905974}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3799021564}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2482501026}) 2024-08-19T11:20:25.058 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4170907715}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4093877558}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3209322128}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171161931}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.947+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3059441227}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.059 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2704406627}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1642310741}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3522092294}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2710346855}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1875488917}) 2024-08-19T11:20:25.060 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1509207962}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1121443437}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=383868521}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.949+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4155876477}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=361365176}) 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.061 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1603561354}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1549293527}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2699315552}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=626766256}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.062 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2099033019}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3760658061}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42469119}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.950+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3577198026}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1682701391}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3305185573}) 2024-08-19T11:20:25.063 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=784954095}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2261671557}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3666327214}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1475534763}) 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.064 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3317144259}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248144416}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.951+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3383334944}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=988453387}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3848770063}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.065 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4269833383}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2458621415}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2959801786}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=463709841}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2409118709}) 2024-08-19T11:20:25.066 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371626037}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.953+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=394112121}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=119350443}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=65917676}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=162128828}) 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.067 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2376171948}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3538529892}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1443738374}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632737991}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1882456043}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.954+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=583888810}) 2024-08-19T11:20:25.068 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=663576938}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3057976337}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2530305952}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2768130519}) 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.069 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3884918621}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=682972074}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2742220248}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2721830884}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3630030017}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.070 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1515632333}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1030137543}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=635399360}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=745650807}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1470619656}) 2024-08-19T11:20:25.071 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2366049940}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2851229194}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2153963436}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4194279858}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2343880566}) 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.072 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4060492137}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1713412749}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2023195629}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=573324809}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.073 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2185673834}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1423378887}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1153530575}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:24.958+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2237581584}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1952198606}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3574610928}) 2024-08-19T11:20:25.074 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=884459819}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1326061883}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.003+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1643271211}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4015466417}) 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.075 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1436218829}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452980767}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.004+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3042380954}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=590899979}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=599465345}) 2024-08-19T11:20:25.076 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1771852824}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2225878009}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2748222204}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.077 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2260131492}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3950581558}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103001287}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.005+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2532297184}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3467434892}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.078 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2873052458}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2882983938}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1627967446}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3338683349}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2265128095}) 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.079 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.006+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.080 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.007+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098167856}) 2024-08-19T11:20:25.080 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.007+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.080 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.007+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1237233449}) 2024-08-19T11:20:25.080 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.007+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1869058470}) 2024-08-19T11:20:25.111 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.111 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.111 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1984954782}) 2024-08-19T11:20:25.111 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1486982048}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=694376563}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2214229618}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2685400606}) 2024-08-19T11:20:25.112 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=357990875}) 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.109+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1503762105}) 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.110+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.110+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4257674279}) 2024-08-19T11:20:25.113 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.110+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4248736058}) 2024-08-19T11:20:25.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2498872546}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1142435623}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=815843786}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3372217626}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3237330349}) 2024-08-19T11:20:25.140 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1929992703}) 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.137+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.138+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.138+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2999370468}) 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.138+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.138+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1062677195}) 2024-08-19T11:20:25.141 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.138+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4105456144}) 2024-08-19T11:20:25.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1147073684}) 2024-08-19T11:20:25.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2039428900}) 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1394461588}) 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1037165356}) 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1546857405}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3169078722}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=912685864}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3919018053}) 2024-08-19T11:20:25.155 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=878487649}) 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.154+0000 7fada80b1640 10 monclient: get_monmap_and_config 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.154+0000 7fada80b1640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.154+0000 7fada80b1640 10 monclient: monmap: 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:25.154991+0000 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:25.154991+0000 2024-08-19T11:20:25.156 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.155+0000 7fada80b1640 1 Processor -- start 2024-08-19T11:20:25.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.155+0000 7fada80b1640 1 -- start start 2024-08-19T11:20:25.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.155+0000 7fada80b1640 10 monclient: init 2024-08-19T11:20:25.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient: _add_conns ranks=[5,2,8,0,6,3,9,10,4,7,1] 2024-08-19T11:20:25.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a58d0 0x7fada00a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): picked mon.noname-h con 0x7fada00a58d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a17f0 0x7fada00a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): picked mon.noname-b con 0x7fada00a17f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 0x7fada0137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): picked mon.noname-e con 0x7fada0137680 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fada00a6730 con 0x7fada00a17f0 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fada0073f00 con 0x7fada00a58d0 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fada0072420 con 0x7fada0137680 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada80b1640 10 monclient(hunting): authenticate will time out at 1283.197599s 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 0x7fada0137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 0x7fada0137ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48792/0 (socket says 172.21.15.71:48792) 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 1 -- 172.21.15.71:0/2272258598 learned_addr learned my addr 172.21.15.71:0/2272258598 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 10 monclient(hunting): get_auth_request con 0x7fada0137680 auth_method 0 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.156+0000 7fada664e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada564c640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a17f0 0x7fada00a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada564c640 10 monclient(hunting): get_auth_request con 0x7fada00a17f0 auth_method 0 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada564c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada564c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada564c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 10 monclient(hunting): handle_auth_done global_id 114209 payload 274 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 1 -- 172.21.15.71:0/2272258598 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a58d0 msgr2=0x7fada00a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a58d0 0x7fada00a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 1 -- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a17f0 msgr2=0x7fada00a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a17f0 0x7fada00a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 1 monclient: found mon.noname-e 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:25.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.157+0000 7fada664e640 1 -- 172.21.15.71:0/2272258598 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada00a4130 con 0x7fada0137680 2024-08-19T11:20:25.164 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2166612664}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3568795651}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=742311649}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=27162957}) 2024-08-19T11:20:25.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3213460843}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3876933373}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1959109700}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=643756980}) 2024-08-19T11:20:25.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=796141142}) 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.160+0000 7fada664e640 1 -- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 msgr2=0x7fada0137ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.160+0000 7fada664e640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 0x7fada0137ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad98009f30 tx=0x7fad9802e970 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b2dcba2aa7145471 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 1 -- 172.21.15.71:0/2272258598 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fad98007a70 con 0x7fada0137680 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: dump: 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.173 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.174 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 1 -- 172.21.15.71:0/2272258598 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad98039070 con 0x7fada0137680 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 1 -- 172.21.15.71:0/2272258598 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fad98007c30 con 0x7fada0137680 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada4e4b640 10 monclient: dump: 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada80b1640 5 monclient: authenticate success, global_id 114209 2024-08-19T11:20:25.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada80b1640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.161+0000 7fada80b1640 4 set_mon_vals no callback set 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 10 monclient: shutdown 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 -- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 msgr2=0x7fada0137ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 0x7fada0137ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad98009f30 tx=0x7fad9802e970 comp rx=0 tx=0).stop 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 -- 172.21.15.71:0/2272258598 shutdown_connections 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fada0137680 0x7fada0137ae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a17f0 0x7fada00a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 --2- 172.21.15.71:0/2272258598 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a58d0 0x7fada00a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 -- 172.21.15.71:0/2272258598 >> 172.21.15.71:0/2272258598 conn(0x7fada00aa4f0 msgr2=0x7fada00a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 -- 172.21.15.71:0/2272258598 shutdown_connections 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.162+0000 7fada80b1640 1 -- 172.21.15.71:0/2272258598 wait complete. 2024-08-19T11:20:25.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.163+0000 7fada80b1640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.163+0000 7fada80b1640 10 monclient: monmap: 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.178 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 Processor -- start 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 -- start start 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient: init 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient: _add_conns ranks=[5,2,1,6,7,4,8,0,3] 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a17f0 0x7fada0120510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): picked mon.noname-h con 0x7fada00a17f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 0x7fada0120a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): picked mon.noname-b con 0x7fada00a58d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fada0137680 0x7fada0120f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): picked mon.noname-f con 0x7fada0137680 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fada0072620 con 0x7fada0137680 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fada00741e0 con 0x7fada00a58d0 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fada00a73d0 con 0x7fada00a17f0 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada80b1640 10 monclient(hunting): authenticate will time out at 1283.205846s 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 0x7fada0120a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 0x7fada0120a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34936/0 (socket says 172.21.15.71:34936) 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 1 -- 172.21.15.71:0/2163336179 learned_addr learned my addr 172.21.15.71:0/2163336179 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 10 monclient(hunting): get_auth_request con 0x7fada00a58d0 auth_method 0 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.164+0000 7fada564c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a17f0 0x7fada0120510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): get_auth_request con 0x7fada00a17f0 auth_method 0 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada664e640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fada0137680 0x7fada0120f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada664e640 10 monclient(hunting): get_auth_request con 0x7fada0137680 auth_method 0 2024-08-19T11:20:25.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada664e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada664e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada664e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 10 monclient(hunting): handle_auth_done global_id 75611 payload 824 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a17f0 msgr2=0x7fada0120510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fada00a17f0 0x7fada0120510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fada0137680 msgr2=0x7fada0120f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fada0137680 0x7fada0120f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 1 monclient: found mon.noname-b 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada564c640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada0123a30 con 0x7fada00a58d0 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.165+0000 7fada664e640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fada0137680 0x7fada0120f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada564c640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 msgr2=0x7fada0120a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada564c640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 0x7fada0120a50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00d800 tx=0x7fad9c00dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fad9c004240 con 0x7fada00a58d0 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: dump: 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.183 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad9c004420 con 0x7fada00a58d0 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fad9c003610 con 0x7fada00a58d0 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad967fc640 10 monclient: dump: 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.185 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fad97fff640 4 set_mon_vals no callback set 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 5 monclient: authenticate success, global_id 75611 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 10 monclient: _renew_subs 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:25.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada0137e60 con 0x7fada00a58d0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 10 monclient: _renew_subs 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.167+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fada01216d0 con 0x7fada00a58d0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada80b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada80b1640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 0x7fada009cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fada0076c60 con 0x7fada009c9f0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 0x7fada009cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient: get_auth_request con 0x7fada009c9f0 auth_method 0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fad9c0037b0 con 0x7fada00a58d0 2024-08-19T11:20:25.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.168+0000 7fad967fc640 1 --2- 172.21.15.71:0/2163336179 >> v2:172.21.15.135:6800/726754104 conn(0x7fad8403eae0 0x7fad84040fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.169+0000 7fada5e4d640 10 monclient(hunting): handle_auth_done global_id 75645 payload 824 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.169+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(291..291 src has 1..291) ==== 3898+0+0 (secure 0 0 0) 0x7fad9c00f040 con 0x7fada00a58d0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.169+0000 7fada5e4d640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fada0137c40 con 0x7fada009c9f0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.169+0000 7fada664e640 1 --2- 172.21.15.71:0/2163336179 >> v2:172.21.15.135:6800/726754104 conn(0x7fad8403eae0 0x7fad84040fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.169+0000 7fada664e640 10 monclient: get_auth_request con 0x7fad8403eae0 auth_method 0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fada5e4d640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 msgr2=0x7fada009cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fada5e4d640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 0x7fada009cdd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e7a0 tx=0x7fad9000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fad90017070 con 0x7fada009c9f0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:25.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 10 monclient: dump: 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.189 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fad9000ee70 con 0x7fada009c9f0 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fada664e640 1 --2- 172.21.15.71:0/2163336179 >> v2:172.21.15.135:6800/726754104 conn(0x7fad8403eae0 0x7fad84040fa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fada00a4580 tx=0x7fad98009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 msgr2=0x7fada009cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 0x7fada009cdd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e7a0 tx=0x7fad9000ec60 comp rx=0 tx=0).stop 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 msgr2=0x7fada009cdd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.171+0000 7fad967fc640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009c9f0 0x7fada009cdd0 secure :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e7a0 tx=0x7fad9000ec60 comp rx=0 tx=0).stop 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada80b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada80b1640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 0x7fada01d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada80b1640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fada00a5cb0 con 0x7fada009d310 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 0x7fada01d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient: get_auth_request con 0x7fada009d310 auth_method 0 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.177+0000 7fada5e4d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.178+0000 7fada5e4d640 10 monclient(hunting): handle_auth_done global_id 75654 payload 824 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.178+0000 7fada5e4d640 1 -- 172.21.15.71:0/2163336179 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fada0135390 con 0x7fada009d310 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fada5e4d640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 msgr2=0x7fada01d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fada5e4d640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 0x7fada01d46d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e7a0 tx=0x7fad900047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fad90017070 con 0x7fada009d310 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 10 monclient: dump: 2024-08-19T11:20:25.193 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.194 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7fad900066e0 con 0x7fada009d310 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 msgr2=0x7fada01d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 0x7fada01d46d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e7a0 tx=0x7fad900047d0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 msgr2=0x7fada01d46d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.180+0000 7fad967fc640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fada009d310 0x7fada01d46d0 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e7a0 tx=0x7fad900047d0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.195 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 274213, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:25.196 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.197 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.198 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:25.199 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:25.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:25.202 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:25.203 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.205 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.206 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.208 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.210 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.211 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:25.212 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.213 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:25.215 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.217 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.218 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:25.219 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 >> v2:172.21.15.135:6800/726754104 conn(0x7fad8403eae0 msgr2=0x7fad84040fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 --2- 172.21.15.71:0/2163336179 >> v2:172.21.15.135:6800/726754104 conn(0x7fad8403eae0 0x7fad84040fa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fada00a4580 tx=0x7fad98009000 comp rx=0 tx=0).stop 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 10 monclient: shutdown 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada664e640 1 -- 172.21.15.71:0/2163336179 reap_dead start 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 msgr2=0x7fada0120a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 0x7fada0120a50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00d800 tx=0x7fad9c00dc00 comp rx=0 tx=0).stop 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 shutdown_connections 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 --2- 172.21.15.71:0/2163336179 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fada00a58d0 0x7fada0120a50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 >> 172.21.15.71:0/2163336179 conn(0x7fada00aa4f0 msgr2=0x7fada00a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 shutdown_connections 2024-08-19T11:20:25.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.181+0000 7fada80b1640 1 -- 172.21.15.71:0/2163336179 wait complete. 2024-08-19T11:20:25.222 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:25.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:20:25.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.359+0000 7fa233b14640 10 monclient: get_monmap_and_config 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.359+0000 7fa233b14640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.359+0000 7fa233b14640 10 monclient: monmap: 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:25.359934+0000 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:25.359934+0000 2024-08-19T11:20:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:25.361 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.359+0000 7fa233b14640 1 Processor -- start 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 1 -- start start 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient: init 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient: _add_conns ranks=[0,5,7,10,3,8,1,6,4,2,9] 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa22c0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 0x7fa22c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): picked mon.noname-h con 0x7fa22c0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa22c0a7440 0x7fa22c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): picked mon.noname-i con 0x7fa22c0a7440 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22c0a6380 con 0x7fa22c0a6950 2024-08-19T11:20:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa22c0a5020 con 0x7fa22c0a57c0 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa22c0a7d40 con 0x7fa22c0a7440 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa233b14640 10 monclient(hunting): authenticate will time out at 1283.401632s 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2318b0640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa22c0a6950 0x7fa22c0a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60490/0 (socket says 172.21.15.71:60490) 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2318b0640 1 -- 172.21.15.71:0/2669798131 learned_addr learned my addr 172.21.15.71:0/2669798131 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2310af640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 0x7fa22c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2320b1640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa22c0a7440 0x7fa22c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2310af640 10 monclient(hunting): get_auth_request con 0x7fa22c0a57c0 auth_method 0 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2310af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2310af640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2310af640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2320b1640 10 monclient(hunting): get_auth_request con 0x7fa22c0a7440 auth_method 0 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2320b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2320b1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.360+0000 7fa2320b1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2320b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2320b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2320b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 10 monclient(hunting): handle_auth_done global_id 46310 payload 274 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 1 -- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa22c0a7440 msgr2=0x7fa22c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa22c0a7440 0x7fa22c1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 1 -- 172.21.15.71:0/2669798131 >> v1:172.21.15.71:6789/0 conn(0x7fa22c0a6950 legacy=0x7fa22c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 1 monclient: found mon.noname-h 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2310af640 1 -- 172.21.15.71:0/2669798131 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c0a3650 con 0x7fa22c0a57c0 2024-08-19T11:20:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.361+0000 7fa2320b1640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa22c0a7440 0x7fa22c1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2310af640 1 -- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 msgr2=0x7fa22c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2310af640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 0x7fa22c13eb60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa220009df0 tx=0x7fa22002a4b0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=a19bd1d4736cd63d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 1 -- 172.21.15.71:0/2669798131 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa220007bc0 con 0x7fa22c0a57c0 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: dump: 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 1 -- 172.21.15.71:0/2669798131 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa220007d80 con 0x7fa22c0a57c0 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 5 monclient: authenticate success, global_id 46310 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 4 set_mon_vals no callback set 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 1 -- 172.21.15.71:0/2669798131 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa220007750 con 0x7fa22c0a57c0 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa2308ae640 10 monclient: dump: 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.375 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 10 monclient: shutdown 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 1 -- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 msgr2=0x7fa22c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.364+0000 7fa233b14640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 0x7fa22c13eb60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa220009df0 tx=0x7fa22002a4b0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 -- 172.21.15.71:0/2669798131 shutdown_connections 2024-08-19T11:20:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa22c0a7440 0x7fa22c1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 --2- 172.21.15.71:0/2669798131 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa22c0a57c0 0x7fa22c13eb60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 -- 172.21.15.71:0/2669798131 >> 172.21.15.71:0/2669798131 conn(0x7fa22c0abf50 msgr2=0x7fa22c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 -- 172.21.15.71:0/2669798131 shutdown_connections 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 -- 172.21.15.71:0/2669798131 wait complete. 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 10 monclient: monmap: 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 Processor -- start 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.365+0000 7fa233b14640 1 -- start start 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient: init 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient: _add_conns ranks=[3,8,2,5,1,4,6,0,7] 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa22c0a57c0 0x7fa22c128bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): picked mon.noname-g con 0x7fa22c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa22c0a6950 0x7fa22c1ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): picked mon.noname-e con 0x7fa22c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 0x7fa22c1266e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): picked mon.noname-b con 0x7fa22c0a7440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0a8700 con 0x7fa22c0a7440 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0a84c0 con 0x7fa22c0a57c0 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa22c1415f0 con 0x7fa22c0a6950 2024-08-19T11:20:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa233b14640 10 monclient(hunting): authenticate will time out at 1283.407429s 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 0x7fa22c1266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa22c0a6950 0x7fa22c1ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa22c0a6950 0x7fa22c1ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48798/0 (socket says 172.21.15.71:48798) 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 0x7fa22c1266e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34942/0 (socket says 172.21.15.71:34942) 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 1 -- 172.21.15.71:0/4234133389 learned_addr learned my addr 172.21.15.71:0/4234133389 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): get_auth_request con 0x7fa22c0a6950 auth_method 0 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): get_auth_request con 0x7fa22c0a7440 auth_method 0 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa22c0a57c0 0x7fa22c128bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): get_auth_request con 0x7fa22c0a57c0 auth_method 0 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2310af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient(hunting): handle_auth_done global_id 75620 payload 824 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa22c0a6950 msgr2=0x7fa22c1ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa22c0a6950 0x7fa22c1ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa22c0a57c0 msgr2=0x7fa22c128bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa22c0a57c0 0x7fa22c128bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 monclient: found mon.noname-b 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.366+0000 7fa2320b1640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c12a0d0 con 0x7fa22c0a7440 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa2320b1640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 msgr2=0x7fa22c1266e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa2320b1640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 0x7fa22c1266e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e7d0 tx=0x7fa21c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa21c017070 con 0x7fa22c0a7440 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: dump: 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c013470 con 0x7fa22c0a7440 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 5 monclient: authenticate success, global_id 75620 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 10 monclient: _renew_subs 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c12a3b0 con 0x7fa22c0a7440 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa21c013a90 con 0x7fa22c0a7440 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22a7fc640 10 monclient: dump: 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa22bfff640 4 set_mon_vals no callback set 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 10 monclient: _renew_subs 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.369+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c129540 con 0x7fa22c0a7440 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa233b14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa233b14640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 0x7fa22c126c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0a9430 con 0x7fa22c1cf020 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa21c013cb0 con 0x7fa22c0a7440 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 0x7fa22c126c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient: get_auth_request con 0x7fa22c1cf020 auth_method 0 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 10 monclient(hunting): handle_auth_done global_id 75629 payload 824 2024-08-19T11:20:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2318b0640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa22c141210 con 0x7fa22c1cf020 2024-08-19T11:20:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa22a7fc640 1 --2- 172.21.15.71:0/4234133389 >> v2:172.21.15.135:6800/726754104 conn(0x7fa21803eab0 0x7fa218040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(291..291 src has 1..291) ==== 3898+0+0 (secure 0 0 0) 0x7fa21c00f040 con 0x7fa22c0a7440 2024-08-19T11:20:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2310af640 1 --2- 172.21.15.71:0/4234133389 >> v2:172.21.15.135:6800/726754104 conn(0x7fa21803eab0 0x7fa218040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.370+0000 7fa2310af640 10 monclient: get_auth_request con 0x7fa21803eab0 auth_method 0 2024-08-19T11:20:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa2318b0640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 msgr2=0x7fa22c126c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa2318b0640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 0x7fa22c126c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa22400ea70 tx=0x7fa22400ef30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa22401a070 con 0x7fa22c1cf020 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 10 monclient: dump: 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.391 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa22400cc50 con 0x7fa22c1cf020 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.372+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 msgr2=0x7fa22c126c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.373+0000 7fa22a7fc640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 0x7fa22c126c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa22400ea70 tx=0x7fa22400ef30 comp rx=0 tx=0).stop 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.373+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 msgr2=0x7fa22c126c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.373+0000 7fa22a7fc640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c1cf020 0x7fa22c126c20 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa22400ea70 tx=0x7fa22400ef30 comp rx=0 tx=0).stop 2024-08-19T11:20:25.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.373+0000 7fa2310af640 1 --2- 172.21.15.71:0/4234133389 >> v2:172.21.15.135:6800/726754104 conn(0x7fa21803eab0 0x7fa218040f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa22c1286c0 tx=0x7fa22002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.378+0000 7fa233b14640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.378+0000 7fa233b14640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 0x7fa22c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa233b14640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c076c60 con 0x7fa22c127160 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 0x7fa22c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient: get_auth_request con 0x7fa22c127160 auth_method 0 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 10 monclient(hunting): handle_auth_done global_id 75638 payload 824 2024-08-19T11:20:25.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.379+0000 7fa2318b0640 1 -- 172.21.15.71:0/4234133389 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa22c127570 con 0x7fa22c127160 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa2318b0640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 msgr2=0x7fa22c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa2318b0640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 0x7fa22c1225a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa224017000 tx=0x7fa224004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa22401a070 con 0x7fa22c127160 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 10 monclient: dump: 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.394 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7fa22401b040 con 0x7fa22c127160 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 msgr2=0x7fa22c1225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 0x7fa22c1225a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa224017000 tx=0x7fa224004940 comp rx=0 tx=0).stop 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 msgr2=0x7fa22c1225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.381+0000 7fa22a7fc640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c127160 0x7fa22c1225a0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa224017000 tx=0x7fa224004940 comp rx=0 tx=0).stop 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 274413, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:25.406 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:25.407 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.408 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.410 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.412 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.415 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:20:25.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.419 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:25.419 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:25.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 >> v2:172.21.15.135:6800/726754104 conn(0x7fa21803eab0 msgr2=0x7fa218040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 --2- 172.21.15.71:0/4234133389 >> v2:172.21.15.135:6800/726754104 conn(0x7fa21803eab0 0x7fa218040f70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa22c1286c0 tx=0x7fa22002f000 comp rx=0 tx=0).stop 2024-08-19T11:20:25.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 10 monclient: shutdown 2024-08-19T11:20:25.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 msgr2=0x7fa22c1266e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 --2- 172.21.15.71:0/4234133389 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa22c0a7440 0x7fa22c1266e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e7d0 tx=0x7fa21c00ec90 comp rx=0 tx=0).stop 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa2320b1640 1 -- 172.21.15.71:0/4234133389 reap_dead start 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa2320b1640 1 -- 172.21.15.71:0/4234133389 reap_dead start 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 shutdown_connections 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 >> 172.21.15.71:0/4234133389 conn(0x7fa22c0abf50 msgr2=0x7fa22c0ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 shutdown_connections 2024-08-19T11:20:25.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.382+0000 7fa233b14640 1 -- 172.21.15.71:0/4234133389 wait complete. 2024-08-19T11:20:25.421 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:25.421 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:20:25.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.519+0000 7f51084cc640 10 monclient: get_monmap_and_config 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.519+0000 7f51084cc640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.519+0000 7f51084cc640 10 monclient: monmap: 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:25.520139+0000 2024-08-19T11:20:25.520 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:25.520139+0000 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:25.521 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:25.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 Processor -- start 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 -- start start 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient: init 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient: _add_conns ranks=[2,4,10,7,1,5,9,6,8,0,3] 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51000a57d0 0x7f51000a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): picked mon.noname-b con 0x7f51000a57d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 0x7f51000a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): picked mon.noname-c con 0x7f51000a5bb0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:25.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5100137580 0x7f5100137a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): picked mon.noname-f con 0x7f5100137580 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f51000a41b0 con 0x7f5100137580 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51000728a0 con 0x7f51000a57d0 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5100072620 con 0x7f51000a5bb0 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f51084cc640 10 monclient(hunting): authenticate will time out at 1283.561788s 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 0x7f51000a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5106268640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51000a57d0 0x7f51000a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 0x7f51000a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59210/0 (socket says 172.21.15.71:59210) 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5106268640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51000a57d0 0x7f51000a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34964/0 (socket says 172.21.15.71:34964) 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 1 -- 172.21.15.71:0/3969742013 learned_addr learned my addr 172.21.15.71:0/3969742013 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 10 monclient(hunting): get_auth_request con 0x7f51000a5bb0 auth_method 0 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5105a67640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5106268640 10 monclient(hunting): get_auth_request con 0x7f51000a57d0 auth_method 0 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5106268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5106268640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.520+0000 7f5106268640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5106268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5106268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5106268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5106a69640 1 --2- 172.21.15.71:0/3969742013 >> v2:172.21.15.135:3300/0 conn(0x7f5100137580 0x7f5100137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 10 monclient(hunting): handle_auth_done global_id 85189 payload 274 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 1 -- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51000a57d0 msgr2=0x7f51000a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 1 --2- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51000a57d0 0x7f51000a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 1 -- 172.21.15.71:0/3969742013 >> v2:172.21.15.135:3300/0 conn(0x7f5100137580 msgr2=0x7f5100137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 1 --2- 172.21.15.71:0/3969742013 >> v2:172.21.15.135:3300/0 conn(0x7f5100137580 0x7f5100137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 1 monclient: found mon.noname-c 2024-08-19T11:20:25.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:25.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5105a67640 1 -- 172.21.15.71:0/3969742013 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100073940 con 0x7f51000a5bb0 2024-08-19T11:20:25.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5106a69640 10 monclient: get_auth_request con 0x7f5100137580 auth_method 0 2024-08-19T11:20:25.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.521+0000 7f5106a69640 1 --2- 172.21.15.71:0/3969742013 >> v2:172.21.15.135:3300/0 conn(0x7f5100137580 0x7f5100137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:20:25.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.523+0000 7f5105a67640 1 -- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 msgr2=0x7f51000a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.523+0000 7f5105a67640 1 --2- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 0x7f51000a5fb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f002a130 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6ed35dccb21a7c89 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 1 -- 172.21.15.71:0/3969742013 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50f0037070 con 0x7f51000a5bb0 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: dump: 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.535 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 5 monclient: authenticate success, global_id 85189 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 1 -- 172.21.15.71:0/3969742013 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f00307b0 con 0x7f51000a5bb0 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 1 -- 172.21.15.71:0/3969742013 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50f0030e50 con 0x7f51000a5bb0 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 4 set_mon_vals no callback set 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f5105266640 10 monclient: dump: 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.537 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 10 monclient: shutdown 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 -- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 msgr2=0x7f51000a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 --2- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 0x7f51000a5fb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f002a130 comp rx=0 tx=0).stop 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 -- 172.21.15.71:0/3969742013 shutdown_connections 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 --2- 172.21.15.71:0/3969742013 >> v2:172.21.15.135:3300/0 conn(0x7f5100137580 0x7f5100137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 --2- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a5bb0 0x7f51000a5fb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 --2- 172.21.15.71:0/3969742013 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51000a57d0 0x7f51000a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 -- 172.21.15.71:0/3969742013 >> 172.21.15.71:0/3969742013 conn(0x7f51000aa3f0 msgr2=0x7f51000a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 -- 172.21.15.71:0/3969742013 shutdown_connections 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.524+0000 7f51084cc640 1 -- 172.21.15.71:0/3969742013 wait complete. 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.525+0000 7f51084cc640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.525+0000 7f51084cc640 10 monclient: monmap: 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.540 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.525+0000 7f51084cc640 1 Processor -- start 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.525+0000 7f51084cc640 1 -- start start 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.525+0000 7f51084cc640 10 monclient: init 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient: _add_conns ranks=[4,8,2,7,0,3,5,1,6] 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 0x7f51000a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): picked mon.noname-c con 0x7f51000a57d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f51000a5bb0 0x7f5100134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): picked mon.noname-e con 0x7f51000a5bb0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5100137580 0x7f5100134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): picked mon.noname-b con 0x7f5100137580 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:25.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5100137f40 con 0x7f5100137580 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f51000a64f0 con 0x7f51000a57d0 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f51001380c0 con 0x7f51000a5bb0 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f51084cc640 10 monclient(hunting): authenticate will time out at 1283.567209s 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 0x7f51000a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f51000a5bb0 0x7f5100134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5100137580 0x7f5100134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 0x7f51000a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59224/0 (socket says 172.21.15.71:59224) 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 -- 172.21.15.71:0/2545949827 learned_addr learned my addr 172.21.15.71:0/2545949827 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): get_auth_request con 0x7f51000a57d0 auth_method 0 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): get_auth_request con 0x7f51000a5bb0 auth_method 0 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): get_auth_request con 0x7f5100137580 auth_method 0 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106a69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient(hunting): handle_auth_done global_id 85198 payload 824 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f51000a5bb0 msgr2=0x7f5100134a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f51000a5bb0 0x7f5100134a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5100137580 msgr2=0x7f5100134fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5100137580 0x7f5100134fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 monclient: found mon.noname-c 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.526+0000 7f5106268640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100122430 con 0x7f51000a57d0 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f5106268640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 msgr2=0x7f51000a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f5106268640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 0x7f51000a0080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50fc012fc0 tx=0x7f50fc010490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50fc00de50 con 0x7f51000a57d0 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 10 monclient: dump: 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.545 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc01d070 con 0x7f51000a57d0 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.528+0000 7f51084cc640 5 monclient: authenticate success, global_id 85198 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 10 monclient: _renew_subs 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51000a09a0 con 0x7f51000a57d0 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f50f6ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50fc010db0 con 0x7f51000a57d0 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f50f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f50f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f50f6ffd640 10 monclient: dump: 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.547 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.548 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f5104a65640 4 set_mon_vals no callback set 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 10 monclient: _renew_subs 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5100122bb0 con 0x7f51000a57d0 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 0x7f51001c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f510006a590 con 0x7f51001c67c0 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f50fc016050 con 0x7f51000a57d0 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f5105a67640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 0x7f51001c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f5105a67640 10 monclient: get_auth_request con 0x7f51001c67c0 auth_method 0 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f5105a67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f5105a67640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.529+0000 7f5105a67640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5105a67640 10 monclient(hunting): handle_auth_done global_id 85207 payload 824 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f50f6ffd640 1 --2- 172.21.15.71:0/2545949827 >> v2:172.21.15.135:6800/726754104 conn(0x7f50e403ec20 0x7f50e40410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5105a67640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51000a5fb0 con 0x7f51001c67c0 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(291..291 src has 1..291) ==== 3898+0+0 (secure 0 0 0) 0x7f50fc055a70 con 0x7f51000a57d0 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5106a69640 1 --2- 172.21.15.71:0/2545949827 >> v2:172.21.15.135:6800/726754104 conn(0x7f50e403ec20 0x7f50e40410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.530+0000 7f5106a69640 10 monclient: get_auth_request con 0x7f50e403ec20 auth_method 0 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f5105a67640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 msgr2=0x7f51001c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f5105a67640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 0x7f51001c6ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51000723b0 tx=0x7f50f00046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50f0037040 con 0x7f51001c67c0 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f50f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f50f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f50f6ffd640 10 monclient: dump: 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.551 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.532+0000 7f5106a69640 1 --2- 172.21.15.71:0/2545949827 >> v2:172.21.15.135:6800/726754104 conn(0x7f50e403ec20 0x7f50e40410e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f50f8007f70 tx=0x7f50f80076e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f50f0003b10 con 0x7f51001c67c0 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 msgr2=0x7f51001c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 0x7f51001c6ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51000723b0 tx=0x7f50f00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 msgr2=0x7f51001c6ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.533+0000 7f50f6ffd640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c67c0 0x7f51001c6ba0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51000723b0 tx=0x7f50f00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f51084cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f51084cc640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 0x7f510009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f51084cc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f5100076c60 con 0x7f51001c70e0 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 0x7f510009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient: get_auth_request con 0x7f51001c70e0 auth_method 0 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 10 monclient(hunting): handle_auth_done global_id 85216 payload 824 2024-08-19T11:20:25.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.539+0000 7f5105a67640 1 -- 172.21.15.71:0/2545949827 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f51001230d0 con 0x7f51001c70e0 2024-08-19T11:20:25.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.555 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4134825970}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=901074456}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.540+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3443879517}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1074900097}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2090449557}) 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1712077645}) 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3829934447}) 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4035868519}) 2024-08-19T11:20:25.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1496366719}) 2024-08-19T11:20:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f5105a67640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 msgr2=0x7f510009c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.541+0000 7f5105a67640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 0x7f510009c9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50f00097c0 tx=0x7f50f0009240 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f50f0032440 con 0x7f51001c70e0 2024-08-19T11:20:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:25.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 10 monclient: dump: 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.559 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f50f00325e0 con 0x7f51001c70e0 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 msgr2=0x7f510009c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 0x7f510009c9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50f00097c0 tx=0x7f50f0009240 comp rx=0 tx=0).stop 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 msgr2=0x7f510009c9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f50f6ffd640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51001c70e0 0x7f510009c9f0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50f00097c0 tx=0x7f50f0009240 comp rx=0 tx=0).stop 2024-08-19T11:20:25.560 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 207689, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:25.561 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 5, 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.562 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.563 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:25.564 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.565 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.566 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.567 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:25.568 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.570 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.571 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.573 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.576 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:25.579 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.580 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.581 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:25.583 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.584 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.584 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:25.584 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 >> v2:172.21.15.135:6800/726754104 conn(0x7f50e403ec20 msgr2=0x7f50e40410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 1 --2- 172.21.15.71:0/2545949827 >> v2:172.21.15.135:6800/726754104 conn(0x7f50e403ec20 0x7f50e40410e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f50f8007f70 tx=0x7f50f80076e0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 10 monclient: shutdown 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 msgr2=0x7f51000a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 1 --2- 172.21.15.71:0/2545949827 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f51000a57d0 0x7f51000a0080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50fc012fc0 tx=0x7f50fc010490 comp rx=0 tx=0).stop 2024-08-19T11:20:25.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f5106a69640 1 -- 172.21.15.71:0/2545949827 reap_dead start 2024-08-19T11:20:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f5106a69640 1 -- 172.21.15.71:0/2545949827 reap_dead start 2024-08-19T11:20:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 shutdown_connections 2024-08-19T11:20:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.542+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 >> 172.21.15.71:0/2545949827 conn(0x7f51000aa3f0 msgr2=0x7f51000a2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.543+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 shutdown_connections 2024-08-19T11:20:25.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.543+0000 7f51084cc640 1 -- 172.21.15.71:0/2545949827 wait complete. 2024-08-19T11:20:25.586 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:25.586 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:20:25.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:20:25.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.684+0000 7fd77fe2f640 10 monclient: get_monmap_and_config 2024-08-19T11:20:25.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.684+0000 7fd77fe2f640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.684+0000 7fd77fe2f640 10 monclient: monmap: 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:25.685301+0000 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:25.685301+0000 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.686 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:25.687 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:25.687 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.687 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.687 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.687 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.687 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.688 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.688 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.688 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:25.688 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:25.688 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 Processor -- start 2024-08-19T11:20:25.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 -- start start 2024-08-19T11:20:25.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient: init 2024-08-19T11:20:25.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient: _add_conns ranks=[8,4,1,2,5,3,9,6,7,10,0] 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd7780a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): picked mon.noname-e con 0x7fd7780a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 0x7fd7780a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): picked mon.noname-c con 0x7fd7780a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd778139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7780a6380 con 0x7fd778139710 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fd7780a5020 con 0x7fd7780a57c0 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd7780a77b0 con 0x7fd7780a6950 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.685+0000 7fd77fe2f640 10 monclient(hunting): authenticate will time out at 1283.726967s 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd7780a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 0x7fd7780a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 0x7fd7780a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59250/0 (socket says 172.21.15.71:59250) 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 1 -- 172.21.15.71:0/4035624757 learned_addr learned my addr 172.21.15.71:0/4035624757 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): get_auth_request con 0x7fd7780a57c0 auth_method 0 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd7780a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48818/0 (socket says 172.21.15.71:48818) 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): get_auth_request con 0x7fd7780a6950 auth_method 0 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_done global_id 114236 payload 274 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 -- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 msgr2=0x7fd7780a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 --2- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 0x7fd7780a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 -- 172.21.15.71:0/4035624757 >> v1:172.21.15.135:6789/0 conn(0x7fd778139710 legacy=0x7fd778139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 monclient: found mon.noname-e 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77dbcb640 1 -- 172.21.15.71:0/4035624757 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7780a3650 con 0x7fd7780a6950 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.686+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 0x7fd7780a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77dbcb640 1 -- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 msgr2=0x7fd7780a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77dbcb640 1 --2- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd7780a6d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd774009800 tx=0x7fd774029fe0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=3f4145eb2fa67cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 1 -- 172.21.15.71:0/4035624757 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd774037070 con 0x7fd7780a6950 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: dump: 2024-08-19T11:20:25.698 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.699 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 1 -- 172.21.15.71:0/4035624757 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77402ad00 con 0x7fd7780a6950 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 5 monclient: authenticate success, global_id 114236 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 1 -- 172.21.15.71:0/4035624757 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd774030c20 con 0x7fd7780a6950 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77cbc9640 10 monclient: dump: 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.700 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.701 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 4 set_mon_vals no callback set 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 10 monclient: shutdown 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 1 -- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 msgr2=0x7fd7780a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.689+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd7780a6d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd774009800 tx=0x7fd774029fe0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 1 -- 172.21.15.71:0/4035624757 shutdown_connections 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fd7780a57c0 0x7fd7780a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/4035624757 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd7780a6d30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 1 -- 172.21.15.71:0/4035624757 >> 172.21.15.71:0/4035624757 conn(0x7fd7780abf50 msgr2=0x7fd7780ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 1 -- 172.21.15.71:0/4035624757 shutdown_connections 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 1 -- 172.21.15.71:0/4035624757 wait complete. 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.690+0000 7fd77fe2f640 10 monclient: monmap: 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:25.703 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 Processor -- start 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 -- start start 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient: init 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient: _add_conns ranks=[0,8,6,3,5,7,1,4,2] 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 0x7fd778124ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): picked mon.noname-a con 0x7fd7780a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd778125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): picked mon.noname-e con 0x7fd7780a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778139710 0x7fd778125760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): picked mon.noname-d con 0x7fd778139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7780a84c0 con 0x7fd7780a57c0 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd7780a7d40 con 0x7fd778139710 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fd7780a8700 con 0x7fd7780a6950 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77fe2f640 10 monclient(hunting): authenticate will time out at 1283.732608s 2024-08-19T11:20:25.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 0x7fd778124ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 0x7fd778124ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38784/0 (socket says 172.21.15.71:38784) 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 1 -- 172.21.15.71:0/3707405253 learned_addr learned my addr 172.21.15.71:0/3707405253 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): get_auth_request con 0x7fd7780a57c0 auth_method 0 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd778125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): get_auth_request con 0x7fd7780a6950 auth_method 0 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778139710 0x7fd778125760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): get_auth_request con 0x7fd778139710 auth_method 0 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77e3cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.691+0000 7fd77dbcb640 10 monclient(hunting): handle_auth_done global_id 75663 payload 824 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 msgr2=0x7fd778125220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd778125220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778139710 msgr2=0x7fd778125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778139710 0x7fd778125760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 1 monclient: found mon.noname-a 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:25.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77dbcb640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd778128b00 con 0x7fd7780a57c0 2024-08-19T11:20:25.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.692+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fd7780a6950 0x7fd778125220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:25.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77dbcb640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 msgr2=0x7fd778124ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77dbcb640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 0x7fd778124ce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd77402a5d0 tx=0x7fd7740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd774037050 con 0x7fd7780a57c0 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: dump: 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.714 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 5 monclient: authenticate success, global_id 75663 2024-08-19T11:20:25.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd774043070 con 0x7fd7780a57c0 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd77403ed30 con 0x7fd7780a57c0 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76e7fc640 10 monclient: dump: 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.716 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd76ffff640 4 set_mon_vals no callback set 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 10 monclient: _renew_subs 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7780a1f00 con 0x7fd7780a57c0 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 10 monclient: _renew_subs 2024-08-19T11:20:25.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.694+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd778127c90 con 0x7fd7780a57c0 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd774003ce0 con 0x7fd7780a57c0 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77fe2f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 0x7fd778063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd77806a590 con 0x7fd77802e340 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 0x7fd778063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient: get_auth_request con 0x7fd77802e340 auth_method 0 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd76e7fc640 1 --2- 172.21.15.71:0/3707405253 >> v2:172.21.15.135:6800/726754104 conn(0x7fd75c03ea80 0x7fd75c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(291..291 src has 1..291) ==== 3898+0+0 (secure 0 0 0) 0x7fd774072440 con 0x7fd7780a57c0 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_done global_id 104559 payload 824 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77d3ca640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd77802e720 con 0x7fd77802e340 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77e3cc640 1 --2- 172.21.15.71:0/3707405253 >> v2:172.21.15.135:6800/726754104 conn(0x7fd75c03ea80 0x7fd75c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.695+0000 7fd77e3cc640 10 monclient: get_auth_request con 0x7fd75c03ea80 auth_method 0 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.697+0000 7fd77d3ca640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 msgr2=0x7fd778063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.697+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 0x7fd778063a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd778126e10 tx=0x7fd76800f610 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd768014ac0 con 0x7fd77802e340 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 10 monclient: dump: 2024-08-19T11:20:25.719 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.720 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd77e3cc640 1 --2- 172.21.15.71:0/3707405253 >> v2:172.21.15.135:6800/726754104 conn(0x7fd75c03ea80 0x7fd75c040f40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd770009f60 tx=0x7fd77000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd768014650 con 0x7fd77802e340 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 msgr2=0x7fd778063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 0x7fd778063a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd778126e10 tx=0x7fd76800f610 comp rx=0 tx=0).stop 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 msgr2=0x7fd778063a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.698+0000 7fd76e7fc640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd77802e340 0x7fd778063a80 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd778126e10 tx=0x7fd76800f610 comp rx=0 tx=0).stop 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77fe2f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 0x7fd7781d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77fe2f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd7780a3f10 con 0x7fd778063fc0 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 0x7fd7781d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient: get_auth_request con 0x7fd778063fc0 auth_method 0 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 10 monclient(hunting): handle_auth_done global_id 104568 payload 824 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.704+0000 7fd77d3ca640 1 -- 172.21.15.71:0/3707405253 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd7780a6d30 con 0x7fd778063fc0 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77d3ca640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 msgr2=0x7fd7781d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77d3ca640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 0x7fd7781d8990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd778126e10 tx=0x7fd7680046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd768000e60 con 0x7fd778063fc0 2024-08-19T11:20:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 10 monclient: dump: 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fd76801d400 con 0x7fd778063fc0 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 msgr2=0x7fd7781d8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 0x7fd7781d8990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd778126e10 tx=0x7fd7680046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 msgr2=0x7fd7781d8990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd76e7fc640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd778063fc0 0x7fd7781d8990 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd778126e10 tx=0x7fd7680046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:25.725 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 81055, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:25.726 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.727 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.728 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.729 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.731 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:25.732 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.735 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.738 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.742 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.743 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.745 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.748 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.749 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:25.749 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:25.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 >> v2:172.21.15.135:6800/726754104 conn(0x7fd75c03ea80 msgr2=0x7fd75c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/3707405253 >> v2:172.21.15.135:6800/726754104 conn(0x7fd75c03ea80 0x7fd75c040f40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd770009f60 tx=0x7fd77000d040 comp rx=0 tx=0).stop 2024-08-19T11:20:25.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 10 monclient: shutdown 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 msgr2=0x7fd778124ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 0x7fd778124ce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd77402a5d0 tx=0x7fd7740046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77e3cc640 1 -- 172.21.15.71:0/3707405253 reap_dead start 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 shutdown_connections 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 --2- 172.21.15.71:0/3707405253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7780a57c0 0x7fd778124ce0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 >> 172.21.15.71:0/3707405253 conn(0x7fd7780abf50 msgr2=0x7fd778138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 shutdown_connections 2024-08-19T11:20:25.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.707+0000 7fd77fe2f640 1 -- 172.21.15.71:0/3707405253 wait complete. 2024-08-19T11:20:25.752 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:25.752 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:20:25.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:20:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1797024806}) 2024-08-19T11:20:25.764 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=336113094}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=887586623}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.742+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2998770252}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2211792638}) 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.765 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=245746368}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2184976022}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3344152427}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.743+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2949962323}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2470606049}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.766 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3987883465}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1963046270}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=74447576}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=75541753}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=48874562}) 2024-08-19T11:20:25.767 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277110752}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=636139861}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.744+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4266178407}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=421261298}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=846138527}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.768 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188373216}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3761791692}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3188397434}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=874254681}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3132821914}) 2024-08-19T11:20:25.769 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3270682966}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.745+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=517260722}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1545614162}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4159074211}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3988984253}) 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.770 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1113355168}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2586772485}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2646864291}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1677832134}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2274921668}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.747+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1056443619}) 2024-08-19T11:20:25.771 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2546946593}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2793689854}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2936635142}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=109334540}) 2024-08-19T11:20:25.772 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3181866342}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1881147928}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195596531}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2468040418}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.748+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1284577461}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.773 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1587552939}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=896492019}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3402397723}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=583874530}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.774 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=634762980}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1420146194}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935020381}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2081121308}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.749+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1246805617}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.750+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2891797679}) 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.775 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1202420320}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3106575430}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=770990314}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3781654647}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.776 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=849825946}) 2024-08-19T11:20:25.777 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.777 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.777 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4196416897}) 2024-08-19T11:20:25.777 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:25.777 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1531833475}) 2024-08-19T11:20:25.777 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:25.751+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4089989531}) 2024-08-19T11:20:25.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.873+0000 7fa65647e640 10 monclient: get_monmap_and_config 2024-08-19T11:20:25.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.873+0000 7fa65647e640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.873+0000 7fa65647e640 10 monclient: monmap: 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:25.874259+0000 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:25.874259+0000 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.875 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:25.876 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 Processor -- start 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 -- start start 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient: init 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient: _add_conns ranks=[2,7,8,3,0,5,10,4,6,1,9] 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6500a6a30 0x7fa6500a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): picked mon.noname-b con 0x7fa6500a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6e10 0x7fa6500a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): picked mon.noname-i con 0x7fa6500a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 0x7fa650139c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): picked mon.noname-e con 0x7fa6501397f0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa6500a2fc0 con 0x7fa6500a6a30 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa6500a63f0 con 0x7fa6500a6e10 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa6500a5000 con 0x7fa6501397f0 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.874+0000 7fa65647e640 10 monclient(hunting): authenticate will time out at 1283.915944s 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 0x7fa650139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6500a6a30 0x7fa6500a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 0x7fa650139c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48824/0 (socket says 172.21.15.71:48824) 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 -- 172.21.15.71:0/3356116716 learned_addr learned my addr 172.21.15.71:0/3356116716 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): get_auth_request con 0x7fa6501397f0 auth_method 0 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): get_auth_request con 0x7fa6500a6a30 auth_method 0 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient(hunting): handle_auth_done global_id 114254 payload 274 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64f7fe640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6e10 0x7fa6500a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 -- 172.21.15.71:0/3356116716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6e10 msgr2=0x7fa6500a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6e10 0x7fa6500a7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 -- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6500a6a30 msgr2=0x7fa6500a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6500a6a30 0x7fa6500a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 monclient: found mon.noname-e 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa654a1b640 1 -- 172.21.15.71:0/3356116716 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500a8590 con 0x7fa6501397f0 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.875+0000 7fa64ffff640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6500a6a30 0x7fa6500a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa654a1b640 1 -- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 msgr2=0x7fa650139c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa654a1b640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 0x7fa650139c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa648009e80 tx=0x7fa64802a520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f9d3609b618d51d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 1 -- 172.21.15.71:0/3356116716 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa648036070 con 0x7fa6501397f0 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: dump: 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.884 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 1 -- 172.21.15.71:0/3356116716 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa648007a70 con 0x7fa6501397f0 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 5 monclient: authenticate success, global_id 114254 2024-08-19T11:20:25.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 1 -- 172.21.15.71:0/3356116716 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa648007c60 con 0x7fa6501397f0 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 4 set_mon_vals no callback set 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa64effd640 10 monclient: dump: 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.886 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 10 monclient: shutdown 2024-08-19T11:20:25.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 -- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 msgr2=0x7fa650139c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 0x7fa650139c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa648009e80 tx=0x7fa64802a520 comp rx=0 tx=0).stop 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 -- 172.21.15.71:0/3356116716 shutdown_connections 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6501397f0 0x7fa650139c50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6e10 0x7fa6500a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 --2- 172.21.15.71:0/3356116716 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa6500a6a30 0x7fa6500a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 -- 172.21.15.71:0/3356116716 >> 172.21.15.71:0/3356116716 conn(0x7fa6500ac030 msgr2=0x7fa6500ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 -- 172.21.15.71:0/3356116716 shutdown_connections 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.878+0000 7fa65647e640 1 -- 172.21.15.71:0/3356116716 wait complete. 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.879+0000 7fa65647e640 10 monclient: build_initial_monmap 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.879+0000 7fa65647e640 10 monclient: monmap: 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:25.888 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:25.889 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.879+0000 7fa65647e640 1 Processor -- start 2024-08-19T11:20:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 -- start start 2024-08-19T11:20:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient: init 2024-08-19T11:20:25.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient: _add_conns ranks=[7,6,1,0,4,3,5,2,8] 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6a30 0x7fa6501cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): picked mon.noname-i con 0x7fa6500a6a30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 0x7fa6501cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): picked mon.noname-d con 0x7fa6500a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6501397f0 0x7fa6501cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): picked mon.noname-f con 0x7fa6501397f0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa65013a190 con 0x7fa6501397f0 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa6500a7770 con 0x7fa6500a6e10 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa65013a310 con 0x7fa6500a6a30 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa65647e640 10 monclient(hunting): authenticate will time out at 1283.921474s 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 0x7fa6501cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 0x7fa6501cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36862/0 (socket says 172.21.15.71:36862) 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 -- 172.21.15.71:0/489797158 learned_addr learned my addr 172.21.15.71:0/489797158 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): get_auth_request con 0x7fa6500a6e10 auth_method 0 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6a30 0x7fa6501cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6501397f0 0x7fa6501cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): get_auth_request con 0x7fa6501397f0 auth_method 0 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): get_auth_request con 0x7fa6500a6a30 auth_method 0 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa654a1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient(hunting): handle_auth_done global_id 104577 payload 824 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6a30 msgr2=0x7fa6501cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa6500a6a30 0x7fa6501cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6501397f0 msgr2=0x7fa6501cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6501397f0 0x7fa6501cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 monclient: found mon.noname-d 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.880+0000 7fa64f7fe640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500a2400 con 0x7fa6500a6e10 2024-08-19T11:20:25.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64f7fe640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 msgr2=0x7fa6501cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64f7fe640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 0x7fa6501cef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c7f0 tx=0x7fa64400ccb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa644015070 con 0x7fa6500a6e10 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: dump: 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.900 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: _finish_auth 0 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa644007ca0 con 0x7fa6500a6e10 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 5 monclient: authenticate success, global_id 104577 2024-08-19T11:20:25.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 10 monclient: _renew_subs 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa650128910 con 0x7fa6500a6e10 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa644011860 con 0x7fa6500a6e10 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64cff9640 10 monclient: dump: 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.902 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 10 monclient: _renew_subs 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6500a59e0 con 0x7fa6500a6e10 2024-08-19T11:20:25.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.883+0000 7fa64e7fc640 4 set_mon_vals no callback set 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa65647e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa65647e640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 0x7fa65009fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa6501384e0 con 0x7fa65009fa10 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64f7fe640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 0x7fa6501cef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c7f0 tx=0x7fa64400ccb0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fa644051670 osd_map(291..291 src has 1..291) 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa6440113f0 con 0x7fa6500a6e10 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 0x7fa65009fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient: get_auth_request con 0x7fa65009fa10 auth_method 0 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 10 monclient(hunting): handle_auth_done global_id 114263 payload 824 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64cff9640 1 --2- 172.21.15.71:0/489797158 >> v2:172.21.15.135:6800/726754104 conn(0x7fa63c03ea80 0x7fa63c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa64ffff640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6500a7230 con 0x7fa65009fa10 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa654a1b640 1 --2- 172.21.15.71:0/489797158 >> v2:172.21.15.135:6800/726754104 conn(0x7fa63c03ea80 0x7fa63c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.884+0000 7fa654a1b640 10 monclient: get_auth_request con 0x7fa63c03ea80 auth_method 0 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.886+0000 7fa64ffff640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 msgr2=0x7fa65009fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.886+0000 7fa64ffff640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 0x7fa65009fdf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6400118e0 tx=0x7fa640011da0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.886+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa6400148b0 con 0x7fa65009fa10 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.886+0000 7fa64cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.886+0000 7fa64cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.886+0000 7fa64cff9640 10 monclient: dump: 2024-08-19T11:20:25.905 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.906 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa640014440 con 0x7fa65009fa10 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 msgr2=0x7fa65009fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 0x7fa65009fdf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6400118e0 tx=0x7fa640011da0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 msgr2=0x7fa65009fdf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa64cff9640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa65009fa10 0x7fa65009fdf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.887+0000 7fa654a1b640 1 --2- 172.21.15.71:0/489797158 >> v2:172.21.15.135:6800/726754104 conn(0x7fa63c03ea80 0x7fa63c040f40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa648009e50 tx=0x7fa648009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa65647e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa65647e640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 0x7fa650124fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa65647e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:25.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa650076c60 con 0x7fa6500a0330 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 0x7fa650124fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient: get_auth_request con 0x7fa6500a0330 auth_method 0 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 10 monclient(hunting): handle_auth_done global_id 114272 payload 824 2024-08-19T11:20:25.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.893+0000 7fa64ffff640 1 -- 172.21.15.71:0/489797158 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa650126890 con 0x7fa6500a0330 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64ffff640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 msgr2=0x7fa650124fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64ffff640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 0x7fa650124fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa6400046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa640022bf0 con 0x7fa6500a0330 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 10 monclient: dump: 2024-08-19T11:20:25.909 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:25.910 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7fa64002a400 con 0x7fa6500a0330 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 msgr2=0x7fa650124fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 0x7fa650124fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa6400046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 msgr2=0x7fa650124fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.895+0000 7fa64cff9640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa6500a0330 0x7fa650124fb0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa640000c00 tx=0x7fa6400046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.911 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 26267, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:25.912 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.913 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.914 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:25.915 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:25.916 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:25.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:25.921 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:25.924 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:25.929 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.930 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.931 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:25.935 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:25.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:25.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:25.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:25.936 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:25.936 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 >> v2:172.21.15.135:6800/726754104 conn(0x7fa63c03ea80 msgr2=0x7fa63c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 --2- 172.21.15.71:0/489797158 >> v2:172.21.15.135:6800/726754104 conn(0x7fa63c03ea80 0x7fa63c040f40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa648009e50 tx=0x7fa648009000 comp rx=0 tx=0).stop 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 10 monclient: shutdown 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 msgr2=0x7fa6501cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 --2- 172.21.15.71:0/489797158 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa6500a6e10 0x7fa6501cef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c7f0 tx=0x7fa64400ccb0 comp rx=0 tx=0).stop 2024-08-19T11:20:25.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa654a1b640 1 -- 172.21.15.71:0/489797158 reap_dead start 2024-08-19T11:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa64cff9640 1 -- 172.21.15.71:0/489797158 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(291..291 src has 1..291) ==== 3898+0+0 (unknown 0 0 0) 0x7fa644051670 con 0x7fa6500a6e10 2024-08-19T11:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa654a1b640 1 -- 172.21.15.71:0/489797158 reap_dead start 2024-08-19T11:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 shutdown_connections 2024-08-19T11:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 >> 172.21.15.71:0/489797158 conn(0x7fa6500ac030 msgr2=0x7fa6501390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 shutdown_connections 2024-08-19T11:20:25.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:25.896+0000 7fa65647e640 1 -- 172.21.15.71:0/489797158 wait complete. 2024-08-19T11:20:25.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:25.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:20:25.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.036+0000 7f3aa3916640 10 monclient: get_monmap_and_config 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.036+0000 7f3aa3916640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.036+0000 7f3aa3916640 10 monclient: monmap: 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:26.037062+0000 2024-08-19T11:20:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:26.037062+0000 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:26.038 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.036+0000 7f3aa3916640 1 Processor -- start 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 -- start start 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient: init 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient: _add_conns ranks=[6,5,9,10,7,1,2,3,0,4,8] 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 0x7f3a9c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): picked mon.noname-d con 0x7f3a9c0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c0a57c0 0x7f3a9c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): picked mon.noname-h con 0x7f3a9c0a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3a9c139710 0x7f3a9c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): picked mon.noname-a con 0x7f3a9c139710 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9c0a5020 con 0x7f3a9c139710 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3a9c0a77b0 con 0x7f3a9c0a57c0 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3a9c0a7d40 con 0x7f3a9c0a6950 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa3916640 10 monclient(hunting): authenticate will time out at 1284.078717s 2024-08-19T11:20:26.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3a9c139710 0x7f3a9c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 0x7f3a9c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3a9c139710 0x7f3a9c139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38788/0 (socket says 172.21.15.71:38788) 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/1959348978 learned_addr learned my addr 172.21.15.71:0/1959348978 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 0x7f3a9c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36864/0 (socket says 172.21.15.71:36864) 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): get_auth_request con 0x7f3a9c139710 auth_method 0 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): get_auth_request con 0x7f3a9c0a6950 auth_method 0 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.037+0000 7f3aa16b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa0eb1640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c0a57c0 0x7f3a9c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa0eb1640 10 monclient(hunting): get_auth_request con 0x7f3a9c0a57c0 auth_method 0 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa0eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa0eb1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa0eb1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_done global_id 75672 payload 274 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 msgr2=0x7f3a9c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 0x7f3a9c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/1959348978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c0a57c0 msgr2=0x7f3a9c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c0a57c0 0x7f3a9c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 1 monclient: found mon.noname-a 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/1959348978 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c0a6380 con 0x7f3a9c139710 2024-08-19T11:20:26.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.038+0000 7f3aa16b2640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 0x7f3a9c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.040+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a9c139710 msgr2=0x7f3a9c139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.040+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a9c139710 0x7f3a9c139b30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009e80 tx=0x7f3a9402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983867b9dd649173 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 1 -- 172.21.15.71:0/1959348978 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a94036070 con 0x7f3a9c139710 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: dump: 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.052 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.053 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 1 -- 172.21.15.71:0/1959348978 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94007a70 con 0x7f3a9c139710 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 5 monclient: authenticate success, global_id 75672 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 1 -- 172.21.15.71:0/1959348978 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a94007ca0 con 0x7f3a9c139710 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 4 set_mon_vals no callback set 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3a93fff640 10 monclient: dump: 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.055 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 10 monclient: shutdown 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 -- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a9c139710 msgr2=0x7f3a9c139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a9c139710 0x7f3a9c139b30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009e80 tx=0x7f3a9402a580 comp rx=0 tx=0).stop 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 -- 172.21.15.71:0/1959348978 shutdown_connections 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a9c139710 0x7f3a9c139b30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c0a57c0 0x7f3a9c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 --2- 172.21.15.71:0/1959348978 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3a9c0a6950 0x7f3a9c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 -- 172.21.15.71:0/1959348978 >> 172.21.15.71:0/1959348978 conn(0x7f3a9c0abf50 msgr2=0x7f3a9c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 -- 172.21.15.71:0/1959348978 shutdown_connections 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.041+0000 7f3aa3916640 1 -- 172.21.15.71:0/1959348978 wait complete. 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.042+0000 7f3aa3916640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.042+0000 7f3aa3916640 10 monclient: monmap: 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:26.057 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.042+0000 7f3aa3916640 1 Processor -- start 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.042+0000 7f3aa3916640 1 -- start start 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.042+0000 7f3aa3916640 10 monclient: init 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient: _add_conns ranks=[3,8,5,2,4,1,0,7,6] 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a9c0a57c0 0x7f3a9c138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): picked mon.noname-g con 0x7f3a9c0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 0x7f3a9c1cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): picked mon.noname-e con 0x7f3a9c0a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c139710 0x7f3a9c1cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): picked mon.noname-h con 0x7f3a9c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c0a84c0 con 0x7f3a9c0a57c0 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3a9c0a3650 con 0x7f3a9c139710 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3a9c0a8700 con 0x7f3a9c0a6950 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa3916640 10 monclient(hunting): authenticate will time out at 1284.084083s 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 0x7f3a9c1cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 0x7f3a9c1cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48852/0 (socket says 172.21.15.71:48852) 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 -- 172.21.15.71:0/2701847638 learned_addr learned my addr 172.21.15.71:0/2701847638 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): get_auth_request con 0x7f3a9c0a6950 auth_method 0 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient(hunting): handle_auth_done global_id 114281 payload 824 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c139710 0x7f3a9c1cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa16b2640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a9c0a57c0 0x7f3a9c138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c139710 msgr2=0x7f3a9c1cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c139710 0x7f3a9c1cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a9c0a57c0 msgr2=0x7f3a9c138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a9c0a57c0 0x7f3a9c138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 monclient: found mon.noname-e 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa0eb1640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c1266c0 con 0x7f3a9c0a6950 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa1eb3640 10 monclient: get_auth_request con 0x7f3a9c139710 auth_method 0 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3a9c139710 0x7f3a9c1cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa16b2640 10 monclient: get_auth_request con 0x7f3a9c0a57c0 auth_method 0 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.043+0000 7f3aa16b2640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a9c0a57c0 0x7f3a9c138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:20:26.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3aa0eb1640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 msgr2=0x7f3a9c1cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3aa0eb1640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 0x7f3a9c1cafc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00d5f0 tx=0x7f3a8c00dab0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a8c012c70 con 0x7f3a9c0a6950 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: dump: 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.062 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3aa3916640 5 monclient: authenticate success, global_id 114281 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c019070 con 0x7f3a9c0a6950 2024-08-19T11:20:26.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3aa3916640 10 monclient: _renew_subs 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3aa3916640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c125730 con 0x7f3a9c0a6950 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a8c0148a0 con 0x7f3a9c0a6950 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a91ffb640 10 monclient: dump: 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.064 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.046+0000 7f3aa3916640 10 monclient: _renew_subs 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.045+0000 7f3a937fe640 4 set_mon_vals no callback set 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.046+0000 7f3aa3916640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:20:26.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.046+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c125e20 con 0x7f3a9c0a6950 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.046+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3a8c014430 con 0x7f3a9c0a6950 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.046+0000 7f3a91ffb640 1 --2- 172.21.15.71:0/2701847638 >> v2:172.21.15.135:6800/726754104 conn(0x7f3a8003ea80 0x7f3a80040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.046+0000 7f3aa3916640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(291..291 src has 1..291) ==== 3898+0+0 (secure 0 0 0) 0x7f3a8c00f040 con 0x7f3a9c0a6950 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa3916640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 0x7f3a9c1cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c06a590 con 0x7f3a9c126060 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa16b2640 1 --2- 172.21.15.71:0/2701847638 >> v2:172.21.15.135:6800/726754104 conn(0x7f3a8003ea80 0x7f3a80040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 0x7f3a9c1cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa16b2640 10 monclient: get_auth_request con 0x7f3a8003ea80 auth_method 0 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient: get_auth_request con 0x7f3a9c126060 auth_method 0 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_done global_id 85240 payload 824 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.047+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a9c077730 con 0x7f3a9c126060 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.049+0000 7f3aa16b2640 1 --2- 172.21.15.71:0/2701847638 >> v2:172.21.15.135:6800/726754104 conn(0x7f3a8003ea80 0x7f3a80040f40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009a40 tx=0x7f3a98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.049+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 msgr2=0x7f3a9c1cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.049+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 0x7f3a9c1cecc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c074f90 tx=0x7f3a94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a94041030 con 0x7f3a9c126060 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 10 monclient: dump: 2024-08-19T11:20:26.067 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.068 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3a94037040 con 0x7f3a9c126060 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 msgr2=0x7f3a9c1cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 0x7f3a9c1cecc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c074f90 tx=0x7f3a94004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 msgr2=0x7f3a9c1cecc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.050+0000 7f3a91ffb640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c126060 0x7f3a9c1cecc0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c074f90 tx=0x7f3a94004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:26.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa3916640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:26.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa3916640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 0x7f3a9c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa3916640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c076c60 con 0x7f3a9c139240 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 0x7f3a9c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient: get_auth_request con 0x7f3a9c139240 auth_method 0 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 10 monclient(hunting): handle_auth_done global_id 85249 payload 824 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.056+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/2701847638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3a9c0a1fe0 con 0x7f3a9c139240 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.059+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 msgr2=0x7f3a9c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.059+0000 7f3aa1eb3640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 0x7f3a9c02d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a9402a5c0 tx=0x7f3a9402f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.059+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3a94041070 con 0x7f3a9c139240 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.059+0000 7f3a91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.059+0000 7f3a91ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.059+0000 7f3a91ffb640 10 monclient: dump: 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.073 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7f3a94003f00 con 0x7f3a9c139240 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:26.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 msgr2=0x7f3a9c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 0x7f3a9c02d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a9402a5c0 tx=0x7f3a9402f000 comp rx=0 tx=0).stop 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 msgr2=0x7f3a9c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3a91ffb640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a9c139240 0x7f3a9c02d1c0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a9402a5c0 tx=0x7f3a9402f000 comp rx=0 tx=0).stop 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:26.075 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 208220, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:26.076 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.077 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.078 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.080 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.081 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.082 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.084 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.086 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.087 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.087 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.087 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.088 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:26.088 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:26.088 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.088 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.089 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.092 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.093 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:26.093 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.094 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.095 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.095 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.095 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.097 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.098 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:26.099 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.100 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.101 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.104 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.105 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:26.106 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:26.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 >> v2:172.21.15.135:6800/726754104 conn(0x7f3a8003ea80 msgr2=0x7f3a80040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 --2- 172.21.15.71:0/2701847638 >> v2:172.21.15.135:6800/726754104 conn(0x7f3a8003ea80 0x7f3a80040f40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009a40 tx=0x7f3a98008040 comp rx=0 tx=0).stop 2024-08-19T11:20:26.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 10 monclient: shutdown 2024-08-19T11:20:26.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 msgr2=0x7f3a9c1cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 --2- 172.21.15.71:0/2701847638 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3a9c0a6950 0x7f3a9c1cafc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00d5f0 tx=0x7f3a8c00dab0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/2701847638 reap_dead start 2024-08-19T11:20:26.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa1eb3640 1 -- 172.21.15.71:0/2701847638 reap_dead start 2024-08-19T11:20:26.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 shutdown_connections 2024-08-19T11:20:26.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 >> 172.21.15.71:0/2701847638 conn(0x7f3a9c0abf50 msgr2=0x7f3a9c0aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 shutdown_connections 2024-08-19T11:20:26.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.060+0000 7f3aa3916640 1 -- 172.21.15.71:0/2701847638 wait complete. 2024-08-19T11:20:26.110 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:26.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:20:26.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:20:26.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3423800446}) 2024-08-19T11:20:26.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.118 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3511055495}) 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1091746729}) 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3511565347}) 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.119 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1167182416}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2650223997}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1232102516}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3630925940}) 2024-08-19T11:20:26.120 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.116+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3721782531}) 2024-08-19T11:20:26.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.135 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3464657440}) 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1756780157}) 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2705559877}) 2024-08-19T11:20:26.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1641476659}) 2024-08-19T11:20:26.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=257471364}) 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3880698180}) 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3238521110}) 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789315246}) 2024-08-19T11:20:26.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4181641750}) 2024-08-19T11:20:26.157 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.157 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.157 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3420488128}) 2024-08-19T11:20:26.157 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.157 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.157 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3724091249}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1257701632}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3188602240}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1056064126}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.158 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1450937757}) 2024-08-19T11:20:26.159 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.159 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.159 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2219920498}) 2024-08-19T11:20:26.159 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.159 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241328701}) 2024-08-19T11:20:26.159 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1869846821}) 2024-08-19T11:20:26.164 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.164 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.164 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1215621166}) 2024-08-19T11:20:26.164 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.164 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4031581027}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1435767131}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=433810276}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.162+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3488070872}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.165 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1082742345}) 2024-08-19T11:20:26.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1788106831}) 2024-08-19T11:20:26.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.166 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3118242877}) 2024-08-19T11:20:26.167 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3339270881}) 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.225+0000 7f5f78a0e640 10 monclient: get_monmap_and_config 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.225+0000 7f5f78a0e640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.225+0000 7f5f78a0e640 10 monclient: monmap: 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:26.225887+0000 2024-08-19T11:20:26.226 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:26.225887+0000 2024-08-19T11:20:26.227 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.227 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.227 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:26.227 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:26.227 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.227 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:26.228 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 Processor -- start 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 -- start start 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient: init 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient: _add_conns ranks=[9,0,5,3,4,1,6,7,8,10,2] 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f74132970 0x7f5f740a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): picked mon.noname-a con 0x7f5f74132970 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f74132d50 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f74133130 0x7f5f74136170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): picked mon.noname-h con 0x7f5f74133130 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f74132560 con 0x7f5f74132d50 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f5f740a5c70 con 0x7f5f74132970 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5f740a40e0 con 0x7f5f74133130 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f78a0e640 10 monclient(hunting): authenticate will time out at 1284.267745s 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f74132970 0x7f5f740a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f6bfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5f74132d50 0x7f5f74135a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:60494/0 (socket says 172.21.15.71:60494) 2024-08-19T11:20:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f6bfff640 1 -- 172.21.15.71:0/3682207414 learned_addr learned my addr 172.21.15.71:0/3682207414 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 10 monclient(hunting): get_auth_request con 0x7f5f74132970 auth_method 0 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.226+0000 7f5f7259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f72d9d640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f74133130 0x7f5f74136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f72d9d640 10 monclient(hunting): get_auth_request con 0x7f5f74133130 auth_method 0 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f72d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f72d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f72d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 10 monclient(hunting): handle_auth_done global_id 75681 payload 274 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 1 -- 172.21.15.71:0/3682207414 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f74133130 msgr2=0x7f5f74136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f74133130 0x7f5f74136170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 1 -- 172.21.15.71:0/3682207414 >> v1:172.21.15.71:6789/0 conn(0x7f5f74132d50 legacy=0x7f5f74135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 1 monclient: found mon.noname-a 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f7259c640 1 -- 172.21.15.71:0/3682207414 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f740a1040 con 0x7f5f74132970 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.227+0000 7f5f72d9d640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f74133130 0x7f5f74136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.229+0000 7f5f7259c640 1 -- 172.21.15.71:0/3682207414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74132970 msgr2=0x7f5f740a21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.229+0000 7f5f7259c640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74132970 0x7f5f740a21e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400a940 tx=0x7f5f6402b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccc98d6455af4e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 1 -- 172.21.15.71:0/3682207414 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f64038070 con 0x7f5f74132970 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: dump: 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.243 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.245 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 1 -- 172.21.15.71:0/3682207414 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f64030920 con 0x7f5f74132970 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 1 -- 172.21.15.71:0/3682207414 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f6400b040 con 0x7f5f74132970 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f71d9b640 10 monclient: dump: 2024-08-19T11:20:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.247 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f78a0e640 5 monclient: authenticate success, global_id 75681 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f78a0e640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f78a0e640 4 set_mon_vals no callback set 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f78a0e640 10 monclient: shutdown 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f78a0e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.230+0000 7f5f78a0e640 1 -- 172.21.15.71:0/3682207414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74132970 msgr2=0x7f5f740a21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74132970 0x7f5f740a21e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400a940 tx=0x7f5f6402b380 comp rx=0 tx=0).stop 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 -- 172.21.15.71:0/3682207414 shutdown_connections 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f74133130 0x7f5f74136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/3682207414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74132970 0x7f5f740a21e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 -- 172.21.15.71:0/3682207414 >> 172.21.15.71:0/3682207414 conn(0x7f5f740a4e70 msgr2=0x7f5f740a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 -- 172.21.15.71:0/3682207414 shutdown_connections 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 1 -- 172.21.15.71:0/3682207414 wait complete. 2024-08-19T11:20:26.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.231+0000 7f5f78a0e640 10 monclient: monmap: 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.250 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 Processor -- start 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 -- start start 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient: init 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient: _add_conns ranks=[8,7,0,3,6,4,1,2,5] 2024-08-19T11:20:26.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 0x7f5f741ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): picked mon.noname-e con 0x7f5f74132970 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5f74132d50 0x7f5f741ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): picked mon.noname-i con 0x7f5f74132d50 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74133130 0x7f5f7412d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): picked mon.noname-a con 0x7f5f74133130 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f740a2720 con 0x7f5f74133130 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f5f740a1600 con 0x7f5f74132d50 2024-08-19T11:20:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f5f741366b0 con 0x7f5f74132970 2024-08-19T11:20:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f78a0e640 10 monclient(hunting): authenticate will time out at 1284.273904s 2024-08-19T11:20:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.232+0000 7f5f7259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 0x7f5f741ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74133130 0x7f5f7412d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 0x7f5f741ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:48866/0 (socket says 172.21.15.71:48866) 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 -- 172.21.15.71:0/858064737 learned_addr learned my addr 172.21.15.71:0/858064737 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): get_auth_request con 0x7f5f74132970 auth_method 0 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): get_auth_request con 0x7f5f74133130 auth_method 0 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5f74132d50 0x7f5f741ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): get_auth_request con 0x7f5f74132d50 auth_method 0 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient(hunting): handle_auth_done global_id 114290 payload 824 2024-08-19T11:20:26.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5f74132d50 msgr2=0x7f5f741ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f5f74132d50 0x7f5f741ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74133130 msgr2=0x7f5f7412d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74133130 0x7f5f7412d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 monclient: found mon.noname-e 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f7259c640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f74130170 con 0x7f5f74132970 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.233+0000 7f5f72d9d640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f74133130 0x7f5f7412d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f7259c640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 msgr2=0x7f5f741ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f7259c640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 0x7f5f741ca1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400a890 tx=0x7f5f640046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f64038040 con 0x7f5f74132970 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: dump: 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.257 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f64041070 con 0x7f5f74132970 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f78a0e640 5 monclient: authenticate success, global_id 114290 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f7159a640 4 set_mon_vals no callback set 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f78a0e640 10 monclient: _renew_subs 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f78a0e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7412fe90 con 0x7f5f74132970 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f64030ea0 con 0x7f5f74132970 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.235+0000 7f5f6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.236+0000 7f5f6affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.236+0000 7f5f6affd640 10 monclient: dump: 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.259 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.260 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.236+0000 7f5f78a0e640 10 monclient: _renew_subs 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.236+0000 7f5f78a0e640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.236+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f74073ec0 con 0x7f5f74132970 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.236+0000 7f5f78a0e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 0x7f5f7412dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7406a590 con 0x7f5f7412d970 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5f64033650 con 0x7f5f74132970 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 0x7f5f7412dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6affd640 1 --2- 172.21.15.71:0/858064737 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f5403e9b0 0x7f5f54040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient: get_auth_request con 0x7f5f7412d970 auth_method 0 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7f5f64071c40 con 0x7f5f74132970 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f72d9d640 1 --2- 172.21.15.71:0/858064737 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f5403e9b0 0x7f5f54040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f72d9d640 10 monclient: get_auth_request con 0x7f5f5403e9b0 auth_method 0 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_done global_id 46065 payload 824 2024-08-19T11:20:26.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.237+0000 7f5f6bfff640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f74131eb0 con 0x7f5f7412d970 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: starting. 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28765 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: created object 0... 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: created object 25... 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: created object 49... 2024-08-19T11:20:26.263 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: finishing. 2024-08-19T11:20:26.264 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28800]: shutting down. 2024-08-19T11:20:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.239+0000 7f5f6bfff640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 msgr2=0x7f5f7412dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.239+0000 7f5f6bfff640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 0x7f5f7412dd50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00ea70 tx=0x7f5f5c00ef30 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.239+0000 7f5f72d9d640 1 --2- 172.21.15.71:0/858064737 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f5403e9b0 0x7f5f54040e70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c003de0 tx=0x7f5f6c0097b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f5c01a070 con 0x7f5f7412d970 2024-08-19T11:20:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 10 monclient: dump: 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.267 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f5c00cc50 con 0x7f5f7412d970 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 msgr2=0x7f5f7412dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 0x7f5f7412dd50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00ea70 tx=0x7f5f5c00ef30 comp rx=0 tx=0).stop 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 msgr2=0x7f5f7412dd50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.240+0000 7f5f6affd640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f7412d970 0x7f5f7412dd50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f78a0e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 0x7f5f741346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f78a0e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5f74136230 con 0x7f5f741342d0 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 0x7f5f741346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient: get_auth_request con 0x7f5f741342d0 auth_method 0 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 10 monclient(hunting): handle_auth_done global_id 46074 payload 824 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.247+0000 7f5f6bfff640 1 -- 172.21.15.71:0/858064737 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f7412e290 con 0x7f5f741342d0 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.249+0000 7f5f6bfff640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 msgr2=0x7f5f741346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.249+0000 7f5f6bfff640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 0x7f5f741346e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c017000 tx=0x7f5f5c004940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f5c01a050 con 0x7f5f741342d0 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 10 monclient: dump: 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.270 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f5f5c01b040 con 0x7f5f741342d0 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:26.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 msgr2=0x7f5f741346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 0x7f5f741346e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c017000 tx=0x7f5f5c004940 comp rx=0 tx=0).stop 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 msgr2=0x7f5f741346e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f6affd640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f741342d0 0x7f5f741346e0 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c017000 tx=0x7f5f5c004940 comp rx=0 tx=0).stop 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:26.272 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 395272, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:20:26.273 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.274 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:26.274 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:26.274 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.274 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.274 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:26.276 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:26.277 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.278 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.280 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.282 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:26.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:26.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.295 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:26.296 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f5403e9b0 msgr2=0x7f5f54040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/858064737 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f5403e9b0 0x7f5f54040e70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c003de0 tx=0x7f5f6c0097b0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 10 monclient: shutdown 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 msgr2=0x7f5f741ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 --2- 172.21.15.71:0/858064737 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f74132970 0x7f5f741ca1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400a890 tx=0x7f5f640046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f72d9d640 1 -- 172.21.15.71:0/858064737 reap_dead start 2024-08-19T11:20:26.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f72d9d640 1 -- 172.21.15.71:0/858064737 reap_dead start 2024-08-19T11:20:26.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 shutdown_connections 2024-08-19T11:20:26.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 >> 172.21.15.71:0/858064737 conn(0x7f5f740a4e70 msgr2=0x7f5f74133650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 shutdown_connections 2024-08-19T11:20:26.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.250+0000 7f5f78a0e640 1 -- 172.21.15.71:0/858064737 wait complete. 2024-08-19T11:20:26.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:26.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:20:26.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:20:26.300 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:26.300 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28802]: starting. 2024-08-19T11:20:26.300 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28802]: listing objects. 2024-08-19T11:20:26.300 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28802]: listed object 0... 2024-08-19T11:20:26.300 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28802]: listed object 25... 2024-08-19T11:20:26.301 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28802]: saw 50 objects 2024-08-19T11:20:26.301 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28802]: shutting down. 2024-08-19T11:20:26.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.435+0000 7f77c2c48640 10 monclient: get_monmap_and_config 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.435+0000 7f77c2c48640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.435+0000 7f77c2c48640 10 monclient: monmap: 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:26.436574+0000 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:26.436574+0000 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.437 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.438 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.439 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.439 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:26.439 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:26.439 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.436+0000 7f77c2c48640 1 Processor -- start 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.436+0000 7f77c2c48640 1 -- start start 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.436+0000 7f77c2c48640 10 monclient: init 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient: _add_conns ranks=[4,3,7,1,8,2,5,0,10,6,9] 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 0x7f77bc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): picked mon.noname-c con 0x7f77bc0a6950 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77bc0a57c0 0x7f77bc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): picked mon.noname-g con 0x7f77bc0a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f77bc139710 0x7f77bc139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): picked mon.noname-i con 0x7f77bc139710 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc0a5020 con 0x7f77bc0a57c0 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f77bc0a77b0 con 0x7f77bc0a6950 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f77bc0a7d40 con 0x7f77bc139710 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c2c48640 10 monclient(hunting): authenticate will time out at 1284.478180s 2024-08-19T11:20:26.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 0x7f77bc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 0x7f77bc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59266/0 (socket says 172.21.15.71:59266) 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 -- 172.21.15.71:0/921475038 learned_addr learned my addr 172.21.15.71:0/921475038 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): get_auth_request con 0x7f77bc0a6950 auth_method 0 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient(hunting): handle_auth_done global_id 85234 payload 274 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77bbfff640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77bc0a57c0 0x7f77bc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 -- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f77bc139710 msgr2=0x7f77bc139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f77bc139710 0x7f77bc139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 -- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77bc0a57c0 msgr2=0x7f77bc0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77bc0a57c0 0x7f77bc0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 monclient: found mon.noname-c 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.437+0000 7f77c09e4640 1 -- 172.21.15.71:0/921475038 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc0a6380 con 0x7f77bc0a6950 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77c09e4640 1 -- 172.21.15.71:0/921475038 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 msgr2=0x7f77bc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77c09e4640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 0x7f77bc0a6d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77b00098d0 tx=0x7f77b002a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a48e85b8ffa30876 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 1 -- 172.21.15.71:0/921475038 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77b0037070 con 0x7f77bc0a6950 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: dump: 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.452 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.453 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 1 -- 172.21.15.71:0/921475038 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b00307b0 con 0x7f77bc0a6950 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77c2c48640 5 monclient: authenticate success, global_id 85234 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77c2c48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 1 -- 172.21.15.71:0/921475038 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77b0030e50 con 0x7f77bc0a6950 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77c2c48640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77c2c48640 4 set_mon_vals no callback set 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.440+0000 7f77bb7fe640 10 monclient: dump: 2024-08-19T11:20:26.455 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 10 monclient: shutdown 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 -- 172.21.15.71:0/921475038 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 msgr2=0x7f77bc0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 0x7f77bc0a6d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77b00098d0 tx=0x7f77b002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 -- 172.21.15.71:0/921475038 shutdown_connections 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f77bc139710 0x7f77bc139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77bc0a57c0 0x7f77bc0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 --2- 172.21.15.71:0/921475038 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f77bc0a6950 0x7f77bc0a6d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 -- 172.21.15.71:0/921475038 >> 172.21.15.71:0/921475038 conn(0x7f77bc0abf50 msgr2=0x7f77bc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 -- 172.21.15.71:0/921475038 shutdown_connections 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 1 -- 172.21.15.71:0/921475038 wait complete. 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.441+0000 7f77c2c48640 10 monclient: monmap: 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 Processor -- start 2024-08-19T11:20:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 -- start start 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient: init 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient: _add_conns ranks=[1,6,5,2,7,8,0,3,4] 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0a57c0 0x7f77bc1ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): picked mon.noname-f con 0x7f77bc0a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 0x7f77bc138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): picked mon.noname-d con 0x7f77bc0a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc139710 0x7f77bc138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): picked mon.noname-h con 0x7f77bc139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0a84c0 con 0x7f77bc0a57c0 2024-08-19T11:20:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f77bc0a3650 con 0x7f77bc139710 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f77bc0a8700 con 0x7f77bc0a6950 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c2c48640 10 monclient(hunting): authenticate will time out at 1284.483704s 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 0x7f77bc138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 0x7f77bc138a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36878/0 (socket says 172.21.15.71:36878) 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 1 -- 172.21.15.71:0/3317064488 learned_addr learned my addr 172.21.15.71:0/3317064488 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): get_auth_request con 0x7f77bc0a6950 auth_method 0 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0a57c0 0x7f77bc1ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): get_auth_request con 0x7f77bc0a57c0 auth_method 0 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc139710 0x7f77bc138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 10 monclient(hunting): get_auth_request con 0x7f77bc139710 auth_method 0 2024-08-19T11:20:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.442+0000 7f77c11e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77c11e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 10 monclient(hunting): handle_auth_done global_id 104595 payload 824 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc139710 msgr2=0x7f77bc138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc139710 0x7f77bc138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0a57c0 msgr2=0x7f77bc1ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0a57c0 0x7f77bc1ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 1 monclient: found mon.noname-d 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.443+0000 7f77bbfff640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc1240f0 con 0x7f77bc0a6950 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77bbfff640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 msgr2=0x7f77bc138a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77bbfff640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 0x7f77bc138a90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c820 tx=0x7f77a800cce0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77a8015070 con 0x7f77bc0a6950 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: dump: 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a800ce10 con 0x7f77bc0a6950 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 5 monclient: authenticate success, global_id 104595 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 10 monclient: _renew_subs 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc0a1e30 con 0x7f77bc0a6950 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77a8011860 con 0x7f77bc0a6950 2024-08-19T11:20:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77b97fa640 10 monclient: dump: 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.468 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 10 monclient: _renew_subs 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77baffd640 4 set_mon_vals no callback set 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.445+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc126450 con 0x7f77bc0a6950 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c2c48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c2c48640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 0x7f77bc02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f77bc076c60 con 0x7f77bc122da0 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f77a80113f0 con 0x7f77bc0a6950 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 0x7f77bc02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient: get_auth_request con 0x7f77bc122da0 auth_method 0 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77b97fa640 1 --2- 172.21.15.71:0/3317064488 >> v2:172.21.15.135:6800/726754104 conn(0x7f77a003ea80 0x7f77a0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7f77a8051740 con 0x7f77bc0a6950 2024-08-19T11:20:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 10 monclient(hunting): handle_auth_done global_id 46346 payload 824 2024-08-19T11:20:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c09e4640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77bc0a2060 con 0x7f77bc122da0 2024-08-19T11:20:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c11e5640 1 --2- 172.21.15.71:0/3317064488 >> v2:172.21.15.135:6800/726754104 conn(0x7f77a003ea80 0x7f77a0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.446+0000 7f77c11e5640 10 monclient: get_auth_request con 0x7f77a003ea80 auth_method 0 2024-08-19T11:20:26.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.448+0000 7f77c09e4640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 msgr2=0x7f77bc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.448+0000 7f77c09e4640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 0x7f77bc02d1c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f77b00098a0 tx=0x7f77b00046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77b0041070 con 0x7f77bc122da0 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 10 monclient: dump: 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.476 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77c11e5640 1 --2- 172.21.15.71:0/3317064488 >> v2:172.21.15.135:6800/726754104 conn(0x7f77a003ea80 0x7f77a0040f40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f77bc074f90 tx=0x7f77b400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f77b0003af0 con 0x7f77bc122da0 2024-08-19T11:20:26.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 msgr2=0x7f77bc02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 0x7f77bc02d1c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f77b00098a0 tx=0x7f77b00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 msgr2=0x7f77bc02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.449+0000 7f77b97fa640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc122da0 0x7f77bc02d1c0 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f77b00098a0 tx=0x7f77b00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c2c48640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c2c48640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 0x7f77bc02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c2c48640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f77bc0a6d30 con 0x7f77bc123180 2024-08-19T11:20:26.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 0x7f77bc02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient: get_auth_request con 0x7f77bc123180 auth_method 0 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.455+0000 7f77c09e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.456+0000 7f77c09e4640 10 monclient(hunting): handle_auth_done global_id 46355 payload 824 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.456+0000 7f77c09e4640 1 -- 172.21.15.71:0/3317064488 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77bc09e100 con 0x7f77bc123180 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77c09e4640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 msgr2=0x7f77bc02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77c09e4640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 0x7f77bc02d700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77b00097c0 tx=0x7f77b0009240 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f77b0037040 con 0x7f77bc123180 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 10 monclient: dump: 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.480 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f77b0032440 con 0x7f77bc123180 2024-08-19T11:20:26.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:26.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:26.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 msgr2=0x7f77bc02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 0x7f77bc02d700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f77b00097c0 tx=0x7f77b0009240 comp rx=0 tx=0).stop 2024-08-19T11:20:26.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 msgr2=0x7f77bc02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.458+0000 7f77b97fa640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f77bc123180 0x7f77bc02d700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 395481, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:26.483 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 6, 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.484 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.485 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:26.486 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:26.487 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:26.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.489 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:26.490 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.493 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.495 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:26.496 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:26.500 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:26.501 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.502 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.503 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.506 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:26.508 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 >> v2:172.21.15.135:6800/726754104 conn(0x7f77a003ea80 msgr2=0x7f77a0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 --2- 172.21.15.71:0/3317064488 >> v2:172.21.15.135:6800/726754104 conn(0x7f77a003ea80 0x7f77a0040f40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f77bc074f90 tx=0x7f77b400d040 comp rx=0 tx=0).stop 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 10 monclient: shutdown 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 msgr2=0x7f77bc138a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 --2- 172.21.15.71:0/3317064488 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f77bc0a6950 0x7f77bc138a90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c820 tx=0x7f77a800cce0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c11e5640 1 -- 172.21.15.71:0/3317064488 reap_dead start 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c11e5640 1 -- 172.21.15.71:0/3317064488 reap_dead start 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 shutdown_connections 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 >> 172.21.15.71:0/3317064488 conn(0x7f77bc0abf50 msgr2=0x7f77bc0aad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 shutdown_connections 2024-08-19T11:20:26.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.459+0000 7f77c2c48640 1 -- 172.21.15.71:0/3317064488 wait complete. 2024-08-19T11:20:26.512 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:26.512 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:20:26.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:20:26.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.542 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=364320196}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1819055677}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2041819293}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.543 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=935727885}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3860430429}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=293010126}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2727576215}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3839175003}) 2024-08-19T11:20:26.544 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.541+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=706114972}) 2024-08-19T11:20:26.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.610+0000 7f54d1602640 10 monclient: get_monmap_and_config 2024-08-19T11:20:26.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.610+0000 7f54d1602640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.610+0000 7f54d1602640 10 monclient: monmap: 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:26.611558+0000 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:26.611558+0000 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.612 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.613 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.613 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.613 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:26.613 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:26.613 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.611+0000 7f54d1602640 1 Processor -- start 2024-08-19T11:20:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.611+0000 7f54d1602640 1 -- start start 2024-08-19T11:20:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.611+0000 7f54d1602640 10 monclient: init 2024-08-19T11:20:26.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient: _add_conns ranks=[3,6,1,0,7,5,2,8,4,10,9] 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54cc0a6950 0x7f54cc0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): picked mon.noname-g con 0x7f54cc0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 0x7f54cc0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): picked mon.noname-d con 0x7f54cc0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f54cc139710 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc0a6380 con 0x7f54cc139710 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0a5020 con 0x7f54cc0a6950 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f54cc0a77b0 con 0x7f54cc0a57c0 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54d1602640 10 monclient(hunting): authenticate will time out at 1284.653163s 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 0x7f54cc0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 0x7f54cc0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36890/0 (socket says 172.21.15.71:36890) 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1082325149 learned_addr learned my addr 172.21.15.71:0/1082325149 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): get_auth_request con 0x7f54cc0a57c0 auth_method 0 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54caffd640 1 --2- 172.21.15.71:0/1082325149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54cc0a6950 0x7f54cc0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_done global_id 104604 payload 274 2024-08-19T11:20:26.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1082325149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54cc0a6950 msgr2=0x7f54cc0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 --2- 172.21.15.71:0/1082325149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54cc0a6950 0x7f54cc0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1082325149 >> v1:172.21.15.135:6789/0 conn(0x7f54cc139710 legacy=0x7f54cc139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 monclient: found mon.noname-d 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:26.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.612+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1082325149 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc0a3650 con 0x7f54cc0a57c0 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1082325149 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 msgr2=0x7f54cc0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54ca7fc640 1 --2- 172.21.15.71:0/1082325149 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 0x7f54cc0a7270 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54c00098d0 tx=0x7f54c002a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=5731af3221049a7d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 1 -- 172.21.15.71:0/1082325149 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f54c0037070 con 0x7f54cc0a57c0 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: dump: 2024-08-19T11:20:26.626 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.627 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54d1602640 5 monclient: authenticate success, global_id 104604 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 1 -- 172.21.15.71:0/1082325149 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c00307b0 con 0x7f54cc0a57c0 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54d1602640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54d1602640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 1 -- 172.21.15.71:0/1082325149 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f54c0030e10 con 0x7f54cc0a57c0 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54d1602640 4 set_mon_vals no callback set 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54c9ffb640 10 monclient: dump: 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.629 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54d1602640 10 monclient: shutdown 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.615+0000 7f54d1602640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 -- 172.21.15.71:0/1082325149 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 msgr2=0x7f54cc0a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 --2- 172.21.15.71:0/1082325149 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 0x7f54cc0a7270 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54c00098d0 tx=0x7f54c002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 -- 172.21.15.71:0/1082325149 shutdown_connections 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 --2- 172.21.15.71:0/1082325149 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f54cc0a57c0 0x7f54cc0a7270 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 --2- 172.21.15.71:0/1082325149 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54cc0a6950 0x7f54cc0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 -- 172.21.15.71:0/1082325149 >> 172.21.15.71:0/1082325149 conn(0x7f54cc0abf50 msgr2=0x7f54cc0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 -- 172.21.15.71:0/1082325149 shutdown_connections 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 1 -- 172.21.15.71:0/1082325149 wait complete. 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.616+0000 7f54d1602640 10 monclient: monmap: 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.631 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 Processor -- start 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 -- start start 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient: init 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient: _add_conns ranks=[7,2,5,4,1,3,0,6,8] 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc0a57c0 0x7f54cc1272f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): picked mon.noname-i con 0x7f54cc0a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:26.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 0x7f54cc1ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): picked mon.noname-b con 0x7f54cc0a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f54cc139710 0x7f54cc1cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): picked mon.noname-h con 0x7f54cc139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0a84c0 con 0x7f54cc0a6950 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f54cc0a7d40 con 0x7f54cc139710 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f54cc0a8700 con 0x7f54cc0a57c0 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54d1602640 10 monclient(hunting): authenticate will time out at 1284.658683s 2024-08-19T11:20:26.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 0x7f54cc1ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 0x7f54cc1ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:34990/0 (socket says 172.21.15.71:34990) 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1424031584 learned_addr learned my addr 172.21.15.71:0/1424031584 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): get_auth_request con 0x7f54cc0a6950 auth_method 0 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc0a57c0 0x7f54cc1272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f54cc139710 0x7f54cc1cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): get_auth_request con 0x7f54cc139710 auth_method 0 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 10 monclient(hunting): get_auth_request con 0x7f54cc0a57c0 auth_method 0 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.617+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 10 monclient(hunting): handle_auth_done global_id 75674 payload 824 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc0a57c0 msgr2=0x7f54cc1272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc0a57c0 0x7f54cc1272f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f54cc139710 msgr2=0x7f54cc1cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f54cc139710 0x7f54cc1cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 1 monclient: found mon.noname-b 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.618+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc127c80 con 0x7f54cc0a6950 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54ca7fc640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 msgr2=0x7f54cc1ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54ca7fc640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 0x7f54cc1ce940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54c00098d0 tx=0x7f54c00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f54c0041020 con 0x7f54cc0a6950 2024-08-19T11:20:26.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: dump: 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.637 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c0030b70 con 0x7f54cc0a6950 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 5 monclient: authenticate success, global_id 75674 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 10 monclient: _renew_subs 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:26.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc128af0 con 0x7f54cc0a6950 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f54c0037040 con 0x7f54cc0a6950 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54b37fe640 10 monclient: dump: 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.639 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54c97fa640 4 set_mon_vals no callback set 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 10 monclient: _renew_subs 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.620+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc126790 con 0x7f54cc0a6950 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54d1602640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54d1602640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 0x7f54cc125460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f54cc0a20b0 con 0x7f54cc1cf3c0 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f54c0044020 con 0x7f54cc0a6950 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 0x7f54cc125460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient: get_auth_request con 0x7f54cc1cf3c0 auth_method 0 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54b37fe640 1 --2- 172.21.15.71:0/1424031584 >> v2:172.21.15.135:6800/726754104 conn(0x7f54b803eab0 0x7f54b8040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7f54c0071f90 con 0x7f54cc0a6950 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54cb7fe640 1 --2- 172.21.15.71:0/1424031584 >> v2:172.21.15.135:6800/726754104 conn(0x7f54b803eab0 0x7f54b8040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 10 monclient(hunting): handle_auth_done global_id 85174 payload 824 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.621+0000 7f54caffd640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54cc1cf7a0 con 0x7f54cc1cf3c0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.622+0000 7f54cb7fe640 10 monclient: get_auth_request con 0x7f54b803eab0 auth_method 0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54caffd640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 msgr2=0x7f54cc125460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54caffd640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 0x7f54cc125460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00f7e0 tx=0x7f54bc00fca0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f54bc00dc30 con 0x7f54cc1cf3c0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54cb7fe640 1 --2- 172.21.15.71:0/1424031584 >> v2:172.21.15.135:6800/726754104 conn(0x7f54b803eab0 0x7f54b8040f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0a27e0 tx=0x7f54c400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 10 monclient: dump: 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.642 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f54bc00dc30 con 0x7f54cc1cf3c0 2024-08-19T11:20:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 msgr2=0x7f54cc125460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 0x7f54cc125460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00f7e0 tx=0x7f54bc00fca0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 msgr2=0x7f54cc125460 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.624+0000 7f54b37fe640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc1cf3c0 0x7f54cc125460 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00f7e0 tx=0x7f54bc00fca0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.630+0000 7f54d1602640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.630+0000 7f54d1602640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 0x7f54cc02d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.630+0000 7f54d1602640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.630+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f54cc076c60 con 0x7f54cc02d1c0 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 0x7f54cc02d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient: get_auth_request con 0x7f54cc02d1c0 auth_method 0 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 10 monclient(hunting): handle_auth_done global_id 85183 payload 824 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.631+0000 7f54caffd640 1 -- 172.21.15.71:0/1424031584 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f54cc1385b0 con 0x7f54cc02d1c0 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.633+0000 7f54caffd640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 msgr2=0x7f54cc02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.633+0000 7f54caffd640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 0x7f54cc02d5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f54bc019000 tx=0x7f54bc004730 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.633+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f54bc013e10 con 0x7f54cc02d1c0 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.633+0000 7f54b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.633+0000 7f54b37fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.633+0000 7f54b37fe640 10 monclient: dump: 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.647 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f54bc013e10 con 0x7f54cc02d1c0 2024-08-19T11:20:26.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 msgr2=0x7f54cc02d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 0x7f54cc02d5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f54bc019000 tx=0x7f54bc004730 comp rx=0 tx=0).stop 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 msgr2=0x7f54cc02d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54b37fe640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f54cc02d1c0 0x7f54cc02d5d0 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f54bc019000 tx=0x7f54bc004730 comp rx=0 tx=0).stop 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:26.649 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 190, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 208794, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.650 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 7, 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.651 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.652 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:26.653 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:26.654 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.655 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:26.656 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.657 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.659 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.660 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.663 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:26.664 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.667 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:26.668 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.669 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:26.670 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.672 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.673 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:26.674 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:26.675 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 >> v2:172.21.15.135:6800/726754104 conn(0x7f54b803eab0 msgr2=0x7f54b8040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 --2- 172.21.15.71:0/1424031584 >> v2:172.21.15.135:6800/726754104 conn(0x7f54b803eab0 0x7f54b8040f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0a27e0 tx=0x7f54c400d040 comp rx=0 tx=0).stop 2024-08-19T11:20:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 10 monclient: shutdown 2024-08-19T11:20:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 msgr2=0x7f54cc1ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 --2- 172.21.15.71:0/1424031584 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f54cc0a6950 0x7f54cc1ce940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54c00098d0 tx=0x7f54c00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54cb7fe640 1 -- 172.21.15.71:0/1424031584 reap_dead start 2024-08-19T11:20:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54cb7fe640 1 -- 172.21.15.71:0/1424031584 reap_dead start 2024-08-19T11:20:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 shutdown_connections 2024-08-19T11:20:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 >> 172.21.15.71:0/1424031584 conn(0x7f54cc0abf50 msgr2=0x7f54cc138ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 shutdown_connections 2024-08-19T11:20:26.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.634+0000 7f54d1602640 1 -- 172.21.15.71:0/1424031584 wait complete. 2024-08-19T11:20:26.678 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:20:26.679 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e'] 2024-08-19T11:20:26.679 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-08-19T11:20:26.679 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-08-19T11:20:26.679 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-08-19T11:20:26.679 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-19T11:20:26.679 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:20:26.721 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.721 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=448268216}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3487032592}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3195140478}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1456965280}) 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.722 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3381647731}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4102484478}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1258390391}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3230975134}) 2024-08-19T11:20:26.723 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:20:26.719+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3033019283}) 2024-08-19T11:20:26.729 INFO:tasks.ceph.mon.e:Stopped 2024-08-19T11:20:26.729 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-08-19T11:20:26.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:26.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.865+0000 7ff4576af640 10 monclient: get_monmap_and_config 2024-08-19T11:20:26.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.865+0000 7ff4576af640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.865+0000 7ff4576af640 10 monclient: monmap: 2024-08-19T11:20:26.866 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.866 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:26.866067+0000 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:26.866067+0000 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.867 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:26.868 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:26.868 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 Processor -- start 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 -- start start 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient: init 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient: _add_conns ranks=[10,4,6,1,7,2,0,5,9,8,3] 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff4500a6a30 0x7ff4500a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): picked mon.noname-f con 0x7ff4500a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 0x7ff4500a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): picked mon.noname-c con 0x7ff4500a6e10 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 0x7ff450139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): picked mon.noname-d con 0x7ff450139860 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff4500a4f90 con 0x7ff4500a6a30 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff4500a6380 con 0x7ff4500a6e10 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff4500a49d0 con 0x7ff450139860 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff4576af640 10 monclient(hunting): authenticate will time out at 1284.907806s 2024-08-19T11:20:26.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff454c4a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 0x7ff4500a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 0x7ff450139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 0x7ff450139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36896/0 (socket says 172.21.15.71:36896) 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff454c4a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 0x7ff4500a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59272/0 (socket says 172.21.15.71:59272) 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 1 -- 172.21.15.71:0/4077953299 learned_addr learned my addr 172.21.15.71:0/4077953299 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 10 monclient(hunting): get_auth_request con 0x7ff450139860 auth_method 0 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff455c4c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff454c4a640 10 monclient(hunting): get_auth_request con 0x7ff4500a6e10 auth_method 0 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff454c4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff454c4a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.866+0000 7ff454c4a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 1 --2- 172.21.15.71:0/4077953299 >> v2:172.21.15.135:3300/0 conn(0x7ff4500a6a30 0x7ff4500a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): get_auth_request con 0x7ff4500a6a30 auth_method 0 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff455c4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff455c4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff455c4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff45544b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 10 monclient(hunting): handle_auth_done global_id 85243 payload 274 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 1 -- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 msgr2=0x7ff450139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 1 --2- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 0x7ff450139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 1 -- 172.21.15.71:0/4077953299 >> v2:172.21.15.135:3300/0 conn(0x7ff4500a6a30 msgr2=0x7ff4500a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 1 --2- 172.21.15.71:0/4077953299 >> v2:172.21.15.135:3300/0 conn(0x7ff4500a6a30 0x7ff4500a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 1 monclient: found mon.noname-c 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff454c4a640 1 -- 172.21.15.71:0/4077953299 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4500a46f0 con 0x7ff4500a6e10 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.867+0000 7ff455c4c640 1 --2- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 0x7ff450139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff454c4a640 1 -- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 msgr2=0x7ff4500a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff454c4a640 1 --2- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 0x7ff4500a71f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4440097d0 tx=0x7ff44402a000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=5eeb297f4637a551 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 1 -- 172.21.15.71:0/4077953299 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff444037070 con 0x7ff4500a6e10 2024-08-19T11:20:26.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: dump: 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.877 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 1 -- 172.21.15.71:0/4077953299 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44402ad20 con 0x7ff4500a6e10 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 5 monclient: authenticate success, global_id 85243 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:26.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 1 -- 172.21.15.71:0/4077953299 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff444030c20 con 0x7ff4500a6e10 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 4 set_mon_vals no callback set 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff44ffff640 10 monclient: dump: 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.879 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 10 monclient: shutdown 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:26.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 -- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 msgr2=0x7ff4500a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 --2- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 0x7ff4500a71f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4440097d0 tx=0x7ff44402a000 comp rx=0 tx=0).stop 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 -- 172.21.15.71:0/4077953299 shutdown_connections 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 --2- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff450139860 0x7ff450139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 --2- 172.21.15.71:0/4077953299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6e10 0x7ff4500a71f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 --2- 172.21.15.71:0/4077953299 >> v2:172.21.15.135:3300/0 conn(0x7ff4500a6a30 0x7ff4500a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 -- 172.21.15.71:0/4077953299 >> 172.21.15.71:0/4077953299 conn(0x7ff4500ac030 msgr2=0x7ff4500ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 -- 172.21.15.71:0/4077953299 shutdown_connections 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.870+0000 7ff4576af640 1 -- 172.21.15.71:0/4077953299 wait complete. 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.871+0000 7ff4576af640 10 monclient: build_initial_monmap 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.871+0000 7ff4576af640 10 monclient: monmap: 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:26.881 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:26.882 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.871+0000 7ff4576af640 1 Processor -- start 2024-08-19T11:20:26.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.871+0000 7ff4576af640 1 -- start start 2024-08-19T11:20:26.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.871+0000 7ff4576af640 10 monclient: init 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient: _add_conns ranks=[4,0,8,1,5,3,7,6,2] 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 0x7ff4501ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): picked mon.noname-c con 0x7ff4500a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4500a6e10 0x7ff450138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): picked mon.noname-a con 0x7ff4500a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff450139860 0x7ff450122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): picked mon.noname-e con 0x7ff450139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500a7730 con 0x7ff4500a6e10 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff45013a200 con 0x7ff4500a6a30 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff4501247e0 con 0x7ff450139860 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff4576af640 10 monclient(hunting): authenticate will time out at 1284.913267s 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff455c4c640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff450139860 msgr2=0x7ff450122a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff455c4c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff450139860 0x7ff450122a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 0x7ff4501ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4500a6e10 0x7ff450138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 0x7ff4501ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59282/0 (socket says 172.21.15.71:59282) 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 -- 172.21.15.71:0/2786378333 learned_addr learned my addr 172.21.15.71:0/2786378333 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): get_auth_request con 0x7ff4500a6a30 auth_method 0 2024-08-19T11:20:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): get_auth_request con 0x7ff4500a6e10 auth_method 0 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient(hunting): handle_auth_done global_id 85252 payload 824 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 -- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff450139860 msgr2=0x7ff450122a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff450139860 0x7ff450122a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 -- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4500a6e10 msgr2=0x7ff450138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4500a6e10 0x7ff450138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 monclient: found mon.noname-c 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff45544b640 1 -- 172.21.15.71:0/2786378333 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4500a21f0 con 0x7ff4500a6a30 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.872+0000 7ff454c4a640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4500a6e10 0x7ff450138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.874+0000 7ff45544b640 1 -- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 msgr2=0x7ff4501ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.874+0000 7ff45544b640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 0x7ff4501ce420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff44000e9b0 tx=0x7ff44000ee70 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.874+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff440017070 con 0x7ff4500a6a30 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: dump: 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: _finish_auth 0 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44000cbb0 con 0x7ff4500a6a30 2024-08-19T11:20:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 5 monclient: authenticate success, global_id 85252 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 10 monclient: _renew_subs 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff450126070 con 0x7ff4500a6a30 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff44000cd60 con 0x7ff4500a6a30 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 10 monclient: dump: 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:26.893 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44f7fe640 4 set_mon_vals no callback set 2024-08-19T11:20:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 10 monclient: _renew_subs 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4500a26d0 con 0x7ff4500a6a30 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.875+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff44001a070 con 0x7ff4500a6a30 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff44dffb640 1 --2- 172.21.15.71:0/2786378333 >> v2:172.21.15.135:6800/726754104 conn(0x7ff43c03ea80 0x7ff43c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff4576af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff4576af640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff4576af640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7ff44000f040 con 0x7ff4500a6a30 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff450077340 con 0x7ff4500a6a30 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff454c4a640 1 --2- 172.21.15.71:0/2786378333 >> v2:172.21.15.135:6800/726754104 conn(0x7ff43c03ea80 0x7ff43c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.876+0000 7ff454c4a640 10 monclient: get_auth_request con 0x7ff43c03ea80 auth_method 0 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.878+0000 7ff454c4a640 1 --2- 172.21.15.71:0/2786378333 >> v2:172.21.15.135:6800/726754104 conn(0x7ff43c03ea80 0x7ff43c040f40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff4500a35e0 tx=0x7ff44402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.880+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7ff450077340 con 0x7ff4500a6a30 2024-08-19T11:20:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.880+0000 7ff44dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:26.880+0000 7ff44dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff4576af640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff4576af640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff4576af640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff45013a560 con 0x7ff4500a6a30 2024-08-19T11:20:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff44dffb640 1 -- 172.21.15.71:0/2786378333 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7ff440021070 con 0x7ff4500a6a30 2024-08-19T11:20:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff44dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.123+0000 7ff44dffb640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:27.125 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":190,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:27.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.125+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 >> v2:172.21.15.135:6800/726754104 conn(0x7ff43c03ea80 msgr2=0x7ff43c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:27.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.125+0000 7ff4576af640 1 --2- 172.21.15.71:0/2786378333 >> v2:172.21.15.135:6800/726754104 conn(0x7ff43c03ea80 0x7ff43c040f40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff4500a35e0 tx=0x7ff44402e000 comp rx=0 tx=0).stop 2024-08-19T11:20:27.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.125+0000 7ff4576af640 10 monclient: shutdown 2024-08-19T11:20:27.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.125+0000 7ff4576af640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:27.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.125+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 msgr2=0x7ff4501ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.125+0000 7ff4576af640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 0x7ff4501ce420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff44000e9b0 tx=0x7ff44000ee70 comp rx=0 tx=0).stop 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 shutdown_connections 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 --2- 172.21.15.71:0/2786378333 >> v2:172.21.15.135:6800/726754104 conn(0x7ff43c03ea80 0x7ff43c040f40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4500a6e10 0x7ff450138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff450139860 0x7ff450122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 --2- 172.21.15.71:0/2786378333 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4500a6a30 0x7ff4501ce420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 >> 172.21.15.71:0/2786378333 conn(0x7ff4500ac030 msgr2=0x7ff4501c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 shutdown_connections 2024-08-19T11:20:27.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:27.126+0000 7ff4576af640 1 -- 172.21.15.71:0/2786378333 wait complete. 2024-08-19T11:20:30.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.246+0000 7f21481aa640 10 monclient: get_monmap_and_config 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.246+0000 7f21481aa640 10 monclient: build_initial_monmap 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.246+0000 7f21481aa640 10 monclient: monmap: 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:30.246921+0000 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:30.246921+0000 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:30.247 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:30.248 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.246+0000 7f21481aa640 1 Processor -- start 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 1 -- start start 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient: init 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient: _add_conns ranks=[6,1,7,9,2,3,8,5,10,4,0] 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 0x7f21400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): picked mon.noname-d con 0x7f21400a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f21400a6e10 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f214013ea30 0x7f2140140e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): picked mon.noname-i con 0x7f214013ea30 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21400a4cb0 con 0x7f21400a6e10 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f21400a3650 con 0x7f21400a6a30 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f21400a5d50 con 0x7f214013ea30 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f21481aa640 10 monclient(hunting): authenticate will time out at 1288.288646s 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 0x7f21400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 0x7f21400a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36902/0 (socket says 172.21.15.71:36902) 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 1 -- 172.21.15.71:0/1603817959 learned_addr learned my addr 172.21.15.71:0/1603817959 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): get_auth_request con 0x7f21400a6a30 auth_method 0 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2145f46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2146747640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f214013ea30 0x7f2140140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2146747640 10 monclient(hunting): get_auth_request con 0x7f214013ea30 auth_method 0 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2146747640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2146747640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.247+0000 7f2146747640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 10 monclient(hunting): handle_auth_done global_id 104622 payload 274 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 1 -- 172.21.15.71:0/1603817959 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f214013ea30 msgr2=0x7f2140140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f214013ea30 0x7f2140140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 1 -- 172.21.15.71:0/1603817959 >> v1:172.21.15.135:6789/0 conn(0x7f21400a6e10 legacy=0x7f21400a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:30.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 10 monclient: _finish_hunting 0 2024-08-19T11:20:30.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 1 monclient: found mon.noname-d 2024-08-19T11:20:30.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:30.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:30.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2145f46640 1 -- 172.21.15.71:0/1603817959 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400a4f90 con 0x7f21400a6a30 2024-08-19T11:20:30.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.248+0000 7f2146747640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f214013ea30 0x7f2140140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.250+0000 7f2145f46640 1 -- 172.21.15.71:0/1603817959 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 msgr2=0x7f21400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.250+0000 7f2145f46640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 0x7f21400a5810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f213c0098a0 tx=0x7f213c02a080 comp rx=0 tx=0).ready entity=mon.6 client_cookie=4ae0b9a923f87941 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.250+0000 7f2144f44640 1 -- 172.21.15.71:0/1603817959 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f213c037070 con 0x7f21400a6a30 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: dump: 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: _finish_auth 0 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: _check_auth_tickets 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 1 -- 172.21.15.71:0/1603817959 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c02ade0 con 0x7f21400a6a30 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 5 monclient: authenticate success, global_id 104622 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 1 -- 172.21.15.71:0/1603817959 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f213c030c20 con 0x7f21400a6a30 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 4 set_mon_vals no callback set 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f2144f44640 10 monclient: dump: 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 10 monclient: shutdown 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 -- 172.21.15.71:0/1603817959 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 msgr2=0x7f21400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 0x7f21400a5810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f213c0098a0 tx=0x7f213c02a080 comp rx=0 tx=0).stop 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 -- 172.21.15.71:0/1603817959 shutdown_connections 2024-08-19T11:20:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f214013ea30 0x7f2140140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 --2- 172.21.15.71:0/1603817959 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f21400a6a30 0x7f21400a5810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 -- 172.21.15.71:0/1603817959 >> 172.21.15.71:0/1603817959 conn(0x7f21400ac030 msgr2=0x7f21400ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 -- 172.21.15.71:0/1603817959 shutdown_connections 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.251+0000 7f21481aa640 1 -- 172.21.15.71:0/1603817959 wait complete. 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.252+0000 7f21481aa640 10 monclient: build_initial_monmap 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.252+0000 7f21481aa640 10 monclient: monmap: 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.252+0000 7f21481aa640 1 Processor -- start 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.252+0000 7f21481aa640 1 -- start start 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.252+0000 7f21481aa640 10 monclient: init 2024-08-19T11:20:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient: _add_conns ranks=[0,2,3,4,7,1,6,8,5] 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 0x7f2140125c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): picked mon.noname-a con 0x7f21400a6a30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 0x7f214013caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): picked mon.noname-b con 0x7f21400a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f214013ea30 0x7f21401ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): picked mon.noname-g con 0x7f214013ea30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21400a87d0 con 0x7f21400a6a30 2024-08-19T11:20:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f21400a8590 con 0x7f21400a6e10 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2140141360 con 0x7f214013ea30 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f21481aa640 10 monclient(hunting): authenticate will time out at 1288.294214s 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 0x7f2140125c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 0x7f214013caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 0x7f2140125c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38828/0 (socket says 172.21.15.71:38828) 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 -- 172.21.15.71:0/255000076 learned_addr learned my addr 172.21.15.71:0/255000076 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 0x7f214013caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35002/0 (socket says 172.21.15.71:35002) 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): get_auth_request con 0x7f21400a6a30 auth_method 0 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): get_auth_request con 0x7f21400a6e10 auth_method 0 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:30.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2146747640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f214013ea30 0x7f21401ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient(hunting): handle_auth_done global_id 75708 payload 824 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 -- 172.21.15.71:0/255000076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f214013ea30 msgr2=0x7f21401ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f214013ea30 0x7f21401ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 -- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 msgr2=0x7f214013caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 0x7f214013caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient: _finish_hunting 0 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 monclient: found mon.noname-a 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:30.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145f46640 1 -- 172.21.15.71:0/255000076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214013d790 con 0x7f21400a6a30 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2146747640 10 monclient: get_auth_request con 0x7f214013ea30 auth_method 0 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2146747640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f214013ea30 0x7f21401ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.253+0000 7f2145745640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 0x7f214013caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.255+0000 7f2145f46640 1 -- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 msgr2=0x7f2140125c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.255+0000 7f2145f46640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 0x7f2140125c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f213c02a5a0 tx=0x7f213c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.255+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f213c042070 con 0x7f21400a6a30 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.255+0000 7f21367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.255+0000 7f21367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.255+0000 7f21367fc640 10 monclient: dump: 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 5 monclient: authenticate success, global_id 75708 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c003c50 con 0x7f21400a6a30 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f213c037040 con 0x7f21400a6a30 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 monclient: _renew_subs 2024-08-19T11:20:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21400a9330 con 0x7f21400a6a30 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f2137fff640 4 set_mon_vals no callback set 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21367fc640 10 monclient: dump: 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 monclient: _renew_subs 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2140126be0 con 0x7f21400a6a30 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.256+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2140126e20 con 0x7f21400a6a30 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.257+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f213c032440 con 0x7f21400a6a30 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.257+0000 7f21367fc640 1 --2- 172.21.15.71:0/255000076 >> v2:172.21.15.135:6800/726754104 conn(0x7f212403ea80 0x7f2124040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.257+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7f213c0715b0 con 0x7f21400a6a30 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.257+0000 7f2145745640 1 --2- 172.21.15.71:0/255000076 >> v2:172.21.15.135:6800/726754104 conn(0x7f212403ea80 0x7f2124040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.257+0000 7f2145745640 10 monclient: get_auth_request con 0x7f212403ea80 auth_method 0 2024-08-19T11:20:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.260+0000 7f2145745640 1 --2- 172.21.15.71:0/255000076 >> v2:172.21.15.135:6800/726754104 conn(0x7f212403ea80 0x7f2124040f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2140125c10 tx=0x7f2130007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.261+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f213c032730 con 0x7f21400a6a30 2024-08-19T11:20:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.261+0000 7f21367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.261+0000 7f21367fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.498+0000 7f21481aa640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.498+0000 7f21481aa640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.498+0000 7f21481aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.498+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f21400a5810 con 0x7f21400a6a30 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.499+0000 7f21367fc640 1 -- 172.21.15.71:0/255000076 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3194 (secure 0 0 0) 0x7f213c071370 con 0x7f21400a6a30 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.499+0000 7f21367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.499+0000 7f21367fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:30.500 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":190,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 >> v2:172.21.15.135:6800/726754104 conn(0x7f212403ea80 msgr2=0x7f2124040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 --2- 172.21.15.71:0/255000076 >> v2:172.21.15.135:6800/726754104 conn(0x7f212403ea80 0x7f2124040f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2140125c10 tx=0x7f2130007e30 comp rx=0 tx=0).stop 2024-08-19T11:20:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 10 monclient: shutdown 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 msgr2=0x7f2140125c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 0x7f2140125c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f213c02a5a0 tx=0x7f213c004730 comp rx=0 tx=0).stop 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 shutdown_connections 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 --2- 172.21.15.71:0/255000076 >> v2:172.21.15.135:6800/726754104 conn(0x7f212403ea80 0x7f2124040f40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f214013ea30 0x7f21401ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21400a6e10 0x7f214013caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 --2- 172.21.15.71:0/255000076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21400a6a30 0x7f2140125c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 >> 172.21.15.71:0/255000076 conn(0x7f21400ac030 msgr2=0x7f214013fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 shutdown_connections 2024-08-19T11:20:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:30.501+0000 7f21481aa640 1 -- 172.21.15.71:0/255000076 wait complete. 2024-08-19T11:20:33.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:33.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.623+0000 7ff64c2de640 10 monclient: get_monmap_and_config 2024-08-19T11:20:33.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.623+0000 7ff64c2de640 10 monclient: build_initial_monmap 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.623+0000 7ff64c2de640 10 monclient: monmap: 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:33.624316+0000 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:33.624316+0000 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:33.625 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:33.626 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:33.626 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:33.626 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:33.626 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:33.626 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:33.626 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:33.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.624+0000 7ff64c2de640 1 Processor -- start 2024-08-19T11:20:33.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.624+0000 7ff64c2de640 1 -- start start 2024-08-19T11:20:33.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.624+0000 7ff64c2de640 10 monclient: init 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.624+0000 7ff64c2de640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient: _add_conns ranks=[2,10,6,8,4,1,7,3,9,5,0] 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff6440a6a30 0x7ff6440a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): picked mon.noname-b con 0x7ff6440a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff6440a6e10 0x7ff6440a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): picked mon.noname-f con 0x7ff6440a6e10 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 0x7ff644139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): picked mon.noname-d con 0x7ff644139860 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:33.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff6440a4f90 con 0x7ff6440a6e10 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff6440a6380 con 0x7ff6440a6a30 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff6440a49d0 con 0x7ff644139860 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64c2de640 10 monclient(hunting): authenticate will time out at 1291.666104s 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff6440a6a30 0x7ff6440a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 0x7ff644139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 0x7ff644139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:36904/0 (socket says 172.21.15.71:36904) 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff6440a6a30 0x7ff6440a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35012/0 (socket says 172.21.15.71:35012) 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 -- 172.21.15.71:0/1957585577 learned_addr learned my addr 172.21.15.71:0/1957585577 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:33.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): get_auth_request con 0x7ff644139860 auth_method 0 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): get_auth_request con 0x7ff6440a6a30 auth_method 0 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:33.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a07a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff649879640 1 --2- 172.21.15.71:0/1957585577 >> v2:172.21.15.135:3300/0 conn(0x7ff6440a6e10 0x7ff6440a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff649879640 10 monclient(hunting): get_auth_request con 0x7ff6440a6e10 auth_method 0 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff649879640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff649879640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff649879640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient(hunting): handle_auth_done global_id 104631 payload 274 2024-08-19T11:20:33.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 -- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff6440a6a30 msgr2=0x7ff6440a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 --2- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff6440a6a30 0x7ff6440a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 -- 172.21.15.71:0/1957585577 >> v2:172.21.15.135:3300/0 conn(0x7ff6440a6e10 msgr2=0x7ff6440a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 --2- 172.21.15.71:0/1957585577 >> v2:172.21.15.135:3300/0 conn(0x7ff6440a6e10 0x7ff6440a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 monclient: found mon.noname-d 2024-08-19T11:20:33.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.625+0000 7ff64a87b640 1 -- 172.21.15.71:0/1957585577 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6440a46f0 con 0x7ff644139860 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff64a87b640 1 -- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 msgr2=0x7ff644139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff64a87b640 1 --2- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 0x7ff644139cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e50 tx=0x7ff63c02a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=45437c580e244715 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 1 -- 172.21.15.71:0/1957585577 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff63c036070 con 0x7ff644139860 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: dump: 2024-08-19T11:20:33.639 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:33.640 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: _finish_auth 0 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: _check_auth_tickets 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 1 -- 172.21.15.71:0/1957585577 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63c007a70 con 0x7ff644139860 2024-08-19T11:20:33.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff64c2de640 5 monclient: authenticate success, global_id 104631 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff64c2de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 1 -- 172.21.15.71:0/1957585577 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff63c007c20 con 0x7ff644139860 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff64c2de640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff64c2de640 4 set_mon_vals no callback set 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.628+0000 7ff649078640 10 monclient: dump: 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:33.642 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:33.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 10 monclient: shutdown 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 -- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 msgr2=0x7ff644139cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 --2- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 0x7ff644139cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e50 tx=0x7ff63c02a560 comp rx=0 tx=0).stop 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 -- 172.21.15.71:0/1957585577 shutdown_connections 2024-08-19T11:20:33.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 --2- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff644139860 0x7ff644139cc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 --2- 172.21.15.71:0/1957585577 >> v2:172.21.15.135:3300/0 conn(0x7ff6440a6e10 0x7ff6440a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 --2- 172.21.15.71:0/1957585577 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff6440a6a30 0x7ff6440a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 -- 172.21.15.71:0/1957585577 >> 172.21.15.71:0/1957585577 conn(0x7ff6440ac030 msgr2=0x7ff6440ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 -- 172.21.15.71:0/1957585577 shutdown_connections 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 1 -- 172.21.15.71:0/1957585577 wait complete. 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 10 monclient: build_initial_monmap 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.629+0000 7ff64c2de640 10 monclient: monmap: 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:33.645 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:33.646 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 Processor -- start 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 -- start start 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient: init 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient: _add_conns ranks=[5,8,4,0,1,7,3,6,2] 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff6440a6a30 0x7ff644127260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): picked mon.noname-h con 0x7ff6440a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6440a6e10 0x7ff644124cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): picked mon.noname-e con 0x7ff6440a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 0x7ff644125230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): picked mon.noname-c con 0x7ff644139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:33.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff6440a7730 con 0x7ff644139860 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff64413a200 con 0x7ff6440a6a30 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff644127bf0 con 0x7ff6440a6e10 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64c2de640 10 monclient(hunting): authenticate will time out at 1291.671773s 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff649879640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6440a6e10 msgr2=0x7ff644124cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:20:33.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff649879640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6440a6e10 0x7ff644124cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 0x7ff644125230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 0x7ff644125230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:59296/0 (socket says 172.21.15.71:59296) 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 1 -- 172.21.15.71:0/2409958515 learned_addr learned my addr 172.21.15.71:0/2409958515 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): get_auth_request con 0x7ff644139860 auth_method 0 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.630+0000 7ff64a87b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:33.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a07a640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff6440a6a30 0x7ff644127260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a07a640 10 monclient(hunting): get_auth_request con 0x7ff6440a6a30 auth_method 0 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a07a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a07a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a07a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 10 monclient(hunting): handle_auth_done global_id 85261 payload 824 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 1 -- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6440a6e10 msgr2=0x7ff644124cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6440a6e10 0x7ff644124cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 1 -- 172.21.15.71:0/2409958515 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff6440a6a30 msgr2=0x7ff644127260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff6440a6a30 0x7ff644127260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:33.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 1 monclient: found mon.noname-c 2024-08-19T11:20:33.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:33.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:33.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.631+0000 7ff64a87b640 1 -- 172.21.15.71:0/2409958515 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff644139cd0 con 0x7ff644139860 2024-08-19T11:20:33.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64a87b640 1 -- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 msgr2=0x7ff644125230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:33.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64a87b640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 0x7ff644125230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e20 tx=0x7ff63c004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff63c040020 con 0x7ff644139860 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: dump: 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:33.654 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: _finish_auth 0 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:33.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 5 monclient: authenticate success, global_id 85261 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63c003ba0 con 0x7ff644139860 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff63c036040 con 0x7ff644139860 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 10 monclient: _renew_subs 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6441260a0 con 0x7ff644139860 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff648877640 4 set_mon_vals no callback set 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff63affd640 10 monclient: dump: 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:33.656 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:33.657 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 10 monclient: _renew_subs 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.633+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff644128a60 con 0x7ff644139860 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff63c043020 con 0x7ff644139860 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff64c2de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff64c2de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff64c2de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64413a560 con 0x7ff644139860 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff63affd640 1 --2- 172.21.15.71:0/2409958515 >> v2:172.21.15.135:6800/726754104 conn(0x7ff62803ea80 0x7ff628040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.634+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7ff63c072520 con 0x7ff644139860 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.635+0000 7ff64a07a640 1 --2- 172.21.15.71:0/2409958515 >> v2:172.21.15.135:6800/726754104 conn(0x7ff62803ea80 0x7ff628040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.635+0000 7ff64a07a640 10 monclient: get_auth_request con 0x7ff62803ea80 auth_method 0 2024-08-19T11:20:33.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.637+0000 7ff64a07a640 1 --2- 172.21.15.71:0/2409958515 >> v2:172.21.15.135:6800/726754104 conn(0x7ff62803ea80 0x7ff628040f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff640009ad0 tx=0x7ff640008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:33.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.639+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7ff63c04a030 con 0x7ff644139860 2024-08-19T11:20:33.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.639+0000 7ff63affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:33.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.639+0000 7ff63affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff64c2de640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff64c2de640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff64c2de640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff64406ca70 con 0x7ff644139860 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff63affd640 1 -- 172.21.15.71:0/2409958515 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3194 (secure 0 0 0) 0x7ff63c071290 con 0x7ff644139860 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff63affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.881+0000 7ff63affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:33.883 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":190,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.883+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 >> v2:172.21.15.135:6800/726754104 conn(0x7ff62803ea80 msgr2=0x7ff628040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.883+0000 7ff64c2de640 1 --2- 172.21.15.71:0/2409958515 >> v2:172.21.15.135:6800/726754104 conn(0x7ff62803ea80 0x7ff628040f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff640009ad0 tx=0x7ff640008040 comp rx=0 tx=0).stop 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.883+0000 7ff64c2de640 10 monclient: shutdown 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.883+0000 7ff64c2de640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.883+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 msgr2=0x7ff644125230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.883+0000 7ff64c2de640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 0x7ff644125230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009e20 tx=0x7ff63c004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 shutdown_connections 2024-08-19T11:20:33.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 --2- 172.21.15.71:0/2409958515 >> v2:172.21.15.135:6800/726754104 conn(0x7ff62803ea80 0x7ff628040f40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff644139860 0x7ff644125230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff6440a6e10 0x7ff644124cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 --2- 172.21.15.71:0/2409958515 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff6440a6a30 0x7ff644127260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:33.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 >> 172.21.15.71:0/2409958515 conn(0x7ff6440ac030 msgr2=0x7ff64409eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:33.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 shutdown_connections 2024-08-19T11:20:33.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:33.884+0000 7ff64c2de640 1 -- 172.21.15.71:0/2409958515 wait complete. 2024-08-19T11:20:36.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:20:37.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.004+0000 7fa1a6541640 10 monclient: get_monmap_and_config 2024-08-19T11:20:37.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.004+0000 7fa1a6541640 10 monclient: build_initial_monmap 2024-08-19T11:20:37.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.005+0000 7fa1a6541640 10 monclient: monmap: 2024-08-19T11:20:37.006 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:37.005607+0000 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:37.005607+0000 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:37.007 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.005+0000 7fa1a6541640 1 Processor -- start 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.005+0000 7fa1a6541640 1 -- start start 2024-08-19T11:20:37.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.005+0000 7fa1a6541640 10 monclient: init 2024-08-19T11:20:37.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:37.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient: _add_conns ranks=[1,9,3,7,2,5,8,10,4,6,0] 2024-08-19T11:20:37.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa1a00a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:37.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:37.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): picked mon.noname-a con 0x7fa1a00a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): picked mon.noname-g con 0x7fa1a013eb10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a00a4f90 con 0x7fa1a00a6a30 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a00a3650 con 0x7fa1a00a6e10 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a00a6380 con 0x7fa1a013eb10 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a6541640 10 monclient(hunting): authenticate will time out at 1295.047347s 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54082/0 (socket says 172.21.15.71:54082) 2024-08-19T11:20:37.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 learned_addr learned my addr 172.21.15.71:0/3965850550 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa1a00a6e10 auth_method 0 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa1a013eb10 auth_method 0 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:37.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:37.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:37.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:37.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:37.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.006+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:37.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.008+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v1:172.21.15.135:6789/0 conn(0x7fa1a00a6a30 legacy=0x7fa1a00a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa1a00a6e10 auth_method 0 2024-08-19T11:20:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:37.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa1a013eb10 auth_method 0 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:37.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.207+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa1a00a6e10 auth_method 0 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:37.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa1a013eb10 auth_method 0 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:37.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:37.608+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:20:38.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa1a00a6e10 auth_method 0 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa1a013eb10 auth_method 0 2024-08-19T11:20:38.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:38.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:38.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:38.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:38.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:38.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:38.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:38.409+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:20:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): tick 2024-08-19T11:20:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:20:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 monclient(hunting): continuing hunt 2024-08-19T11:20:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 msgr2=0x7fa1a0140f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1a013eb10 0x7fa1a0140f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 msgr2=0x7fa1a00a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.71:3300/0 conn(0x7fa1a00a6e10 0x7fa1a00a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 -- 172.21.15.71:0/3965850550 >> v1:172.21.15.135:6789/0 conn(0x7fa1a00a6a30 legacy=0x7fa1a00a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient: _add_conns ranks=[10,7,5,6,4,8,2,0] 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): picked mon.noname-f con 0x7fa18c0038a0 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): picked mon.noname-i con 0x7fa18c0062d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): picked mon.noname-h con 0x7fa18c008e40 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 -- 172.21.15.71:0/3965850550 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a00a6380 con 0x7fa18c0038a0 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 -- 172.21.15.71:0/3965850550 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa18c00ba00 con 0x7fa18c008e40 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 1 -- 172.21.15.71:0/3965850550 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa18c00bc00 con 0x7fa18c0062d0 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19dffb640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.006+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 10 monclient(hunting): get_auth_request con 0x7fa18c0038a0 auth_method 0 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa18c0062d0 auth_method 0 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa18c008e40 auth_method 0 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:40.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.007+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 10 monclient(hunting): get_auth_request con 0x7fa18c0038a0 auth_method 0 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa18c0062d0 auth_method 0 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa18c008e40 auth_method 0 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:20:40.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.208+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 10 monclient(hunting): get_auth_request con 0x7fa18c0038a0 auth_method 0 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa18c008e40 auth_method 0 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19ffff640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa18c0062d0 auth_method 0 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:20:40.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:40.609+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa18c008e40 auth_method 0 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa18c0062d0 auth_method 0 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa19f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_done global_id 46382 payload 274 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 msgr2=0x7fa18c008740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa18c0062d0 0x7fa18c008740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 msgr2=0x7fa18c005cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.410+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> v2:172.21.15.135:3300/0 conn(0x7fa18c0038a0 0x7fa18c005cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.411+0000 7fa1a4ade640 10 monclient: _finish_hunting 0 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.411+0000 7fa1a4ade640 1 monclient: found mon.noname-h 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.411+0000 7fa1a4ade640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.411+0000 7fa1a4ade640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.411+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a00a49d0 con 0x7fa18c008e40 2024-08-19T11:20:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.411+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 reap_dead start 2024-08-19T11:20:41.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa1a4ade640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00a3c90 tx=0x7fa19802c1f0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=f9b6789a0e797ccb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 1 -- 172.21.15.71:0/3965850550 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa198032070 con 0x7fa18c008e40 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: dump: 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.418 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: _finish_auth 0 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:41.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 1 -- 172.21.15.71:0/3965850550 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa198035820 con 0x7fa18c008e40 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 1 -- 172.21.15.71:0/3965850550 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa198035e40 con 0x7fa18c008e40 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa19effd640 10 monclient: dump: 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.420 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa1a6541640 5 monclient: authenticate success, global_id 46382 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa1a6541640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.414+0000 7fa1a6541640 4 set_mon_vals no callback set 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 10 monclient: shutdown 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:41.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 -- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 msgr2=0x7fa18c00b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00a3c90 tx=0x7fa19802c1f0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 -- 172.21.15.71:0/3965850550 shutdown_connections 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 --2- 172.21.15.71:0/3965850550 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa18c008e40 0x7fa18c00b300 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 -- 172.21.15.71:0/3965850550 >> 172.21.15.71:0/3965850550 conn(0x7fa1a00ac030 msgr2=0x7fa1a00ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 -- 172.21.15.71:0/3965850550 shutdown_connections 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.415+0000 7fa1a6541640 1 -- 172.21.15.71:0/3965850550 wait complete. 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.416+0000 7fa1a6541640 10 monclient: build_initial_monmap 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.416+0000 7fa1a6541640 10 monclient: monmap: 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:41.422 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.416+0000 7fa1a6541640 1 Processor -- start 2024-08-19T11:20:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 -- start start 2024-08-19T11:20:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient: init 2024-08-19T11:20:41.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient: _add_conns ranks=[1,5,4,7,2,0,3,8,6] 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa18c008e40 0x7fa1a01ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): picked mon.noname-f con 0x7fa18c008e40 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa1a00a1dd0 0x7fa1a00a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): picked mon.noname-h con 0x7fa1a00a1dd0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 0x7fa1a009d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): picked mon.noname-c con 0x7fa1a009cd00 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a00a5970 con 0x7fa18c008e40 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa1a00a57f0 con 0x7fa1a009cd00 2024-08-19T11:20:41.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa1a00a5af0 con 0x7fa1a00a1dd0 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a6541640 10 monclient(hunting): authenticate will time out at 1299.458737s 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 0x7fa1a009d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 0x7fa1a009d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:40640/0 (socket says 172.21.15.71:40640) 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 1 -- 172.21.15.71:0/2836530570 learned_addr learned my addr 172.21.15.71:0/2836530570 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request con 0x7fa1a009cd00 auth_method 0 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.417+0000 7fa1a4ade640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa1a00a1dd0 0x7fa1a00a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request con 0x7fa1a00a1dd0 auth_method 0 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19ffff640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa18c008e40 0x7fa1a01ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19ffff640 10 monclient(hunting): get_auth_request con 0x7fa18c008e40 auth_method 0 2024-08-19T11:20:41.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 10 monclient(hunting): handle_auth_done global_id 85270 payload 824 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 1 -- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa1a00a1dd0 msgr2=0x7fa1a00a2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa1a00a1dd0 0x7fa1a00a2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 1 -- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa18c008e40 msgr2=0x7fa1a01ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa18c008e40 0x7fa1a01ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 10 monclient: _finish_hunting 0 2024-08-19T11:20:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 1 monclient: found mon.noname-c 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa1a4ade640 1 -- 172.21.15.71:0/2836530570 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a009e540 con 0x7fa1a009cd00 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.418+0000 7fa19ffff640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa18c008e40 0x7fa1a01ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa1a4ade640 1 -- 172.21.15.71:0/2836530570 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 msgr2=0x7fa1a009d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa1a4ade640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 0x7fa1a009d140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa198009610 tx=0x7fa198004ab0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa19803fb00 con 0x7fa1a009cd00 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: dump: 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.433 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: _finish_auth 0 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa1a6541640 5 monclient: authenticate success, global_id 85270 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa198045070 con 0x7fa1a009cd00 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa1a6541640 10 monclient: _renew_subs 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa1a6541640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a00a08a0 con 0x7fa1a009cd00 2024-08-19T11:20:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa19803fd00 con 0x7fa1a009cd00 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19cff9640 10 monclient: dump: 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.421+0000 7fa1a6541640 10 monclient: _renew_subs 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.421+0000 7fa1a6541640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.421+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a00a0000 con 0x7fa1a009cd00 2024-08-19T11:20:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.420+0000 7fa19e7fc640 4 set_mon_vals no callback set 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa198015040 con 0x7fa1a009cd00 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa19cff9640 1 --2- 172.21.15.71:0/2836530570 >> v2:172.21.15.135:6800/726754104 conn(0x7fa18c03feb0 0x7fa18c042370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7fa198073f70 con 0x7fa1a009cd00 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa1a6541640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa1a6541640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa1a6541640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a00a71f0 con 0x7fa1a009cd00 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa19ffff640 1 --2- 172.21.15.71:0/2836530570 >> v2:172.21.15.135:6800/726754104 conn(0x7fa18c03feb0 0x7fa18c042370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.422+0000 7fa19ffff640 10 monclient: get_auth_request con 0x7fa18c03feb0 auth_method 0 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.425+0000 7fa19ffff640 1 --2- 172.21.15.71:0/2836530570 >> v2:172.21.15.135:6800/726754104 conn(0x7fa18c03feb0 0x7fa18c042370 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa190000c00 tx=0x7fa190009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.427+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fa198010040 con 0x7fa1a009cd00 2024-08-19T11:20:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.427+0000 7fa19cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.427+0000 7fa19cff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:41.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa1a6541640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:20:41.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa1a6541640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:41.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa1a6541640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:20:41.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa1a009f0a0 con 0x7fa1a009cd00 2024-08-19T11:20:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa19cff9640 1 -- 172.21.15.71:0/2836530570 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7fa19803f690 con 0x7fa1a009cd00 2024-08-19T11:20:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa19cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:20:41.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.672+0000 7fa19cff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:41.674 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":194,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:20:41.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 >> v2:172.21.15.135:6800/726754104 conn(0x7fa18c03feb0 msgr2=0x7fa18c042370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 --2- 172.21.15.71:0/2836530570 >> v2:172.21.15.135:6800/726754104 conn(0x7fa18c03feb0 0x7fa18c042370 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa190000c00 tx=0x7fa190009040 comp rx=0 tx=0).stop 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 10 monclient: shutdown 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 msgr2=0x7fa1a009d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 0x7fa1a009d140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa198009610 tx=0x7fa198004ab0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 shutdown_connections 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 --2- 172.21.15.71:0/2836530570 >> v2:172.21.15.135:6800/726754104 conn(0x7fa18c03feb0 0x7fa18c042370 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa1a009cd00 0x7fa1a009d140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa1a00a1dd0 0x7fa1a00a2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 --2- 172.21.15.71:0/2836530570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa18c008e40 0x7fa1a01ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 >> 172.21.15.71:0/2836530570 conn(0x7fa1a00ac030 msgr2=0x7fa1a0139ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 shutdown_connections 2024-08-19T11:20:41.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.674+0000 7fa1a6541640 1 -- 172.21.15.71:0/2836530570 wait complete. 2024-08-19T11:20:41.687 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-08-19T11:20:41.687 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-08-19T11:20:41.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.788+0000 7fbde966e640 10 monclient: get_monmap_and_config 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.788+0000 7fbde966e640 10 monclient: build_initial_monmap 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.788+0000 7fbde966e640 10 monclient: monmap: 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:41.789122+0000 2024-08-19T11:20:41.789 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:41.789122+0000 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:41.790 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:41.791 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:41.791 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:41.791 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 Processor -- start 2024-08-19T11:20:41.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 -- start start 2024-08-19T11:20:41.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient: init 2024-08-19T11:20:41.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient: _add_conns ranks=[8,4,7,5,3,2,1,0,10,6,9] 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbde40a47c0 0x7fbde40a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): picked mon.noname-e con 0x7fbde40a47c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 0x7fbde4139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): picked mon.noname-c con 0x7fbde40a50e0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde413a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): picked mon.noname-i con 0x7fbde4139eb0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fbde40a1540 con 0x7fbde40a50e0 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fbde40a32a0 con 0x7fbde4139eb0 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbde406cc40 con 0x7fbde40a47c0 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde966e640 10 monclient(hunting): authenticate will time out at 1299.830784s 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde2ffd640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbde40a47c0 msgr2=0x7fbde40a4ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbde40a47c0 0x7fbde40a4ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 0x7fbde4139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 0x7fbde4139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:40652/0 (socket says 172.21.15.71:40652) 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 1 -- 172.21.15.71:0/4292857299 learned_addr learned my addr 172.21.15.71:0/4292857299 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 10 monclient(hunting): get_auth_request con 0x7fbde40a50e0 auth_method 0 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.789+0000 7fbddbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde413a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): get_auth_request con 0x7fbde4139eb0 auth_method 0 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbde37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 10 monclient(hunting): handle_auth_done global_id 85279 payload 274 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 1 -- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbde40a47c0 msgr2=0x7fbde40a4ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbde40a47c0 0x7fbde40a4ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 1 -- 172.21.15.71:0/4292857299 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 msgr2=0x7fbde413a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde413a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 1 monclient: found mon.noname-c 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.790+0000 7fbddbfff640 1 -- 172.21.15.71:0/4292857299 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde40a6380 con 0x7fbde40a50e0 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbddbfff640 1 -- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 msgr2=0x7fbde4139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbddbfff640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 0x7fbde4139970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0098a0 tx=0x7fbdcc02a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=359fd06047d457b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 1 -- 172.21.15.71:0/4292857299 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbdcc037070 con 0x7fbde40a50e0 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: dump: 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.805 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.806 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 1 -- 172.21.15.71:0/4292857299 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc02ae00 con 0x7fbde40a50e0 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde966e640 5 monclient: authenticate success, global_id 85279 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde966e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde966e640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 1 -- 172.21.15.71:0/4292857299 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbdcc030c20 con 0x7fbde40a50e0 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde966e640 4 set_mon_vals no callback set 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.793+0000 7fbde27fc640 10 monclient: dump: 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.808 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 10 monclient: shutdown 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 -- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 msgr2=0x7fbde4139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 0x7fbde4139970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0098a0 tx=0x7fbdcc02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 -- 172.21.15.71:0/4292857299 shutdown_connections 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde413a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fbde40a50e0 0x7fbde4139970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 --2- 172.21.15.71:0/4292857299 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbde40a47c0 0x7fbde40a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 -- 172.21.15.71:0/4292857299 >> 172.21.15.71:0/4292857299 conn(0x7fbde40a9470 msgr2=0x7fbde40a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 -- 172.21.15.71:0/4292857299 shutdown_connections 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 1 -- 172.21.15.71:0/4292857299 wait complete. 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 10 monclient: build_initial_monmap 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.794+0000 7fbde966e640 10 monclient: monmap: 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.810 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 Processor -- start 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 -- start start 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient: init 2024-08-19T11:20:41.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient: _add_conns ranks=[2,6,7,1,3,5,4,8,0] 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 0x7fbde41ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): picked mon.noname-b con 0x7fbde40a47c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbde40a50e0 0x7fbde41cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): picked mon.noname-d con 0x7fbde40a50e0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde41cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): picked mon.noname-i con 0x7fbde4139eb0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbde40a5500 con 0x7fbde40a47c0 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbde406cfd0 con 0x7fbde40a50e0 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fbde406d300 con 0x7fbde4139eb0 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde966e640 10 monclient(hunting): authenticate will time out at 1299.836661s 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 0x7fbde41ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbde40a50e0 0x7fbde41cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 0x7fbde41ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35394/0 (socket says 172.21.15.71:35394) 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 1 -- 172.21.15.71:0/2565372807 learned_addr learned my addr 172.21.15.71:0/2565372807 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): get_auth_request con 0x7fbde40a47c0 auth_method 0 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): get_auth_request con 0x7fbde40a50e0 auth_method 0 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde41cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): get_auth_request con 0x7fbde4139eb0 auth_method 0 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.795+0000 7fbde2ffd640 10 monclient(hunting): handle_auth_done global_id 75701 payload 824 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 msgr2=0x7fbde41cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbde4139eb0 0x7fbde41cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbde40a50e0 msgr2=0x7fbde41cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbde40a50e0 0x7fbde41cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 1 monclient: found mon.noname-b 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbde2ffd640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde413a550 con 0x7fbde40a47c0 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.796+0000 7fbddbfff640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbde40a50e0 0x7fbde41cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde2ffd640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 msgr2=0x7fbde41ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde2ffd640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 0x7fbde41ce780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400b550 tx=0x7fbdd400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbdd40092c0 con 0x7fbde40a47c0 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: dump: 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 5 monclient: authenticate success, global_id 75701 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd4015070 con 0x7fbde40a47c0 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:41.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbdd4003dd0 con 0x7fbde40a47c0 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 10 monclient: _renew_subs 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde40a3f00 con 0x7fbde40a47c0 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde1ffb640 4 set_mon_vals no callback set 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbddb7fe640 10 monclient: dump: 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 10 monclient: _renew_subs 2024-08-19T11:20:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.798+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde4129c40 con 0x7fbde40a47c0 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbde966e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbde966e640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 0x7fbde41265f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbde4076c60 con 0x7fbde4126210 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbdd4005070 con 0x7fbde40a47c0 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 0x7fbde41265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient: get_auth_request con 0x7fbde4126210 auth_method 0 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddb7fe640 1 --2- 172.21.15.71:0/2565372807 >> v2:172.21.15.135:6800/726754104 conn(0x7fbdc403eab0 0x7fbdc4040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 10 monclient(hunting): handle_auth_done global_id 75717 payload 824 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7fbdd4051930 con 0x7fbde40a47c0 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbddbfff640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbde41290b0 con 0x7fbde4126210 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbde37fe640 1 --2- 172.21.15.71:0/2565372807 >> v2:172.21.15.135:6800/726754104 conn(0x7fbdc403eab0 0x7fbdc4040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.799+0000 7fbde37fe640 10 monclient: get_auth_request con 0x7fbdc403eab0 auth_method 0 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.801+0000 7fbddbfff640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 msgr2=0x7fbde41265f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.801+0000 7fbddbfff640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 0x7fbde41265f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc031000 tx=0x7fbdcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbdcc042070 con 0x7fbde4126210 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 10 monclient: dump: 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbdcc047450 con 0x7fbde4126210 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 msgr2=0x7fbde41265f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 0x7fbde41265f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc031000 tx=0x7fbdcc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 msgr2=0x7fbde41265f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbddb7fe640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126210 0x7fbde41265f0 secure :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc031000 tx=0x7fbdcc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.802+0000 7fbde37fe640 1 --2- 172.21.15.71:0/2565372807 >> v2:172.21.15.135:6800/726754104 conn(0x7fbdc403eab0 0x7fbdc4040f70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbddc011340 tx=0x7fbddc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbde966e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbde966e640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 0x7fbde40a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbde966e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbde4069ed0 con 0x7fbde4126b30 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 0x7fbde40a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient: get_auth_request con 0x7fbde4126b30 auth_method 0 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 10 monclient(hunting): handle_auth_done global_id 75726 payload 824 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.808+0000 7fbddbfff640 1 -- 172.21.15.71:0/2565372807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbde409fab0 con 0x7fbde4126b30 2024-08-19T11:20:41.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddbfff640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 msgr2=0x7fbde40a6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddbfff640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 0x7fbde40a6cb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0097c0 tx=0x7fbdcc008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbdcc037040 con 0x7fbde4126b30 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 10 monclient: dump: 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.828 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9426 (secure 0 0 0) 0x7fbdcc03d440 con 0x7fbde4126b30 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 msgr2=0x7fbde40a6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 0x7fbde40a6cb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0097c0 tx=0x7fbdcc008030 comp rx=0 tx=0).stop 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 msgr2=0x7fbde40a6cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbddb7fe640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde4126b30 0x7fbde40a6cb0 secure :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0097c0 tx=0x7fbdcc008030 comp rx=0 tx=0).stop 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 290843, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:41.857 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 >> v2:172.21.15.135:6800/726754104 conn(0x7fbdc403eab0 msgr2=0x7fbdc4040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde966e640 1 --2- 172.21.15.71:0/2565372807 >> v2:172.21.15.135:6800/726754104 conn(0x7fbdc403eab0 0x7fbdc4040f70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbddc011340 tx=0x7fbddc00b040 comp rx=0 tx=0).stop 2024-08-19T11:20:41.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde966e640 10 monclient: shutdown 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde966e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 msgr2=0x7fbde41ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde966e640 1 --2- 172.21.15.71:0/2565372807 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbde40a47c0 0x7fbde41ce780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400b550 tx=0x7fbdd400ba10 comp rx=0 tx=0).stop 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde37fe640 1 -- 172.21.15.71:0/2565372807 reap_dead start 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.811+0000 7fbde37fe640 1 -- 172.21.15.71:0/2565372807 reap_dead start 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.812+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 shutdown_connections 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.812+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 >> 172.21.15.71:0/2565372807 conn(0x7fbde40a9470 msgr2=0x7fbde409f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.812+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 shutdown_connections 2024-08-19T11:20:41.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.812+0000 7fbde966e640 1 -- 172.21.15.71:0/2565372807 wait complete. 2024-08-19T11:20:41.860 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:41.860 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-08-19T11:20:41.860 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:20:41.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.958+0000 7fa150a20640 10 monclient: get_monmap_and_config 2024-08-19T11:20:41.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.958+0000 7fa150a20640 10 monclient: build_initial_monmap 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.958+0000 7fa150a20640 10 monclient: monmap: 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:41.959107+0000 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:41.959107+0000 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 Processor -- start 2024-08-19T11:20:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 -- start start 2024-08-19T11:20:41.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient: init 2024-08-19T11:20:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient: _add_conns ranks=[3,1,7,8,9,6,4,10,5,0,2] 2024-08-19T11:20:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 0x7fa14c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): picked mon.noname-g con 0x7fa14c0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa14c0a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a7270 0x7fa14c139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): picked mon.noname-i con 0x7fa14c0a7270 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14c0a6380 con 0x7fa14c0a57c0 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c0a5020 con 0x7fa14c0a6950 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa14c0a7d40 con 0x7fa14c0a7270 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.959+0000 7fa150a20640 10 monclient(hunting): authenticate will time out at 1300.000737s 2024-08-19T11:20:41.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 0x7fa14c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a7270 0x7fa14c139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa149d9b640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa14c0a57c0 0x7fa14c139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:53408/0 (socket says 172.21.15.71:53408) 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa149d9b640 1 -- 172.21.15.71:0/2509103284 learned_addr learned my addr 172.21.15.71:0/2509103284 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): get_auth_request con 0x7fa14c0a6950 auth_method 0 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): get_auth_request con 0x7fa14c0a7270 auth_method 0 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient(hunting): handle_auth_done global_id 46083 payload 274 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 1 -- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a7270 msgr2=0x7fa14c139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 1 --2- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a7270 0x7fa14c139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 1 -- 172.21.15.71:0/2509103284 >> v1:172.21.15.135:6789/0 conn(0x7fa14c0a57c0 legacy=0x7fa14c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient: _finish_hunting 0 2024-08-19T11:20:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 1 monclient: found mon.noname-g 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14a59c640 1 -- 172.21.15.71:0/2509103284 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c0a3650 con 0x7fa14c0a6950 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.960+0000 7fa14ad9d640 1 --2- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a7270 0x7fa14c139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14a59c640 1 -- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 msgr2=0x7fa14c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14a59c640 1 --2- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 0x7fa14c0a6d30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009800 tx=0x7fa13c029fe0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=34614d926ed31ce0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 1 -- 172.21.15.71:0/2509103284 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa13c037070 con 0x7fa14c0a6950 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: dump: 2024-08-19T11:20:41.975 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.976 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: _finish_auth 0 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: _check_auth_tickets 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 1 -- 172.21.15.71:0/2509103284 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13c02ad00 con 0x7fa14c0a6950 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 1 -- 172.21.15.71:0/2509103284 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa13c030c20 con 0x7fa14c0a6950 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa150a20640 5 monclient: authenticate success, global_id 46083 2024-08-19T11:20:41.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa150a20640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa150a20640 4 set_mon_vals no callback set 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.963+0000 7fa14959a640 10 monclient: dump: 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 10 monclient: shutdown 2024-08-19T11:20:41.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 -- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 msgr2=0x7fa14c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 --2- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 0x7fa14c0a6d30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009800 tx=0x7fa13c029fe0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 -- 172.21.15.71:0/2509103284 shutdown_connections 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 --2- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a7270 0x7fa14c139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 --2- 172.21.15.71:0/2509103284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa14c0a6950 0x7fa14c0a6d30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 -- 172.21.15.71:0/2509103284 >> 172.21.15.71:0/2509103284 conn(0x7fa14c0abf50 msgr2=0x7fa14c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 -- 172.21.15.71:0/2509103284 shutdown_connections 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 1 -- 172.21.15.71:0/2509103284 wait complete. 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 10 monclient: build_initial_monmap 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.964+0000 7fa150a20640 10 monclient: monmap: 2024-08-19T11:20:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 Processor -- start 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 -- start start 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient: init 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient: _add_conns ranks=[8,7,5,2,0,3,4,6,1] 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa14c0a57c0 0x7fa14c139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): picked mon.noname-e con 0x7fa14c0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:41.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 0x7fa14c139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): picked mon.noname-i con 0x7fa14c0a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa14c0a7270 0x7fa14c123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): picked mon.noname-h con 0x7fa14c0a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa14c0a8700 con 0x7fa14c0a7270 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa14c0a84c0 con 0x7fa14c0a6950 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa14c0a7690 con 0x7fa14c0a57c0 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:41.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa150a20640 10 monclient(hunting): authenticate will time out at 1300.006737s 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa14a59c640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa14c0a57c0 msgr2=0x7fa14c139860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.965+0000 7fa14a59c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa14c0a57c0 0x7fa14c139860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 0x7fa14c139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa14c0a7270 0x7fa14c123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 0x7fa14c139da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3303/0 says I am v2:172.21.15.71:57926/0 (socket says 172.21.15.71:57926) 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 -- 172.21.15.71:0/82031097 learned_addr learned my addr 172.21.15.71:0/82031097 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): get_auth_request con 0x7fa14c0a6950 auth_method 0 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): get_auth_request con 0x7fa14c0a7270 auth_method 0 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient(hunting): handle_auth_done global_id 85237 payload 824 2024-08-19T11:20:41.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa14c0a57c0 msgr2=0x7fa14c139860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa14c0a57c0 0x7fa14c139860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa14c0a7270 msgr2=0x7fa14c123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa14c0a7270 0x7fa14c123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient: _finish_hunting 0 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 monclient: found mon.noname-i 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa149d9b640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c124ec0 con 0x7fa14c0a6950 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.966+0000 7fa14ad9d640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa14c0a7270 0x7fa14c123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:41.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa149d9b640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 msgr2=0x7fa14c139da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa149d9b640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 0x7fa14c139da0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa14000c460 tx=0x7fa14000c860 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa140017070 con 0x7fa14c0a6950 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: dump: 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.987 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: _finish_auth 0 2024-08-19T11:20:41.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa140005cf0 con 0x7fa14c0a6950 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa140004b20 con 0x7fa14c0a6950 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa13affd640 10 monclient: dump: 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.989 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.990 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 5 monclient: authenticate success, global_id 85237 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa148d99640 4 set_mon_vals no callback set 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 10 monclient: _renew_subs 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c126980 con 0x7fa14c0a6950 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 10 monclient: _renew_subs 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.968+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c1ce400 con 0x7fa14c0a6950 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa150a20640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa150a20640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 0x7fa14c123d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c06a590 con 0x7fa14c123940 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 0x7fa14c123d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient: get_auth_request con 0x7fa14c123940 auth_method 0 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.969+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa140007070 con 0x7fa14c0a6950 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.970+0000 7fa14a59c640 10 monclient(hunting): handle_auth_done global_id 75710 payload 824 2024-08-19T11:20:41.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.970+0000 7fa14a59c640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa14c1cf0a0 con 0x7fa14c123940 2024-08-19T11:20:41.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.970+0000 7fa13affd640 1 --2- 172.21.15.71:0/82031097 >> v2:172.21.15.135:6800/726754104 conn(0x7fa12c03ea80 0x7fa12c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.970+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7fa140050f80 con 0x7fa14c0a6950 2024-08-19T11:20:41.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.970+0000 7fa14ad9d640 1 --2- 172.21.15.71:0/82031097 >> v2:172.21.15.135:6800/726754104 conn(0x7fa12c03ea80 0x7fa12c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.970+0000 7fa14ad9d640 10 monclient: get_auth_request con 0x7fa12c03ea80 auth_method 0 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa14a59c640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 msgr2=0x7fa14c123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa14a59c640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 0x7fa14c123d20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa13c034000 tx=0x7fa13c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa13c041020 con 0x7fa14c123940 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 10 monclient: dump: 2024-08-19T11:20:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa13c02ad00 con 0x7fa14c123940 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 msgr2=0x7fa14c123d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 0x7fa14c123d20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa13c034000 tx=0x7fa13c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 msgr2=0x7fa14c123d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa13affd640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c123940 0x7fa14c123d20 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa13c034000 tx=0x7fa13c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:41.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.972+0000 7fa14ad9d640 1 --2- 172.21.15.71:0/82031097 >> v2:172.21.15.135:6800/726754104 conn(0x7fa12c03ea80 0x7fa12c040f40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa144003b80 tx=0x7fa14400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa150a20640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa150a20640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 0x7fa14c09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa150a20640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c076c60 con 0x7fa14c124260 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa14a59c640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 0x7fa14c09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa14a59c640 10 monclient: get_auth_request con 0x7fa14c124260 auth_method 0 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa14a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa14a59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.978+0000 7fa14a59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.979+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:41.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.979+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.979+0000 7fa14a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.979+0000 7fa14a59c640 10 monclient(hunting): handle_auth_done global_id 75719 payload 824 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.979+0000 7fa14a59c640 1 -- 172.21.15.71:0/82031097 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa14c1ce660 con 0x7fa14c124260 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa14a59c640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 msgr2=0x7fa14c09e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa14a59c640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 0x7fa14c09e6f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa13c02afd0 tx=0x7fa13c009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa13c041040 con 0x7fa14c124260 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 10 monclient: dump: 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9257 (secure 0 0 0) 0x7fa13c0482c0 con 0x7fa14c124260 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 msgr2=0x7fa14c09e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 0x7fa14c09e6f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa13c02afd0 tx=0x7fa13c009190 comp rx=0 tx=0).stop 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 msgr2=0x7fa14c09e6f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.981+0000 7fa13affd640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa14c124260 0x7fa14c09e6f0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa13c02afd0 tx=0x7fa13c009190 comp rx=0 tx=0).stop 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 291012, 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:42.003 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.004 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:42.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.006 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:42.007 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:42.008 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.009 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.018 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.020 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:42.026 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.028 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.030 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:42.032 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:42.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 >> v2:172.21.15.135:6800/726754104 conn(0x7fa12c03ea80 msgr2=0x7fa12c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 --2- 172.21.15.71:0/82031097 >> v2:172.21.15.135:6800/726754104 conn(0x7fa12c03ea80 0x7fa12c040f40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa144003b80 tx=0x7fa14400b040 comp rx=0 tx=0).stop 2024-08-19T11:20:42.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 10 monclient: shutdown 2024-08-19T11:20:42.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 msgr2=0x7fa14c139da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa14ad9d640 1 -- 172.21.15.71:0/82031097 reap_dead start 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 0x7fa14c139da0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa14000c460 tx=0x7fa14000c860 comp rx=0 tx=0).stop 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 shutdown_connections 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 --2- 172.21.15.71:0/82031097 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa14c0a6950 0x7fa14c139da0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 >> 172.21.15.71:0/82031097 conn(0x7fa14c0abf50 msgr2=0x7fa14c1c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 shutdown_connections 2024-08-19T11:20:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:41.982+0000 7fa150a20640 1 -- 172.21.15.71:0/82031097 wait complete. 2024-08-19T11:20:42.035 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:42.036 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-08-19T11:20:42.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:20:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.133+0000 7fa672898640 10 monclient: get_monmap_and_config 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.133+0000 7fa672898640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.133+0000 7fa672898640 10 monclient: monmap: 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:42.134541+0000 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:42.134541+0000 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:42.136 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.134+0000 7fa672898640 1 Processor -- start 2024-08-19T11:20:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.134+0000 7fa672898640 1 -- start start 2024-08-19T11:20:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.134+0000 7fa672898640 10 monclient: init 2024-08-19T11:20:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient: _add_conns ranks=[9,4,10,1,2,5,3,8,6,7,0] 2024-08-19T11:20:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa66c0a6950 0x7fa66c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): picked mon.noname-a con 0x7fa66c0a6950 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): picked mon.noname-c con 0x7fa66c0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa66c139710 0x7fa66c139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): picked mon.noname-f con 0x7fa66c139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa66c0a5020 con 0x7fa66c0a6950 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa66c0a77b0 con 0x7fa66c139710 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa66c0a7d40 con 0x7fa66c0a57c0 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa672898640 10 monclient(hunting): authenticate will time out at 1300.176225s 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa66c0a6950 0x7fa66c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa66c0a6950 0x7fa66c0a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54162/0 (socket says 172.21.15.71:54162) 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c0a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:40668/0 (socket says 172.21.15.71:40668) 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 -- 172.21.15.71:0/4106517343 learned_addr learned my addr 172.21.15.71:0/4106517343 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): get_auth_request con 0x7fa66c0a6950 auth_method 0 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): get_auth_request con 0x7fa66c0a57c0 auth_method 0 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient(hunting): handle_auth_done global_id 75735 payload 274 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa670e35640 1 --2- 172.21.15.71:0/4106517343 >> v2:172.21.15.135:3300/0 conn(0x7fa66c139710 0x7fa66c139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 -- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 msgr2=0x7fa66c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 -- 172.21.15.71:0/4106517343 >> v2:172.21.15.135:3300/0 conn(0x7fa66c139710 msgr2=0x7fa66c139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4106517343 >> v2:172.21.15.135:3300/0 conn(0x7fa66c139710 0x7fa66c139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 monclient: found mon.noname-a 2024-08-19T11:20:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66bfff640 1 -- 172.21.15.71:0/4106517343 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c0a6380 con 0x7fa66c0a6950 2024-08-19T11:20:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.135+0000 7fa66b7fe640 1 --2- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.138+0000 7fa66bfff640 1 -- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c0a6950 msgr2=0x7fa66c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.138+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c0a6950 0x7fa66c0a6d30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa66c06c930 tx=0x7fa65c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549752f7e334410e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 1 -- 172.21.15.71:0/4106517343 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa65c037070 con 0x7fa66c0a6950 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: dump: 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa672898640 5 monclient: authenticate success, global_id 75735 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa672898640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 1 -- 172.21.15.71:0/4106517343 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c02ae20 con 0x7fa66c0a6950 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa672898640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa672898640 4 set_mon_vals no callback set 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 1 -- 172.21.15.71:0/4106517343 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa65c030c20 con 0x7fa66c0a6950 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.140+0000 7fa66affd640 10 monclient: dump: 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 10 monclient: shutdown 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 -- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c0a6950 msgr2=0x7fa66c0a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 --2- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c0a6950 0x7fa66c0a6d30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa66c06c930 tx=0x7fa65c02a100 comp rx=0 tx=0).stop 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 -- 172.21.15.71:0/4106517343 shutdown_connections 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 --2- 172.21.15.71:0/4106517343 >> v2:172.21.15.135:3300/0 conn(0x7fa66c139710 0x7fa66c139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 --2- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 --2- 172.21.15.71:0/4106517343 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c0a6950 0x7fa66c0a6d30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 -- 172.21.15.71:0/4106517343 >> 172.21.15.71:0/4106517343 conn(0x7fa66c0abf50 msgr2=0x7fa66c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 -- 172.21.15.71:0/4106517343 shutdown_connections 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 1 -- 172.21.15.71:0/4106517343 wait complete. 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.141+0000 7fa672898640 10 monclient: monmap: 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 Processor -- start 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 -- start start 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient: init 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient: _add_conns ranks=[4,1,0,7,8,5,6,2,3] 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): picked mon.noname-c con 0x7fa66c0a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66c0a6950 0x7fa66c122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): picked mon.noname-f con 0x7fa66c0a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 0x7fa66c122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): picked mon.noname-a con 0x7fa66c139710 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c0a84c0 con 0x7fa66c139710 2024-08-19T11:20:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c0a3650 con 0x7fa66c0a6950 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa66c0a8700 con 0x7fa66c0a57c0 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa672898640 10 monclient(hunting): authenticate will time out at 1300.183824s 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c138bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:40672/0 (socket says 172.21.15.71:40672) 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 1 -- 172.21.15.71:0/4224791025 learned_addr learned my addr 172.21.15.71:0/4224791025 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): get_auth_request con 0x7fa66c0a57c0 auth_method 0 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa670e35640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 0x7fa66c122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa670e35640 10 monclient(hunting): get_auth_request con 0x7fa66c139710 auth_method 0 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa670e35640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa670e35640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa670e35640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.142+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 10 monclient(hunting): handle_auth_done global_id 75744 payload 824 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa66b7fe640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66c0a6950 0x7fa66c122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 msgr2=0x7fa66c138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66c0a6950 msgr2=0x7fa66c122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa66c0a6950 0x7fa66c122630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 1 monclient: found mon.noname-a 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa670e35640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c1251c0 con 0x7fa66c139710 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.143+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c0a57c0 0x7fa66c138bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa670e35640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 msgr2=0x7fa66c122b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa670e35640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 0x7fa66c122b70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa66400cc80 tx=0x7fa66400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa66400ce30 con 0x7fa66c139710 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: dump: 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.159 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66400fa70 con 0x7fa66c139710 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 5 monclient: authenticate success, global_id 75744 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 10 monclient: _renew_subs 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c1cc710 con 0x7fa66c139710 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa66400fc60 con 0x7fa66c139710 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa668ff9640 10 monclient: dump: 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.161 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa66a7fc640 4 set_mon_vals no callback set 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 10 monclient: _renew_subs 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.145+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1240a0 con 0x7fa66c139710 2024-08-19T11:20:42.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa672898640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa672898640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 0x7fa66c02d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa66c126080 con 0x7fa66c123870 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 0x7fa66c02d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient: get_auth_request con 0x7fa66c123870 auth_method 0 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa66400f600 con 0x7fa66c139710 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 10 monclient(hunting): handle_auth_done global_id 85306 payload 824 2024-08-19T11:20:42.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa66bfff640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa66c0a6d30 con 0x7fa66c123870 2024-08-19T11:20:42.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa668ff9640 1 --2- 172.21.15.71:0/4224791025 >> v2:172.21.15.135:6800/726754104 conn(0x7fa65803ea80 0x7fa658040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.146+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7fa664009030 con 0x7fa66c139710 2024-08-19T11:20:42.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.147+0000 7fa66b7fe640 1 --2- 172.21.15.71:0/4224791025 >> v2:172.21.15.135:6800/726754104 conn(0x7fa65803ea80 0x7fa658040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.147+0000 7fa66b7fe640 10 monclient: get_auth_request con 0x7fa65803ea80 auth_method 0 2024-08-19T11:20:42.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.148+0000 7fa66bfff640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 msgr2=0x7fa66c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 0x7fa66c02d1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000c00 tx=0x7fa65c0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa65c042070 con 0x7fa66c123870 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 10 monclient: dump: 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa65c003e50 con 0x7fa66c123870 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 msgr2=0x7fa66c02d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 0x7fa66c02d1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000c00 tx=0x7fa65c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 msgr2=0x7fa66c02d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa668ff9640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c123870 0x7fa66c02d1c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.149+0000 7fa66b7fe640 1 --2- 172.21.15.71:0/4224791025 >> v2:172.21.15.135:6800/726754104 conn(0x7fa65803ea80 0x7fa658040f40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa660009560 tx=0x7fa660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa672898640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa672898640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 0x7fa66c02d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa672898640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa66c076c60 con 0x7fa66c1390f0 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 0x7fa66c02d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient: get_auth_request con 0x7fa66c1390f0 auth_method 0 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 10 monclient(hunting): handle_auth_done global_id 85315 payload 824 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.155+0000 7fa66bfff640 1 -- 172.21.15.71:0/4224791025 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa66c09e100 con 0x7fa66c1390f0 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa66bfff640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 msgr2=0x7fa66c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa66bfff640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 0x7fa66c02d700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa65c041000 tx=0x7fa65c008030 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa65c037040 con 0x7fa66c1390f0 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 10 monclient: dump: 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7fa65c03d440 con 0x7fa66c1390f0 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 msgr2=0x7fa66c02d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 0x7fa66c02d700 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa65c041000 tx=0x7fa65c008030 comp rx=0 tx=0).stop 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 msgr2=0x7fa66c02d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa668ff9640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa66c1390f0 0x7fa66c02d700 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa65c041000 tx=0x7fa65c008030 comp rx=0 tx=0).stop 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:42.172 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 224305, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 0, 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.173 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.174 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.175 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.176 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.177 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.178 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:42.179 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.180 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:42.182 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.183 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.185 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:42.186 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.187 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.188 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.191 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.193 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.194 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.194 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.194 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.196 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.198 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.199 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:42.201 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 >> v2:172.21.15.135:6800/726754104 conn(0x7fa65803ea80 msgr2=0x7fa658040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 --2- 172.21.15.71:0/4224791025 >> v2:172.21.15.135:6800/726754104 conn(0x7fa65803ea80 0x7fa658040f40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa660009560 tx=0x7fa660008040 comp rx=0 tx=0).stop 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 10 monclient: shutdown 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 msgr2=0x7fa66c122b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa670e35640 1 -- 172.21.15.71:0/4224791025 reap_dead start 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 0x7fa66c122b70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa66400cc80 tx=0x7fa66400a5c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 shutdown_connections 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 --2- 172.21.15.71:0/4224791025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa66c139710 0x7fa66c122b70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.158+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 >> 172.21.15.71:0/4224791025 conn(0x7fa66c0abf50 msgr2=0x7fa66c0aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.159+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 shutdown_connections 2024-08-19T11:20:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.159+0000 7fa672898640 1 -- 172.21.15.71:0/4224791025 wait complete. 2024-08-19T11:20:42.204 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:42.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-08-19T11:20:42.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.302+0000 7fc851684640 10 monclient: get_monmap_and_config 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.302+0000 7fc851684640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.302+0000 7fc851684640 10 monclient: monmap: 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:42.303105+0000 2024-08-19T11:20:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:42.303105+0000 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:42.304 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 Processor -- start 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 -- start start 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient: init 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient: _add_conns ranks=[0,6,5,3,8,9,2,7,4,1,10] 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc84c0a6950 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 0x7fc84c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): picked mon.noname-d con 0x7fc84c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc84c0a7440 0x7fc84c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): picked mon.noname-h con 0x7fc84c0a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84c0a6380 con 0x7fc84c0a6950 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fc84c0a5020 con 0x7fc84c0a7440 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc84c0a7d40 con 0x7fc84c0a57c0 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc851684640 10 monclient(hunting): authenticate will time out at 1300.344796s 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 0x7fc84c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc84affd640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc84c0a6950 0x7fc84c0a6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42204/0 (socket says 172.21.15.71:42204) 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc84affd640 1 -- 172.21.15.71:0/1629071480 learned_addr learned my addr 172.21.15.71:0/1629071480 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 10 monclient(hunting): get_auth_request con 0x7fc84c0a57c0 auth_method 0 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.303+0000 7fc843fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc84b7fe640 1 --2- 172.21.15.71:0/1629071480 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc84c0a7440 0x7fc84c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc84b7fe640 10 monclient(hunting): get_auth_request con 0x7fc84c0a7440 auth_method 0 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc84b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc84b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 10 monclient(hunting): handle_auth_done global_id 104649 payload 274 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 1 -- 172.21.15.71:0/1629071480 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc84c0a7440 msgr2=0x7fc84c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 1 --2- 172.21.15.71:0/1629071480 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc84c0a7440 0x7fc84c1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 1 -- 172.21.15.71:0/1629071480 >> v1:172.21.15.71:6789/0 conn(0x7fc84c0a6950 legacy=0x7fc84c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 1 monclient: found mon.noname-d 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.304+0000 7fc843fff640 1 -- 172.21.15.71:0/1629071480 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c0a3650 con 0x7fc84c0a57c0 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.306+0000 7fc843fff640 1 -- 172.21.15.71:0/1629071480 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 msgr2=0x7fc84c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.306+0000 7fc843fff640 1 --2- 172.21.15.71:0/1629071480 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 0x7fc84c13eb60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc834009800 tx=0x7fc834029fe0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=be66191e4860aecf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 1 -- 172.21.15.71:0/1629071480 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc834037070 con 0x7fc84c0a57c0 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: dump: 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 5 monclient: authenticate success, global_id 104649 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 1 -- 172.21.15.71:0/1629071480 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83402ad00 con 0x7fc84c0a57c0 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 4 set_mon_vals no callback set 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 1 -- 172.21.15.71:0/1629071480 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc834030c20 con 0x7fc84c0a57c0 2024-08-19T11:20:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc84a7fc640 10 monclient: dump: 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 10 monclient: shutdown 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 -- 172.21.15.71:0/1629071480 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 msgr2=0x7fc84c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 --2- 172.21.15.71:0/1629071480 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 0x7fc84c13eb60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc834009800 tx=0x7fc834029fe0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 -- 172.21.15.71:0/1629071480 shutdown_connections 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 --2- 172.21.15.71:0/1629071480 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fc84c0a7440 0x7fc84c1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 --2- 172.21.15.71:0/1629071480 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a57c0 0x7fc84c13eb60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 -- 172.21.15.71:0/1629071480 >> 172.21.15.71:0/1629071480 conn(0x7fc84c0abf50 msgr2=0x7fc84c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 -- 172.21.15.71:0/1629071480 shutdown_connections 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.307+0000 7fc851684640 1 -- 172.21.15.71:0/1629071480 wait complete. 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.308+0000 7fc851684640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.308+0000 7fc851684640 10 monclient: monmap: 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.308+0000 7fc851684640 1 Processor -- start 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.308+0000 7fc851684640 1 -- start start 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.308+0000 7fc851684640 10 monclient: init 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient: _add_conns ranks=[2,1,6,0,5,7,4,3,8] 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84c0a57c0 0x7fc84c126c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): picked mon.noname-b con 0x7fc84c0a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c0a6950 0x7fc84c128d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): picked mon.noname-f con 0x7fc84c0a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 0x7fc84c13fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): picked mon.noname-d con 0x7fc84c0a7440 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c0a8700 con 0x7fc84c0a6950 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc84c0a84c0 con 0x7fc84c0a57c0 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc84c1415f0 con 0x7fc84c0a7440 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc851684640 10 monclient(hunting): authenticate will time out at 1300.350162s 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84c0a57c0 0x7fc84c126c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 0x7fc84c13fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84c0a57c0 0x7fc84c126c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35420/0 (socket says 172.21.15.71:35420) 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 1 -- 172.21.15.71:0/1329037923 learned_addr learned my addr 172.21.15.71:0/1329037923 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): get_auth_request con 0x7fc84c0a57c0 auth_method 0 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): get_auth_request con 0x7fc84c0a7440 auth_method 0 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc843fff640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c0a6950 0x7fc84c128d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc843fff640 10 monclient(hunting): get_auth_request con 0x7fc84c0a6950 auth_method 0 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc843fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc843fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc843fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient(hunting): handle_auth_done global_id 104658 payload 824 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84c0a57c0 msgr2=0x7fc84c126c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84c0a57c0 0x7fc84c126c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c0a6950 msgr2=0x7fc84c128d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c0a6950 0x7fc84c128d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 monclient: found mon.noname-d 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84b7fe640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c0a9530 con 0x7fc84c0a7440 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc84affd640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc84c0a57c0 0x7fc84c126c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.309+0000 7fc843fff640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc84c0a6950 0x7fc84c128d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc84b7fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 msgr2=0x7fc84c13fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc84b7fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 0x7fc84c13fbb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc844007cf0 tx=0x7fc84400e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc844014890 con 0x7fc84c0a7440 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: dump: 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844014a50 con 0x7fc84c0a7440 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc851684640 5 monclient: authenticate success, global_id 104658 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc844014c00 con 0x7fc84c0a7440 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc8437fe640 10 monclient: dump: 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc851684640 10 monclient: _renew_subs 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc851684640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c140850 con 0x7fc84c0a7440 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.311+0000 7fc849ffb640 4 set_mon_vals no callback set 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 10 monclient: _renew_subs 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c12a260 con 0x7fc84c0a7440 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 0x7fc84c1ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc84c076c60 con 0x7fc84c1400f0 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc84affd640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 0x7fc84c1ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc84affd640 10 monclient: get_auth_request con 0x7fc84c1400f0 auth_method 0 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc84affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc84affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.312+0000 7fc84affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc84401b030 con 0x7fc84c0a7440 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc84affd640 10 monclient(hunting): handle_auth_done global_id 104667 payload 824 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc84affd640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc84c140d30 con 0x7fc84c1400f0 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc8437fe640 1 --2- 172.21.15.71:0/1329037923 >> v2:172.21.15.135:6800/726754104 conn(0x7fc82c03ea80 0x7fc82c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7fc844019020 con 0x7fc84c0a7440 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc843fff640 1 --2- 172.21.15.71:0/1329037923 >> v2:172.21.15.135:6800/726754104 conn(0x7fc82c03ea80 0x7fc82c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.313+0000 7fc843fff640 10 monclient: get_auth_request con 0x7fc82c03ea80 auth_method 0 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc84affd640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 msgr2=0x7fc84c1ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc84affd640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 0x7fc84c1ce570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0072e0 tx=0x7fc83c0077a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc83c00fd40 con 0x7fc84c1400f0 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 10 monclient: dump: 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc83c00fd40 con 0x7fc84c1400f0 2024-08-19T11:20:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 msgr2=0x7fc84c1ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 0x7fc84c1ce570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0072e0 tx=0x7fc83c0077a0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 msgr2=0x7fc84c1ce570 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.315+0000 7fc8437fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1400f0 0x7fc84c1ce570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.316+0000 7fc843fff640 1 --2- 172.21.15.71:0/1329037923 >> v2:172.21.15.135:6800/726754104 conn(0x7fc82c03ea80 0x7fc82c040f40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc834009800 tx=0x7fc83402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.321+0000 7fc851684640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.321+0000 7fc851684640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 0x7fc84c1ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.321+0000 7fc851684640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.321+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc84c1cf400 con 0x7fc84c1ceab0 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 0x7fc84c1ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient: get_auth_request con 0x7fc84c1ceab0 auth_method 0 2024-08-19T11:20:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 10 monclient(hunting): handle_auth_done global_id 104676 payload 824 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.322+0000 7fc84affd640 1 -- 172.21.15.71:0/1329037923 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc84c0a6d30 con 0x7fc84c1ceab0 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc84affd640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 msgr2=0x7fc84c1ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc84affd640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 0x7fc84c1ceec0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0072e0 tx=0x7fc83c004940 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc83c0133f0 con 0x7fc84c1ceab0 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 10 monclient: dump: 2024-08-19T11:20:42.341 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9256 (secure 0 0 0) 0x7fc83c006450 con 0x7fc84c1ceab0 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 msgr2=0x7fc84c1ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 0x7fc84c1ceec0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0072e0 tx=0x7fc83c004940 comp rx=0 tx=0).stop 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 msgr2=0x7fc84c1ceec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.324+0000 7fc8437fe640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c1ceab0 0x7fc84c1ceec0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0072e0 tx=0x7fc83c004940 comp rx=0 tx=0).stop 2024-08-19T11:20:42.343 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 97672, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.345 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.346 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:42.347 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.348 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:42.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:42.350 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.351 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.352 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.353 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.358 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.359 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:42.360 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:42.362 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:42.363 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.365 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:42.366 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 >> v2:172.21.15.135:6800/726754104 conn(0x7fc82c03ea80 msgr2=0x7fc82c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 --2- 172.21.15.71:0/1329037923 >> v2:172.21.15.135:6800/726754104 conn(0x7fc82c03ea80 0x7fc82c040f40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc834009800 tx=0x7fc83402e000 comp rx=0 tx=0).stop 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 10 monclient: shutdown 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 msgr2=0x7fc84c13fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc84b7fe640 1 -- 172.21.15.71:0/1329037923 reap_dead start 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 0x7fc84c13fbb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc844007cf0 tx=0x7fc84400e4b0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 shutdown_connections 2024-08-19T11:20:42.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 --2- 172.21.15.71:0/1329037923 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc84c0a7440 0x7fc84c13fbb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 >> 172.21.15.71:0/1329037923 conn(0x7fc84c0abf50 msgr2=0x7fc84c09f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 shutdown_connections 2024-08-19T11:20:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.325+0000 7fc851684640 1 -- 172.21.15.71:0/1329037923 wait complete. 2024-08-19T11:20:42.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:42.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-08-19T11:20:42.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.468+0000 7f5f43ccc640 10 monclient: get_monmap_and_config 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.468+0000 7f5f43ccc640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.468+0000 7f5f43ccc640 10 monclient: monmap: 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:42.468758+0000 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:42.468758+0000 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.469 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:42.470 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.468+0000 7f5f43ccc640 1 Processor -- start 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.468+0000 7f5f43ccc640 1 -- start start 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.468+0000 7f5f43ccc640 10 monclient: init 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient: _add_conns ranks=[5,6,0,9,1,7,8,2,10,4,3] 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f3c0a3cb0 0x7f5f3c0a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): picked mon.noname-h con 0x7f5f3c0a3cb0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): picked mon.noname-d con 0x7f5f3c0a5020 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f3c139970 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3c0a4da0 con 0x7f5f3c139970 2024-08-19T11:20:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f5f3c0a4b10 con 0x7f5f3c0a3cb0 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5f3c0a13d0 con 0x7f5f3c0a5020 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f43ccc640 10 monclient(hunting): authenticate will time out at 1300.510480s 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f42269640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5f3c139970 0x7f5f3c139de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42218/0 (socket says 172.21.15.71:42218) 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f42269640 1 -- 172.21.15.71:0/1307150611 learned_addr learned my addr 172.21.15.71:0/1307150611 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): get_auth_request con 0x7f5f3c0a5020 auth_method 0 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41a68640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f3c0a3cb0 0x7f5f3c0a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41a68640 10 monclient(hunting): get_auth_request con 0x7f5f3c0a3cb0 auth_method 0 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient(hunting): handle_auth_done global_id 104685 payload 274 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 1 -- 172.21.15.71:0/1307150611 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f3c0a3cb0 msgr2=0x7f5f3c0a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f3c0a3cb0 0x7f5f3c0a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 1 -- 172.21.15.71:0/1307150611 >> v1:172.21.15.71:6789/0 conn(0x7f5f3c139970 legacy=0x7f5f3c139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 1 monclient: found mon.noname-d 2024-08-19T11:20:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.469+0000 7f5f41267640 1 -- 172.21.15.71:0/1307150611 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c0a0b30 con 0x7f5f3c0a5020 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f41267640 1 -- 172.21.15.71:0/1307150611 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 msgr2=0x7f5f3c0a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f41267640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0a45d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097d0 tx=0x7f5f30029fb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=8686d1736028b9c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 1 -- 172.21.15.71:0/1307150611 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f30037070 con 0x7f5f3c0a5020 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: dump: 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 1 -- 172.21.15.71:0/1307150611 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3002ad10 con 0x7f5f3c0a5020 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f43ccc640 5 monclient: authenticate success, global_id 104685 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f43ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f43ccc640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 1 -- 172.21.15.71:0/1307150611 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f30030c20 con 0x7f5f3c0a5020 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f43ccc640 4 set_mon_vals no callback set 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.472+0000 7f5f40a66640 10 monclient: dump: 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 10 monclient: shutdown 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 -- 172.21.15.71:0/1307150611 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 msgr2=0x7f5f3c0a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0a45d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097d0 tx=0x7f5f30029fb0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 -- 172.21.15.71:0/1307150611 shutdown_connections 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0a45d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/1307150611 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f5f3c0a3cb0 0x7f5f3c0a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 -- 172.21.15.71:0/1307150611 >> 172.21.15.71:0/1307150611 conn(0x7f5f3c0a91d0 msgr2=0x7f5f3c0a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 -- 172.21.15.71:0/1307150611 shutdown_connections 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.473+0000 7f5f43ccc640 1 -- 172.21.15.71:0/1307150611 wait complete. 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient: monmap: 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 Processor -- start 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 -- start start 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient: init 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient: _add_conns ranks=[2,6,8,0,1,3,4,5,7] 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3c0a3cb0 0x7f5f3c1ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f5f3c0a3cb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): picked mon.noname-d con 0x7f5f3c0a5020 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f3c139970 0x7f5f3c138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): picked mon.noname-e con 0x7f5f3c139970 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:42.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5f3c0a54f0 con 0x7f5f3c0a3cb0 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f5f3c074530 con 0x7f5f3c0a5020 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f5f3c13a4f0 con 0x7f5f3c139970 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.474+0000 7f5f43ccc640 10 monclient(hunting): authenticate will time out at 1300.515992s 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f42269640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f3c139970 msgr2=0x7f5f3c138fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f42269640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f3c139970 0x7f5f3c138fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3c0a3cb0 0x7f5f3c1ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:38940/0 (socket says 172.21.15.71:38940) 2024-08-19T11:20:42.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 -- 172.21.15.71:0/2522710026 learned_addr learned my addr 172.21.15.71:0/2522710026 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): get_auth_request con 0x7f5f3c0a5020 auth_method 0 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): get_auth_request con 0x7f5f3c0a3cb0 auth_method 0 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient(hunting): handle_auth_done global_id 104694 payload 824 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f3c139970 msgr2=0x7f5f3c138fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f5f3c139970 0x7f5f3c138fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3c0a3cb0 msgr2=0x7f5f3c1ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3c0a3cb0 0x7f5f3c1ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 monclient: found mon.noname-d 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41267640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c1260c0 con 0x7f5f3c0a5020 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.475+0000 7f5f41a68640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f3c0a3cb0 0x7f5f3c1ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f41267640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 msgr2=0x7f5f3c0733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f41267640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0733d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f30035040 tx=0x7f5f300046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f30037040 con 0x7f5f3c0a5020 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: dump: 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30042070 con 0x7f5f3c0a5020 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 5 monclient: authenticate success, global_id 104694 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 10 monclient: _renew_subs 2024-08-19T11:20:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3c0a6d40 con 0x7f5f3c0a5020 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f3003dd20 con 0x7f5f3c0a5020 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3a7fc640 10 monclient: dump: 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 10 monclient: _renew_subs 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3c126960 con 0x7f5f3c0a5020 2024-08-19T11:20:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.477+0000 7f5f3bfff640 4 set_mon_vals no callback set 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.478+0000 7f5f43ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.478+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 0x7f5f3c123810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.478+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.478+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c076c60 con 0x7f5f3c1394e0 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.478+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5f30003bf0 con 0x7f5f3c0a5020 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f3a7fc640 1 --2- 172.21.15.71:0/2522710026 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f2803eab0 0x7f5f28040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 0x7f5f3c123810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7f5f30072150 con 0x7f5f3c0a5020 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient: get_auth_request con 0x7f5f3c1394e0 auth_method 0 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f42269640 1 --2- 172.21.15.71:0/2522710026 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f2803eab0 0x7f5f28040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f42269640 10 monclient: get_auth_request con 0x7f5f2803eab0 auth_method 0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 10 monclient(hunting): handle_auth_done global_id 85303 payload 824 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.479+0000 7f5f41a68640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f3c0a8330 con 0x7f5f3c1394e0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.481+0000 7f5f42269640 1 --2- 172.21.15.71:0/2522710026 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f2803eab0 0x7f5f28040f70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c124e00 tx=0x7f5f2c004fe0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.481+0000 7f5f41a68640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 msgr2=0x7f5f3c123810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.481+0000 7f5f41a68640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 0x7f5f3c123810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f34010bd0 tx=0x7f5f3400e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.481+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f34018020 con 0x7f5f3c1394e0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 10 monclient: dump: 2024-08-19T11:20:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f34004240 con 0x7f5f3c1394e0 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 msgr2=0x7f5f3c123810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 0x7f5f3c123810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f34010bd0 tx=0x7f5f3400e5a0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 msgr2=0x7f5f3c123810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.482+0000 7f5f3a7fc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c1394e0 0x7f5f3c123810 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f34010bd0 tx=0x7f5f3400e5a0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f43ccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:42.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 0x7f5f3c124130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f43ccc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c124670 con 0x7f5f3c123d50 2024-08-19T11:20:42.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 0x7f5f3c124130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient: get_auth_request con 0x7f5f3c123d50 auth_method 0 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 10 monclient(hunting): handle_auth_done global_id 85312 payload 824 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.488+0000 7f5f41a68640 1 -- 172.21.15.71:0/2522710026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f3c139de0 con 0x7f5f3c123d50 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f41a68640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 msgr2=0x7f5f3c124130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f41a68640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 0x7f5f3c124130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f34019000 tx=0x7f5f340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5f34018040 con 0x7f5f3c123d50 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 10 monclient: dump: 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9591 (secure 0 0 0) 0x7f5f34020e50 con 0x7f5f3c123d50 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 msgr2=0x7f5f3c124130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 0x7f5f3c124130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f34019000 tx=0x7f5f340046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 msgr2=0x7f5f3c124130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f3a7fc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f3c123d50 0x7f5f3c124130 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f34019000 tx=0x7f5f340046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 224652, 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:42.531 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f2803eab0 msgr2=0x7f5f28040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/2522710026 >> v2:172.21.15.135:6800/726754104 conn(0x7f5f2803eab0 0x7f5f28040f70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c124e00 tx=0x7f5f2c004fe0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f43ccc640 10 monclient: shutdown 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f43ccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 msgr2=0x7f5f3c0733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f43ccc640 1 --2- 172.21.15.71:0/2522710026 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f5f3c0a5020 0x7f5f3c0733d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f30035040 tx=0x7f5f300046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.491+0000 7f5f42269640 1 -- 172.21.15.71:0/2522710026 reap_dead start 2024-08-19T11:20:42.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.492+0000 7f5f42269640 1 -- 172.21.15.71:0/2522710026 reap_dead start 2024-08-19T11:20:42.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.492+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 shutdown_connections 2024-08-19T11:20:42.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.492+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 >> 172.21.15.71:0/2522710026 conn(0x7f5f3c0a91d0 msgr2=0x7f5f3c0a5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.492+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 shutdown_connections 2024-08-19T11:20:42.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.492+0000 7f5f43ccc640 1 -- 172.21.15.71:0/2522710026 wait complete. 2024-08-19T11:20:42.534 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:42.534 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-08-19T11:20:42.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:20:42.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.633+0000 7ff10d22f640 10 monclient: get_monmap_and_config 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.633+0000 7ff10d22f640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.633+0000 7ff10d22f640 10 monclient: monmap: 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:42.634146+0000 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:42.634146+0000 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 Processor -- start 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 -- start start 2024-08-19T11:20:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient: init 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient: _add_conns ranks=[10,6,0,5,4,7,3,8,2,9,1] 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff1080a6950 0x7ff1080a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): picked mon.noname-f con 0x7ff1080a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 0x7ff1080a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): picked mon.noname-d con 0x7ff1080a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff108139710 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1080a6380 con 0x7ff108139710 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff1080a5020 con 0x7ff1080a6950 2024-08-19T11:20:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff1080a77b0 con 0x7ff1080a57c0 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10d22f640 10 monclient(hunting): authenticate will time out at 1300.675666s 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 0x7ff1080a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10759e640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff108139710 0x7ff108139b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42222/0 (socket says 172.21.15.71:42222) 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10759e640 1 -- 172.21.15.71:0/863653719 learned_addr learned my addr 172.21.15.71:0/863653719 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): get_auth_request con 0x7ff1080a57c0 auth_method 0 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff106d9d640 1 --2- 172.21.15.71:0/863653719 >> v2:172.21.15.135:3300/0 conn(0x7ff1080a6950 0x7ff1080a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff106d9d640 10 monclient(hunting): get_auth_request con 0x7ff1080a6950 auth_method 0 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff106d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff106d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.634+0000 7ff106d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 10 monclient(hunting): handle_auth_done global_id 104703 payload 274 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 1 -- 172.21.15.71:0/863653719 >> v2:172.21.15.135:3300/0 conn(0x7ff1080a6950 msgr2=0x7ff1080a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 1 --2- 172.21.15.71:0/863653719 >> v2:172.21.15.135:3300/0 conn(0x7ff1080a6950 0x7ff1080a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 1 -- 172.21.15.71:0/863653719 >> v1:172.21.15.71:6789/0 conn(0x7ff108139710 legacy=0x7ff108139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 1 monclient: found mon.noname-d 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.635+0000 7ff10659c640 1 -- 172.21.15.71:0/863653719 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1080a3650 con 0x7ff1080a57c0 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff10659c640 1 -- 172.21.15.71:0/863653719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 msgr2=0x7ff1080a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff10659c640 1 --2- 172.21.15.71:0/863653719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 0x7ff1080a7270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097d0 tx=0x7ff0fc02a000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ef2e4eb6d5ae2d60 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 1 -- 172.21.15.71:0/863653719 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0fc037070 con 0x7ff1080a57c0 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 10 monclient: dump: 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.637+0000 7ff105d9b640 1 -- 172.21.15.71:0/863653719 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc02ad20 con 0x7ff1080a57c0 2024-08-19T11:20:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 5 monclient: authenticate success, global_id 104703 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff105d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff105d9b640 1 -- 172.21.15.71:0/863653719 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0fc030c20 con 0x7ff1080a57c0 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 4 set_mon_vals no callback set 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff105d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff105d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff105d9b640 10 monclient: dump: 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 10 monclient: shutdown 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 -- 172.21.15.71:0/863653719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 msgr2=0x7ff1080a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 --2- 172.21.15.71:0/863653719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 0x7ff1080a7270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097d0 tx=0x7ff0fc02a000 comp rx=0 tx=0).stop 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 -- 172.21.15.71:0/863653719 shutdown_connections 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 --2- 172.21.15.71:0/863653719 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff1080a57c0 0x7ff1080a7270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 --2- 172.21.15.71:0/863653719 >> v2:172.21.15.135:3300/0 conn(0x7ff1080a6950 0x7ff1080a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 -- 172.21.15.71:0/863653719 >> 172.21.15.71:0/863653719 conn(0x7ff1080abf50 msgr2=0x7ff1080ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 -- 172.21.15.71:0/863653719 shutdown_connections 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.638+0000 7ff10d22f640 1 -- 172.21.15.71:0/863653719 wait complete. 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.639+0000 7ff10d22f640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.639+0000 7ff10d22f640 10 monclient: monmap: 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.648 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.639+0000 7ff10d22f640 1 Processor -- start 2024-08-19T11:20:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.639+0000 7ff10d22f640 1 -- start start 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.639+0000 7ff10d22f640 10 monclient: init 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient: _add_conns ranks=[0,7,2,8,4,6,3,1,5] 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 0x7ff1081ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): picked mon.noname-a con 0x7ff1080a57c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff1080a6950 0x7ff1081388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): picked mon.noname-i con 0x7ff1080a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff108139710 0x7ff108138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): picked mon.noname-b con 0x7ff108139710 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1080a84c0 con 0x7ff1080a57c0 2024-08-19T11:20:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff1080a7d40 con 0x7ff108139710 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7ff1080a8700 con 0x7ff1080a6950 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10d22f640 10 monclient(hunting): authenticate will time out at 1300.681315s 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 0x7ff1081ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 0x7ff1081ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54176/0 (socket says 172.21.15.71:54176) 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 -- 172.21.15.71:0/2836174006 learned_addr learned my addr 172.21.15.71:0/2836174006 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): get_auth_request con 0x7ff1080a57c0 auth_method 0 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff108139710 0x7ff108138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): get_auth_request con 0x7ff108139710 auth_method 0 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff1080a6950 0x7ff1081388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): get_auth_request con 0x7ff1080a6950 auth_method 0 2024-08-19T11:20:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient(hunting): handle_auth_done global_id 75753 payload 824 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff1080a6950 msgr2=0x7ff1081388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7ff1080a6950 0x7ff1081388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff108139710 msgr2=0x7ff108138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff108139710 0x7ff108138df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 monclient: found mon.noname-a 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.640+0000 7ff106d9d640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff108123f10 con 0x7ff1080a57c0 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.642+0000 7ff106d9d640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 msgr2=0x7ff1081ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.642+0000 7ff106d9d640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 0x7ff1081ce180 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800d800 tx=0x7ff0f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0f800bd40 con 0x7ff1080a57c0 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: dump: 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 5 monclient: authenticate success, global_id 75753 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8019070 con 0x7ff1080a57c0 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 10 monclient: _renew_subs 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1080a1f90 con 0x7ff1080a57c0 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0f80148a0 con 0x7ff1080a57c0 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff0ef7fe640 10 monclient: dump: 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 10 monclient: _renew_subs 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10559a640 4 set_mon_vals no callback set 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff108126270 con 0x7ff1080a57c0 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 0x7ff108122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.643+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff10806a590 con 0x7ff1081225a0 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff0f8014430 con 0x7ff1080a57c0 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff0ef7fe640 1 --2- 172.21.15.71:0/2836174006 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f403eab0 0x7ff0f4040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 0x7ff108122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient: get_auth_request con 0x7ff1081225a0 auth_method 0 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(292..292 src has 1..292) ==== 3898+0+0 (secure 0 0 0) 0x7ff0f800f040 con 0x7ff1080a57c0 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10759e640 1 --2- 172.21.15.71:0/2836174006 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f403eab0 0x7ff0f4040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10759e640 10 monclient: get_auth_request con 0x7ff0f403eab0 auth_method 0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 10 monclient(hunting): handle_auth_done global_id 46092 payload 824 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.644+0000 7ff10659c640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1080a6d30 con 0x7ff1081225a0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.646+0000 7ff10659c640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 msgr2=0x7ff108122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.646+0000 7ff10659c640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 0x7ff108122980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc034000 tx=0x7ff0fc0046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff10759e640 1 --2- 172.21.15.71:0/2836174006 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f403eab0 0x7ff0f4040f70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff1000055a0 tx=0x7ff100005530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0fc042070 con 0x7ff1081225a0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:42.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 10 monclient: dump: 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff0fc003a30 con 0x7ff1081225a0 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 msgr2=0x7ff108122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 0x7ff108122980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc034000 tx=0x7ff0fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 msgr2=0x7ff108122980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.647+0000 7ff0ef7fe640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff1081225a0 0x7ff108122980 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc034000 tx=0x7ff0fc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10d22f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10d22f640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 0x7ff10809da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10d22f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff108076c60 con 0x7ff108122ec0 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10659c640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 0x7ff10809da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10659c640 10 monclient: get_auth_request con 0x7ff108122ec0 auth_method 0 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10659c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.653+0000 7ff10659c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.654+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.654+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.654+0000 7ff10659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.654+0000 7ff10659c640 10 monclient(hunting): handle_auth_done global_id 46101 payload 824 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.654+0000 7ff10659c640 1 -- 172.21.15.71:0/2836174006 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff1081ce6c0 con 0x7ff108122ec0 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.656+0000 7ff10659c640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 msgr2=0x7ff10809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.656+0000 7ff10659c640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 0x7ff10809da00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff1080a1dc0 tx=0x7ff0fc009190 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.656+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff0fc037040 con 0x7ff108122ec0 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.656+0000 7ff0ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.656+0000 7ff0ef7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.656+0000 7ff0ef7fe640 10 monclient: dump: 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7ff0fc03d440 con 0x7ff108122ec0 2024-08-19T11:20:42.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 msgr2=0x7ff10809da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 0x7ff10809da00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff1080a1dc0 tx=0x7ff0fc009190 comp rx=0 tx=0).stop 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 msgr2=0x7ff10809da00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff0ef7fe640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff108122ec0 0x7ff10809da00 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff1080a1dc0 tx=0x7ff0fc009190 comp rx=0 tx=0).stop 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:42.670 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 411679, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:20:42.671 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.672 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.674 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.675 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.676 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.677 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.678 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.679 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.681 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.684 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:42.687 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.688 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.689 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.690 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.691 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.692 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:42.693 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f403eab0 msgr2=0x7ff0f4040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 --2- 172.21.15.71:0/2836174006 >> v2:172.21.15.135:6800/726754104 conn(0x7ff0f403eab0 0x7ff0f4040f70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff1000055a0 tx=0x7ff100005530 comp rx=0 tx=0).stop 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 10 monclient: shutdown 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 msgr2=0x7ff1081ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 0x7ff1081ce180 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800d800 tx=0x7ff0f800dcc0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10759e640 1 -- 172.21.15.71:0/2836174006 reap_dead start 2024-08-19T11:20:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 shutdown_connections 2024-08-19T11:20:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 --2- 172.21.15.71:0/2836174006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080a57c0 0x7ff1081ce180 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 >> 172.21.15.71:0/2836174006 conn(0x7ff1080abf50 msgr2=0x7ff1081c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 shutdown_connections 2024-08-19T11:20:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.657+0000 7ff10d22f640 1 -- 172.21.15.71:0/2836174006 wait complete. 2024-08-19T11:20:42.697 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:42.697 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-08-19T11:20:42.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:20:42.794 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:42.794 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28801]: starting. 2024-08-19T11:20:42.795 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28801]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28765 2024-08-19T11:20:42.795 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28801]: shutting down. 2024-08-19T11:20:42.796 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:42.796 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:42.796 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:20:42.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.802+0000 7fcd3993a640 10 monclient: get_monmap_and_config 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.802+0000 7fcd3993a640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.802+0000 7fcd3993a640 10 monclient: monmap: 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:42.802987+0000 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:42.802987+0000 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:42.803 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:42.804 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.802+0000 7fcd3993a640 1 Processor -- start 2024-08-19T11:20:42.806 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.802+0000 7fcd3993a640 1 -- start start 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.802+0000 7fcd3993a640 10 monclient: init 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient: _add_conns ranks=[3,0,6,1,4,8,9,2,10,5,7] 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd340a6950 0x7fcd340a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): picked mon.noname-g con 0x7fcd340a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcd340a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 0x7fcd34139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): picked mon.noname-d con 0x7fcd340a7270 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340a6380 con 0x7fcd340a57c0 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340a5020 con 0x7fcd340a6950 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcd340a7d40 con 0x7fcd340a7270 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd3993a640 10 monclient(hunting): authenticate will time out at 1300.844484s 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 0x7fcd34139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd2a7fc640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcd340a57c0 0x7fcd34139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:42234/0 (socket says 172.21.15.71:42234) 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd2a7fc640 1 -- 172.21.15.71:0/3073593840 learned_addr learned my addr 172.21.15.71:0/3073593840 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): get_auth_request con 0x7fcd340a7270 auth_method 0 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd32ffd640 1 --2- 172.21.15.71:0/3073593840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd340a6950 0x7fcd340a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd32ffd640 10 monclient(hunting): get_auth_request con 0x7fcd340a6950 auth_method 0 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd32ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd32ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient(hunting): handle_auth_done global_id 104712 payload 274 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 1 -- 172.21.15.71:0/3073593840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd340a6950 msgr2=0x7fcd340a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 1 --2- 172.21.15.71:0/3073593840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd340a6950 0x7fcd340a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 1 -- 172.21.15.71:0/3073593840 >> v1:172.21.15.71:6789/0 conn(0x7fcd340a57c0 legacy=0x7fcd34139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 1 monclient: found mon.noname-d 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:20:42.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.803+0000 7fcd337fe640 1 -- 172.21.15.71:0/3073593840 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd340a3650 con 0x7fcd340a7270 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd337fe640 1 -- 172.21.15.71:0/3073593840 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 msgr2=0x7fcd34139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd337fe640 1 --2- 172.21.15.71:0/3073593840 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 0x7fcd34139e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009df0 tx=0x7fcd2c02a4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=b3f5a890ba47b2b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 1 -- 172.21.15.71:0/3073593840 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd2c007bc0 con 0x7fcd340a7270 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: dump: 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.817 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 1 -- 172.21.15.71:0/3073593840 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c007d80 con 0x7fcd340a7270 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd3993a640 5 monclient: authenticate success, global_id 104712 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd3993a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd3993a640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 1 -- 172.21.15.71:0/3073593840 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd2c031870 con 0x7fcd340a7270 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd3993a640 4 set_mon_vals no callback set 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.806+0000 7fcd327fc640 10 monclient: dump: 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.819 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 10 monclient: shutdown 2024-08-19T11:20:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 -- 172.21.15.71:0/3073593840 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 msgr2=0x7fcd34139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 --2- 172.21.15.71:0/3073593840 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 0x7fcd34139e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009df0 tx=0x7fcd2c02a4b0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 -- 172.21.15.71:0/3073593840 shutdown_connections 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 --2- 172.21.15.71:0/3073593840 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcd340a7270 0x7fcd34139e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 --2- 172.21.15.71:0/3073593840 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd340a6950 0x7fcd340a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 -- 172.21.15.71:0/3073593840 >> 172.21.15.71:0/3073593840 conn(0x7fcd340abf50 msgr2=0x7fcd340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 -- 172.21.15.71:0/3073593840 shutdown_connections 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 1 -- 172.21.15.71:0/3073593840 wait complete. 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.807+0000 7fcd3993a640 10 monclient: monmap: 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:42.821 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.822 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.808+0000 7fcd3993a640 1 Processor -- start 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.808+0000 7fcd3993a640 1 -- start start 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.808+0000 7fcd3993a640 10 monclient: init 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.808+0000 7fcd3993a640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.808+0000 7fcd3993a640 10 monclient: _add_conns ranks=[4,5,0,3,2,1,6,8,7] 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd340a57c0 0x7fcd341ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): picked mon.noname-c con 0x7fcd340a57c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd340a6950 0x7fcd34139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): picked mon.noname-h con 0x7fcd340a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 0x7fcd341235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): picked mon.noname-a con 0x7fcd340a7270 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340a8700 con 0x7fcd340a7270 2024-08-19T11:20:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcd340a84c0 con 0x7fcd340a57c0 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcd340a7690 con 0x7fcd340a6950 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd3993a640 10 monclient(hunting): authenticate will time out at 1300.850079s 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd340a57c0 0x7fcd341ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 0x7fcd341235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd340a57c0 0x7fcd341ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:40702/0 (socket says 172.21.15.71:40702) 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 1 -- 172.21.15.71:0/1605132622 learned_addr learned my addr 172.21.15.71:0/1605132622 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): get_auth_request con 0x7fcd340a7270 auth_method 0 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): get_auth_request con 0x7fcd340a57c0 auth_method 0 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd340a6950 0x7fcd34139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): get_auth_request con 0x7fcd340a6950 auth_method 0 2024-08-19T11:20:42.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd2a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient(hunting): handle_auth_done global_id 75762 payload 824 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd340a6950 msgr2=0x7fcd34139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd340a6950 0x7fcd34139c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd340a57c0 msgr2=0x7fcd341ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd340a57c0 0x7fcd341ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 monclient: found mon.noname-a 2024-08-19T11:20:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd337fe640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd34125040 con 0x7fcd340a7270 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.809+0000 7fcd32ffd640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcd340a57c0 0x7fcd341ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd337fe640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 msgr2=0x7fcd341235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd337fe640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 0x7fcd341235a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c031000 tx=0x7fcd2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd2c003e50 con 0x7fcd340a7270 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: dump: 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.827 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0046c0 con 0x7fcd340a7270 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 5 monclient: authenticate success, global_id 75762 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 10 monclient: _renew_subs 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd2c03b880 con 0x7fcd340a7270 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd341273a0 con 0x7fcd340a7270 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd31ffb640 4 set_mon_vals no callback set 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd30ff9640 10 monclient: dump: 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.829 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.830 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 10 monclient: _renew_subs 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.811+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd341ce760 con 0x7fcd340a7270 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd3993a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd3993a640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 0x7fcd34123ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcd34076c60 con 0x7fcd3413a150 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 0x7fcd34123ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcd2c03b410 con 0x7fcd340a7270 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 10 monclient: get_auth_request con 0x7fcd3413a150 auth_method 0 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.812+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd30ff9640 1 --2- 172.21.15.71:0/1605132622 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd1403ec20 0x7fcd140410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(293..293 src has 1..293) ==== 3506+0+0 (secure 0 0 0) 0x7fcd2c072a00 con 0x7fcd340a7270 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_done global_id 46436 payload 824 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd32ffd640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd340a3fd0 con 0x7fcd3413a150 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd2a7fc640 1 --2- 172.21.15.71:0/1605132622 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd1403ec20 0x7fcd140410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.813+0000 7fcd2a7fc640 10 monclient: get_auth_request con 0x7fcd1403ec20 auth_method 0 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd32ffd640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 msgr2=0x7fcd34123ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd32ffd640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 0x7fcd34123ae0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcd24010c80 tx=0x7fcd2400e5a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd24018070 con 0x7fcd3413a150 2024-08-19T11:20:42.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 10 monclient: dump: 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd2a7fc640 1 --2- 172.21.15.71:0/1605132622 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd1403ec20 0x7fcd140410e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c007c90 tx=0x7fcd1c007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcd24014640 con 0x7fcd3413a150 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 msgr2=0x7fcd34123ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 0x7fcd34123ae0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcd24010c80 tx=0x7fcd2400e5a0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 msgr2=0x7fcd34123ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.815+0000 7fcd30ff9640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd3413a150 0x7fcd34123ae0 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcd24010c80 tx=0x7fcd2400e5a0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.821+0000 7fcd3993a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.821+0000 7fcd3993a640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 0x7fcd3409e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd3993a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fcd34124430 con 0x7fcd34124020 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 0x7fcd3409e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient: get_auth_request con 0x7fcd34124020 auth_method 0 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 10 monclient(hunting): handle_auth_done global_id 46445 payload 824 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.822+0000 7fcd32ffd640 1 -- 172.21.15.71:0/1605132622 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd340a9380 con 0x7fcd34124020 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.824+0000 7fcd32ffd640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 msgr2=0x7fcd3409e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.824+0000 7fcd32ffd640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 0x7fcd3409e5d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd2401a000 tx=0x7fcd240046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.824+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcd2402b020 con 0x7fcd34124020 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 10 monclient: dump: 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9257 (secure 0 0 0) 0x7fcd2401dbd0 con 0x7fcd34124020 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 msgr2=0x7fcd3409e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 0x7fcd3409e5d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd2401a000 tx=0x7fcd240046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 msgr2=0x7fcd3409e5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd30ff9640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fcd34124020 0x7fcd3409e5d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 411847, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:42.840 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.842 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:42.843 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:42.844 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.845 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.849 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.850 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:42.854 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.856 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.857 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.858 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:42.859 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.861 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:42.862 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd1403ec20 msgr2=0x7fcd140410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 --2- 172.21.15.71:0/1605132622 >> v2:172.21.15.135:6800/726754104 conn(0x7fcd1403ec20 0x7fcd140410e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c007c90 tx=0x7fcd1c007be0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 10 monclient: shutdown 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 msgr2=0x7fcd341235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd337fe640 1 -- 172.21.15.71:0/1605132622 reap_dead start 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 0x7fcd341235a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c031000 tx=0x7fcd2c004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 shutdown_connections 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 --2- 172.21.15.71:0/1605132622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd340a7270 0x7fcd341235a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 >> 172.21.15.71:0/1605132622 conn(0x7fcd340abf50 msgr2=0x7fcd341c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 shutdown_connections 2024-08-19T11:20:42.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.825+0000 7fcd3993a640 1 -- 172.21.15.71:0/1605132622 wait complete. 2024-08-19T11:20:42.865 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:42.865 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-08-19T11:20:42.865 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.963+0000 7f94aed98640 10 monclient: get_monmap_and_config 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.963+0000 7f94aed98640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.963+0000 7f94aed98640 10 monclient: monmap: 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:20:42.963904+0000 2024-08-19T11:20:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:20:42.963904+0000 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:20:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:20:42.966 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 Processor -- start 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 -- start start 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient: init 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient: _add_conns ranks=[2,9,10,8,1,0,6,7,5,3,4] 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 0x7f94a80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): picked mon.noname-b con 0x7f94a80a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:20:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 0x7f94a80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): picked mon.noname-a con 0x7f94a80a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f94a8139710 0x7f94a8139b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): picked mon.noname-f con 0x7f94a8139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f94a80a5020 con 0x7f94a80a57c0 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f94a80a77b0 con 0x7f94a8139710 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f94a80a7d40 con 0x7f94a80a6950 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94aed98640 10 monclient(hunting): authenticate will time out at 1301.005620s 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 0x7f94a80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 0x7f94a80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 0x7f94a80a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54180/0 (socket says 172.21.15.71:54180) 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 0x7f94a80a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35434/0 (socket says 172.21.15.71:35434) 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 1 -- 172.21.15.71:0/3825155479 learned_addr learned my addr 172.21.15.71:0/3825155479 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): get_auth_request con 0x7f94a80a57c0 auth_method 0 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): get_auth_request con 0x7f94a80a6950 auth_method 0 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94ad335640 1 --2- 172.21.15.71:0/3825155479 >> v2:172.21.15.135:3300/0 conn(0x7f94a8139710 0x7f94a8139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94acb34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94ad335640 10 monclient(hunting): get_auth_request con 0x7f94a8139710 auth_method 0 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94ad335640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94ad335640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.964+0000 7f94ad335640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94ad335640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94ad335640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94ad335640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 10 monclient(hunting): handle_auth_done global_id 75773 payload 274 2024-08-19T11:20:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 1 -- 172.21.15.71:0/3825155479 >> v2:172.21.15.135:3300/0 conn(0x7f94a8139710 msgr2=0x7f94a8139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 1 --2- 172.21.15.71:0/3825155479 >> v2:172.21.15.135:3300/0 conn(0x7f94a8139710 0x7f94a8139b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 1 -- 172.21.15.71:0/3825155479 >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 msgr2=0x7f94a80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 1 --2- 172.21.15.71:0/3825155479 >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 0x7f94a80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 1 monclient: found mon.noname-b 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94acb34640 1 -- 172.21.15.71:0/3825155479 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a80a6380 con 0x7f94a80a6950 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.965+0000 7f94a7fff640 1 --2- 172.21.15.71:0/3825155479 >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 0x7f94a80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.967+0000 7f94acb34640 1 -- 172.21.15.71:0/3825155479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 msgr2=0x7f94a80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.967+0000 7f94acb34640 1 --2- 172.21.15.71:0/3825155479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 0x7f94a80a6d30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f94a806c930 tx=0x7f94a002a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aed0146a029ae525 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 1 -- 172.21.15.71:0/3825155479 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94a0037070 con 0x7f94a80a6950 2024-08-19T11:20:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: dump: 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 1 -- 172.21.15.71:0/3825155479 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a002ad60 con 0x7f94a80a6950 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 5 monclient: authenticate success, global_id 75773 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 10 monclient: get_monmap_and_config success 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 1 -- 172.21.15.71:0/3825155479 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94a0030c20 con 0x7f94a80a6950 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 4 set_mon_vals no callback set 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94a77fe640 10 monclient: dump: 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 10 monclient: shutdown 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 -- 172.21.15.71:0/3825155479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 msgr2=0x7f94a80a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 --2- 172.21.15.71:0/3825155479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 0x7f94a80a6d30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f94a806c930 tx=0x7f94a002a000 comp rx=0 tx=0).stop 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 -- 172.21.15.71:0/3825155479 shutdown_connections 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 --2- 172.21.15.71:0/3825155479 >> v2:172.21.15.135:3300/0 conn(0x7f94a8139710 0x7f94a8139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 --2- 172.21.15.71:0/3825155479 >> v2:172.21.15.71:3300/0 conn(0x7f94a80a57c0 0x7f94a80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 --2- 172.21.15.71:0/3825155479 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f94a80a6950 0x7f94a80a6d30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 -- 172.21.15.71:0/3825155479 >> 172.21.15.71:0/3825155479 conn(0x7f94a80abf50 msgr2=0x7f94a80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 -- 172.21.15.71:0/3825155479 shutdown_connections 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.968+0000 7f94aed98640 1 -- 172.21.15.71:0/3825155479 wait complete. 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.969+0000 7f94aed98640 10 monclient: build_initial_monmap 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.969+0000 7f94aed98640 10 monclient: monmap: 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.969+0000 7f94aed98640 1 Processor -- start 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.969+0000 7f94aed98640 1 -- start start 2024-08-19T11:20:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.969+0000 7f94aed98640 10 monclient: init 2024-08-19T11:20:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient: _reopen_session rank -1 2024-08-19T11:20:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient: _add_conns ranks=[1,3,8,6,7,5,4,0,2] 2024-08-19T11:20:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 0x7f94a81386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): picked mon.noname-f con 0x7f94a80a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94a80a6950 0x7f94a8138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): picked mon.noname-g con 0x7f94a80a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94a8139710 0x7f94a81225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): picked mon.noname-e con 0x7f94a8139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94a80a84c0 con 0x7f94a80a57c0 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f94a80a3650 con 0x7f94a80a6950 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f94a80a8700 con 0x7f94a8139710 2024-08-19T11:20:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): _renew_subs 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94aed98640 10 monclient(hunting): authenticate will time out at 1301.011260s 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94ad335640 1 -- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94a8139710 msgr2=0x7f94a81225a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.71:3304/0 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94ad335640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94a8139710 0x7f94a81225a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 0x7f94a81386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94a80a6950 0x7f94a8138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 0x7f94a81386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:46090/0 (socket says 172.21.15.71:46090) 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 -- 172.21.15.71:0/1945101473 learned_addr learned my addr 172.21.15.71:0/1945101473 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): get_auth_request con 0x7f94a80a57c0 auth_method 0 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): get_auth_request con 0x7f94a80a6950 auth_method 0 2024-08-19T11:20:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient(hunting): handle_auth_done global_id 85357 payload 824 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94a8139710 msgr2=0x7f94a81225a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f94a8139710 0x7f94a81225a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94a80a6950 msgr2=0x7f94a8138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94a80a6950 0x7f94a8138c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient: _finish_hunting 0 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 monclient: found mon.noname-f 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.135:3300/0 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94acb34640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a8125dc0 con 0x7f94a80a57c0 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.970+0000 7f94a7fff640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f94a80a6950 0x7f94a8138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94acb34640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 msgr2=0x7f94a81386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94acb34640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 0x7f94a81386e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009890 tx=0x7f94a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94a0040030 con 0x7f94a80a57c0 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: dump: 2024-08-19T11:20:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.991 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: _finish_auth 0 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: _check_auth_tickets 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a0038040 con 0x7f94a80a57c0 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 5 monclient: authenticate success, global_id 85357 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 10 monclient: _renew_subs 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f94a0037070 con 0x7f94a80a57c0 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a81260a0 con 0x7f94a80a57c0 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a57fa640 10 monclient: dump: 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 10 monclient: _renew_subs 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94a6ffd640 4 set_mon_vals no callback set 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.973+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a8125800 con 0x7f94a80a57c0 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94aed98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94aed98640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 0x7f94a81232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f94a81259d0 con 0x7f94a81248a0 2024-08-19T11:20:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 0x7f94a81232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient: get_auth_request con 0x7f94a81248a0 auth_method 0 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f94a0043070 con 0x7f94a80a57c0 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a57fa640 1 --2- 172.21.15.71:0/1945101473 >> v2:172.21.15.135:6800/726754104 conn(0x7f948803ea80 0x7f9488040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 10 monclient(hunting): handle_auth_done global_id 85273 payload 824 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a7fff640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94a813a200 con 0x7f94a81248a0 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(293..293 src has 1..293) ==== 3506+0+0 (secure 0 0 0) 0x7f94a0041070 con 0x7f94a80a57c0 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94ad335640 1 --2- 172.21.15.71:0/1945101473 >> v2:172.21.15.135:6800/726754104 conn(0x7f948803ea80 0x7f9488040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.974+0000 7f94ad335640 10 monclient: get_auth_request con 0x7f948803ea80 auth_method 0 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a7fff640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 msgr2=0x7f94a81232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a7fff640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 0x7f94a81232a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94a81243b0 tx=0x7f94980077c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9498017dd0 con 0x7f94a81248a0 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 10 monclient: dump: 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94ad335640 1 --2- 172.21.15.71:0/1945101473 >> v2:172.21.15.135:6800/726754104 conn(0x7f948803ea80 0x7f9488040f40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9490009450 tx=0x7f9490009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9498017960 con 0x7f94a81248a0 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:20:42.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 msgr2=0x7f94a81232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 0x7f94a81232a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94a81243b0 tx=0x7f94980077c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 msgr2=0x7f94a81232a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.977+0000 7f94a57fa640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a81248a0 0x7f94a81232a0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94a81243b0 tx=0x7f94980077c0 comp rx=0 tx=0).stop 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94aed98640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94aed98640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 0x7f94a802d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94aed98640 10 monclient(hunting): start opening mon connection 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f94a8076c60 con 0x7f94a802d1c0 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 0x7f94a802d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient: get_auth_request con 0x7f94a802d1c0 auth_method 0 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:20:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:20:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.983+0000 7f94a7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:20:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.984+0000 7f94a7fff640 10 monclient(hunting): handle_auth_done global_id 85282 payload 824 2024-08-19T11:20:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.984+0000 7f94a7fff640 1 -- 172.21.15.71:0/1945101473 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f94a80a6d30 con 0x7f94a802d1c0 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a7fff640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 msgr2=0x7f94a802d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a7fff640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 0x7f94a802d5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f949801b000 tx=0x7f9498004a40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9498021020 con 0x7f94a802d1c0 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 10 monclient: dump: 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:20:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9424 (secure 0 0 0) 0x7f9498015620 con 0x7f94a802d1c0 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:20:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 msgr2=0x7f94a802d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 0x7f94a802d5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f949801b000 tx=0x7f9498004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 msgr2=0x7f94a802d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.986+0000 7f94a57fa640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f94a802d1c0 0x7f94a802d5a0 secure :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f949801b000 tx=0x7f9498004a40 comp rx=0 tx=0).stop 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 194, 2024-08-19T11:20:43.002 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 225147, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: 7 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 1, 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:43.003 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:43.004 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:43.005 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:20:43.006 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:20:43.007 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:20:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:20:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:20:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:20:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:20:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:20:43.025 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:20:43.026 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:20:43.026 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:20:43.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:20:43.026 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:20:43.026 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:20:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 >> v2:172.21.15.135:6800/726754104 conn(0x7f948803ea80 msgr2=0x7f9488040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 --2- 172.21.15.71:0/1945101473 >> v2:172.21.15.135:6800/726754104 conn(0x7f948803ea80 0x7f9488040f40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9490009450 tx=0x7f9490009190 comp rx=0 tx=0).stop 2024-08-19T11:20:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 10 monclient: shutdown 2024-08-19T11:20:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:20:43.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 msgr2=0x7f94a81386e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 --2- 172.21.15.71:0/1945101473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94a80a57c0 0x7f94a81386e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009890 tx=0x7f94a00046c0 comp rx=0 tx=0).stop 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94ad335640 1 -- 172.21.15.71:0/1945101473 reap_dead start 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94ad335640 1 -- 172.21.15.71:0/1945101473 reap_dead start 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 shutdown_connections 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 >> 172.21.15.71:0/1945101473 conn(0x7f94a80abf50 msgr2=0x7f94a80aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 shutdown_connections 2024-08-19T11:20:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:20:42.987+0000 7f94aed98640 1 -- 172.21.15.71:0/1945101473 wait complete. 2024-08-19T11:20:43.028 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-08-19T11:20:43.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: starting. 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28868 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: created object 0... 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: created object 25... 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: created object 49... 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: finishing. 2024-08-19T11:20:44.915 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28869]: shutting down. 2024-08-19T11:20:45.814 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28870]: starting. 2024-08-19T11:20:45.814 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28870]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28868 2024-08-19T11:20:45.814 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28870]: shutting down. 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: starting. 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28868 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: created object 0... 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: created object 25... 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: created object 49... 2024-08-19T11:20:48.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: finishing. 2024-08-19T11:20:48.931 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[28903]: shutting down. 2024-08-19T11:20:48.967 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:48.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28905]: starting. 2024-08-19T11:20:48.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28905]: listing objects. 2024-08-19T11:20:48.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28905]: listed object 0... 2024-08-19T11:20:48.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28905]: listed object 25... 2024-08-19T11:20:48.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28905]: saw 50 objects 2024-08-19T11:20:48.968 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[28905]: shutting down. 2024-08-19T11:20:49.828 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:49.829 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28904]: starting. 2024-08-19T11:20:49.829 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28904]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28868 2024-08-19T11:20:49.829 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[28904]: shutting down. 2024-08-19T11:20:49.830 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:49.831 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:20:49.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: starting. 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28971 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: created object 0... 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: created object 25... 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: created object 49... 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: finishing. 2024-08-19T11:20:52.022 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[28972]: shutting down. 2024-08-19T11:20:52.929 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28973]: starting. 2024-08-19T11:20:52.929 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28973]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28971 2024-08-19T11:20:52.930 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[28973]: shutting down. 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: starting. 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-28971 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: created object 0... 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: created object 25... 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: created object 49... 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: finishing. 2024-08-19T11:20:55.150 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29006]: shutting down. 2024-08-19T11:20:55.188 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:55.188 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29008]: starting. 2024-08-19T11:20:55.189 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29008]: listing objects. 2024-08-19T11:20:55.189 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29008]: listed object 0... 2024-08-19T11:20:55.189 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29008]: listed object 25... 2024-08-19T11:20:55.189 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29008]: saw 50 objects 2024-08-19T11:20:55.189 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29008]: shutting down. 2024-08-19T11:20:56.042 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:56.042 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29007]: starting. 2024-08-19T11:20:56.042 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29007]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-28971 2024-08-19T11:20:56.043 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29007]: shutting down. 2024-08-19T11:20:56.044 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:56.044 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:20:56.044 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:20:56.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:20:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: starting. 2024-08-19T11:20:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-29074 2024-08-19T11:20:58.694 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: created object 0... 2024-08-19T11:20:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: created object 25... 2024-08-19T11:20:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: created object 49... 2024-08-19T11:20:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: finishing. 2024-08-19T11:20:58.695 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29075]: shutting down. 2024-08-19T11:21:00.131 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29076]: starting. 2024-08-19T11:21:00.131 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29076]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-29074 2024-08-19T11:21:00.131 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29076]: shutting down. 2024-08-19T11:21:02.264 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:02.264 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: starting. 2024-08-19T11:21:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-29074 2024-08-19T11:21:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: created object 0... 2024-08-19T11:21:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: created object 25... 2024-08-19T11:21:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: created object 49... 2024-08-19T11:21:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: finishing. 2024-08-19T11:21:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29109]: shutting down. 2024-08-19T11:21:02.303 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:02.303 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29111]: starting. 2024-08-19T11:21:02.303 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29111]: listing objects. 2024-08-19T11:21:02.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29111]: listed object 0... 2024-08-19T11:21:02.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29111]: listed object 25... 2024-08-19T11:21:02.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29111]: saw 50 objects 2024-08-19T11:21:02.304 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29111]: shutting down. 2024-08-19T11:21:03.029 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-08-19T11:21:03.029 INFO:tasks.ceph.mon.e:Restarting daemon 2024-08-19T11:21:03.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-08-19T11:21:03.032 INFO:tasks.ceph.mon.e:Started 2024-08-19T11:21:03.032 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-08-19T11:21:03.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:21:03.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.142+0000 7f557bf04640 10 monclient: get_monmap_and_config 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.142+0000 7f557bf04640 10 monclient: build_initial_monmap 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.142+0000 7f557bf04640 10 monclient: monmap: 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:03.144346+0000 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:03.144346+0000 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:03.146 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:03.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.144+0000 7f557bf04640 1 Processor -- start 2024-08-19T11:21:03.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.145+0000 7f557bf04640 1 -- start start 2024-08-19T11:21:03.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.145+0000 7f557bf04640 10 monclient: init 2024-08-19T11:21:03.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.145+0000 7f557bf04640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:03.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient: _add_conns ranks=[9,5,6,8,0,7,1,2,10,3,4] 2024-08-19T11:21:03.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f55741398f0 0x7f5574139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): picked mon.noname-a con 0x7f55741398f0 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f557409d490 0x7f55740a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): picked mon.noname-h con 0x7f557409d490 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 0x7f55740a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): picked mon.noname-d con 0x7f55740a34e0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f55740a43a0 con 0x7f55741398f0 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f557409cc70 con 0x7f557409d490 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f557409dd10 con 0x7f55740a34e0 2024-08-19T11:21:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557bf04640 10 monclient(hunting): authenticate will time out at 1321.188133s 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.146+0000 7f557949f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f557409d490 0x7f55740a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 0x7f55740a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 0x7f55740a3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:56922/0 (socket says 172.21.15.71:56922) 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f557409d490 0x7f55740a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:42428/0 (socket says 172.21.15.71:42428) 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 1 -- 172.21.15.71:0/2584258425 learned_addr learned my addr 172.21.15.71:0/2584258425 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 10 monclient(hunting): get_auth_request con 0x7f55740a34e0 auth_method 0 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557a4a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): get_auth_request con 0x7f557409d490 auth_method 0 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f557949f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2584258425 >> v2:172.21.15.71:3300/0 conn(0x7f55741398f0 0x7f5574139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f5579ca0640 10 monclient(hunting): get_auth_request con 0x7f55741398f0 auth_method 0 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f5579ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f5579ca0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.147+0000 7f5579ca0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f557a4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f557a4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f557a4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 10 monclient(hunting): handle_auth_done global_id 75852 payload 274 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 1 -- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 msgr2=0x7f55740a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 0x7f55740a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 1 -- 172.21.15.71:0/2584258425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f557409d490 msgr2=0x7f55740a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f557409d490 0x7f55740a2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 10 monclient: _finish_hunting 0 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 1 monclient: found mon.noname-a 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.148+0000 7f5579ca0640 1 -- 172.21.15.71:0/2584258425 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557409dff0 con 0x7f55741398f0 2024-08-19T11:21:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.149+0000 7f557a4a1640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 0x7f55740a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:03.157 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:03.157 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29110]: starting. 2024-08-19T11:21:03.157 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29110]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-29074 2024-08-19T11:21:03.157 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29110]: shutting down. 2024-08-19T11:21:03.158 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:03.158 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:03.158 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:21:03.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5579ca0640 1 -- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55741398f0 msgr2=0x7f5574139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55741398f0 0x7f5574139cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f55700097a0 tx=0x7f5570029fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385c11076758589 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 1 -- 172.21.15.71:0/2584258425 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5570037070 con 0x7f55741398f0 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: dump: 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: _finish_auth 0 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: _check_auth_tickets 2024-08-19T11:21:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 1 -- 172.21.15.71:0/2584258425 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557002ad30 con 0x7f55741398f0 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 1 -- 172.21.15.71:0/2584258425 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5570030c20 con 0x7f55741398f0 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f5578c9e640 10 monclient: dump: 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f557bf04640 5 monclient: authenticate success, global_id 75852 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f557bf04640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.152+0000 7f557bf04640 4 set_mon_vals no callback set 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 10 monclient: shutdown 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 -- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55741398f0 msgr2=0x7f5574139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55741398f0 0x7f5574139cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f55700097a0 tx=0x7f5570029fd0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 -- 172.21.15.71:0/2584258425 shutdown_connections 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f55740a34e0 0x7f55740a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f557409d490 0x7f55740a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 --2- 172.21.15.71:0/2584258425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55741398f0 0x7f5574139cd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 -- 172.21.15.71:0/2584258425 >> 172.21.15.71:0/2584258425 conn(0x7f557406ccc0 msgr2=0x7f557406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 -- 172.21.15.71:0/2584258425 shutdown_connections 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.153+0000 7f557bf04640 1 -- 172.21.15.71:0/2584258425 wait complete. 2024-08-19T11:21:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.154+0000 7f557bf04640 10 monclient: build_initial_monmap 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.154+0000 7f557bf04640 10 monclient: monmap: 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.154+0000 7f557bf04640 1 Processor -- start 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.154+0000 7f557bf04640 1 -- start start 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.154+0000 7f557bf04640 10 monclient: init 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient: _add_conns ranks=[2,3,7,0,5,1,6,4,8] 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 0x7f557413a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): picked mon.noname-b con 0x7f557409d490 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55740a34e0 0x7f557413aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): picked mon.noname-g con 0x7f55740a34e0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f55741398f0 0x7f557413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): picked mon.noname-i con 0x7f55741398f0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f557413a390 con 0x7f557409d490 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f557413a210 con 0x7f55740a34e0 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f557409ce80 con 0x7f55741398f0 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557bf04640 10 monclient(hunting): authenticate will time out at 1321.197528s 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 0x7f557413a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 0x7f557413a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:45954/0 (socket says 172.21.15.71:45954) 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 1 -- 172.21.15.71:0/2746373038 learned_addr learned my addr 172.21.15.71:0/2746373038 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): get_auth_request con 0x7f557409d490 auth_method 0 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557949f640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55740a34e0 0x7f557413aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557949f640 10 monclient(hunting): get_auth_request con 0x7f55740a34e0 auth_method 0 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557949f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557949f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557949f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557a4a1640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f55741398f0 0x7f557413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f5579ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557a4a1640 10 monclient(hunting): get_auth_request con 0x7f55741398f0 auth_method 0 2024-08-19T11:21:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557a4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557a4a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557a4a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.155+0000 7f557a4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f557a4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f557a4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f557949f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f557949f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f557949f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 10 monclient(hunting): handle_auth_done global_id 75890 payload 824 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 1 -- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f55741398f0 msgr2=0x7f557413af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f55741398f0 0x7f557413af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 1 -- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55740a34e0 msgr2=0x7f557413aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55740a34e0 0x7f557413aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 10 monclient: _finish_hunting 0 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 1 monclient: found mon.noname-b 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.156+0000 7f5579ca0640 1 -- 172.21.15.71:0/2746373038 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55741391f0 con 0x7f557409d490 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.158+0000 7f5579ca0640 1 -- 172.21.15.71:0/2746373038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 msgr2=0x7f557413a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.158+0000 7f5579ca0640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 0x7f557413a510 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5570035040 tx=0x7f55700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f5570037040 con 0x7f557409d490 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: dump: 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5570042070 con 0x7f557409d490 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 5 monclient: authenticate success, global_id 75890 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f557003dd20 con 0x7f557409d490 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:03.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556a7fc640 10 monclient: dump: 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f556bfff640 4 set_mon_vals no callback set 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 10 monclient: _renew_subs 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5574073950 con 0x7f557409d490 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 10 monclient: _renew_subs 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.159+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f557413bbe0 con 0x7f557409d490 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.160+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f5570003bd0 con 0x7f557409d490 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.160+0000 7f556a7fc640 1 --2- 172.21.15.71:0/2746373038 >> v2:172.21.15.135:6800/726754104 conn(0x7f555803eab0 0x7f5558040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.160+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(312..312 src has 1..312) ==== 3506+0+0 (secure 0 0 0) 0x7f5570071d20 con 0x7f557409d490 2024-08-19T11:21:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.161+0000 7f557949f640 1 --2- 172.21.15.71:0/2746373038 >> v2:172.21.15.135:6800/726754104 conn(0x7f555803eab0 0x7f5558040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.161+0000 7f557949f640 10 monclient: get_auth_request con 0x7f555803eab0 auth_method 0 2024-08-19T11:21:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.161+0000 7f557bf04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.161+0000 7f557bf04640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.161+0000 7f557bf04640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.161+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55740a3990 con 0x7f557409d490 2024-08-19T11:21:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.163+0000 7f557949f640 1 --2- 172.21.15.71:0/2746373038 >> v2:172.21.15.135:6800/726754104 conn(0x7f555803eab0 0x7f5558040f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5574073750 tx=0x7f5564009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.166+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f557003d440 con 0x7f557409d490 2024-08-19T11:21:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.166+0000 7f556a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.166+0000 7f556a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:03.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.414+0000 7f557bf04640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:21:03.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.415+0000 7f557bf04640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:03.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.415+0000 7f557bf04640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:03.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.415+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f557413cfb0 con 0x7f557409d490 2024-08-19T11:21:03.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.415+0000 7f556a7fc640 1 -- 172.21.15.71:0/2746373038 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3188 (secure 0 0 0) 0x7f557003bcd0 con 0x7f557409d490 2024-08-19T11:21:03.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.415+0000 7f556a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:03.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.415+0000 7f556a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:03.418 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":194,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 >> v2:172.21.15.135:6800/726754104 conn(0x7f555803eab0 msgr2=0x7f5558040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 --2- 172.21.15.71:0/2746373038 >> v2:172.21.15.135:6800/726754104 conn(0x7f555803eab0 0x7f5558040f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5574073750 tx=0x7f5564009190 comp rx=0 tx=0).stop 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 10 monclient: shutdown 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 msgr2=0x7f557413a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 0x7f557413a510 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5570035040 tx=0x7f55700046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 shutdown_connections 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 --2- 172.21.15.71:0/2746373038 >> v2:172.21.15.135:6800/726754104 conn(0x7f555803eab0 0x7f5558040f70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f55741398f0 0x7f557413af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55740a34e0 0x7f557413aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 --2- 172.21.15.71:0/2746373038 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f557409d490 0x7f557413a510 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:03.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 >> 172.21.15.71:0/2746373038 conn(0x7f557406ccc0 msgr2=0x7f5574131a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:03.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 shutdown_connections 2024-08-19T11:21:03.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:03.417+0000 7f557bf04640 1 -- 172.21.15.71:0/2746373038 wait complete. 2024-08-19T11:21:05.371 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: starting. 2024-08-19T11:21:05.371 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-29177 2024-08-19T11:21:05.371 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: created object 0... 2024-08-19T11:21:05.371 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: created object 25... 2024-08-19T11:21:05.371 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: created object 49... 2024-08-19T11:21:05.371 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: finishing. 2024-08-19T11:21:05.372 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29178]: shutting down. 2024-08-19T11:21:06.042 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29179]: starting. 2024-08-19T11:21:06.042 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29179]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-29177 2024-08-19T11:21:06.042 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29179]: shutting down. 2024-08-19T11:21:06.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:21:06.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.530+0000 7fee35512640 10 monclient: get_monmap_and_config 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.530+0000 7fee35512640 10 monclient: build_initial_monmap 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.530+0000 7fee35512640 10 monclient: monmap: 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:06.532433+0000 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:06.532433+0000 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:06.533 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:06.534 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 Processor -- start 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 -- start start 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient: init 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient: _add_conns ranks=[4,7,5,0,6,2,10,9,1,8,3] 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee300a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): picked mon.noname-c con 0x7fee300a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fee300a6e10 0x7fee300a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): picked mon.noname-i con 0x7fee300a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee30139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): picked mon.noname-h con 0x7fee30139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fee300a4f90 con 0x7fee300a6a30 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fee300a6380 con 0x7fee30139860 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fee300a49d0 con 0x7fee300a6e10 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.531+0000 7fee35512640 10 monclient(hunting): authenticate will time out at 1324.573956s 2024-08-19T11:21:06.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee300a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee300a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:56440/0 (socket says 172.21.15.71:56440) 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 -- 172.21.15.71:0/3846585211 learned_addr learned my addr 172.21.15.71:0/3846585211 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): get_auth_request con 0x7fee300a6a30 auth_method 0 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient(hunting): handle_auth_done global_id 85405 payload 274 2024-08-19T11:21:06.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 -- 172.21.15.71:0/3846585211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fee300a6e10 msgr2=0x7fee300a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fee300a6e10 0x7fee300a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 -- 172.21.15.71:0/3846585211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 msgr2=0x7fee30139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee30139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 monclient: found mon.noname-c 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:06.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.532+0000 7fee2effd640 1 -- 172.21.15.71:0/3846585211 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee300a46f0 con 0x7fee300a6a30 2024-08-19T11:21:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2effd640 1 -- 172.21.15.71:0/3846585211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 msgr2=0x7fee300a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2effd640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee300a57f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee20009eb0 tx=0x7fee2002a560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2144d7ff586e9222 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:06.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 1 -- 172.21.15.71:0/3846585211 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee20036070 con 0x7fee300a6a30 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: dump: 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:06.546 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: _finish_auth 0 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:21:06.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 5 monclient: authenticate success, global_id 85405 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 1 -- 172.21.15.71:0/3846585211 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee20007a70 con 0x7fee300a6a30 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 1 -- 172.21.15.71:0/3846585211 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee20007ca0 con 0x7fee300a6a30 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 4 set_mon_vals no callback set 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee2dffb640 10 monclient: dump: 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.548 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:06.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 10 monclient: shutdown 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 -- 172.21.15.71:0/3846585211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 msgr2=0x7fee300a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee300a57f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fee20009eb0 tx=0x7fee2002a560 comp rx=0 tx=0).stop 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 -- 172.21.15.71:0/3846585211 shutdown_connections 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee30139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fee300a6e10 0x7fee300a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 --2- 172.21.15.71:0/3846585211 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee300a57f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 -- 172.21.15.71:0/3846585211 >> 172.21.15.71:0/3846585211 conn(0x7fee300ac030 msgr2=0x7fee300ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 -- 172.21.15.71:0/3846585211 shutdown_connections 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.535+0000 7fee35512640 1 -- 172.21.15.71:0/3846585211 wait complete. 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.536+0000 7fee35512640 10 monclient: build_initial_monmap 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.536+0000 7fee35512640 10 monclient: monmap: 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:06.551 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:06.552 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.536+0000 7fee35512640 1 Processor -- start 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.536+0000 7fee35512640 1 -- start start 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.536+0000 7fee35512640 10 monclient: init 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient: _add_conns ranks=[4,8,5,2,1,0,6,3,7] 2024-08-19T11:21:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee30124d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): picked mon.noname-c con 0x7fee300a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 0x7fee301252a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): picked mon.noname-e con 0x7fee300a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee301257e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): picked mon.noname-h con 0x7fee30139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fee300a7730 con 0x7fee300a6a30 2024-08-19T11:21:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fee3013a1a0 con 0x7fee30139860 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fee300a2280 con 0x7fee300a6e10 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee35512640 10 monclient(hunting): authenticate will time out at 1324.579321s 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee30124d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee30124d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:56452/0 (socket says 172.21.15.71:56452) 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 -- 172.21.15.71:0/851791507 learned_addr learned my addr 172.21.15.71:0/851791507 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): get_auth_request con 0x7fee300a6a30 auth_method 0 2024-08-19T11:21:06.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 0x7fee301252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 10 monclient(hunting): get_auth_request con 0x7fee300a6e10 auth_method 0 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee301257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): get_auth_request con 0x7fee30139860 auth_method 0 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 1 -- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 msgr2=0x7fee301252a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 1 -- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 msgr2=0x7fee301252a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 0x7fee301252a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2e7fc640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 0x7fee301252a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient(hunting): handle_auth_done global_id 85414 payload 824 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 -- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 msgr2=0x7fee301252a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 0x7fee301252a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 -- 172.21.15.71:0/851791507 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 msgr2=0x7fee301257e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee301257e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 monclient: found mon.noname-c 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.537+0000 7fee2effd640 1 -- 172.21.15.71:0/851791507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee30128bb0 con 0x7fee300a6a30 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.539+0000 7fee2effd640 1 -- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 msgr2=0x7fee30124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.539+0000 7fee2effd640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee30124d60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee200093e0 tx=0x7fee20004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:06.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee20036050 con 0x7fee300a6a30 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: dump: 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:06.560 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:06.561 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee20037040 con 0x7fee300a6a30 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 5 monclient: authenticate success, global_id 85414 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 10 monclient: _renew_subs 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee300a57f0 con 0x7fee300a6a30 2024-08-19T11:21:06.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fee2003b400 con 0x7fee300a6a30 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 10 monclient: dump: 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:06.563 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:06.564 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee2d7fa640 4 set_mon_vals no callback set 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 10 monclient: _renew_subs 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fee30126850 con 0x7fee300a6a30 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.540+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fee20044030 con 0x7fee300a6a30 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee277fe640 1 --2- 172.21.15.71:0/851791507 >> v2:172.21.15.135:6800/726754104 conn(0x7fee1003ea80 0x7fee10040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee35512640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:06.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee35512640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee35512640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3013a500 con 0x7fee300a6a30 2024-08-19T11:21:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(315..315 src has 1..315) ==== 3506+0+0 (secure 0 0 0) 0x7fee20042020 con 0x7fee300a6a30 2024-08-19T11:21:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee2e7fc640 1 --2- 172.21.15.71:0/851791507 >> v2:172.21.15.135:6800/726754104 conn(0x7fee1003ea80 0x7fee10040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:06.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.541+0000 7fee2e7fc640 10 monclient: get_auth_request con 0x7fee1003ea80 auth_method 0 2024-08-19T11:21:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.544+0000 7fee2e7fc640 1 --2- 172.21.15.71:0/851791507 >> v2:172.21.15.135:6800/726754104 conn(0x7fee1003ea80 0x7fee10040f40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fee18006fd0 tx=0x7fee18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.545+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fee2004b060 con 0x7fee300a6a30 2024-08-19T11:21:06.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.545+0000 7fee277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:06.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.545+0000 7fee277fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:06.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.787+0000 7fee35512640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:21:06.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.787+0000 7fee35512640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:06.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.787+0000 7fee35512640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:06.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.787+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fee300a1200 con 0x7fee300a6a30 2024-08-19T11:21:06.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.788+0000 7fee277fe640 1 -- 172.21.15.71:0/851791507 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3188 (secure 0 0 0) 0x7fee200044c0 con 0x7fee300a6a30 2024-08-19T11:21:06.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.788+0000 7fee277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:06.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.788+0000 7fee277fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:06.791 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":194,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:21:06.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 >> v2:172.21.15.135:6800/726754104 conn(0x7fee1003ea80 msgr2=0x7fee10040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:06.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 --2- 172.21.15.71:0/851791507 >> v2:172.21.15.135:6800/726754104 conn(0x7fee1003ea80 0x7fee10040f40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fee18006fd0 tx=0x7fee18008040 comp rx=0 tx=0).stop 2024-08-19T11:21:06.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 10 monclient: shutdown 2024-08-19T11:21:06.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 msgr2=0x7fee30124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee30124d60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee200093e0 tx=0x7fee20004a40 comp rx=0 tx=0).stop 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 shutdown_connections 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 --2- 172.21.15.71:0/851791507 >> v2:172.21.15.135:6800/726754104 conn(0x7fee1003ea80 0x7fee10040f40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fee30139860 0x7fee301257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fee300a6e10 0x7fee301252a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 --2- 172.21.15.71:0/851791507 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fee300a6a30 0x7fee30124d60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 >> 172.21.15.71:0/851791507 conn(0x7fee300ac030 msgr2=0x7fee30139090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 shutdown_connections 2024-08-19T11:21:06.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:06.790+0000 7fee35512640 1 -- 172.21.15.71:0/851791507 wait complete. 2024-08-19T11:21:09.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:21:09.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.912+0000 7fb602753640 10 monclient: get_monmap_and_config 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.912+0000 7fb602753640 10 monclient: build_initial_monmap 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.912+0000 7fb602753640 10 monclient: monmap: 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:09.913332+0000 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:09.913332+0000 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:09.914 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:09.915 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.913+0000 7fb602753640 1 Processor -- start 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.913+0000 7fb602753640 1 -- start start 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.913+0000 7fb602753640 10 monclient: init 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.913+0000 7fb602753640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.913+0000 7fb602753640 10 monclient: _add_conns ranks=[3,5,0,1,7,9,4,10,6,8,2] 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): picked mon.noname-g con 0x7fb5fc0a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:09.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): picked mon.noname-h con 0x7fb5fc0a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb5fc139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc0a4f90 con 0x7fb5fc139860 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a6380 con 0x7fb5fc0a6a30 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a49d0 con 0x7fb5fc0a6e10 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb602753640 10 monclient(hunting): authenticate will time out at 1327.955081s 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb600cf0640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb5fc139860 0x7fb5fc139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55184/0 (socket says 172.21.15.71:55184) 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb600cf0640 1 -- 172.21.15.71:0/186676654 learned_addr learned my addr 172.21.15.71:0/186676654 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:21:09.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6e10 auth_method 0 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6a30 auth_method 0 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:09.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.914+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:09.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:09.916+0000 7fb600cf0640 1 -- 172.21.15.71:0/186676654 >> v1:172.21.15.71:6789/0 conn(0x7fb5fc139860 legacy=0x7fb5fc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6a30 auth_method 0 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6e10 auth_method 0 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:10.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:10.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.116+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:10.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:10.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:10.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6a30 auth_method 0 2024-08-19T11:21:10.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:10.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:10.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:10.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6e10 auth_method 0 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:10.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:10.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:10.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:10.518+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6e10 auth_method 0 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:11.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5fc0a6a30 auth_method 0 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:11.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:11.319+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.388+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911640288 0 0) 0x7fb5fc0a4f90 con 0x7fb5fc139860 2024-08-19T11:21:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.388+0000 7fb5faffd640 10 monclient(hunting): _negotiate 2024-08-19T11:21:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.388+0000 7fb5faffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.388+0000 7fb5faffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.388+0000 7fb5faffd640 10 monclient(hunting): my global_id is 75906 2024-08-19T11:21:12.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.388+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e4003520 con 0x7fb5fc139860 2024-08-19T11:21:12.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2494156255 0 0) 0x7fb5e4003520 con 0x7fb5fc139860 2024-08-19T11:21:12.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 msgr2=0x7fb5fc0a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:12.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fb5fc0a6e10 0x7fb5fc0a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 msgr2=0x7fb5fc0a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:12.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5fc0a6a30 0x7fb5fc0a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc0a46f0 con 0x7fb5fc139860 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:12.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7fb5f4001f90 con 0x7fb5fc139860 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: dump: 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:12.395 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:12.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 >> v1:172.21.15.71:6789/0 conn(0x7fb5fc139860 legacy=0x7fb5fc139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient: _add_conns ranks=[2,6,1,7,8,0,4,5,3] 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 0x7fb5e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): picked mon.b con 0x7fb5e40042d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5e4004ee0 0x7fb5e40099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): picked mon.d con 0x7fb5e4004ee0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5e4009ef0 0x7fb5e400c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): picked mon.f con 0x7fb5e4009ef0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a6380 con 0x7fb5e4009ef0 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a49d0 con 0x7fb5e40042d0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fb5e400ca60 con 0x7fb5e4004ee0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5faffd640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.390+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 0x7fb5e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5e40042d0 auth_method 0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5e4004ee0 0x7fb5e40099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5e4009ef0 0x7fb5e400c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): get_auth_request con 0x7fb5e4009ef0 auth_method 0 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5e4004ee0 auth_method 0 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_done global_id 75906 payload 293 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5e4004ee0 msgr2=0x7fb5e40099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fb5e4004ee0 0x7fb5e40099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5e4009ef0 msgr2=0x7fb5e400c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5e4009ef0 0x7fb5e400c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 1 monclient: found mon.b 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:12.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb600cf0640 1 -- 172.21.15.71:0/186676654 reap_dead start 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e4003520 con 0x7fb5e40042d0 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient: _finish_auth 0 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 10 monclient: _check_auth_tickets 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb5fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb602753640 5 monclient: authenticate success, global_id 75906 2024-08-19T11:21:12.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.391+0000 7fb602753640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:12.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5fbfff640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 msgr2=0x7fb5e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:12.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 0x7fb5e4004800 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec011b90 tx=0x7fb5e4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89f83fd7eaab0f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:12.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb5ec031070 con 0x7fb5e40042d0 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: dump: 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:12.406 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb602753640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ec02bc00 con 0x7fb5e40042d0 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb602753640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb602753640 4 set_mon_vals no callback set 2024-08-19T11:21:12.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 1 -- 172.21.15.71:0/186676654 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb5ec011790 con 0x7fb5e40042d0 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.394+0000 7fb5faffd640 10 monclient: dump: 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:12.408 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 10 monclient: shutdown 2024-08-19T11:21:12.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 -- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 msgr2=0x7fb5e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 0x7fb5e4004800 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec011b90 tx=0x7fb5e4005830 comp rx=0 tx=0).stop 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 -- 172.21.15.71:0/186676654 shutdown_connections 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 --2- 172.21.15.71:0/186676654 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e40042d0 0x7fb5e4004800 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 -- 172.21.15.71:0/186676654 >> 172.21.15.71:0/186676654 conn(0x7fb5fc0ac030 msgr2=0x7fb5fc0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 -- 172.21.15.71:0/186676654 shutdown_connections 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.395+0000 7fb602753640 1 -- 172.21.15.71:0/186676654 wait complete. 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.396+0000 7fb602753640 10 monclient: build_initial_monmap 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.396+0000 7fb602753640 10 monclient: monmap: 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:12.410 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:12.411 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.396+0000 7fb602753640 1 Processor -- start 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 -- start start 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient: init 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient: _add_conns ranks=[7,8,0,3,1,4,5,2,6] 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5e40042d0 0x7fb5fc1cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): picked mon.noname-i con 0x7fb5e40042d0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 0x7fb5fc138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): picked mon.noname-e con 0x7fb5fc138990 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): picked mon.noname-a con 0x7fb5fc122680 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a5b80 con 0x7fb5fc122680 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a5a00 con 0x7fb5e40042d0 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fb5fc0a5d00 con 0x7fb5fc138990 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb602753640 10 monclient(hunting): authenticate will time out at 1330.438743s 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 0x7fb5fc138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb600cf0640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 0x7fb5fc138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:39022/0 (socket says 172.21.15.71:39022) 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 learned_addr learned my addr 172.21.15.71:0/1961200173 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5fc138990 auth_method 0 2024-08-19T11:21:12.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb600cf0640 10 monclient(hunting): get_auth_request con 0x7fb5fc122680 auth_method 0 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb600cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb600cf0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.397+0000 7fb600cf0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 msgr2=0x7fb5fc138dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 msgr2=0x7fb5fc138dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 0x7fb5fc138dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:12.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5e40042d0 0x7fb5fc1cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 0x7fb5fc138dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5e40042d0 auth_method 0 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 10 monclient(hunting): handle_auth_done global_id 75915 payload 824 2024-08-19T11:21:12.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 msgr2=0x7fb5fc138dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fb5fc138990 0x7fb5fc138dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5e40042d0 msgr2=0x7fb5fc1cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fb5e40042d0 0x7fb5fc1cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 10 monclient: _finish_hunting 0 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 monclient: found mon.noname-a 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc126170 con 0x7fb5fc122680 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 msgr2=0x7fb5fc122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 msgr2=0x7fb5fc122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:12.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc074fb0 tx=0x7fb5f400f530 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:12.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.398+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:12.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 10 monclient: get_auth_request con 0x7fb5fc122680 auth_method 0 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 0 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient: ms_handle_reset current mon [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 msgr2=0x7fb5fc122ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5fc122680 0x7fb5fc122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient: _add_conns ranks=[4,2,3,1,5,6] 2024-08-19T11:21:12.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5e80035d0 0x7fb5e8005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e80035d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 0x7fb5e8008a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e80065c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5e8009630 0x7fb5e800baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): picked mon.noname-g con 0x7fb5e8009630 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e800c6e0 con 0x7fb5e80065c0 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e800c860 con 0x7fb5e8009630 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fb5e800ca60 con 0x7fb5e80035d0 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5f8ff9640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:12.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5e80035d0 0x7fb5e8005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 0x7fb5e8008a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request con 0x7fb5e80065c0 auth_method 0 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request con 0x7fb5e80035d0 auth_method 0 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:12.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5e8009630 0x7fb5e800baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient(hunting): handle_auth_done global_id 75915 payload 293 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5e80035d0 msgr2=0x7fb5e8005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5e80035d0 0x7fb5e8005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5e8009630 msgr2=0x7fb5e800baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5e8009630 0x7fb5e800baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 monclient: found mon.noname-b 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:12.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e800cd20 con 0x7fb5e80065c0 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fb5e80035d0 0x7fb5e8005a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 10 monclient: get_auth_request con 0x7fb5e8009630 auth_method 0 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5e8009630 0x7fb5e800baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.600+0000 7fb600cf0640 1 -- 172.21.15.71:0/1961200173 reap_dead start 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5fb7fe640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 msgr2=0x7fb5e8008a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5fb7fe640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 0x7fb5e8008a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0004650 tx=0x7fb5f4004cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb5f0004320 con 0x7fb5e80065c0 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: dump: 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: _finish_auth 0 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0004120 con 0x7fb5e80065c0 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 5 monclient: authenticate success, global_id 75915 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 10 monclient: _renew_subs 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc126450 con 0x7fb5e80065c0 2024-08-19T11:21:12.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fb5f0003d20 con 0x7fb5e80065c0 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5fa7fc640 4 set_mon_vals no callback set 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb5f8ff9640 10 monclient: dump: 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 10 monclient: _renew_subs 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.603+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc125100 con 0x7fb5e80065c0 2024-08-19T11:21:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fb5f00038b0 con 0x7fb5e80065c0 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb602753640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb602753640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb602753640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5fc0a71f0 con 0x7fb5e80065c0 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb5f8ff9640 1 --2- 172.21.15.71:0/1961200173 >> v2:172.21.15.135:6800/726754104 conn(0x7fb5e8043110 0x7fb5e80455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.604+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(316..316 src has 1..316) ==== 3898+0+0 (secure 0 0 0) 0x7fb5f000f040 con 0x7fb5e80065c0 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.605+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/1961200173 >> v2:172.21.15.135:6800/726754104 conn(0x7fb5e8043110 0x7fb5e80455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:12.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.605+0000 7fb5fbfff640 10 monclient: get_auth_request con 0x7fb5e8043110 auth_method 0 2024-08-19T11:21:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.607+0000 7fb5fbfff640 1 --2- 172.21.15.71:0/1961200173 >> v2:172.21.15.135:6800/726754104 conn(0x7fb5e8043110 0x7fb5e80455d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec006fd0 tx=0x7fb5ec040040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.609+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fb5f0050c90 con 0x7fb5e80065c0 2024-08-19T11:21:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.609+0000 7fb5f8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:12.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.609+0000 7fb5f8ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:12.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.855+0000 7fb602753640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.855+0000 7fb602753640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.855+0000 7fb602753640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.855+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb5fc1240f0 con 0x7fb5e80065c0 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.856+0000 7fb5f8ff9640 1 -- 172.21.15.71:0/1961200173 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7fb5f0017d40 con 0x7fb5e80065c0 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.856+0000 7fb5f8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.856+0000 7fb5f8ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:12.857 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":202,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 >> v2:172.21.15.135:6800/726754104 conn(0x7fb5e8043110 msgr2=0x7fb5e80455d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 --2- 172.21.15.71:0/1961200173 >> v2:172.21.15.135:6800/726754104 conn(0x7fb5e8043110 0x7fb5e80455d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec006fd0 tx=0x7fb5ec040040 comp rx=0 tx=0).stop 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 10 monclient: shutdown 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 msgr2=0x7fb5e8008a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 0x7fb5e8008a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0004650 tx=0x7fb5f4004cc0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 shutdown_connections 2024-08-19T11:21:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 --2- 172.21.15.71:0/1961200173 >> v2:172.21.15.135:6800/726754104 conn(0x7fb5e8043110 0x7fb5e80455d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 --2- 172.21.15.71:0/1961200173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5e80065c0 0x7fb5e8008a50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 >> 172.21.15.71:0/1961200173 conn(0x7fb5fc0ac030 msgr2=0x7fb5fc0aa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 shutdown_connections 2024-08-19T11:21:12.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:12.858+0000 7fb602753640 1 -- 172.21.15.71:0/1961200173 wait complete. 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: starting. 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-29177 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: created object 0... 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: created object 25... 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: created object 49... 2024-08-19T11:21:13.383 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: finishing. 2024-08-19T11:21:13.384 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29212]: shutting down. 2024-08-19T11:21:15.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:21:15.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.978+0000 7f9aca06e640 10 monclient: get_monmap_and_config 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.978+0000 7f9aca06e640 10 monclient: build_initial_monmap 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.978+0000 7f9aca06e640 10 monclient: monmap: 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:15.979464+0000 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:15.979464+0000 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:15.980 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:15.981 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.979+0000 7f9aca06e640 1 Processor -- start 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.979+0000 7f9aca06e640 1 -- start start 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.979+0000 7f9aca06e640 10 monclient: init 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient: _add_conns ranks=[10,6,0,5,7,1,4,3,9,2,8] 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): picked mon.noname-f con 0x7f9ac40a6a30 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): picked mon.noname-d con 0x7f9ac40a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:15.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9ac4139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac40a4f90 con 0x7f9ac4139860 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac40a6380 con 0x7f9ac40a6a30 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9ac40a49d0 con 0x7f9ac40a6e10 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9aca06e640 10 monclient(hunting): authenticate will time out at 1334.021215s 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac3fff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9ac4139860 0x7f9ac4139cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39964/0 (socket says 172.21.15.71:39964) 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 learned_addr learned my addr 172.21.15.71:0/1269772673 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6e10 auth_method 0 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:15.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6a30 auth_method 0 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:15.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.980+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:15.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:15.982+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 >> v1:172.21.15.71:6789/0 conn(0x7f9ac4139860 legacy=0x7f9ac4139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:16.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.181+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6e10 auth_method 0 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6a30 auth_method 0 2024-08-19T11:21:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.182+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6a30 auth_method 0 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:16.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6e10 auth_method 0 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.583+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:16.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:16.584+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.384+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.384+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6a30 auth_method 0 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.384+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.384+0000 7f9ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.384+0000 7f9ac37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.385+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.385+0000 7f9ac37fe640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.385+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:17.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.385+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:17.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:17.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6e10 auth_method 0 2024-08-19T11:21:17.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:17.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:17.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:17.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:17.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:17.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:17.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:17.386+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.390+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586042748 0 0) 0x7f9ac40a4f90 con 0x7f9ac4139860 2024-08-19T11:21:18.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.390+0000 7f9ac27fc640 10 monclient(hunting): _negotiate 2024-08-19T11:21:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.390+0000 7f9ac27fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.390+0000 7f9ac27fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.390+0000 7f9ac27fc640 10 monclient(hunting): my global_id is 75924 2024-08-19T11:21:18.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.390+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aac003520 con 0x7f9ac4139860 2024-08-19T11:21:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1705966976 0 0) 0x7f9aac003520 con 0x7f9ac4139860 2024-08-19T11:21:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9ac40a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9ac40a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 msgr2=0x7f9ac40a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 --2- 172.21.15.71:0/1269772673 >> v2:172.21.15.135:3300/0 conn(0x7f9ac40a6a30 0x7f9ac40a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: _finish_hunting 0 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 monclient: found mon.noname-a-legacy 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.71:6789/0 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac40a46f0 con 0x7f9ac4139860 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (unknown 743527944 0 0) 0x7f9abc001f90 con 0x7f9ac4139860 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-08-19T11:21:18.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: dump: 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:18.400 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] but i'm connected to v1:172.21.15.71:6789/0, reconnecting 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 >> v1:172.21.15.71:6789/0 conn(0x7f9ac4139860 legacy=0x7f9ac4139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient: _add_conns ranks=[6,5,1,7,8,0,4,2,3] 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9aac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): picked mon.d con 0x7f9ac40a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9aac004d40 0x7f9aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): picked mon.h con 0x7f9aac004d40 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac0099b0 0x7f9aac00bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): picked mon.f con 0x7f9aac0099b0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40a6380 con 0x7f9aac0099b0 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9ac40a49d0 con 0x7f9aac004d40 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f9aac00c550 con 0x7f9ac40a6e10 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac27fc640 10 monclient(hunting): _finish_auth 0 2024-08-19T11:21:18.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9aac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request con 0x7f9ac40a6e10 auth_method 0 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac0099b0 0x7f9aac00bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.395+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9aac004d40 0x7f9aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): get_auth_request con 0x7f9aac0099b0 auth_method 0 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f9aac004d40 auth_method 0 2024-08-19T11:21:18.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_done global_id 75924 payload 293 2024-08-19T11:21:18.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 msgr2=0x7f9aac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9aac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9aac004d40 msgr2=0x7f9aac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9aac004d40 0x7f9aac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 1 monclient: found mon.f 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.135:3300/0 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac003520 con 0x7f9aac0099b0 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient: _finish_auth 0 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 10 monclient: _check_auth_tickets 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:18.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9aca06e640 5 monclient: authenticate success, global_id 75924 2024-08-19T11:21:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9aca06e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:18.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.396+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f9ac40a6e10 0x7f9aac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac0099b0 msgr2=0x7f9aac00bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac0099b0 0x7f9aac00bda0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9abc001850 tx=0x7f9aac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea54fbe6b97b86a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9abc005100 con 0x7f9aac0099b0 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: dump: 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:18.412 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:18.413 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc02f030 con 0x7f9aac0099b0 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9aca06e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9aca06e640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9aca06e640 4 set_mon_vals no callback set 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 1 -- 172.21.15.71:0/1269772673 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9abc02bbb0 con 0x7f9aac0099b0 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.399+0000 7f9ac27fc640 10 monclient: dump: 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.414 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 10 monclient: shutdown 2024-08-19T11:21:18.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 1 -- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac0099b0 msgr2=0x7f9aac00bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 1 --2- 172.21.15.71:0/1269772673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aac0099b0 0x7f9aac00bda0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9abc001850 tx=0x7f9aac005830 comp rx=0 tx=0).stop 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9ac3fff640 1 -- 172.21.15.71:0/1269772673 reap_dead start 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 1 -- 172.21.15.71:0/1269772673 shutdown_connections 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 1 -- 172.21.15.71:0/1269772673 >> 172.21.15.71:0/1269772673 conn(0x7f9ac40ac030 msgr2=0x7f9ac40ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 1 -- 172.21.15.71:0/1269772673 shutdown_connections 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.400+0000 7f9aca06e640 1 -- 172.21.15.71:0/1269772673 wait complete. 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.401+0000 7f9aca06e640 10 monclient: build_initial_monmap 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.401+0000 7f9aca06e640 10 monclient: monmap: 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:18.416 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.401+0000 7f9aca06e640 1 Processor -- start 2024-08-19T11:21:18.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 -- start start 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient: init 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient: _add_conns ranks=[7,1,0,8,4,5,2,3,6] 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9aac0099b0 0x7f9ac4122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): picked mon.noname-i con 0x7f9aac0099b0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac41389a0 0x7f9ac4138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): picked mon.noname-f con 0x7f9ac41389a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 0x7f9ac41ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): picked mon.noname-a con 0x7f9ac41cdf20 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac413a580 con 0x7f9ac41cdf20 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:18.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac413a400 con 0x7f9ac41389a0 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9ac40a71f0 con 0x7f9aac0099b0 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9aca06e640 10 monclient(hunting): authenticate will time out at 1336.443760s 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 0x7f9ac41ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 0x7f9ac41ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45126/0 (socket says 172.21.15.71:45126) 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 1 -- 172.21.15.71:0/253701700 learned_addr learned my addr 172.21.15.71:0/253701700 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 10 monclient(hunting): get_auth_request con 0x7f9ac41cdf20 auth_method 0 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:18.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.402+0000 7f9ac2ffd640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac41389a0 0x7f9ac4138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request con 0x7f9ac41389a0 auth_method 0 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9aac0099b0 0x7f9ac4122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request con 0x7f9aac0099b0 auth_method 0 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:18.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 10 monclient(hunting): handle_auth_done global_id 75933 payload 824 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 1 -- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9aac0099b0 msgr2=0x7f9ac4122c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9aac0099b0 0x7f9ac4122c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 1 -- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac41389a0 msgr2=0x7f9ac4138e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac41389a0 0x7f9ac4138e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.403+0000 7f9ac3fff640 1 -- 172.21.15.71:0/253701700 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac4124000 con 0x7f9ac41cdf20 2024-08-19T11:21:18.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9ac3fff640 1 -- 172.21.15.71:0/253701700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 msgr2=0x7f9ac41ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9ac3fff640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 0x7f9ac41ce3a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9abc02b3f0 tx=0x7f9ac40a7f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9ab4011790 con 0x7f9ac41cdf20 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: dump: 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:18.422 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: _finish_auth 0 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: _check_auth_tickets 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc001f70 con 0x7f9ac41cdf20 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 5 monclient: authenticate success, global_id 75933 2024-08-19T11:21:18.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 10 monclient: _renew_subs 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac4139340 con 0x7f9ac41cdf20 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9abc005100 con 0x7f9ac41cdf20 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aabfff640 10 monclient: dump: 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:18.424 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 10 monclient: _renew_subs 2024-08-19T11:21:18.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9ac1ffb640 4 set_mon_vals no callback set 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.405+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac4125ac0 con 0x7f9ac41cdf20 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9abc02bb60 con 0x7f9ac41cdf20 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aca06e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aca06e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aca06e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac4123be0 con 0x7f9ac41cdf20 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aabfff640 1 --2- 172.21.15.71:0/253701700 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ab003eab0 0x7f9ab0040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(317..317 src has 1..317) ==== 3898+0+0 (secure 0 0 0) 0x7f9abc03c020 con 0x7f9ac41cdf20 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/253701700 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ab003eab0 0x7f9ab0040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.407+0000 7f9ac37fe640 10 monclient: get_auth_request con 0x7f9ab003eab0 auth_method 0 2024-08-19T11:21:18.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.410+0000 7f9ac37fe640 1 --2- 172.21.15.71:0/253701700 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ab003eab0 0x7f9ab0040f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:18.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.412+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9abc0080e0 con 0x7f9ac41cdf20 2024-08-19T11:21:18.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.412+0000 7f9aabfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:18.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.412+0000 7f9aabfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29214]: starting. 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29214]: listing objects. 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29214]: listed object 0... 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29214]: listed object 25... 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29214]: saw 50 objects 2024-08-19T11:21:18.438 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29214]: shutting down. 2024-08-19T11:21:18.466 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:18.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29213]: starting. 2024-08-19T11:21:18.466 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29213]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-29177 2024-08-19T11:21:18.467 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29213]: shutting down. 2024-08-19T11:21:18.467 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:18.467 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:18.468 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:21:18.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-08-19T11:21:18.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.670+0000 7f9aca06e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.670+0000 7f9aca06e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.670+0000 7f9aca06e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.670+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ac40a57f0 con 0x7f9ac41cdf20 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.671+0000 7f9aabfff640 1 -- 172.21.15.71:0/253701700 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7f9abc0701d0 con 0x7f9ac41cdf20 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.671+0000 7f9aabfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.671+0000 7f9aabfff640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:18.672 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":206,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:21:18.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ab003eab0 msgr2=0x7f9ab0040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:18.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 --2- 172.21.15.71:0/253701700 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ab003eab0 0x7f9ab0040f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4008040 comp rx=0 tx=0).stop 2024-08-19T11:21:18.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 10 monclient: shutdown 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 msgr2=0x7f9ac41ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 0x7f9ac41ce3a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9abc02b3f0 tx=0x7f9ac40a7f70 comp rx=0 tx=0).stop 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 shutdown_connections 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 --2- 172.21.15.71:0/253701700 >> v2:172.21.15.135:6800/726754104 conn(0x7f9ab003eab0 0x7f9ab0040f70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ac41cdf20 0x7f9ac41ce3a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ac41389a0 0x7f9ac4138e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 --2- 172.21.15.71:0/253701700 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9aac0099b0 0x7f9ac4122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 >> 172.21.15.71:0/253701700 conn(0x7f9ac40ac030 msgr2=0x7f9ac40aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 shutdown_connections 2024-08-19T11:21:18.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:18.673+0000 7f9aca06e640 1 -- 172.21.15.71:0/253701700 wait complete. 2024-08-19T11:21:21.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:21:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.793+0000 7fa376d21640 10 monclient: get_monmap_and_config 2024-08-19T11:21:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.793+0000 7fa376d21640 10 monclient: build_initial_monmap 2024-08-19T11:21:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.793+0000 7fa376d21640 10 monclient: monmap: 2024-08-19T11:21:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:21.794 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:21.794087+0000 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:21.794087+0000 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:21.795 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:21.796 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 Processor -- start 2024-08-19T11:21:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 -- start start 2024-08-19T11:21:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient: init 2024-08-19T11:21:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:21.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient: _add_conns ranks=[4,7,3,5,8,10,9,2,1,6,0] 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): picked mon.noname-c con 0x7fa3700a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): picked mon.noname-i con 0x7fa3700a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): picked mon.noname-g con 0x7fa370139860 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa3700a4f90 con 0x7fa370139860 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa3700a6380 con 0x7fa3700a6a30 2024-08-19T11:21:21.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa3700a49d0 con 0x7fa3700a6e10 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa376d21640 10 monclient(hunting): authenticate will time out at 1339.835860s 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa374abd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.794+0000 7fa374abd640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:54288/0 (socket says 172.21.15.71:54288) 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 learned_addr learned my addr 172.21.15.71:0/3018869095 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 10 monclient(hunting): get_auth_request con 0x7fa3700a6a30 auth_method 0 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:21.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 10 monclient(hunting): get_auth_request con 0x7fa370139860 auth_method 0 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 10 monclient(hunting): get_auth_request con 0x7fa3700a6e10 auth_method 0 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:21.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:21.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.795+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:21.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:21.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 10 monclient(hunting): get_auth_request con 0x7fa3700a6a30 auth_method 0 2024-08-19T11:21:21.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.996+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 10 monclient(hunting): get_auth_request con 0x7fa370139860 auth_method 0 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:21.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 10 monclient(hunting): get_auth_request con 0x7fa3700a6e10 auth_method 0 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:22.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:21.997+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T11:21:22.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:22.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 10 monclient(hunting): get_auth_request con 0x7fa3700a6a30 auth_method 0 2024-08-19T11:21:22.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:22.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:22.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:22.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:22.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:22.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:22.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.397+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 10 monclient(hunting): get_auth_request con 0x7fa3700a6e10 auth_method 0 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 10 monclient(hunting): get_auth_request con 0x7fa370139860 auth_method 0 2024-08-19T11:21:22.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:22.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:22.399+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 10 monclient(hunting): get_auth_request con 0x7fa3700a6a30 auth_method 0 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:23.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:23.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.199+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 10 monclient(hunting): get_auth_request con 0x7fa370139860 auth_method 0 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 10 monclient(hunting): get_auth_request con 0x7fa3700a6e10 auth_method 0 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:23.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:23.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:23.200+0000 7fa3752be640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T11:21:24.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): tick 2024-08-19T11:21:24.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): _check_auth_tickets 2024-08-19T11:21:24.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 monclient(hunting): continuing hunt 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): _reopen_session rank -1 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 msgr2=0x7fa3700a71f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa3700a6e10 0x7fa3700a71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 msgr2=0x7fa3700a57f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa3700a6a30 0x7fa3700a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 msgr2=0x7fa370139c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa370139860 0x7fa370139c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient: _add_conns ranks=[10,9,1,5,0,8,6,2] 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 --2- 172.21.15.71:0/3018869095 >> v2:172.21.15.135:3300/0 conn(0x7fa358003850 0x7fa358005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): picked mon.noname-f con 0x7fa358003850 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:24.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 --2- 172.21.15.71:0/3018869095 >> v2:172.21.15.71:3300/0 conn(0x7fa358006270 0x7fa358008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): picked mon.noname-a con 0x7fa358006270 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa358008e20 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 -- 172.21.15.71:0/3018869095 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3700a46f0 con 0x7fa358008e20 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 -- 172.21.15.71:0/3018869095 --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fa3700a4f90 con 0x7fa358006270 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 1 -- 172.21.15.71:0/3018869095 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa3700a6380 con 0x7fa358003850 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3667fc640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> v2:172.21.15.71:3300/0 conn(0x7fa358006270 0x7fa358008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): get_auth_request con 0x7fa358006270 auth_method 0 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:24.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa374abd640 1 --2- 172.21.15.71:0/3018869095 >> v2:172.21.15.135:3300/0 conn(0x7fa358003850 0x7fa358005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa374abd640 10 monclient(hunting): get_auth_request con 0x7fa358003850 auth_method 0 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa374abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa374abd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa374abd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:24.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient(hunting): handle_auth_done global_id 75960 payload 274 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> v2:172.21.15.135:3300/0 conn(0x7fa358003850 msgr2=0x7fa358005c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> v2:172.21.15.135:3300/0 conn(0x7fa358003850 0x7fa358005c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> v1:172.21.15.135:6789/0 conn(0x7fa358008e20 legacy=0x7fa35800b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa3752be640 1 -- 172.21.15.71:0/3018869095 reap_dead start 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:24.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.795+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35800dc10 con 0x7fa358006270 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa367fff640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa358006270 msgr2=0x7fa358008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa367fff640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa358006270 0x7fa358008730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa358003700 tx=0x7fa36002ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402aa7cb6032aa18 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 1 -- 172.21.15.71:0/3018869095 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa360031070 con 0x7fa358006270 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: dump: 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.808 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:24.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 1 -- 172.21.15.71:0/3018869095 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36002bd20 con 0x7fa358006270 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa376d21640 5 monclient: authenticate success, global_id 75960 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa376d21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 1 -- 172.21.15.71:0/3018869095 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa360035870 con 0x7fa358006270 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.798+0000 7fa3677fe640 10 monclient: dump: 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:24.810 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:24.811 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 4 set_mon_vals no callback set 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 10 monclient: shutdown 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 -- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa358006270 msgr2=0x7fa358008730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa358006270 0x7fa358008730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa358003700 tx=0x7fa36002ada0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 -- 172.21.15.71:0/3018869095 shutdown_connections 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 --2- 172.21.15.71:0/3018869095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa358006270 0x7fa358008730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 -- 172.21.15.71:0/3018869095 >> 172.21.15.71:0/3018869095 conn(0x7fa3700ac030 msgr2=0x7fa3700ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 -- 172.21.15.71:0/3018869095 shutdown_connections 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.799+0000 7fa376d21640 1 -- 172.21.15.71:0/3018869095 wait complete. 2024-08-19T11:21:24.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.800+0000 7fa376d21640 10 monclient: build_initial_monmap 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.800+0000 7fa376d21640 10 monclient: monmap: 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:24.813 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.801+0000 7fa376d21640 1 Processor -- start 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.801+0000 7fa376d21640 1 -- start start 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.801+0000 7fa376d21640 10 monclient: init 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.801+0000 7fa376d21640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.801+0000 7fa376d21640 10 monclient: _add_conns ranks=[5,0,4,2,7,3,1,8,6] 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa358006270 0x7fa3701ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:24.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): picked mon.noname-h con 0x7fa358006270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 0x7fa370138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): picked mon.noname-a con 0x7fa370138a70 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa370122680 0x7fa370122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): picked mon.noname-c con 0x7fa370122680 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3700a5b80 con 0x7fa370138a70 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fa3700a5a00 con 0x7fa370122680 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa3700a5d00 con 0x7fa358006270 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa376d21640 10 monclient(hunting): authenticate will time out at 1342.843069s 2024-08-19T11:21:24.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 0x7fa370138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa370122680 0x7fa370122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 0x7fa370138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46194/0 (socket says 172.21.15.71:46194) 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 -- 172.21.15.71:0/3561540309 learned_addr learned my addr 172.21.15.71:0/3561540309 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): get_auth_request con 0x7fa370138a70 auth_method 0 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): get_auth_request con 0x7fa370122680 auth_method 0 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:24.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa358006270 0x7fa3701ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): get_auth_request con 0x7fa358006270 auth_method 0 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa374abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:24.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient(hunting): handle_auth_done global_id 75969 payload 824 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 -- 172.21.15.71:0/3561540309 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa358006270 msgr2=0x7fa3701ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa358006270 0x7fa3701ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 -- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa370122680 msgr2=0x7fa370122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa370122680 0x7fa370122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa367fff640 1 -- 172.21.15.71:0/3561540309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa370126430 con 0x7fa370138a70 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.802+0000 7fa3752be640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa370122680 0x7fa370122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa367fff640 1 -- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 msgr2=0x7fa370138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:24.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa367fff640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 0x7fa370138ed0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa36000fa20 tx=0x7fa3600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa360044070 con 0x7fa370138a70 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: dump: 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:24.819 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa360035e50 con 0x7fa370138a70 2024-08-19T11:21:24.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 5 monclient: authenticate success, global_id 75969 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 10 monclient: _renew_subs 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3700a2510 con 0x7fa370138a70 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa360040d20 con 0x7fa370138a70 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa3657fa640 10 monclient: dump: 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:24.821 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:24.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 10 monclient: _renew_subs 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa366ffd640 4 set_mon_vals no callback set 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.805+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37013a3e0 con 0x7fa370138a70 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.806+0000 7fa376d21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.806+0000 7fa376d21640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.806+0000 7fa376d21640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.806+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3700a71f0 con 0x7fa370138a70 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.806+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa360047070 con 0x7fa370138a70 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.807+0000 7fa3657fa640 1 --2- 172.21.15.71:0/3561540309 >> v2:172.21.15.135:6800/726754104 conn(0x7fa35803fe30 0x7fa3580422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.807+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(319..319 src has 1..319) ==== 3898+0+0 (secure 0 0 0) 0x7fa36000f040 con 0x7fa370138a70 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.807+0000 7fa374abd640 1 --2- 172.21.15.71:0/3561540309 >> v2:172.21.15.135:6800/726754104 conn(0x7fa35803fe30 0x7fa3580422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:24.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.807+0000 7fa374abd640 10 monclient: get_auth_request con 0x7fa35803fe30 auth_method 0 2024-08-19T11:21:24.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.809+0000 7fa374abd640 1 --2- 172.21.15.71:0/3561540309 >> v2:172.21.15.135:6800/726754104 conn(0x7fa35803fe30 0x7fa3580422f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa3580036a0 tx=0x7fa36c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:24.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.811+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fa360040440 con 0x7fa370138a70 2024-08-19T11:21:24.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.811+0000 7fa3657fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:24.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:24.811+0000 7fa3657fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:25.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.055+0000 7fa376d21640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.055+0000 7fa376d21640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.055+0000 7fa376d21640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.055+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa3701240d0 con 0x7fa370138a70 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.056+0000 7fa3657fa640 1 -- 172.21.15.71:0/3561540309 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3187 (secure 0 0 0) 0x7fa36004bd40 con 0x7fa370138a70 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.056+0000 7fa3657fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.056+0000 7fa3657fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:25.057 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":210,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 >> v2:172.21.15.135:6800/726754104 conn(0x7fa35803fe30 msgr2=0x7fa3580422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 --2- 172.21.15.71:0/3561540309 >> v2:172.21.15.135:6800/726754104 conn(0x7fa35803fe30 0x7fa3580422f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa3580036a0 tx=0x7fa36c008040 comp rx=0 tx=0).stop 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 10 monclient: shutdown 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 msgr2=0x7fa370138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 0x7fa370138ed0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa36000fa20 tx=0x7fa3600046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:25.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 shutdown_connections 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 --2- 172.21.15.71:0/3561540309 >> v2:172.21.15.135:6800/726754104 conn(0x7fa35803fe30 0x7fa3580422f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fa370122680 0x7fa370122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa370138a70 0x7fa370138ed0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 --2- 172.21.15.71:0/3561540309 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa358006270 0x7fa3701ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 >> 172.21.15.71:0/3561540309 conn(0x7fa3700ac030 msgr2=0x7fa3700aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 shutdown_connections 2024-08-19T11:21:25.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:25.058+0000 7fa376d21640 1 -- 172.21.15.71:0/3561540309 wait complete. 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: starting. 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-29280 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: created object 0... 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: created object 25... 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: created object 49... 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: finishing. 2024-08-19T11:21:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:process_1_[29281]: shutting down. 2024-08-19T11:21:26.765 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29282]: starting. 2024-08-19T11:21:26.765 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29282]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-29280 2024-08-19T11:21:26.765 INFO:teuthology.orchestra.run.smithi135.stdout:process_2_[29282]: shutting down. 2024-08-19T11:21:28.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-08-19T11:21:28.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.182+0000 7f7da8df4640 10 monclient: get_monmap_and_config 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.182+0000 7f7da8df4640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.182+0000 7f7da8df4640 10 monclient: monmap: 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:28.182948+0000 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:28.182948+0000 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.184 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.182+0000 7f7da8df4640 1 Processor -- start 2024-08-19T11:21:28.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.182+0000 7f7da8df4640 1 -- start start 2024-08-19T11:21:28.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.182+0000 7f7da8df4640 10 monclient: init 2024-08-19T11:21:28.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient: _add_conns ranks=[8,5,4,2,6,1,3,0,10,9,7] 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 0x7f7da40a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): picked mon.noname-e con 0x7f7da40a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7da40a6e10 0x7f7da40a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): picked mon.noname-h con 0x7f7da40a6e10 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 0x7f7da4139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): picked mon.noname-c con 0x7f7da4139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f7da40a4f90 con 0x7f7da4139860 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f7da40a6380 con 0x7f7da40a6e10 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7da40a49d0 con 0x7f7da40a6a30 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da8df4640 10 monclient(hunting): authenticate will time out at 1346.224665s 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 0x7f7da4139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 0x7f7da40a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 0x7f7da4139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38672/0 (socket says 172.21.15.71:38672) 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 0x7f7da40a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55474/0 (socket says 172.21.15.71:55474) 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 1 -- 172.21.15.71:0/1608752173 learned_addr learned my addr 172.21.15.71:0/1608752173 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): get_auth_request con 0x7f7da4139860 auth_method 0 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): get_auth_request con 0x7f7da40a6a30 auth_method 0 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.183+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da1d9b640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7da40a6e10 0x7f7da40a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da1d9b640 10 monclient(hunting): get_auth_request con 0x7f7da40a6e10 auth_method 0 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_done global_id 85459 payload 274 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 1 -- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 msgr2=0x7f7da40a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 0x7f7da40a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 1 -- 172.21.15.71:0/1608752173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7da40a6e10 msgr2=0x7f7da40a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7da40a6e10 0x7f7da40a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 1 monclient: found mon.noname-c 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da2d9d640 1 -- 172.21.15.71:0/1608752173 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da40a46f0 con 0x7f7da4139860 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.184+0000 7f7da259c640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 0x7f7da40a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.186+0000 7f7da2d9d640 1 -- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 msgr2=0x7f7da4139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.186+0000 7f7da2d9d640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 0x7f7da4139c60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009eb0 tx=0x7f7d9402a560 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2eef43bc00d37bc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 1 -- 172.21.15.71:0/1608752173 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d94036070 con 0x7f7da4139860 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: dump: 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.197 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 1 -- 172.21.15.71:0/1608752173 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d94007a70 con 0x7f7da4139860 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 5 monclient: authenticate success, global_id 85459 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 1 -- 172.21.15.71:0/1608752173 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d94007c60 con 0x7f7da4139860 2024-08-19T11:21:28.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 4 set_mon_vals no callback set 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da159a640 10 monclient: dump: 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.199 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 10 monclient: shutdown 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 -- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 msgr2=0x7f7da4139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 0x7f7da4139c60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009eb0 tx=0x7f7d9402a560 comp rx=0 tx=0).stop 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 -- 172.21.15.71:0/1608752173 shutdown_connections 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f7da40a6e10 0x7f7da40a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f7da4139860 0x7f7da4139c60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 --2- 172.21.15.71:0/1608752173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7da40a6a30 0x7f7da40a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 -- 172.21.15.71:0/1608752173 >> 172.21.15.71:0/1608752173 conn(0x7f7da40ac030 msgr2=0x7f7da40ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 -- 172.21.15.71:0/1608752173 shutdown_connections 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.187+0000 7f7da8df4640 1 -- 172.21.15.71:0/1608752173 wait complete. 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.188+0000 7f7da8df4640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.188+0000 7f7da8df4640 10 monclient: monmap: 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:28.201 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.188+0000 7f7da8df4640 1 Processor -- start 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.188+0000 7f7da8df4640 1 -- start start 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.188+0000 7f7da8df4640 10 monclient: init 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient: _add_conns ranks=[0,3,7,8,2,1,6,5,4] 2024-08-19T11:21:28.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 0x7f7da4124df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): picked mon.noname-a con 0x7f7da40a6a30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7da40a6e10 0x7f7da4125330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): picked mon.noname-g con 0x7f7da40a6e10 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7da4139860 0x7f7da4125870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): picked mon.noname-i con 0x7f7da4139860 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40a7730 con 0x7f7da40a6a30 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7da413a1a0 con 0x7f7da40a6e10 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f7da41378c0 con 0x7f7da4139860 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da8df4640 10 monclient(hunting): authenticate will time out at 1346.230393s 2024-08-19T11:21:28.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 0x7f7da4124df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 0x7f7da4124df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46212/0 (socket says 172.21.15.71:46212) 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 -- 172.21.15.71:0/3602500471 learned_addr learned my addr 172.21.15.71:0/3602500471 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): get_auth_request con 0x7f7da40a6a30 auth_method 0 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7da40a6e10 0x7f7da4125330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7da4139860 0x7f7da4125870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): get_auth_request con 0x7f7da40a6e10 auth_method 0 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): get_auth_request con 0x7f7da4139860 auth_method 0 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient(hunting): handle_auth_done global_id 75978 payload 824 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 -- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7da4139860 msgr2=0x7f7da4125870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7da4139860 0x7f7da4125870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 -- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7da40a6e10 msgr2=0x7f7da4125330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7da40a6e10 0x7f7da4125330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 monclient: found mon.noname-a 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.189+0000 7f7da259c640 1 -- 172.21.15.71:0/3602500471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da4128bb0 con 0x7f7da40a6a30 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da259c640 1 -- 172.21.15.71:0/3602500471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 msgr2=0x7f7da4124df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da259c640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 0x7f7da4124df0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00ebe0 tx=0x7f7d9c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d9c017070 con 0x7f7da40a6a30 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: dump: 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.208 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9c00ce40 con 0x7f7da40a6a30 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7d9c013d50 con 0x7f7da40a6a30 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 5 monclient: authenticate success, global_id 75978 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 10 monclient: _renew_subs 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da40a57f0 con 0x7f7da40a6a30 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da0d99640 4 set_mon_vals no callback set 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7d9affd640 10 monclient: dump: 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.210 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.211 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 10 monclient: _renew_subs 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.192+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da4126850 con 0x7f7da40a6a30 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7da8df4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7da8df4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7da8df4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7d9c01a070 con 0x7f7da40a6a30 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da413a500 con 0x7f7da40a6a30 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7d9affd640 1 --2- 172.21.15.71:0/3602500471 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d8403ea80 0x7f7d84040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(321..321 src has 1..321) ==== 3506+0+0 (secure 0 0 0) 0x7f7d9c00f040 con 0x7f7da40a6a30 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.193+0000 7f7da1d9b640 1 --2- 172.21.15.71:0/3602500471 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d8403ea80 0x7f7d84040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.194+0000 7f7da1d9b640 10 monclient: get_auth_request con 0x7f7d8403ea80 auth_method 0 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.196+0000 7f7da1d9b640 1 --2- 172.21.15.71:0/3602500471 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d8403ea80 0x7f7d84040f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7da4126510 tx=0x7f7d8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.212 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.198+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f7d9c021070 con 0x7f7da40a6a30 2024-08-19T11:21:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.198+0000 7f7d9affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.198+0000 7f7d9affd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7da8df4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-08-19T11:21:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7da8df4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7da8df4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:28.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7da40a1910 con 0x7f7da40a6a30 2024-08-19T11:21:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7d9affd640 1 -- 172.21.15.71:0/3602500471 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3193 (secure 0 0 0) 0x7f7d9c013650 con 0x7f7da40a6a30 2024-08-19T11:21:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7d9affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-08-19T11:21:28.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.441+0000 7f7d9affd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:28.443 INFO:teuthology.orchestra.run.smithi071.stdout:{"election_epoch":212,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","modified":"2024-08-19T11:09:34.396622Z","created":"2024-08-19T11:09:34.396622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3301","nonce":0},{"type":"v1","addr":"172.21.15.71:6790","nonce":0}]},"addr":"172.21.15.71:6790/0","public_addr":"172.21.15.71:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3302","nonce":0},{"type":"v1","addr":"172.21.15.71:6791","nonce":0}]},"addr":"172.21.15.71:6791/0","public_addr":"172.21.15.71:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3302","nonce":0},{"type":"v1","addr":"172.21.15.135:6791","nonce":0}]},"addr":"172.21.15.135:6791/0","public_addr":"172.21.15.135:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3303","nonce":0},{"type":"v1","addr":"172.21.15.71:6792","nonce":0}]},"addr":"172.21.15.71:6792/0","public_addr":"172.21.15.71:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3303","nonce":0},{"type":"v1","addr":"172.21.15.135:6792","nonce":0}]},"addr":"172.21.15.135:6792/0","public_addr":"172.21.15.135:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3304","nonce":0},{"type":"v1","addr":"172.21.15.71:6793","nonce":0}]},"addr":"172.21.15.71:6793/0","public_addr":"172.21.15.71:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-08-19T11:21:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.443+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d8403ea80 msgr2=0x7f7d84040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.443+0000 7f7da8df4640 1 --2- 172.21.15.71:0/3602500471 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d8403ea80 0x7f7d84040f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7da4126510 tx=0x7f7d8c008040 comp rx=0 tx=0).stop 2024-08-19T11:21:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.443+0000 7f7da8df4640 10 monclient: shutdown 2024-08-19T11:21:28.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.443+0000 7f7da8df4640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.443+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 msgr2=0x7f7da4124df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.443+0000 7f7da8df4640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 0x7f7da4124df0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00ebe0 tx=0x7f7d9c00c520 comp rx=0 tx=0).stop 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 shutdown_connections 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 --2- 172.21.15.71:0/3602500471 >> v2:172.21.15.135:6800/726754104 conn(0x7f7d8403ea80 0x7f7d84040f40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f7da4139860 0x7f7da4125870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7da40a6e10 0x7f7da4125330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 --2- 172.21.15.71:0/3602500471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7da40a6a30 0x7f7da4124df0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 >> 172.21.15.71:0/3602500471 conn(0x7f7da40ac030 msgr2=0x7f7da409eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 shutdown_connections 2024-08-19T11:21:28.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.444+0000 7f7da8df4640 1 -- 172.21.15.71:0/3602500471 wait complete. 2024-08-19T11:21:28.455 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-08-19T11:21:28.455 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-08-19T11:21:28.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.553+0000 7f09f57aa640 10 monclient: get_monmap_and_config 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.553+0000 7f09f57aa640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.553+0000 7f09f57aa640 10 monclient: monmap: 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:28.554434+0000 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:28.554434+0000 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:28.555 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 Processor -- start 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 -- start start 2024-08-19T11:21:28.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient: init 2024-08-19T11:21:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient: _add_conns ranks=[7,1,4,10,5,0,8,3,9,6,2] 2024-08-19T11:21:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09f00a6950 0x7f09f00a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): picked mon.noname-i con 0x7f09f00a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f09f00a57c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 0x7f09f0139e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): picked mon.noname-c con 0x7f09f00a7270 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f00a6380 con 0x7f09f00a57c0 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f09f00a5020 con 0x7f09f00a7270 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f09f00a7d40 con 0x7f09f00a6950 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.554+0000 7f09f57aa640 10 monclient(hunting): authenticate will time out at 1346.595922s 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 0x7f09f0139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 0x7f09f0139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38680/0 (socket says 172.21.15.71:38680) 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 -- 172.21.15.71:0/652108519 learned_addr learned my addr 172.21.15.71:0/652108519 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): get_auth_request con 0x7f09f00a7270 auth_method 0 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 1 --2- 172.21.15.71:0/652108519 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09f00a6950 0x7f09f00a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): get_auth_request con 0x7f09f00a6950 auth_method 0 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_done global_id 85468 payload 274 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 -- 172.21.15.71:0/652108519 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09f00a6950 msgr2=0x7f09f00a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 --2- 172.21.15.71:0/652108519 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09f00a6950 0x7f09f00a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 -- 172.21.15.71:0/652108519 >> v1:172.21.15.135:6789/0 conn(0x7f09f00a57c0 legacy=0x7f09f0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 monclient: found mon.noname-c 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.555+0000 7f09ef7fe640 1 -- 172.21.15.71:0/652108519 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f00a3650 con 0x7f09f00a7270 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09ef7fe640 1 -- 172.21.15.71:0/652108519 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 msgr2=0x7f09f0139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09ef7fe640 1 --2- 172.21.15.71:0/652108519 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 0x7f09f0139e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098d0 tx=0x7f09e002a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=68bf3f6724bbbc76 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 1 -- 172.21.15.71:0/652108519 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09e0037070 con 0x7f09f00a7270 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: dump: 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 5 monclient: authenticate success, global_id 85468 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 1 -- 172.21.15.71:0/652108519 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e002adc0 con 0x7f09f00a7270 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 4 set_mon_vals no callback set 2024-08-19T11:21:28.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 1 -- 172.21.15.71:0/652108519 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09e0030c20 con 0x7f09f00a7270 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09edffb640 10 monclient: dump: 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.566 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 10 monclient: shutdown 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 -- 172.21.15.71:0/652108519 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 msgr2=0x7f09f0139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 --2- 172.21.15.71:0/652108519 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 0x7f09f0139e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098d0 tx=0x7f09e002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 -- 172.21.15.71:0/652108519 shutdown_connections 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 --2- 172.21.15.71:0/652108519 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f09f00a7270 0x7f09f0139e20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 --2- 172.21.15.71:0/652108519 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f09f00a6950 0x7f09f00a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 -- 172.21.15.71:0/652108519 >> 172.21.15.71:0/652108519 conn(0x7f09f00abf50 msgr2=0x7f09f00ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 -- 172.21.15.71:0/652108519 shutdown_connections 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.558+0000 7f09f57aa640 1 -- 172.21.15.71:0/652108519 wait complete. 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.559+0000 7f09f57aa640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.559+0000 7f09f57aa640 10 monclient: monmap: 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:28.568 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.559+0000 7f09f57aa640 1 Processor -- start 2024-08-19T11:21:28.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.559+0000 7f09f57aa640 1 -- start start 2024-08-19T11:21:28.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.559+0000 7f09f57aa640 10 monclient: init 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient: _add_conns ranks=[3,1,5,8,6,2,0,4,7] 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 0x7f09f01ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): picked mon.noname-g con 0x7f09f00a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09f00a6950 0x7f09f0139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): picked mon.noname-f con 0x7f09f00a6950 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f09f00a7270 0x7f09f013a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): picked mon.noname-h con 0x7f09f00a7270 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09f00a8700 con 0x7f09f00a6950 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09f00a84c0 con 0x7f09f00a57c0 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f09f00a7690 con 0x7f09f00a7270 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09f57aa640 10 monclient(hunting): authenticate will time out at 1346.601410s 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 0x7f09f01ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09f00a6950 0x7f09f0139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f09f00a7270 0x7f09f013a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 0x7f09f01ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.71:43460/0 (socket says 172.21.15.71:43460) 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09f00a6950 0x7f09f0139b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:48614/0 (socket says 172.21.15.71:48614) 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 1 -- 172.21.15.71:0/57222800 learned_addr learned my addr 172.21.15.71:0/57222800 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f09f00a7270 0x7f09f013a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:39970/0 (socket says 172.21.15.71:39970) 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): get_auth_request con 0x7f09f00a7270 auth_method 0 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): get_auth_request con 0x7f09f00a57c0 auth_method 0 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): get_auth_request con 0x7f09f00a6950 auth_method 0 2024-08-19T11:21:28.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.560+0000 7f09eeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 10 monclient(hunting): handle_auth_done global_id 46263 payload 824 2024-08-19T11:21:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f09f00a7270 msgr2=0x7f09f013a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f09f00a7270 0x7f09f013a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09f00a6950 msgr2=0x7f09f0139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09f00a6950 0x7f09f0139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 1 monclient: found mon.noname-g 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09eeffd640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f01251b0 con 0x7f09f00a57c0 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09ee7fc640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09f00a6950 0x7f09f0139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.561+0000 7f09ef7fe640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f09f00a7270 0x7f09f013a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09eeffd640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 msgr2=0x7f09f01ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09eeffd640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 0x7f09f01ce220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009db0 tx=0x7f09e800c490 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09e8018020 con 0x7f09f00a57c0 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: dump: 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.582 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 5 monclient: authenticate success, global_id 46263 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e80148f0 con 0x7f09f00a57c0 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09e80133e0 con 0x7f09f00a57c0 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 10 monclient: _renew_subs 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f00a94a0 con 0x7f09f00a57c0 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09ed7fa640 4 set_mon_vals no callback set 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09e77fe640 10 monclient: dump: 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 10 monclient: _renew_subs 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.135:3301/0 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.563+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f0126f50 con 0x7f09f00a57c0 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09f57aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09f57aa640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 0x7f09f0123bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0076c60 con 0x7f09f01237e0 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 0x7f09f0123bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient: get_auth_request con 0x7f09f01237e0 auth_method 0 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.3 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f09e8005d10 con 0x7f09f00a57c0 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_done global_id 75987 payload 824 2024-08-19T11:21:28.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09ee7fc640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09f00a6030 con 0x7f09f01237e0 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.564+0000 7f09e77fe640 1 --2- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 0x7f09d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.3 v2:172.21.15.135:3301/0 5 ==== osd_map(321..321 src has 1..321) ==== 3506+0+0 (secure 0 0 0) 0x7f09e8052370 con 0x7f09f00a57c0 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09ef7fe640 1 --2- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 0x7f09d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09ef7fe640 10 monclient: get_auth_request con 0x7f09d003ea80 auth_method 0 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09ef7fe640 1 -- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 msgr2=0x7f09d0040f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09ef7fe640 1 -- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 msgr2=0x7f09d0040f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09ef7fe640 1 --2- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 0x7f09d0040f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.565+0000 7f09ef7fe640 1 --2- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 0x7f09d0040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09ee7fc640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 msgr2=0x7f09f0123bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09ee7fc640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 0x7f09f0123bc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09f0124ee0 tx=0x7f09d800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09d80054a0 con 0x7f09f01237e0 2024-08-19T11:21:28.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 10 monclient: dump: 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.588 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f09d800dd60 con 0x7f09f01237e0 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 msgr2=0x7f09f0123bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 0x7f09f0123bc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09f0124ee0 tx=0x7f09d800ff70 comp rx=0 tx=0).stop 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 msgr2=0x7f09f0123bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.567+0000 7f09e77fe640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f01237e0 0x7f09f0123bc0 secure :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09f0124ee0 tx=0x7f09d800ff70 comp rx=0 tx=0).stop 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09f57aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:28.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09f57aa640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 0x7f09f009e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09f57aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0127120 con 0x7f09f0124100 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 0x7f09f009e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient: get_auth_request con 0x7f09f0124100 auth_method 0 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 10 monclient(hunting): handle_auth_done global_id 75996 payload 824 2024-08-19T11:21:28.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.573+0000 7f09ee7fc640 1 -- 172.21.15.71:0/57222800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f09f00a6d30 con 0x7f09f0124100 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09ee7fc640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 msgr2=0x7f09f009e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09ee7fc640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 0x7f09f009e680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f09d8018000 tx=0x7f09d8003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f09d8007490 con 0x7f09f0124100 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 10 monclient: dump: 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.591 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 <== mon.0 v2:172.21.15.71:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9437 (secure 0 0 0) 0x7f09d801e030 con 0x7f09f0124100 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:28.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 msgr2=0x7f09f009e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 0x7f09f009e680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f09d8018000 tx=0x7f09d8003760 comp rx=0 tx=0).stop 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 msgr2=0x7f09f009e680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09e77fe640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f0124100 0x7f09f009e680 secure :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f09d8018000 tx=0x7f09d8003760 comp rx=0 tx=0).stop 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "leader", 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 337609, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:21:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:28.595 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:28.596 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:28.597 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:28.598 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:28.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:28.600 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:28.602 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.603 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:28.604 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.606 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.607 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.610 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:28.611 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.613 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.614 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.615 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.616 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:28.617 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 msgr2=0x7f09d0040f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 --2- 172.21.15.71:0/57222800 >> v2:172.21.15.135:6800/726754104 conn(0x7f09d003ea80 0x7f09d0040f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 10 monclient: shutdown 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 msgr2=0x7f09f01ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 --2- 172.21.15.71:0/57222800 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09f00a57c0 0x7f09f01ce220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009db0 tx=0x7f09e800c490 comp rx=0 tx=0).stop 2024-08-19T11:21:28.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09ef7fe640 1 -- 172.21.15.71:0/57222800 reap_dead start 2024-08-19T11:21:28.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09ef7fe640 1 -- 172.21.15.71:0/57222800 reap_dead start 2024-08-19T11:21:28.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 shutdown_connections 2024-08-19T11:21:28.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 >> 172.21.15.71:0/57222800 conn(0x7f09f00abf50 msgr2=0x7f09f01c1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 shutdown_connections 2024-08-19T11:21:28.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.576+0000 7f09f57aa640 1 -- 172.21.15.71:0/57222800 wait complete. 2024-08-19T11:21:28.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:28.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-08-19T11:21:28.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-08-19T11:21:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.717+0000 7fbb170a6640 10 monclient: get_monmap_and_config 2024-08-19T11:21:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.717+0000 7fbb170a6640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.717+0000 7fbb170a6640 10 monclient: monmap: 2024-08-19T11:21:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.718 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:28.718070+0000 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:28.718070+0000 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.719 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:28.720 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:28.720 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 Processor -- start 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 -- start start 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient: init 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient: _add_conns ranks=[1,6,5,7,10,2,8,0,4,9,3] 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbb100a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 0x7fbb1013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): picked mon.noname-d con 0x7fbb100a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:28.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbb100a7440 0x7fbb101410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): picked mon.noname-h con 0x7fbb100a7440 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb100a6380 con 0x7fbb100a6950 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fbb100a5020 con 0x7fbb100a7440 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fbb100a7d40 con 0x7fbb100a57c0 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb170a6640 10 monclient(hunting): authenticate will time out at 1346.759719s 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 0x7fbb1013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 0x7fbb1013eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51254/0 (socket says 172.21.15.71:51254) 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 1 -- 172.21.15.71:0/2182835384 learned_addr learned my addr 172.21.15.71:0/2182835384 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): get_auth_request con 0x7fbb100a57c0 auth_method 0 2024-08-19T11:21:28.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb15643640 1 --2- 172.21.15.71:0/2182835384 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbb100a7440 0x7fbb101410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb15643640 10 monclient(hunting): get_auth_request con 0x7fbb100a7440 auth_method 0 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb15643640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb15643640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb15643640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.718+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb15643640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb15643640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb15643640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_done global_id 104838 payload 274 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 1 -- 172.21.15.71:0/2182835384 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbb100a7440 msgr2=0x7fbb101410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/2182835384 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbb100a7440 0x7fbb101410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 1 -- 172.21.15.71:0/2182835384 >> v1:172.21.15.135:6789/0 conn(0x7fbb100a6950 legacy=0x7fbb100a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 1 monclient: found mon.noname-d 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:28.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.719+0000 7fbb0ffff640 1 -- 172.21.15.71:0/2182835384 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb100a3650 con 0x7fbb100a57c0 2024-08-19T11:21:28.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.721+0000 7fbb0ffff640 1 -- 172.21.15.71:0/2182835384 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 msgr2=0x7fbb1013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.721+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/2182835384 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 0x7fbb1013eb60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0098d0 tx=0x7fbafc02a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=268c83c58c0cd26e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 1 -- 172.21.15.71:0/2182835384 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbafc037070 con 0x7fbb100a57c0 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: dump: 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.733 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 1 -- 172.21.15.71:0/2182835384 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbafc02adc0 con 0x7fbb100a57c0 2024-08-19T11:21:28.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 5 monclient: authenticate success, global_id 104838 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 1 -- 172.21.15.71:0/2182835384 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbafc030c20 con 0x7fbb100a57c0 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 4 set_mon_vals no callback set 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb0f7fe640 10 monclient: dump: 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.735 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 10 monclient: shutdown 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 -- 172.21.15.71:0/2182835384 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 msgr2=0x7fbb1013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 --2- 172.21.15.71:0/2182835384 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 0x7fbb1013eb60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0098d0 tx=0x7fbafc02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 -- 172.21.15.71:0/2182835384 shutdown_connections 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 --2- 172.21.15.71:0/2182835384 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fbb100a7440 0x7fbb101410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 --2- 172.21.15.71:0/2182835384 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fbb100a57c0 0x7fbb1013eb60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 -- 172.21.15.71:0/2182835384 >> 172.21.15.71:0/2182835384 conn(0x7fbb100abf50 msgr2=0x7fbb100ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 -- 172.21.15.71:0/2182835384 shutdown_connections 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.722+0000 7fbb170a6640 1 -- 172.21.15.71:0/2182835384 wait complete. 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.723+0000 7fbb170a6640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.723+0000 7fbb170a6640 10 monclient: monmap: 2024-08-19T11:21:28.737 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.738 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.723+0000 7fbb170a6640 1 Processor -- start 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.723+0000 7fbb170a6640 1 -- start start 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.723+0000 7fbb170a6640 10 monclient: init 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient: _add_conns ranks=[2,8,7,6,5,1,3,0,4] 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 0x7fbb10126c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): picked mon.noname-b con 0x7fbb100a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbb100a6950 0x7fbb10128d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): picked mon.noname-e con 0x7fbb100a6950 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbb100a7440 0x7fbb1013fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): picked mon.noname-i con 0x7fbb100a7440 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:28.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbb100a8700 con 0x7fbb100a57c0 2024-08-19T11:21:28.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fbb100a84c0 con 0x7fbb100a7440 2024-08-19T11:21:28.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fbb101415f0 con 0x7fbb100a6950 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb170a6640 10 monclient(hunting): authenticate will time out at 1346.765284s 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 0x7fbb10126c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbb100a6950 0x7fbb10128d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 0x7fbb10126c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48012/0 (socket says 172.21.15.71:48012) 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 -- 172.21.15.71:0/675127057 learned_addr learned my addr 172.21.15.71:0/675127057 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbb100a6950 0x7fbb10128d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55486/0 (socket says 172.21.15.71:55486) 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): get_auth_request con 0x7fbb100a57c0 auth_method 0 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): get_auth_request con 0x7fbb100a6950 auth_method 0 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbb100a7440 0x7fbb1013fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): get_auth_request con 0x7fbb100a7440 auth_method 0 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb15643640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient(hunting): handle_auth_done global_id 75989 payload 824 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbb100a6950 msgr2=0x7fbb10128d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbb100a6950 0x7fbb10128d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbb100a7440 msgr2=0x7fbb1013fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fbb100a7440 0x7fbb1013fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 monclient: found mon.noname-b 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb14e42640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb100a9530 con 0x7fbb100a57c0 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.724+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fbb100a6950 0x7fbb10128d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.726+0000 7fbb14e42640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 msgr2=0x7fbb10126c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.726+0000 7fbb14e42640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 0x7fbb10126c30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c460 tx=0x7fbb0400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb04016020 con 0x7fbb100a57c0 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: dump: 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.745 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb04012cb0 con 0x7fbb100a57c0 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 5 monclient: authenticate success, global_id 75989 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 10 monclient: _renew_subs 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb10140850 con 0x7fbb100a57c0 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbb040117f0 con 0x7fbb100a57c0 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0d7fa640 10 monclient: dump: 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.747 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb0effd640 4 set_mon_vals no callback set 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 10 monclient: _renew_subs 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1012a260 con 0x7fbb100a57c0 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 0x7fbb101ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.727+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbb10076c60 con 0x7fbb101400f0 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 0x7fbb101ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient: get_auth_request con 0x7fbb101400f0 auth_method 0 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fbb04019020 con 0x7fbb100a57c0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_done global_id 75998 payload 824 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0ffff640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb10140d30 con 0x7fbb101400f0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0d7fa640 1 --2- 172.21.15.71:0/675127057 >> v2:172.21.15.135:6800/726754104 conn(0x7fbaf403ea80 0x7fbaf4040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(321..321 src has 1..321) ==== 3506+0+0 (secure 0 0 0) 0x7fbb040517c0 con 0x7fbb100a57c0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb15643640 1 --2- 172.21.15.71:0/675127057 >> v2:172.21.15.135:6800/726754104 conn(0x7fbaf403ea80 0x7fbaf4040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.728+0000 7fbb15643640 10 monclient: get_auth_request con 0x7fbaf403ea80 auth_method 0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0ffff640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 msgr2=0x7fbb101ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 0x7fbb101ce570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbafc034000 tx=0x7fbafc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbafc037040 con 0x7fbb101400f0 2024-08-19T11:21:28.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 10 monclient: dump: 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.751 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbafc02adc0 con 0x7fbb101400f0 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 msgr2=0x7fbb101ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 0x7fbb101ce570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbafc034000 tx=0x7fbafc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 msgr2=0x7fbb101ce570 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:28.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.730+0000 7fbb0d7fa640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101400f0 0x7fbb101ce570 secure :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbafc034000 tx=0x7fbafc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.731+0000 7fbb15643640 1 --2- 172.21.15.71:0/675127057 >> v2:172.21.15.135:6800/726754104 conn(0x7fbaf403ea80 0x7fbaf4040f40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbb08011340 tx=0x7fbb0800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.736+0000 7fbb170a6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.736+0000 7fbb170a6640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 0x7fbb101ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.736+0000 7fbb170a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbb101cf400 con 0x7fbb101ceab0 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 0x7fbb101ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient: get_auth_request con 0x7fbb101ceab0 auth_method 0 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 10 monclient(hunting): handle_auth_done global_id 76007 payload 824 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.737+0000 7fbb0ffff640 1 -- 172.21.15.71:0/675127057 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbb10129e30 con 0x7fbb101ceab0 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0ffff640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 msgr2=0x7fbb101ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0ffff640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 0x7fbb101ceec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097c0 tx=0x7fbafc008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fbafc037040 con 0x7fbb101ceab0 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 10 monclient: dump: 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.756 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 <== mon.2 v2:172.21.15.71:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7fbafc03ee30 con 0x7fbb101ceab0 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:28.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 msgr2=0x7fbb101ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 0x7fbb101ceec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097c0 tx=0x7fbafc008030 comp rx=0 tx=0).stop 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 msgr2=0x7fbb101ceec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.739+0000 7fbb0d7fa640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb101ceab0 0x7fbb101ceec0 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0097c0 tx=0x7fbafc008030 comp rx=0 tx=0).stop 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 337771, 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:28.758 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:28.759 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:28.760 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:28.761 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:28.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:28.763 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.764 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.765 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.766 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:28.767 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.768 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.771 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:28.772 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.775 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:28.776 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.777 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.778 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:28.779 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:28.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:28.781 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 >> v2:172.21.15.135:6800/726754104 conn(0x7fbaf403ea80 msgr2=0x7fbaf4040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 --2- 172.21.15.71:0/675127057 >> v2:172.21.15.135:6800/726754104 conn(0x7fbaf403ea80 0x7fbaf4040f40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbb08011340 tx=0x7fbb0800b040 comp rx=0 tx=0).stop 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 10 monclient: shutdown 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 msgr2=0x7fbb10126c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 --2- 172.21.15.71:0/675127057 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbb100a57c0 0x7fbb10126c30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c460 tx=0x7fbb0400c920 comp rx=0 tx=0).stop 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb15643640 1 -- 172.21.15.71:0/675127057 reap_dead start 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb15643640 1 -- 172.21.15.71:0/675127057 reap_dead start 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 shutdown_connections 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 >> 172.21.15.71:0/675127057 conn(0x7fbb100abf50 msgr2=0x7fbb1009f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 shutdown_connections 2024-08-19T11:21:28.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.740+0000 7fbb170a6640 1 -- 172.21.15.71:0/675127057 wait complete. 2024-08-19T11:21:28.784 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:28.784 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-08-19T11:21:28.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-08-19T11:21:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.880+0000 7ff4f9c67640 10 monclient: get_monmap_and_config 2024-08-19T11:21:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.880+0000 7ff4f9c67640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.880+0000 7ff4f9c67640 10 monclient: monmap: 2024-08-19T11:21:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.881 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:28.881047+0000 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:28.881047+0000 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.882 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.883 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:28.883 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:28.883 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 1 Processor -- start 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 1 -- start start 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient: init 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient: _add_conns ranks=[1,0,8,4,7,6,2,10,5,9,3] 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff4f40a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:28.885 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff4f40a57c0 addr v1:172.21.15.71:6789/0 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 0x7ff4f4142290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient(hunting): picked mon.noname-e con 0x7ff4f40a7440 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f40a6380 con 0x7ff4f40a57c0 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f40a3650 con 0x7ff4f40a6950 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff4f40a5020 con 0x7ff4f40a7440 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.881+0000 7ff4f9c67640 10 monclient(hunting): authenticate will time out at 1346.922925s 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 0x7ff4f4142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4ebfff640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff4f40a57c0 0x7ff4f413eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52160/0 (socket says 172.21.15.71:52160) 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4ebfff640 1 -- 172.21.15.71:0/2300990000 learned_addr learned my addr 172.21.15.71:0/2300990000 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 0x7ff4f4142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55492/0 (socket says 172.21.15.71:55492) 2024-08-19T11:21:28.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): get_auth_request con 0x7ff4f40a7440 auth_method 0 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_done global_id 124127 payload 274 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 1 -- 172.21.15.71:0/2300990000 >> v1:172.21.15.135:6789/0 conn(0x7ff4f40a6950 legacy=0x7ff4f40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 1 -- 172.21.15.71:0/2300990000 >> v1:172.21.15.71:6789/0 conn(0x7ff4f40a57c0 legacy=0x7ff4f413eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 1 monclient: found mon.noname-e 2024-08-19T11:21:28.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:28.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.882+0000 7ff4f3fff640 1 -- 172.21.15.71:0/2300990000 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40a84c0 con 0x7ff4f40a7440 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f3fff640 1 -- 172.21.15.71:0/2300990000 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 msgr2=0x7ff4f4142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/2300990000 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 0x7ff4f4142290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009dc0 tx=0x7ff4ec02a480 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2e2a0041d6468bbb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 1 -- 172.21.15.71:0/2300990000 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4ec007ca0 con 0x7ff4f40a7440 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: dump: 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.893 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.894 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 5 monclient: authenticate success, global_id 124127 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 1 -- 172.21.15.71:0/2300990000 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec031400 con 0x7ff4f40a7440 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 4 set_mon_vals no callback set 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 1 -- 172.21.15.71:0/2300990000 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4ec007e60 con 0x7ff4f40a7440 2024-08-19T11:21:28.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f2ffd640 10 monclient: dump: 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:28.896 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 10 monclient: shutdown 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 -- 172.21.15.71:0/2300990000 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 msgr2=0x7ff4f4142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/2300990000 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 0x7ff4f4142290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009dc0 tx=0x7ff4ec02a480 comp rx=0 tx=0).stop 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 -- 172.21.15.71:0/2300990000 shutdown_connections 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/2300990000 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4f40a7440 0x7ff4f4142290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 -- 172.21.15.71:0/2300990000 >> 172.21.15.71:0/2300990000 conn(0x7ff4f40abf50 msgr2=0x7ff4f40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 -- 172.21.15.71:0/2300990000 shutdown_connections 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.885+0000 7ff4f9c67640 1 -- 172.21.15.71:0/2300990000 wait complete. 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.886+0000 7ff4f9c67640 10 monclient: build_initial_monmap 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.886+0000 7ff4f9c67640 10 monclient: monmap: 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:28.898 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.886+0000 7ff4f9c67640 1 Processor -- start 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.886+0000 7ff4f9c67640 1 -- start start 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.886+0000 7ff4f9c67640 10 monclient: init 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:28.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient: _add_conns ranks=[3,6,2,1,7,8,5,0,4] 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4f40a57c0 0x7ff4f4128cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): picked mon.noname-g con 0x7ff4f40a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff4f40a6950 0x7ff4f4140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): picked mon.noname-d con 0x7ff4f40a6950 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): picked mon.noname-b con 0x7ff4f40a7440 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40a8700 con 0x7ff4f40a7440 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40a7d40 con 0x7ff4f40a57c0 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7ff4f41427d0 con 0x7ff4f40a6950 2024-08-19T11:21:28.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f9c67640 10 monclient(hunting): authenticate will time out at 1346.928330s 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff4f40a6950 0x7ff4f4140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff4f40a6950 0x7ff4f4140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51268/0 (socket says 172.21.15.71:51268) 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 1 -- 172.21.15.71:0/3830933825 learned_addr learned my addr 172.21.15.71:0/3830933825 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): get_auth_request con 0x7ff4f40a6950 auth_method 0 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): get_auth_request con 0x7ff4f40a7440 auth_method 0 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4f40a57c0 0x7ff4f4128cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): get_auth_request con 0x7ff4f40a57c0 auth_method 0 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient(hunting): handle_auth_done global_id 76016 payload 824 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff4f40a6950 msgr2=0x7ff4f4140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7ff4f40a6950 0x7ff4f4140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4f40a57c0 msgr2=0x7ff4f4128cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4f40a57c0 0x7ff4f4128cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 monclient: found mon.noname-b 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:28.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f412a4d0 con 0x7ff4f40a7440 2024-08-19T11:21:28.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 msgr2=0x7ff4f41267c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:21:28.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 msgr2=0x7ff4f41267c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:28.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec031000 tx=0x7ff4ec004a40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:28.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:28.887+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 10 monclient: get_auth_request con 0x7ff4f40a7440 auth_method 0 2024-08-19T11:21:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 0 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:21:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient: ms_handle_reset current mon [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 msgr2=0x7ff4f41267c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff4f40a7440 0x7ff4f41267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient: _add_conns ranks=[8,5,1,0,4,7] 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 0x7ff4d4005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): picked mon.noname-e con 0x7ff4d40035d0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff4d40065c0 0x7ff4d4008a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): picked mon.noname-h con 0x7ff4d40065c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4009630 0x7ff4d400baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): picked mon.noname-f con 0x7ff4d4009630 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d400c6e0 con 0x7ff4d4009630 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7ff4d400c860 con 0x7ff4d40065c0 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7ff4d400ca60 con 0x7ff4d40035d0 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f0ff9640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 0x7ff4d4005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): get_auth_request con 0x7ff4d40035d0 auth_method 0 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4ebfff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff4d40065c0 0x7ff4d4008a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4ebfff640 10 monclient(hunting): get_auth_request con 0x7ff4d40065c0 auth_method 0 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4ebfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4009630 0x7ff4d400baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient(hunting): handle_auth_done global_id 76016 payload 293 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff4d40065c0 msgr2=0x7ff4d4008a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7ff4d40065c0 0x7ff4d4008a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4009630 msgr2=0x7ff4d400baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4009630 0x7ff4d400baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 monclient: found mon.noname-e 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f37fe640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d400cd20 con 0x7ff4d40035d0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 10 monclient: get_auth_request con 0x7ff4d4009630 auth_method 0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4d4009630 0x7ff4d400baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.088+0000 7ff4f3fff640 1 -- 172.21.15.71:0/3830933825 reap_dead start 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f37fe640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 msgr2=0x7ff4d4005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f37fe640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 0x7ff4d4005a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4004ff0 tx=0x7ff4ec02f000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4e4017030 con 0x7ff4d40035d0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: dump: 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e400f7b0 con 0x7ff4d40035d0 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 5 monclient: authenticate success, global_id 76016 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 10 monclient: _renew_subs 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f40a9600 con 0x7ff4d40035d0 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4e4004bc0 con 0x7ff4d40035d0 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f0ff9640 10 monclient: dump: 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f27fc640 4 set_mon_vals no callback set 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 10 monclient: _renew_subs 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.091+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f4128170 con 0x7ff4d40035d0 2024-08-19T11:21:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f9c67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 0x7ff4f4140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f9c67640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff4f4076c60 con 0x7ff4f4128cd0 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 0x7ff4f4140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient: get_auth_request con 0x7ff4f4128cd0 auth_method 0 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7ff4e401a070 con 0x7ff4d40035d0 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_done global_id 85477 payload 824 2024-08-19T11:21:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4ebfff640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4f40a6050 con 0x7ff4f4128cd0 2024-08-19T11:21:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> v2:172.21.15.135:6800/726754104 conn(0x7ff4d40434f0 0x7ff4d40459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(322..322 src has 1..322) ==== 3898+0+0 (secure 0 0 0) 0x7ff4e4018070 con 0x7ff4d40035d0 2024-08-19T11:21:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> v2:172.21.15.135:6800/726754104 conn(0x7ff4d40434f0 0x7ff4d40459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.092+0000 7ff4f3fff640 10 monclient: get_auth_request con 0x7ff4d40434f0 auth_method 0 2024-08-19T11:21:29.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.094+0000 7ff4ebfff640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 msgr2=0x7ff4f4140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.094+0000 7ff4ebfff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 0x7ff4f4140b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41287e0 tx=0x7ff4dc010ca0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4dc01a070 con 0x7ff4f4128cd0 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 10 monclient: dump: 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.107 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff4dc00ead0 con 0x7ff4f4128cd0 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 msgr2=0x7ff4f4140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 0x7ff4f4140b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41287e0 tx=0x7ff4dc010ca0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 msgr2=0x7ff4f4140b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 0x7ff4f4140b50 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41287e0 tx=0x7ff4dc010ca0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.095+0000 7ff4f3fff640 1 --2- 172.21.15.71:0/3830933825 >> v2:172.21.15.135:6800/726754104 conn(0x7ff4d40434f0 0x7ff4d40459b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41cf4f0 tx=0x7ff4ec033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4f9c67640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 0x7ff4f4126ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4f9c67640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7ff4f40a6d30 con 0x7ff4f41267c0 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 0x7ff4f4126ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient: get_auth_request con 0x7ff4f41267c0 auth_method 0 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 10 monclient(hunting): handle_auth_done global_id 85486 payload 824 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.101+0000 7ff4ebfff640 1 -- 172.21.15.71:0/3830933825 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4f41cf520 con 0x7ff4f41267c0 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.103+0000 7ff4ebfff640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 msgr2=0x7ff4f4126ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4ebfff640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 0x7ff4f4126ba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41287e0 tx=0x7ff4dc004a10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7ff4dc01a040 con 0x7ff4f41267c0 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 10 monclient: dump: 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.110 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.111 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 <== mon.4 v2:172.21.15.71:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7ff4dc015dc0 con 0x7ff4f41267c0 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 msgr2=0x7ff4f4126ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 0x7ff4f4126ba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41287e0 tx=0x7ff4dc004a10 comp rx=0 tx=0).stop 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 msgr2=0x7ff4f4126ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f0ff9640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 0x7ff4f4126ba0 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41287e0 tx=0x7ff4dc004a10 comp rx=0 tx=0).stop 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:29.112 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 271251, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:29.113 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.114 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.115 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:29.116 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:29.117 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:29.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.123 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:29.125 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.128 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.130 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.131 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.133 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:21:29.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.136 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:29.136 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 >> v2:172.21.15.135:6800/726754104 conn(0x7ff4d40434f0 msgr2=0x7ff4d40459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> v2:172.21.15.135:6800/726754104 conn(0x7ff4d40434f0 0x7ff4d40459b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41cf4f0 tx=0x7ff4ec033040 comp rx=0 tx=0).stop 2024-08-19T11:21:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 10 monclient: shutdown 2024-08-19T11:21:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 msgr2=0x7ff4d4005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 0x7ff4d4005a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4004ff0 tx=0x7ff4ec02f000 comp rx=0 tx=0).stop 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 shutdown_connections 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> v2:172.21.15.135:6800/726754104 conn(0x7ff4d40434f0 0x7ff4d40459b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7ff4d40035d0 0x7ff4d4005a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f41267c0 0x7ff4f4126ba0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 --2- 172.21.15.71:0/3830933825 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7ff4f4128cd0 0x7ff4f4140b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 >> 172.21.15.71:0/3830933825 conn(0x7ff4f40abf50 msgr2=0x7ff4f409f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 shutdown_connections 2024-08-19T11:21:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.104+0000 7ff4f9c67640 1 -- 172.21.15.71:0/3830933825 wait complete. 2024-08-19T11:21:29.138 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:29.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-08-19T11:21:29.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.237+0000 7f2574b9f640 10 monclient: get_monmap_and_config 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.237+0000 7f2574b9f640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.237+0000 7f2574b9f640 10 monclient: monmap: 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:29.238158+0000 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:29.238158+0000 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 Processor -- start 2024-08-19T11:21:29.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 -- start start 2024-08-19T11:21:29.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient: init 2024-08-19T11:21:29.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient: _add_conns ranks=[5,3,10,1,6,8,9,4,2,7,0] 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 0x7f25700a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): picked mon.noname-h con 0x7f25700a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25700a57c0 0x7f25700a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): picked mon.noname-g con 0x7f25700a57c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 0x7f2570139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): picked mon.noname-f con 0x7f2570139710 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f25700a5020 con 0x7f2570139710 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f25700a77b0 con 0x7f25700a57c0 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f25700a7d40 con 0x7f25700a6950 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.238+0000 7f2574b9f640 10 monclient(hunting): authenticate will time out at 1347.279861s 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 0x7f2570139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25700a57c0 0x7f25700a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 0x7f25700a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 0x7f25700a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:39996/0 (socket says 172.21.15.71:39996) 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 -- 172.21.15.71:0/148813722 learned_addr learned my addr 172.21.15.71:0/148813722 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): get_auth_request con 0x7f25700a6950 auth_method 0 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 1 --2- 172.21.15.71:0/148813722 >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 0x7f2570139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:48638/0 (socket says 172.21.15.71:48638) 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): get_auth_request con 0x7f25700a57c0 auth_method 0 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): get_auth_request con 0x7f2570139710 auth_method 0 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient(hunting): handle_auth_done global_id 46589 payload 274 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 -- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25700a57c0 msgr2=0x7f25700a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 --2- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25700a57c0 0x7f25700a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 -- 172.21.15.71:0/148813722 >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 msgr2=0x7f2570139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 --2- 172.21.15.71:0/148813722 >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 0x7f2570139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 monclient: found mon.noname-h 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256e59c640 1 -- 172.21.15.71:0/148813722 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25700a6380 con 0x7f25700a6950 2024-08-19T11:21:29.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.239+0000 7f256ed9d640 1 --2- 172.21.15.71:0/148813722 >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 0x7f2570139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256e59c640 1 -- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 msgr2=0x7f25700a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256e59c640 1 --2- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 0x7f25700a6d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f256002a0a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=7e73dbdcd7016ed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 1 -- 172.21.15.71:0/148813722 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2560037070 con 0x7f25700a6950 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: dump: 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.249 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.250 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 1 -- 172.21.15.71:0/148813722 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256002ae00 con 0x7f25700a6950 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 1 -- 172.21.15.71:0/148813722 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2560030c20 con 0x7f25700a6950 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f2574b9f640 5 monclient: authenticate success, global_id 46589 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f2574b9f640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f2574b9f640 4 set_mon_vals no callback set 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.242+0000 7f256d59a640 10 monclient: dump: 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.251 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.252 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 10 monclient: shutdown 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 -- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 msgr2=0x7f25700a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 --2- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 0x7f25700a6d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f256002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 -- 172.21.15.71:0/148813722 shutdown_connections 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 --2- 172.21.15.71:0/148813722 >> v2:172.21.15.135:3300/0 conn(0x7f2570139710 0x7f2570139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 --2- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f25700a57c0 0x7f25700a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 --2- 172.21.15.71:0/148813722 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f25700a6950 0x7f25700a6d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 -- 172.21.15.71:0/148813722 >> 172.21.15.71:0/148813722 conn(0x7f25700abf50 msgr2=0x7f25700ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 -- 172.21.15.71:0/148813722 shutdown_connections 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.243+0000 7f2574b9f640 1 -- 172.21.15.71:0/148813722 wait complete. 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.244+0000 7f2574b9f640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.244+0000 7f2574b9f640 10 monclient: monmap: 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.253 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.254 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.244+0000 7f2574b9f640 1 Processor -- start 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.244+0000 7f2574b9f640 1 -- start start 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.244+0000 7f2574b9f640 10 monclient: init 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.244+0000 7f2574b9f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient: _add_conns ranks=[1,2,8,5,4,7,6,3,0] 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25700a57c0 0x7f2570138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): picked mon.noname-f con 0x7f25700a57c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25700a6950 0x7f25701390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): picked mon.noname-b con 0x7f25700a6950 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 0x7f25701ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): picked mon.noname-e con 0x7f2570139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25700a84c0 con 0x7f25700a57c0 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f25700a3650 con 0x7f25700a6950 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f25700a8700 con 0x7f2570139710 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f2574b9f640 10 monclient(hunting): authenticate will time out at 1347.286100s 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 0x7f25701ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25700a6950 0x7f25701390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25700a6950 0x7f25701390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48042/0 (socket says 172.21.15.71:48042) 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 0x7f25701ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55508/0 (socket says 172.21.15.71:55508) 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 1 -- 172.21.15.71:0/3823331783 learned_addr learned my addr 172.21.15.71:0/3823331783 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): get_auth_request con 0x7f25700a6950 auth_method 0 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): get_auth_request con 0x7f2570139710 auth_method 0 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25700a57c0 0x7f2570138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): get_auth_request con 0x7f25700a57c0 auth_method 0 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient(hunting): handle_auth_done global_id 124136 payload 824 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25700a6950 msgr2=0x7f25701390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.264 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25700a6950 0x7f25701390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25700a57c0 msgr2=0x7f2570138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25700a57c0 0x7f2570138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 monclient: found mon.noname-e 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256ed9d640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257013a190 con 0x7f2570139710 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256dd9b640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f25700a6950 0x7f25701390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.245+0000 7f256e59c640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25700a57c0 0x7f2570138bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f256ed9d640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 msgr2=0x7f25701ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f256ed9d640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 0x7f25701ce4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f256800efc0 tx=0x7f256800c490 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2568018030 con 0x7f2570139710 2024-08-19T11:21:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: dump: 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25680148f0 con 0x7f2570139710 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f2574b9f640 5 monclient: authenticate success, global_id 124136 2024-08-19T11:21:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f25680133e0 con 0x7f2570139710 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f255effd640 10 monclient: dump: 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f256cd99640 4 set_mon_vals no callback set 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f2574b9f640 10 monclient: _renew_subs 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f2574b9f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.247+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25701256e0 con 0x7f2570139710 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f2574b9f640 10 monclient: _renew_subs 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f2574b9f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2570125dd0 con 0x7f2570139710 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f2574b9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f2574b9f640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 0x7f25701cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2568005d10 con 0x7f2570139710 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.248+0000 7f256e59c640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 0x7f25701cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f2570076c60 con 0x7f25701cea00 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient: get_auth_request con 0x7f25701cea00 auth_method 0 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f255effd640 1 --2- 172.21.15.71:0/3823331783 >> v2:172.21.15.135:6800/726754104 conn(0x7f255003ea80 0x7f2550040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(322..322 src has 1..322) ==== 3898+0+0 (secure 0 0 0) 0x7f2568019070 con 0x7f2570139710 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 10 monclient(hunting): handle_auth_done global_id 104856 payload 824 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256e59c640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25700a1d90 con 0x7f25701cea00 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256dd9b640 1 --2- 172.21.15.71:0/3823331783 >> v2:172.21.15.135:6800/726754104 conn(0x7f255003ea80 0x7f2550040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.249+0000 7f256dd9b640 10 monclient: get_auth_request con 0x7f255003ea80 auth_method 0 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.251+0000 7f256e59c640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 msgr2=0x7f25701cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.251+0000 7f256e59c640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 0x7f25701cb780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2560031000 tx=0x7f25600046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.251+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2560042070 con 0x7f25701cea00 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.251+0000 7f255effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.251+0000 7f255effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:29.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.251+0000 7f255effd640 10 monclient: dump: 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f256dd9b640 1 --2- 172.21.15.71:0/3823331783 >> v2:172.21.15.135:6800/726754104 conn(0x7f255003ea80 0x7f2550040f40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2570124980 tx=0x7f2564009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2560003e70 con 0x7f25701cea00 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 msgr2=0x7f25701cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 0x7f25701cb780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2560031000 tx=0x7f25600046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 msgr2=0x7f25701cb780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.252+0000 7f255effd640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f25701cea00 0x7f25701cb780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f2574b9f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f2574b9f640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 0x7f257002d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f2574b9f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f25700a1f60 con 0x7f257002d1c0 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 0x7f257002d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient: get_auth_request con 0x7f257002d1c0 auth_method 0 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 10 monclient(hunting): handle_auth_done global_id 104865 payload 824 2024-08-19T11:21:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.258+0000 7f256e59c640 1 -- 172.21.15.71:0/3823331783 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f25700a6d30 con 0x7f257002d1c0 2024-08-19T11:21:29.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.260+0000 7f256e59c640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 msgr2=0x7f257002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.260+0000 7f256e59c640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 0x7f257002d5d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2570077a50 tx=0x7f2560008030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.260+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2560037040 con 0x7f257002d1c0 2024-08-19T11:21:29.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.260+0000 7f255effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.260+0000 7f255effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.260+0000 7f255effd640 10 monclient: dump: 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.276 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 <== mon.6 v2:172.21.15.71:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9268 (secure 0 0 0) 0x7f256003d440 con 0x7f257002d1c0 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 msgr2=0x7f257002d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 0x7f257002d5d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2570077a50 tx=0x7f2560008030 comp rx=0 tx=0).stop 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 msgr2=0x7f257002d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f255effd640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f257002d1c0 0x7f257002d5d0 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2570077a50 tx=0x7f2560008030 comp rx=0 tx=0).stop 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 144608, 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:29.300 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 >> v2:172.21.15.135:6800/726754104 conn(0x7f255003ea80 msgr2=0x7f2550040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 --2- 172.21.15.71:0/3823331783 >> v2:172.21.15.135:6800/726754104 conn(0x7f255003ea80 0x7f2550040f40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2570124980 tx=0x7f2564009190 comp rx=0 tx=0).stop 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 10 monclient: shutdown 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 msgr2=0x7f25701ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 --2- 172.21.15.71:0/3823331783 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2570139710 0x7f25701ce4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f256800efc0 tx=0x7f256800c490 comp rx=0 tx=0).stop 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f256ed9d640 1 -- 172.21.15.71:0/3823331783 reap_dead start 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f256ed9d640 1 -- 172.21.15.71:0/3823331783 reap_dead start 2024-08-19T11:21:29.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 shutdown_connections 2024-08-19T11:21:29.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 >> 172.21.15.71:0/3823331783 conn(0x7f25700abf50 msgr2=0x7f25700aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 shutdown_connections 2024-08-19T11:21:29.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.261+0000 7f2574b9f640 1 -- 172.21.15.71:0/3823331783 wait complete. 2024-08-19T11:21:29.303 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:29.303 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-08-19T11:21:29.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.401+0000 7f9082070640 10 monclient: get_monmap_and_config 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.401+0000 7f9082070640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.401+0000 7f9082070640 10 monclient: monmap: 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:29.401908+0000 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:29.401908+0000 2024-08-19T11:21:29.402 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:29.403 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 Processor -- start 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 -- start start 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient: init 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient: _add_conns ranks=[3,8,6,9,2,10,1,7,5,0,4] 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c0a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): picked mon.noname-g con 0x7f907c0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c0a57c0 0x7f907c0a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): picked mon.noname-e con 0x7f907c0a57c0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 0x7f907c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): picked mon.noname-d con 0x7f907c139710 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f907c0a5020 con 0x7f907c0a6950 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f907c0a77b0 con 0x7f907c139710 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f907c0a7d40 con 0x7f907c0a57c0 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9082070640 10 monclient(hunting): authenticate will time out at 1347.443632s 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 0x7f907c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 0x7f907c139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51300/0 (socket says 172.21.15.71:51300) 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 1 -- 172.21.15.71:0/938557550 learned_addr learned my addr 172.21.15.71:0/938557550 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): get_auth_request con 0x7f907c139710 auth_method 0 2024-08-19T11:21:29.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c0a57c0 0x7f907c0a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): get_auth_request con 0x7f907c0a57c0 auth_method 0 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907b7fe640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c0a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907b7fe640 10 monclient(hunting): get_auth_request con 0x7f907c0a6950 auth_method 0 2024-08-19T11:21:29.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f907b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.402+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 10 monclient(hunting): handle_auth_done global_id 104874 payload 274 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 1 -- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c0a57c0 msgr2=0x7f907c0a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c0a57c0 0x7f907c0a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 1 -- 172.21.15.71:0/938557550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 msgr2=0x7f907c0a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c0a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 1 monclient: found mon.noname-d 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907bfff640 1 -- 172.21.15.71:0/938557550 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c0a6380 con 0x7f907c139710 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.403+0000 7f907b7fe640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.405+0000 7f907bfff640 1 -- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 msgr2=0x7f907c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.405+0000 7f907bfff640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 0x7f907c139b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9074009eb0 tx=0x7f907402a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=2c77d8342e47cbf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.405+0000 7f907affd640 1 -- 172.21.15.71:0/938557550 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9074036070 con 0x7f907c139710 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.405+0000 7f907affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: dump: 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.412 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 1 -- 172.21.15.71:0/938557550 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074007a70 con 0x7f907c139710 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 5 monclient: authenticate success, global_id 104874 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 1 -- 172.21.15.71:0/938557550 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9074007ca0 con 0x7f907c139710 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 4 set_mon_vals no callback set 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f907affd640 10 monclient: dump: 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.414 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.415 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 10 monclient: shutdown 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 -- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 msgr2=0x7f907c139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 0x7f907c139b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9074009eb0 tx=0x7f907402a560 comp rx=0 tx=0).stop 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 -- 172.21.15.71:0/938557550 shutdown_connections 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c139710 0x7f907c139b10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c0a57c0 0x7f907c0a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 --2- 172.21.15.71:0/938557550 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c0a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 -- 172.21.15.71:0/938557550 >> 172.21.15.71:0/938557550 conn(0x7f907c0abf50 msgr2=0x7f907c0ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 -- 172.21.15.71:0/938557550 shutdown_connections 2024-08-19T11:21:29.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.406+0000 7f9082070640 1 -- 172.21.15.71:0/938557550 wait complete. 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.407+0000 7f9082070640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.407+0000 7f9082070640 10 monclient: monmap: 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.417 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.418 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.407+0000 7f9082070640 1 Processor -- start 2024-08-19T11:21:29.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.407+0000 7f9082070640 1 -- start start 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.407+0000 7f9082070640 10 monclient: init 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient: _add_conns ranks=[6,3,5,1,7,0,4,2,8] 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 0x7f907c138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): picked mon.noname-d con 0x7f907c0a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): picked mon.noname-g con 0x7f907c0a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f907c139710 0x7f907c1225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): picked mon.noname-h con 0x7f907c139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f907c0a84c0 con 0x7f907c0a6950 2024-08-19T11:21:29.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f907c0a3650 con 0x7f907c139710 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f907c0a8700 con 0x7f907c0a57c0 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9082070640 10 monclient(hunting): authenticate will time out at 1347.449310s 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 0x7f907c138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 0x7f907c138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51316/0 (socket says 172.21.15.71:51316) 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 -- 172.21.15.71:0/3505232709 learned_addr learned my addr 172.21.15.71:0/3505232709 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): get_auth_request con 0x7f907c0a57c0 auth_method 0 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9072ffd640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient(hunting): handle_auth_done global_id 104883 payload 824 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907bfff640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f907c139710 0x7f907c1225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f907c139710 msgr2=0x7f907c1225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f907c139710 0x7f907c1225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 msgr2=0x7f907c138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 monclient: found mon.noname-d 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f907b7fe640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c1cefc0 con 0x7f907c0a57c0 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9072ffd640 10 monclient: get_auth_request con 0x7f907c0a6950 auth_method 0 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.408+0000 7f9072ffd640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f907c0a6950 0x7f907c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.410+0000 7f907b7fe640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 msgr2=0x7f907c138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.410+0000 7f907b7fe640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 0x7f907c138860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f906c00e730 tx=0x7f906c00ebf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.410+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f906c00f040 con 0x7f907c0a57c0 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.410+0000 7f9078ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: dump: 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906c0044a0 con 0x7f907c0a57c0 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 5 monclient: authenticate success, global_id 104883 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 10 monclient: _renew_subs 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c0a22e0 con 0x7f907c0a57c0 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f906c00cd50 con 0x7f907c0a57c0 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 10 monclient: dump: 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.431 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f907a7fc640 4 set_mon_vals no callback set 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 10 monclient: _renew_subs 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c0a1d90 con 0x7f907c0a57c0 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.411+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f906c00c8e0 con 0x7f907c0a57c0 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9082070640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9082070640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 0x7f907c02d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f907c06a590 con 0x7f907c02d1c0 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9078ff9640 1 --2- 172.21.15.71:0/3505232709 >> v2:172.21.15.135:6800/726754104 conn(0x7f905c03ea80 0x7f905c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(322..322 src has 1..322) ==== 3898+0+0 (secure 0 0 0) 0x7f906c051a20 con 0x7f907c0a57c0 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 0x7f907c02d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient: get_auth_request con 0x7f907c02d1c0 auth_method 0 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f907bfff640 1 --2- 172.21.15.71:0/3505232709 >> v2:172.21.15.135:6800/726754104 conn(0x7f905c03ea80 0x7f905c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f907bfff640 10 monclient: get_auth_request con 0x7f905c03ea80 auth_method 0 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 10 monclient(hunting): handle_auth_done global_id 124154 payload 824 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.412+0000 7f9072ffd640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f907c0a6d30 con 0x7f907c02d1c0 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f9072ffd640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 msgr2=0x7f907c02d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f9072ffd640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 0x7f907c02d5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9064009fd0 tx=0x7f9064010c90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f906400f040 con 0x7f907c02d1c0 2024-08-19T11:21:29.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f9078ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f9078ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f9078ff9640 10 monclient: dump: 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.434 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.414+0000 7f907bfff640 1 --2- 172.21.15.71:0/3505232709 >> v2:172.21.15.135:6800/726754104 conn(0x7f905c03ea80 0x7f905c040f40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9074033000 tx=0x7f9074009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f906401c400 con 0x7f907c02d1c0 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 msgr2=0x7f907c02d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 0x7f907c02d5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9064009fd0 tx=0x7f9064010c90 comp rx=0 tx=0).stop 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 msgr2=0x7f907c02d5a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.415+0000 7f9078ff9640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02d1c0 0x7f907c02d5a0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9064009fd0 tx=0x7f9064010c90 comp rx=0 tx=0).stop 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9082070640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9082070640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 0x7f907c02def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9082070640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f907c123f70 con 0x7f907c02dae0 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 0x7f907c02def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient: get_auth_request con 0x7f907c02dae0 auth_method 0 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 10 monclient(hunting): handle_auth_done global_id 124163 payload 824 2024-08-19T11:21:29.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.421+0000 7f9072ffd640 1 -- 172.21.15.71:0/3505232709 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f907c09e100 con 0x7f907c02dae0 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.423+0000 7f9072ffd640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 msgr2=0x7f907c02def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.423+0000 7f9072ffd640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 0x7f907c02def0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9064009fd0 tx=0x7f90640046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.423+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f906401dda0 con 0x7f907c02dae0 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.423+0000 7f9078ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.423+0000 7f9078ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.423+0000 7f9078ff9640 10 monclient: dump: 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 <== mon.8 v2:172.21.15.71:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9267 (secure 0 0 0) 0x7f9064003610 con 0x7f907c02dae0 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 msgr2=0x7f907c02def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 0x7f907c02def0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9064009fd0 tx=0x7f90640046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 msgr2=0x7f907c02def0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9078ff9640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f907c02dae0 0x7f907c02def0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9064009fd0 tx=0x7f90640046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 26296, 2024-08-19T11:21:29.439 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 3, 2024-08-19T11:21:29.440 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.441 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.442 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:29.443 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.444 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.446 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:29.447 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.448 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:29.450 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.451 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:29.454 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.455 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.456 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:29.459 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:29.460 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.461 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.462 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:29.462 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 >> v2:172.21.15.135:6800/726754104 conn(0x7f905c03ea80 msgr2=0x7f905c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 --2- 172.21.15.71:0/3505232709 >> v2:172.21.15.135:6800/726754104 conn(0x7f905c03ea80 0x7f905c040f40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9074033000 tx=0x7f9074009000 comp rx=0 tx=0).stop 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 10 monclient: shutdown 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 msgr2=0x7f907c138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 --2- 172.21.15.71:0/3505232709 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f907c0a57c0 0x7f907c138860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f906c00e730 tx=0x7f906c00ebf0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f907bfff640 1 -- 172.21.15.71:0/3505232709 reap_dead start 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f907bfff640 1 -- 172.21.15.71:0/3505232709 reap_dead start 2024-08-19T11:21:29.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 shutdown_connections 2024-08-19T11:21:29.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 >> 172.21.15.71:0/3505232709 conn(0x7f907c0abf50 msgr2=0x7f907c0aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 shutdown_connections 2024-08-19T11:21:29.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.424+0000 7f9082070640 1 -- 172.21.15.71:0/3505232709 wait complete. 2024-08-19T11:21:29.464 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:29.464 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-08-19T11:21:29.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-08-19T11:21:29.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.562+0000 7f27ec638640 10 monclient: get_monmap_and_config 2024-08-19T11:21:29.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.562+0000 7f27ec638640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.562+0000 7f27ec638640 10 monclient: monmap: 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:29.563402+0000 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:29.563402+0000 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.564 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.565 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.565 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.565 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.565 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:29.565 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:29.565 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.563+0000 7f27ec638640 1 Processor -- start 2024-08-19T11:21:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.563+0000 7f27ec638640 1 -- start start 2024-08-19T11:21:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.563+0000 7f27ec638640 10 monclient: init 2024-08-19T11:21:29.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.563+0000 7f27ec638640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.563+0000 7f27ec638640 10 monclient: _add_conns ranks=[1,2,3,8,4,0,5,7,9,6,10] 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f27e40a6950 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 0x7f27e413eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): picked mon.noname-b con 0x7f27e40a57c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27e40a7440 0x7f27e41410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): picked mon.noname-g con 0x7f27e40a7440 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e40a6380 con 0x7f27e40a6950 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f27e40a5020 con 0x7f27e40a57c0 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f27e40a7d40 con 0x7f27e40a7440 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27ec638640 10 monclient(hunting): authenticate will time out at 1347.605072s 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 0x7f27e413eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 0x7f27e413eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48056/0 (socket says 172.21.15.71:48056) 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 -- 172.21.15.71:0/4205840771 learned_addr learned my addr 172.21.15.71:0/4205840771 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): get_auth_request con 0x7f27e40a57c0 auth_method 0 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27eabd5640 1 --2- 172.21.15.71:0/4205840771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27e40a7440 0x7f27e41410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27eabd5640 10 monclient(hunting): get_auth_request con 0x7f27e40a7440 auth_method 0 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27eabd5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27eabd5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27eabd5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_done global_id 76034 payload 274 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 -- 172.21.15.71:0/4205840771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27e40a7440 msgr2=0x7f27e41410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/4205840771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27e40a7440 0x7f27e41410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 -- 172.21.15.71:0/4205840771 >> v1:172.21.15.135:6789/0 conn(0x7f27e40a6950 legacy=0x7f27e40a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 monclient: found mon.noname-b 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.564+0000 7f27e9bd3640 1 -- 172.21.15.71:0/4205840771 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e40a3650 con 0x7f27e40a57c0 2024-08-19T11:21:29.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e9bd3640 1 -- 172.21.15.71:0/4205840771 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 msgr2=0x7f27e413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/4205840771 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 0x7f27e413eb60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27d80098d0 tx=0x7f27d802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f749b03c30943ab server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 1 -- 172.21.15.71:0/4205840771 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27d8037070 con 0x7f27e40a57c0 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: dump: 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.573 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 1 -- 172.21.15.71:0/4205840771 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d802adc0 con 0x7f27e40a57c0 2024-08-19T11:21:29.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 5 monclient: authenticate success, global_id 76034 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 1 -- 172.21.15.71:0/4205840771 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27d8030c20 con 0x7f27e40a57c0 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 4 set_mon_vals no callback set 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27e93d2640 10 monclient: dump: 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.575 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 10 monclient: shutdown 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 1 -- 172.21.15.71:0/4205840771 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 msgr2=0x7f27e413eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.567+0000 7f27ec638640 1 --2- 172.21.15.71:0/4205840771 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 0x7f27e413eb60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27d80098d0 tx=0x7f27d802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 -- 172.21.15.71:0/4205840771 shutdown_connections 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 --2- 172.21.15.71:0/4205840771 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f27e40a7440 0x7f27e41410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 --2- 172.21.15.71:0/4205840771 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f27e40a57c0 0x7f27e413eb60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 -- 172.21.15.71:0/4205840771 >> 172.21.15.71:0/4205840771 conn(0x7f27e40abf50 msgr2=0x7f27e40ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 -- 172.21.15.71:0/4205840771 shutdown_connections 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 -- 172.21.15.71:0/4205840771 wait complete. 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 10 monclient: monmap: 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:29.577 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.568+0000 7f27ec638640 1 Processor -- start 2024-08-19T11:21:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 -- start start 2024-08-19T11:21:29.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient: init 2024-08-19T11:21:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient: _add_conns ranks=[7,5,1,2,3,8,4,0,6] 2024-08-19T11:21:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 0x7f27e4128a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): picked mon.noname-i con 0x7f27e40a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27e40a6950 0x7f27e41ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): picked mon.noname-h con 0x7f27e40a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e40a7440 0x7f27e41265f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): picked mon.noname-f con 0x7f27e40a7440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27e40a8700 con 0x7f27e40a7440 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f27e40a84c0 con 0x7f27e40a6950 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f27e41415f0 con 0x7f27e40a57c0 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ec638640 10 monclient(hunting): authenticate will time out at 1347.610524s 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e40a7440 0x7f27e41265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 0x7f27e4128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e40a7440 0x7f27e41265f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.71:48664/0 (socket says 172.21.15.71:48664) 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 1 -- 172.21.15.71:0/1204316180 learned_addr learned my addr 172.21.15.71:0/1204316180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): get_auth_request con 0x7f27e40a7440 auth_method 0 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): get_auth_request con 0x7f27e40a57c0 auth_method 0 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27e40a6950 0x7f27e41ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): get_auth_request con 0x7f27e40a6950 auth_method 0 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27ea3d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27eabd5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.569+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 10 monclient(hunting): handle_auth_done global_id 85507 payload 824 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27e40a6950 msgr2=0x7f27e41ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f27e40a6950 0x7f27e41ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e40a7440 msgr2=0x7f27e41265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e40a7440 0x7f27e41265f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 1 monclient: found mon.noname-i 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.135:3303/0 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.570+0000 7f27ea3d4640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e40a94a0 con 0x7f27e40a57c0 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ea3d4640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 msgr2=0x7f27e4128a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ea3d4640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 0x7f27e4128a80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c7b0 tx=0x7f27d400cc70 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27d4016020 con 0x7f27e40a57c0 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: dump: 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.589 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.7 v2:172.21.15.135:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d4012420 con 0x7f27e40a57c0 2024-08-19T11:21:29.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 5 monclient: authenticate success, global_id 85507 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 10 monclient: _renew_subs 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e4129fa0 con 0x7f27e40a57c0 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.7 v2:172.21.15.135:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27d400ce60 con 0x7f27e40a57c0 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e2ffd640 10 monclient: dump: 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.591 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27e8bd1640 4 set_mon_vals no callback set 2024-08-19T11:21:29.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 10 monclient: _renew_subs 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.135:3303/0 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.572+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e4141280 con 0x7f27e40a57c0 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27ec638640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27ec638640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4076c60 con 0x7f27e41cf0b0 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient: get_auth_request con 0x7f27e41cf0b0 auth_method 0 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.7 v2:172.21.15.135:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f27d4019020 con 0x7f27e40a57c0 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e2ffd640 1 --2- 172.21.15.71:0/1204316180 >> v2:172.21.15.135:6800/726754104 conn(0x7f27d003ea80 0x7f27d0040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_done global_id 85510 payload 824 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27e40a6d30 con 0x7f27e41cf0b0 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.7 v2:172.21.15.135:3303/0 5 ==== osd_map(322..322 src has 1..322) ==== 3898+0+0 (secure 0 0 0) 0x7f27d4051b80 con 0x7f27e40a57c0 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 msgr2=0x7f27e4126b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 msgr2=0x7f27e4126b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.573+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a2e70 tx=0x7f27d80046c0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.574+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.574+0000 7f27eabd5640 1 --2- 172.21.15.71:0/1204316180 >> v2:172.21.15.135:6800/726754104 conn(0x7f27d003ea80 0x7f27d0040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.574+0000 7f27eabd5640 10 monclient: get_auth_request con 0x7f27d003ea80 auth_method 0 2024-08-19T11:21:29.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.576+0000 7f27eabd5640 1 --2- 172.21.15.71:0/1204316180 >> v2:172.21.15.135:6800/726754104 conn(0x7f27d003ea80 0x7f27d0040f40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0079e0 tx=0x7f27dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: get_auth_request con 0x7f27e41cf0b0 auth_method 0 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: _init_auth method 2 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: _init_auth already have auth, reseting 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: handle_auth_reply_more payload 9 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.775+0000 7f27e9bd3640 10 monclient: handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:29.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.776+0000 7f27e9bd3640 10 monclient: handle_auth_done global_id 85510 payload 293 2024-08-19T11:21:29.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.778+0000 7f27e9bd3640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 msgr2=0x7f27e4126b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.778+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097c0 tx=0x7f27d802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.778+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27d8037040 con 0x7f27e41cf0b0 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.778+0000 7f27e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.778+0000 7f27e2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.778+0000 7f27e2ffd640 10 monclient: dump: 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.780 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f27d8003bc0 con 0x7f27e41cf0b0 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:29.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 msgr2=0x7f27e4126b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097c0 tx=0x7f27d802e000 comp rx=0 tx=0).stop 2024-08-19T11:21:29.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 msgr2=0x7f27e4126b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.779+0000 7f27e2ffd640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e41cf0b0 0x7f27e4126b30 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097c0 tx=0x7f27d802e000 comp rx=0 tx=0).stop 2024-08-19T11:21:29.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27ec638640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:29.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27ec638640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 0x7f27e41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27ec638640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4127480 con 0x7f27e4127070 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 0x7f27e41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient: get_auth_request con 0x7f27e4127070 auth_method 0 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.785+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.786+0000 7f27e9bd3640 10 monclient(hunting): handle_auth_done global_id 85519 payload 824 2024-08-19T11:21:29.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.786+0000 7f27e9bd3640 1 -- 172.21.15.71:0/1204316180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27e4140d30 con 0x7f27e4127070 2024-08-19T11:21:29.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e9bd3640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 msgr2=0x7f27e41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e9bd3640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 0x7f27e41225a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a2e70 tx=0x7f27d8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.789 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f27d8054070 con 0x7f27e4127070 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 10 monclient: dump: 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.790 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 <== mon.1 v2:172.21.15.135:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9602 (secure 0 0 0) 0x7f27d804d670 con 0x7f27e4127070 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 msgr2=0x7f27e41225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 0x7f27e41225a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a2e70 tx=0x7f27d8008030 comp rx=0 tx=0).stop 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 msgr2=0x7f27e41225a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.788+0000 7f27e2ffd640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27e4127070 0x7f27e41225a0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a2e70 tx=0x7f27d8008030 comp rx=0 tx=0).stop 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 271949, 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": [ 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:29.816 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:29.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 >> v2:172.21.15.135:6800/726754104 conn(0x7f27d003ea80 msgr2=0x7f27d0040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 --2- 172.21.15.71:0/1204316180 >> v2:172.21.15.135:6800/726754104 conn(0x7f27d003ea80 0x7f27d0040f40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0079e0 tx=0x7f27dc008040 comp rx=0 tx=0).stop 2024-08-19T11:21:29.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 10 monclient: shutdown 2024-08-19T11:21:29.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 msgr2=0x7f27e4128a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 0x7f27e4128a80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c7b0 tx=0x7f27d400cc70 comp rx=0 tx=0).stop 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27eabd5640 1 -- 172.21.15.71:0/1204316180 reap_dead start 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 shutdown_connections 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 --2- 172.21.15.71:0/1204316180 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f27e40a57c0 0x7f27e4128a80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 >> 172.21.15.71:0/1204316180 conn(0x7f27e40abf50 msgr2=0x7f27e409f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 shutdown_connections 2024-08-19T11:21:29.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.789+0000 7f27ec638640 1 -- 172.21.15.71:0/1204316180 wait complete. 2024-08-19T11:21:29.818 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:29.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-08-19T11:21:29.819 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-08-19T11:21:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.916+0000 7fa2ad267640 10 monclient: get_monmap_and_config 2024-08-19T11:21:29.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.916+0000 7fa2ad267640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.916+0000 7fa2ad267640 10 monclient: monmap: 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:29.917339+0000 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:29.917339+0000 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.918 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:29.919 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:29.919 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 1 Processor -- start 2024-08-19T11:21:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 1 -- start start 2024-08-19T11:21:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 10 monclient: init 2024-08-19T11:21:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 10 monclient: _add_conns ranks=[10,7,8,4,2,1,0,9,3,6,5] 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2a80a6950 0x7fa2a80a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 10 monclient(hunting): picked mon.noname-f con 0x7fa2a80a6950 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a57c0 0x7fa2a80a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 10 monclient(hunting): picked mon.noname-i con 0x7fa2a80a57c0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.917+0000 7fa2ad267640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 0x7fa2a8139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 10 monclient(hunting): picked mon.noname-e con 0x7fa2a8139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a80a5020 con 0x7fa2a80a6950 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa2a80a77b0 con 0x7fa2a80a57c0 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fa2a80a7d40 con 0x7fa2a8139710 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2ad267640 10 monclient(hunting): authenticate will time out at 1347.959044s 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 0x7fa2a8139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 0x7fa2a8139b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55542/0 (socket says 172.21.15.71:55542) 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 -- 172.21.15.71:0/1913970911 learned_addr learned my addr 172.21.15.71:0/1913970911 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): get_auth_request con 0x7fa2a8139710 auth_method 0 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 1 --2- 172.21.15.71:0/1913970911 >> v2:172.21.15.135:3300/0 conn(0x7fa2a80a6950 0x7fa2a80a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 1 --2- 172.21.15.71:0/1913970911 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a57c0 0x7fa2a80a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): get_auth_request con 0x7fa2a80a6950 auth_method 0 2024-08-19T11:21:29.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): get_auth_request con 0x7fa2a80a57c0 auth_method 0 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa29ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_done global_id 124172 payload 274 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 -- 172.21.15.71:0/1913970911 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a57c0 msgr2=0x7fa2a80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/1913970911 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a57c0 0x7fa2a80a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 -- 172.21.15.71:0/1913970911 >> v2:172.21.15.135:3300/0 conn(0x7fa2a80a6950 msgr2=0x7fa2a80a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/1913970911 >> v2:172.21.15.135:3300/0 conn(0x7fa2a80a6950 0x7fa2a80a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 monclient: found mon.noname-e 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:29.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.918+0000 7fa2a77fe640 1 -- 172.21.15.71:0/1913970911 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a80a6380 con 0x7fa2a8139710 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a77fe640 1 -- 172.21.15.71:0/1913970911 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 msgr2=0x7fa2a8139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/1913970911 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 0x7fa2a8139b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009e80 tx=0x7fa2a002a580 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c3dac7631148a501 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 1 -- 172.21.15.71:0/1913970911 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2a0036070 con 0x7fa2a8139710 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: dump: 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.932 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 5 monclient: authenticate success, global_id 124172 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 1 -- 172.21.15.71:0/1913970911 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0007a70 con 0x7fa2a8139710 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 4 set_mon_vals no callback set 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 1 -- 172.21.15.71:0/1913970911 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2a0007c60 con 0x7fa2a8139710 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2a67fc640 10 monclient: dump: 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.934 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.935 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 10 monclient: shutdown 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 1 -- 172.21.15.71:0/1913970911 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 msgr2=0x7fa2a8139b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.921+0000 7fa2ad267640 1 --2- 172.21.15.71:0/1913970911 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 0x7fa2a8139b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009e80 tx=0x7fa2a002a580 comp rx=0 tx=0).stop 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 -- 172.21.15.71:0/1913970911 shutdown_connections 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 --2- 172.21.15.71:0/1913970911 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fa2a8139710 0x7fa2a8139b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 --2- 172.21.15.71:0/1913970911 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a57c0 0x7fa2a80a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 --2- 172.21.15.71:0/1913970911 >> v2:172.21.15.135:3300/0 conn(0x7fa2a80a6950 0x7fa2a80a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 -- 172.21.15.71:0/1913970911 >> 172.21.15.71:0/1913970911 conn(0x7fa2a80abf50 msgr2=0x7fa2a80ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 -- 172.21.15.71:0/1913970911 shutdown_connections 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 -- 172.21.15.71:0/1913970911 wait complete. 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 10 monclient: build_initial_monmap 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 10 monclient: monmap: 2024-08-19T11:21:29.936 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:29.937 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 Processor -- start 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 1 -- start start 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.922+0000 7fa2ad267640 10 monclient: init 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient: _add_conns ranks=[6,7,5,3,0,8,1,2,4] 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 0x7fa2a81ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): picked mon.noname-d con 0x7fa2a80a57c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a6950 0x7fa2a8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): picked mon.noname-i con 0x7fa2a80a6950 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa2a8139710 0x7fa2a81229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): picked mon.noname-h con 0x7fa2a8139710 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fa2a80a84c0 con 0x7fa2a8139710 2024-08-19T11:21:29.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fa2a80a3650 con 0x7fa2a80a57c0 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fa2a80a8700 con 0x7fa2a80a6950 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2ad267640 10 monclient(hunting): authenticate will time out at 1347.964423s 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 0x7fa2a81ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 0x7fa2a81ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51324/0 (socket says 172.21.15.71:51324) 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 -- 172.21.15.71:0/4037877426 learned_addr learned my addr 172.21.15.71:0/4037877426 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): get_auth_request con 0x7fa2a80a57c0 auth_method 0 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a6950 0x7fa2a8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): get_auth_request con 0x7fa2a80a6950 auth_method 0 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa2a8139710 0x7fa2a81229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): get_auth_request con 0x7fa2a8139710 auth_method 0 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa29ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient(hunting): handle_auth_done global_id 104892 payload 824 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a6950 msgr2=0x7fa2a8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fa2a80a6950 0x7fa2a8138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa2a8139710 msgr2=0x7fa2a81229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fa2a8139710 0x7fa2a81229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 monclient: found mon.noname-d 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.923+0000 7fa2a6ffd640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a81243a0 con 0x7fa2a80a57c0 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2a6ffd640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 msgr2=0x7fa2a81ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2a6ffd640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 0x7fa2a81ce5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa29800e9b0 tx=0x7fa29800ee70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa298017070 con 0x7fa2a80a57c0 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: dump: 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.942 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29800cbb0 con 0x7fa2a80a57c0 2024-08-19T11:21:29.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 5 monclient: authenticate success, global_id 104892 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa29800cd60 con 0x7fa2a80a57c0 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 10 monclient: _renew_subs 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a81ceaf0 con 0x7fa2a80a57c0 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2a5ffb640 4 set_mon_vals no callback set 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa29f7fe640 10 monclient: dump: 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.944 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 10 monclient: _renew_subs 2024-08-19T11:21:29.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.926+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a8125e60 con 0x7fa2a80a57c0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fa29801a070 con 0x7fa2a80a57c0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa29f7fe640 1 --2- 172.21.15.71:0/4037877426 >> v2:172.21.15.135:6800/726754104 conn(0x7fa28803ea80 0x7fa288040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2ad267640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2ad267640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 0x7fa2a81236f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a8076c60 con 0x7fa2a8139280 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(322..322 src has 1..322) ==== 3898+0+0 (secure 0 0 0) 0x7fa29800f040 con 0x7fa2a80a57c0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa29ffff640 1 --2- 172.21.15.71:0/4037877426 >> v2:172.21.15.135:6800/726754104 conn(0x7fa28803ea80 0x7fa288040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 0x7fa2a81236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa29ffff640 10 monclient: get_auth_request con 0x7fa28803ea80 auth_method 0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2a77fe640 10 monclient: get_auth_request con 0x7fa2a8139280 auth_method 0 2024-08-19T11:21:29.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.927+0000 7fa2a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.928+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.928+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.928+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.928+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_done global_id 46308 payload 824 2024-08-19T11:21:29.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.928+0000 7fa2a77fe640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2a80a1eb0 con 0x7fa2a8139280 2024-08-19T11:21:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.932+0000 7fa2a77fe640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 msgr2=0x7fa2a81236f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.932+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 0x7fa2a81236f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a0004a40 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.933+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2a0041030 con 0x7fa2a8139280 2024-08-19T11:21:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.933+0000 7fa29f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.933+0000 7fa29f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:21:29.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.933+0000 7fa29f7fe640 10 monclient: dump: 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.950 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.933+0000 7fa29ffff640 1 --2- 172.21.15.71:0/4037877426 >> v2:172.21.15.135:6800/726754104 conn(0x7fa28803ea80 0x7fa288040f40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8124150 tx=0x7fa290009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa2a00044d0 con 0x7fa2a8139280 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 msgr2=0x7fa2a81236f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 0x7fa2a81236f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a0004a40 comp rx=0 tx=0).stop 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 msgr2=0x7fa2a81236f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.934+0000 7fa29f7fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8139280 0x7fa2a81236f0 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0033000 tx=0x7fa2a0004a40 comp rx=0 tx=0).stop 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.946+0000 7fa2ad267640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:29.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.946+0000 7fa2ad267640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 0x7fa2a802d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.946+0000 7fa2ad267640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.946+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a81265b0 con 0x7fa2a8123c30 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 0x7fa2a802d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient: get_auth_request con 0x7fa2a8123c30 auth_method 0 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 10 monclient(hunting): handle_auth_done global_id 46317 payload 824 2024-08-19T11:21:29.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.947+0000 7fa2a77fe640 1 -- 172.21.15.71:0/4037877426 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2a80a6d30 con 0x7fa2a8123c30 2024-08-19T11:21:29.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.949+0000 7fa2a77fe640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 msgr2=0x7fa2a802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:29.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.949+0000 7fa2a77fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 0x7fa2a802d1c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002a5c0 tx=0x7fa2a002f000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.949+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fa2a0041040 con 0x7fa2a8123c30 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.949+0000 7fa29f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 10 monclient: dump: 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:29.954 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 <== mon.3 v2:172.21.15.135:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7fa2a003d460 con 0x7fa2a8123c30 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 msgr2=0x7fa2a802d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 0x7fa2a802d1c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002a5c0 tx=0x7fa2a002f000 comp rx=0 tx=0).stop 2024-08-19T11:21:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 msgr2=0x7fa2a802d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa29f7fe640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa2a8123c30 0x7fa2a802d1c0 secure :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002a5c0 tx=0x7fa2a002f000 comp rx=0 tx=0).stop 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 458972, 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:29.956 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.957 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:29.958 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.959 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:29.960 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:29.961 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.965 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.968 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:29.970 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.971 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:29.972 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.976 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:29.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:29.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:29.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:29.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 >> v2:172.21.15.135:6800/726754104 conn(0x7fa28803ea80 msgr2=0x7fa288040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2ad267640 1 --2- 172.21.15.71:0/4037877426 >> v2:172.21.15.135:6800/726754104 conn(0x7fa28803ea80 0x7fa288040f40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8124150 tx=0x7fa290009190 comp rx=0 tx=0).stop 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2ad267640 10 monclient: shutdown 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2ad267640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 msgr2=0x7fa2a81ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2a77fe640 1 -- 172.21.15.71:0/4037877426 reap_dead start 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.950+0000 7fa2ad267640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 0x7fa2a81ce5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa29800e9b0 tx=0x7fa29800ee70 comp rx=0 tx=0).stop 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.951+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 shutdown_connections 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.951+0000 7fa2ad267640 1 --2- 172.21.15.71:0/4037877426 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fa2a80a57c0 0x7fa2a81ce5b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.951+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 >> 172.21.15.71:0/4037877426 conn(0x7fa2a80abf50 msgr2=0x7fa2a80aa720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.951+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 shutdown_connections 2024-08-19T11:21:29.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:29.951+0000 7fa2ad267640 1 -- 172.21.15.71:0/4037877426 wait complete. 2024-08-19T11:21:29.983 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:29.983 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-08-19T11:21:29.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-08-19T11:21:30.039 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:30.039 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: starting. 2024-08-19T11:21:30.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: creating pool ceph_test_rados_delete_pools_parallel.smithi135-29280 2024-08-19T11:21:30.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: created object 0... 2024-08-19T11:21:30.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: created object 25... 2024-08-19T11:21:30.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: created object 49... 2024-08-19T11:21:30.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: finishing. 2024-08-19T11:21:30.040 INFO:teuthology.orchestra.run.smithi135.stdout:process_3_[29315]: shutting down. 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29317]: starting. 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29317]: listing objects. 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29317]: listed object 0... 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29317]: listed object 25... 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29317]: saw 50 objects 2024-08-19T11:21:30.079 INFO:teuthology.orchestra.run.smithi135.stdout:process_5_[29317]: shutting down. 2024-08-19T11:21:30.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.085+0000 7f295ad33640 10 monclient: get_monmap_and_config 2024-08-19T11:21:30.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.085+0000 7f295ad33640 10 monclient: build_initial_monmap 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.086+0000 7f295ad33640 10 monclient: monmap: 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:30.086637+0000 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:30.086637+0000 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:30.088 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.086+0000 7f295ad33640 1 Processor -- start 2024-08-19T11:21:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.086+0000 7f295ad33640 1 -- start start 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.086+0000 7f295ad33640 10 monclient: init 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient: _add_conns ranks=[5,9,3,1,2,10,7,8,6,0,4] 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a6950 0x7f29540a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): picked mon.noname-h con 0x7f29540a6950 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f29540a57c0 0x7f29540a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): picked mon.noname-a con 0x7f29540a57c0 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2954139710 0x7f2954139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): picked mon.noname-g con 0x7f2954139710 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f29540a5020 con 0x7f29540a57c0 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29540a77b0 con 0x7f2954139710 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f29540a7d40 con 0x7f29540a6950 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f295ad33640 10 monclient(hunting): authenticate will time out at 1348.128376s 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f29540a57c0 0x7f29540a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f29540a57c0 0x7f29540a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46238/0 (socket says 172.21.15.71:46238) 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 -- 172.21.15.71:0/220326363 learned_addr learned my addr 172.21.15.71:0/220326363 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): get_auth_request con 0x7f29540a57c0 auth_method 0 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2958acf640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a6950 0x7f29540a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f29592d0640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2954139710 0x7f2954139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2958acf640 10 monclient(hunting): get_auth_request con 0x7f29540a6950 auth_method 0 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2958acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2958acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2958acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f29592d0640 10 monclient(hunting): get_auth_request con 0x7f2954139710 auth_method 0 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f29592d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f29592d0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f29592d0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient(hunting): handle_auth_done global_id 76005 payload 274 2024-08-19T11:21:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 -- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a6950 msgr2=0x7f29540a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a6950 0x7f29540a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 -- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2954139710 msgr2=0x7f2954139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2954139710 0x7f2954139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2953fff640 1 -- 172.21.15.71:0/220326363 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29540a6380 con 0x7f29540a57c0 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f2958acf640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a6950 0x7f29540a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.087+0000 7f29592d0640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2954139710 0x7f2954139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:30.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f2953fff640 1 -- 172.21.15.71:0/220326363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29540a57c0 msgr2=0x7f29540a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f2953fff640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29540a57c0 0x7f29540a7270 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2944009e80 tx=0x7f294402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796b2b09f00253ae server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 1 -- 172.21.15.71:0/220326363 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2944036070 con 0x7f29540a57c0 2024-08-19T11:21:30.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: dump: 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.102 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.103 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 1 -- 172.21.15.71:0/220326363 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2944007a70 con 0x7f29540a57c0 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f295ad33640 5 monclient: authenticate success, global_id 76005 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f295ad33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f295ad33640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 1 -- 172.21.15.71:0/220326363 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2944007c20 con 0x7f29540a57c0 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f295ad33640 4 set_mon_vals no callback set 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.090+0000 7f29537fe640 10 monclient: dump: 2024-08-19T11:21:30.104 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.105 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 10 monclient: shutdown 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 -- 172.21.15.71:0/220326363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29540a57c0 msgr2=0x7f29540a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29540a57c0 0x7f29540a7270 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2944009e80 tx=0x7f294402a580 comp rx=0 tx=0).stop 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 -- 172.21.15.71:0/220326363 shutdown_connections 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2954139710 0x7f2954139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29540a57c0 0x7f29540a7270 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 --2- 172.21.15.71:0/220326363 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a6950 0x7f29540a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 -- 172.21.15.71:0/220326363 >> 172.21.15.71:0/220326363 conn(0x7f29540abf50 msgr2=0x7f29540ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 -- 172.21.15.71:0/220326363 shutdown_connections 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 1 -- 172.21.15.71:0/220326363 wait complete. 2024-08-19T11:21:30.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 10 monclient: build_initial_monmap 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.091+0000 7f295ad33640 10 monclient: monmap: 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:30.107 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 Processor -- start 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 -- start start 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient: init 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient: _add_conns ranks=[5,3,8,0,2,1,6,7,4] 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a57c0 0x7f29541ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): picked mon.noname-h con 0x7f29540a57c0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29540a6950 0x7f2954138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): picked mon.noname-g con 0x7f29540a6950 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 0x7f29541390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): picked mon.noname-e con 0x7f2954139710 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29540a84c0 con 0x7f29540a6950 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f29540a3650 con 0x7f29540a57c0 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f29540a8700 con 0x7f2954139710 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.092+0000 7f295ad33640 10 monclient(hunting): authenticate will time out at 1348.133953s 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 0x7f29541390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 0x7f29541390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55556/0 (socket says 172.21.15.71:55556) 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29540a6950 0x7f2954138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 learned_addr learned my addr 172.21.15.71:0/2129153173 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): get_auth_request con 0x7f2954139710 auth_method 0 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a57c0 0x7f29541ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): get_auth_request con 0x7f29540a6950 auth_method 0 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): get_auth_request con 0x7f29540a57c0 auth_method 0 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient(hunting): handle_auth_done global_id 124181 payload 824 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a57c0 msgr2=0x7f29541ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f29540a57c0 0x7f29541ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29540a6950 msgr2=0x7f2954138bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29540a6950 0x7f2954138bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient: _finish_hunting 0 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 monclient: found mon.noname-e 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.093+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29541254e0 con 0x7f2954139710 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 msgr2=0x7f29541390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29592d0640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 0x7f29541390f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d5f0 tx=0x7f293c00dab0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f293c0044a0 con 0x7f2954139710 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: dump: 2024-08-19T11:21:30.112 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.113 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f293c012800 con 0x7f2954139710 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 5 monclient: authenticate success, global_id 124181 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 10 monclient: _renew_subs 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295413a220 con 0x7f2954139710 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f293c012e20 con 0x7f2954139710 2024-08-19T11:21:30.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f29517fa640 10 monclient: dump: 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.115 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 10 monclient: _renew_subs 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f2952ffd640 4 set_mon_vals no callback set 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.095+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2954126570 con 0x7f2954139710 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f295ad33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f295ad33640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 0x7f295402d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f295406a590 con 0x7f2954123050 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f29592d0640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 0x7f29541390f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d5f0 tx=0x7f293c00dab0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f293c00f040 osd_map(323..323 src has 1..323) 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f293c0129b0 con 0x7f2954139710 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 0x7f295402d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient: get_auth_request con 0x7f2954123050 auth_method 0 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.096+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.097+0000 7f29517fa640 1 --2- 172.21.15.71:0/2129153173 >> v2:172.21.15.135:6800/726754104 conn(0x7f293403ea80 0x7f2934040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.097+0000 7f2958acf640 10 monclient(hunting): handle_auth_done global_id 46634 payload 824 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.097+0000 7f2958acf640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29541ce810 con 0x7f2954123050 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.097+0000 7f2953fff640 1 --2- 172.21.15.71:0/2129153173 >> v2:172.21.15.135:6800/726754104 conn(0x7f293403ea80 0x7f2934040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.097+0000 7f2953fff640 10 monclient: get_auth_request con 0x7f293403ea80 auth_method 0 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f2958acf640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 msgr2=0x7f295402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f2958acf640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 0x7f295402d1c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c011c90 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f294c019020 con 0x7f2954123050 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:21:30.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 10 monclient: dump: 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.119 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f2953fff640 1 --2- 172.21.15.71:0/2129153173 >> v2:172.21.15.135:6800/726754104 conn(0x7f293403ea80 0x7f2934040f40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2944009e80 tx=0x7f2944009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f294c004450 con 0x7f2954123050 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 msgr2=0x7f295402d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 0x7f295402d1c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c011c90 comp rx=0 tx=0).stop 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 msgr2=0x7f295402d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:30.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.099+0000 7f29517fa640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123050 0x7f295402d1c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.105+0000 7f295ad33640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.105+0000 7f295ad33640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 0x7f295402d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.105+0000 7f295ad33640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.105+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f2954126010 con 0x7f2954123430 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 0x7f295402d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient: get_auth_request con 0x7f2954123430 auth_method 0 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.122 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 10 monclient(hunting): handle_auth_done global_id 46643 payload 824 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.106+0000 7f2958acf640 1 -- 172.21.15.71:0/2129153173 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f29541261d0 con 0x7f2954123430 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.108+0000 7f2958acf640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 msgr2=0x7f295402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.108+0000 7f2958acf640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 0x7f295402d700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c0046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.108+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f294c019040 con 0x7f2954123430 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.108+0000 7f29517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.108+0000 7f29517fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.108+0000 7f29517fa640 10 monclient: dump: 2024-08-19T11:21:30.123 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.124 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.5 v2:172.21.15.135:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f294c003820 con 0x7f2954123430 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 msgr2=0x7f295402d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 0x7f295402d700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 msgr2=0x7f295402d700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f2954123430 0x7f295402d700 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f294c006fd0 tx=0x7f294c0046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.125 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 459131, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:30.141 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 3 2024-08-19T11:21:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:30.149 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 >> v2:172.21.15.135:6800/726754104 conn(0x7f293403ea80 msgr2=0x7f2934040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 --2- 172.21.15.71:0/2129153173 >> v2:172.21.15.135:6800/726754104 conn(0x7f293403ea80 0x7f2934040f40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2944009e80 tx=0x7f2944009000 comp rx=0 tx=0).stop 2024-08-19T11:21:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 10 monclient: shutdown 2024-08-19T11:21:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 msgr2=0x7f29541390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 --2- 172.21.15.71:0/2129153173 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f2954139710 0x7f29541390f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d5f0 tx=0x7f293c00dab0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 reap_dead start 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29517fa640 1 -- 172.21.15.71:0/2129153173 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(323..323 src has 1..323) ==== 3898+0+0 (unknown 0 0 0) 0x7f293c00f040 con 0x7f2954139710 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f29592d0640 1 -- 172.21.15.71:0/2129153173 reap_dead start 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 shutdown_connections 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 >> 172.21.15.71:0/2129153173 conn(0x7f29540abf50 msgr2=0x7f29540aa940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 shutdown_connections 2024-08-19T11:21:30.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.109+0000 7f295ad33640 1 -- 172.21.15.71:0/2129153173 wait complete. 2024-08-19T11:21:30.151 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:30.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-08-19T11:21:30.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-08-19T11:21:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.250+0000 7f3d0d5ba640 10 monclient: get_monmap_and_config 2024-08-19T11:21:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.250+0000 7f3d0d5ba640 10 monclient: build_initial_monmap 2024-08-19T11:21:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.250+0000 7f3d0d5ba640 10 monclient: monmap: 2024-08-19T11:21:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.251 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:30.251111+0000 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:30.251111+0000 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:30.252 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:30.253 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 Processor -- start 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 -- start start 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient: init 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient: _add_conns ranks=[7,8,10,9,2,5,0,6,1,4,3] 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d0809b980 0x7f3d0809df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): picked mon.noname-i con 0x7f3d0809b980 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 0x7f3d080a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): picked mon.noname-e con 0x7f3d0809bd60 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3d080a42c0 0x7f3d080a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): picked mon.noname-f con 0x7f3d080a42c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:30.257 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3d080a5bd0 con 0x7f3d080a42c0 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3d0809c980 con 0x7f3d0809b980 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f3d0809d280 con 0x7f3d0809bd60 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d0d5ba640 10 monclient(hunting): authenticate will time out at 1348.292545s 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 0x7f3d080a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 0x7f3d080a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55568/0 (socket says 172.21.15.71:55568) 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 -- 172.21.15.71:0/4129713753 learned_addr learned my addr 172.21.15.71:0/4129713753 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): get_auth_request con 0x7f3d0809bd60 auth_method 0 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 1 --2- 172.21.15.71:0/4129713753 >> v2:172.21.15.135:3300/0 conn(0x7f3d080a42c0 0x7f3d080a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d0809b980 0x7f3d0809df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): get_auth_request con 0x7f3d080a42c0 auth_method 0 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): get_auth_request con 0x7f3d0809b980 auth_method 0 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 10 monclient(hunting): handle_auth_done global_id 124190 payload 274 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 -- 172.21.15.71:0/4129713753 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d0809b980 msgr2=0x7f3d0809df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d0809b980 0x7f3d0809df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 -- 172.21.15.71:0/4129713753 >> v2:172.21.15.135:3300/0 conn(0x7f3d080a42c0 msgr2=0x7f3d080a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.251+0000 7f3d067fc640 1 --2- 172.21.15.71:0/4129713753 >> v2:172.21.15.135:3300/0 conn(0x7f3d080a42c0 0x7f3d080a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d067fc640 10 monclient: _finish_hunting 0 2024-08-19T11:21:30.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d067fc640 1 monclient: found mon.noname-e 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d067fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d067fc640 1 -- 172.21.15.71:0/4129713753 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0809d560 con 0x7f3d0809bd60 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d06ffd640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d0809b980 0x7f3d0809df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.252+0000 7f3d077fe640 1 --2- 172.21.15.71:0/4129713753 >> v2:172.21.15.135:3300/0 conn(0x7f3d080a42c0 0x7f3d080a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d067fc640 1 -- 172.21.15.71:0/4129713753 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 msgr2=0x7f3d080a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d067fc640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 0x7f3d080a3d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0098a0 tx=0x7f3cfc02a0d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=ee143d6bad4b89eb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 1 -- 172.21.15.71:0/4129713753 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3cfc037070 con 0x7f3d0809bd60 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 10 monclient: dump: 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.261 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.262 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 10 monclient: _finish_auth 0 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 10 monclient: _check_auth_tickets 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.254+0000 7f3d05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d05ffb640 1 -- 172.21.15.71:0/4129713753 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc02adf0 con 0x7f3d0809bd60 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d05ffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d05ffb640 1 -- 172.21.15.71:0/4129713753 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3cfc030c20 con 0x7f3d0809bd60 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 5 monclient: authenticate success, global_id 124190 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 4 set_mon_vals no callback set 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d05ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d05ffb640 10 monclient: dump: 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 10 monclient: shutdown 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/4129713753 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 msgr2=0x7f3d080a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 0x7f3d080a3d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0098a0 tx=0x7f3cfc02a0d0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/4129713753 shutdown_connections 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/4129713753 >> v2:172.21.15.135:3300/0 conn(0x7f3d080a42c0 0x7f3d080a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f3d0809bd60 0x7f3d080a3d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/4129713753 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d0809b980 0x7f3d0809df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/4129713753 >> 172.21.15.71:0/4129713753 conn(0x7f3d080a4e70 msgr2=0x7f3d080a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/4129713753 shutdown_connections 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.255+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/4129713753 wait complete. 2024-08-19T11:21:30.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.256+0000 7f3d0d5ba640 10 monclient: build_initial_monmap 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.256+0000 7f3d0d5ba640 10 monclient: monmap: 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:30.267 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:30.267 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.256+0000 7f3d0d5ba640 1 Processor -- start 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.256+0000 7f3d0d5ba640 1 -- start start 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.256+0000 7f3d0d5ba640 10 monclient: init 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient: _add_conns ranks=[6,4,0,7,2,5,1,8,3] 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 0x7f3d0809a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): picked mon.noname-d con 0x7f3d0809b980 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3d0809bd60 0x7f3d0809a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): picked mon.noname-c con 0x7f3d0809bd60 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d080a42c0 0x7f3d08095060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): picked mon.noname-a con 0x7f3d080a42c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08140530 con 0x7f3d080a42c0 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3d0809e480 con 0x7f3d0809bd60 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3d081406b0 con 0x7f3d0809b980 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d0d5ba640 10 monclient(hunting): authenticate will time out at 1348.298196s 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3d0809bd60 0x7f3d0809a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 0x7f3d0809a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3d0809bd60 0x7f3d0809a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38728/0 (socket says 172.21.15.71:38728) 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 1 -- 172.21.15.71:0/1378703616 learned_addr learned my addr 172.21.15.71:0/1378703616 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): get_auth_request con 0x7f3d0809bd60 auth_method 0 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): get_auth_request con 0x7f3d0809b980 auth_method 0 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d080a42c0 0x7f3d08095060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): get_auth_request con 0x7f3d080a42c0 auth_method 0 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient(hunting): handle_auth_done global_id 104901 payload 824 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3d0809bd60 msgr2=0x7f3d0809a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3d0809bd60 0x7f3d0809a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d080a42c0 msgr2=0x7f3d08095060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d080a42c0 0x7f3d08095060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 monclient: found mon.noname-d 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d06ffd640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d08140360 con 0x7f3d0809b980 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d067fc640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3d0809bd60 0x7f3d0809a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.257+0000 7f3d077fe640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d080a42c0 0x7f3d08095060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.259+0000 7f3d06ffd640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 msgr2=0x7f3d0809a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.259+0000 7f3d06ffd640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 0x7f3d0809a2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800e900 tx=0x7f3cf800ed00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.259+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3cf8017070 con 0x7f3d0809b980 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.259+0000 7f3cef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.259+0000 7f3d06ffd640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 0x7f3d0809a2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800e900 tx=0x7f3cf800ed00 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f3cf8013a90 mon_map magic: 0 2024-08-19T11:21:30.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 10 monclient: dump: 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.279 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf8013470 con 0x7f3d0809b980 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 5 monclient: authenticate success, global_id 104901 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 10 monclient: _renew_subs 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d080a5400 con 0x7f3d0809b980 2024-08-19T11:21:30.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3cef7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d057fa640 4 set_mon_vals no callback set 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 10 monclient: _renew_subs 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d08096a60 con 0x7f3d0809b980 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 0x7f3d08095980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.260+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3d08076c60 con 0x7f3d080955a0 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3cf8013a90 con 0x7f3d0809b980 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3cef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3cef7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3cef7fe640 10 monclient: dump: 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.281 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.282 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3cf801a070 con 0x7f3d0809b980 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 0x7f3d08095980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient: get_auth_request con 0x7f3d080955a0 auth_method 0 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3cef7fe640 1 --2- 172.21.15.71:0/1378703616 >> v2:172.21.15.135:6800/726754104 conn(0x7f3cf403ead0 0x7f3cf4040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d077fe640 1 --2- 172.21.15.71:0/1378703616 >> v2:172.21.15.135:6800/726754104 conn(0x7f3cf403ead0 0x7f3cf4040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d077fe640 10 monclient: get_auth_request con 0x7f3cf403ead0 auth_method 0 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 10 monclient(hunting): handle_auth_done global_id 85543 payload 824 2024-08-19T11:21:30.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.261+0000 7f3d067fc640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d08095ec0 con 0x7f3d080955a0 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3d067fc640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 msgr2=0x7f3d08095980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3d067fc640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 0x7f3d08095980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0097c0 tx=0x7f3cfc0046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3d077fe640 1 --2- 172.21.15.71:0/1378703616 >> v2:172.21.15.135:6800/726754104 conn(0x7f3cf403ead0 0x7f3cf4040f90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d08096700 tx=0x7f3d0000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3cfc042070 con 0x7f3d080955a0 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3cef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3cef7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.263+0000 7f3cef7fe640 10 monclient: dump: 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.284 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3cfc003cc0 con 0x7f3d080955a0 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 msgr2=0x7f3d08095980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 0x7f3d08095980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0097c0 tx=0x7f3cfc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 msgr2=0x7f3d08095980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.264+0000 7f3cef7fe640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d080955a0 0x7f3d08095980 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0097c0 tx=0x7f3cfc0046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d0d5ba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 0x7f3d080730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d0d5ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3d0809df40 con 0x7f3d08072cf0 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 0x7f3d080730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient: get_auth_request con 0x7f3d08072cf0 auth_method 0 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 10 monclient(hunting): handle_auth_done global_id 85552 payload 824 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.270+0000 7f3d067fc640 1 -- 172.21.15.71:0/1378703616 --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d08098a00 con 0x7f3d08072cf0 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d067fc640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 msgr2=0x7f3d080730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d067fc640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 0x7f3d080730d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc02a110 tx=0x7f3cfc008030 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.7 v2:172.21.15.135:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3cfc037040 con 0x7f3d08072cf0 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 10 monclient: dump: 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.287 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.288 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.7 v2:172.21.15.135:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9435 (secure 0 0 0) 0x7f3cfc030cb0 con 0x7f3d08072cf0 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 msgr2=0x7f3d080730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 0x7f3d080730d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc02a110 tx=0x7f3cfc008030 comp rx=0 tx=0).stop 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 msgr2=0x7f3d080730d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3d08072cf0 0x7f3d080730d0 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc02a110 tx=0x7f3cfc008030 comp rx=0 tx=0).stop 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "peon", 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "election_epoch": 212, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 272434, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum": [ 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 0, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 1, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 2, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 3, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 4, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 5, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 6, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 7, 2024-08-19T11:21:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: 8 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_age": 4, 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "required_con": "2450521708007866372", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "required_mon": [ 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_con": "4540701547738038271", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "quorum_mon": [ 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "outside_quorum": [], 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "extra_probe_peers": [], 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "sync_provider": [], 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": { 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 1, 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "e00860b6-633c-4a91-b05e-d46659da1ed6", 2024-08-19T11:21:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-08-19T11:09:34.396622Z", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release": 19, 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "min_mon_release_name": "squid", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "election_strategy": 1, 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "disallowed_leaders: ": "", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false, 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "tiebreaker_mon": "", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_ranks: ": "", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "features": { 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "persistent": [ 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "kraken", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "luminous", 2024-08-19T11:21:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mimic", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap-prune", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "nautilus", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "octopus", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "pacific", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "elector-pinging", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "quincy", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "reef", 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "squid" 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "optional": [] 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mons": [ 2024-08-19T11:21:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 0, 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "a", 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3300", 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789", 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6789/0", 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6789/0", 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 1, 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "f", 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3300", 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789", 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6789/0", 2024-08-19T11:21:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6789/0", 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 2, 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "b", 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3301", 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790", 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6790/0", 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6790/0", 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 3, 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "g", 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3301", 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790", 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6790/0", 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6790/0", 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 4, 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "c", 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3302", 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791", 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6791/0", 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6791/0", 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 5, 2024-08-19T11:21:30.304 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "h", 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3302", 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791", 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6791/0", 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6791/0", 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 6, 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "d", 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3303", 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792", 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6792/0", 2024-08-19T11:21:30.307 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6792/0", 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 7, 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "i", 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:3303", 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792", 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.135:6792/0", 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.135:6792/0", 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "rank": 8, 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "e", 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:3304", 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793", 2024-08-19T11:21:30.310 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 0 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6793/0", 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6793/0", 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "priority": 0, 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "{}" 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "feature_map": { 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": [ 2024-08-19T11:21:30.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": [ 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 1 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client": [ 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-08-19T11:21:30.312 INFO:teuthology.orchestra.run.smithi071.stdout: "features": "0x3f03cffffffdffff", 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout: "release": "squid", 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 2 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": false 2024-08-19T11:21:30.313 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 >> v2:172.21.15.135:6800/726754104 conn(0x7f3cf403ead0 msgr2=0x7f3cf4040f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/1378703616 >> v2:172.21.15.135:6800/726754104 conn(0x7f3cf403ead0 0x7f3cf4040f90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d08096700 tx=0x7f3d0000b040 comp rx=0 tx=0).stop 2024-08-19T11:21:30.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 10 monclient: shutdown 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 msgr2=0x7f3d0809a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 --2- 172.21.15.71:0/1378703616 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3d0809b980 0x7f3d0809a2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800e900 tx=0x7f3cf800ed00 comp rx=0 tx=0).stop 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d077fe640 1 -- 172.21.15.71:0/1378703616 reap_dead start 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3cef7fe640 1 -- 172.21.15.71:0/1378703616 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(323..323 src has 1..323) ==== 3898+0+0 (unknown 0 0 0) 0x7f3cf800f040 con 0x7f3d0809b980 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d077fe640 1 -- 172.21.15.71:0/1378703616 reap_dead start 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 shutdown_connections 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 >> 172.21.15.71:0/1378703616 conn(0x7f3d080a4e70 msgr2=0x7f3d080a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 shutdown_connections 2024-08-19T11:21:30.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.273+0000 7f3d0d5ba640 1 -- 172.21.15.71:0/1378703616 wait complete. 2024-08-19T11:21:30.316 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-08-19T11:21:30.316 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-08-19T11:21:30.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.412+0000 7f131bcde640 10 monclient: get_monmap_and_config 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.413+0000 7f131bcde640 10 monclient: build_initial_monmap 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.413+0000 7f131bcde640 10 monclient: monmap: 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:30.413652+0000 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:30.413652+0000 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.414 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:30.415 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.413+0000 7f131bcde640 1 Processor -- start 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.413+0000 7f131bcde640 1 -- start start 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.413+0000 7f131bcde640 10 monclient: init 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient: _add_conns ranks=[4,2,8,6,0,7,10,3,5,1,9] 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 0x7f13140a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): picked mon.noname-c con 0x7f13140a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 0x7f13140a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): picked mon.noname-b con 0x7f13140a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1314139860 0x7f1314139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): picked mon.noname-e con 0x7f1314139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:30.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f13140a4f90 con 0x7f13140a6e10 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f13140a6380 con 0x7f13140a6a30 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f13140a49d0 con 0x7f1314139860 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131bcde640 10 monclient(hunting): authenticate will time out at 1348.455387s 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 0x7f13140a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 0x7f13140a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1314139860 0x7f1314139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 0x7f13140a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38738/0 (socket says 172.21.15.71:38738) 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1314139860 0x7f1314139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55570/0 (socket says 172.21.15.71:55570) 2024-08-19T11:21:30.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 -- 172.21.15.71:0/2468264727 learned_addr learned my addr 172.21.15.71:0/2468264727 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 0x7f13140a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48072/0 (socket says 172.21.15.71:48072) 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): get_auth_request con 0x7f13140a6a30 auth_method 0 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): get_auth_request con 0x7f13140a6e10 auth_method 0 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): get_auth_request con 0x7f1314139860 auth_method 0 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f131a27b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient(hunting): handle_auth_done global_id 85504 payload 274 2024-08-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 -- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1314139860 msgr2=0x7f1314139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1314139860 0x7f1314139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 -- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 msgr2=0x7f13140a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 0x7f13140a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient: _finish_hunting 0 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 monclient: found mon.noname-c 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319a7a640 1 -- 172.21.15.71:0/2468264727 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13140a46f0 con 0x7f13140a6a30 2024-08-19T11:21:30.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.414+0000 7f1319279640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 0x7f13140a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1319a7a640 1 -- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 msgr2=0x7f13140a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1319a7a640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 0x7f13140a57f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f13100098d0 tx=0x7f131002a0a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=fad1903d3d66fdb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 1 -- 172.21.15.71:0/2468264727 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1310037070 con 0x7f13140a6a30 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: dump: 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.428 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: _finish_auth 0 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: _check_auth_tickets 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 1 -- 172.21.15.71:0/2468264727 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131002adc0 con 0x7f13140a6a30 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f131bcde640 5 monclient: authenticate success, global_id 85504 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f131bcde640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f131bcde640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 1 -- 172.21.15.71:0/2468264727 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1310030c20 con 0x7f13140a6a30 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f131bcde640 4 set_mon_vals no callback set 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.417+0000 7f1318a78640 10 monclient: dump: 2024-08-19T11:21:30.430 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.431 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 10 monclient: shutdown 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 -- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 msgr2=0x7f13140a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 0x7f13140a57f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f13100098d0 tx=0x7f131002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 -- 172.21.15.71:0/2468264727 shutdown_connections 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f13140a6e10 0x7f13140a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f1314139860 0x7f1314139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 --2- 172.21.15.71:0/2468264727 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f13140a6a30 0x7f13140a57f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 -- 172.21.15.71:0/2468264727 >> 172.21.15.71:0/2468264727 conn(0x7f13140ac030 msgr2=0x7f13140ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 -- 172.21.15.71:0/2468264727 shutdown_connections 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.418+0000 7f131bcde640 1 -- 172.21.15.71:0/2468264727 wait complete. 2024-08-19T11:21:30.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient: build_initial_monmap 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient: monmap: 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:30.433 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 Processor -- start 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 -- start start 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient: init 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient: _add_conns ranks=[6,0,4,8,5,3,7,1,2] 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 0x7f1314124f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): picked mon.noname-d con 0x7f13140a6a30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13140a6e10 0x7f1314125440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): picked mon.noname-a con 0x7f13140a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:30.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1314139860 0x7f1314125980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): picked mon.noname-c con 0x7f1314139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f13140a7730 con 0x7f13140a6e10 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f131413a1a0 con 0x7f1314139860 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f1314128a30 con 0x7f13140a6a30 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f131bcde640 10 monclient(hunting): authenticate will time out at 1348.460921s 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f1319a7a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 0x7f1314124f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f1319a7a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 0x7f1314124f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51342/0 (socket says 172.21.15.71:51342) 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 -- 172.21.15.71:0/39156100 learned_addr learned my addr 172.21.15.71:0/39156100 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:30.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): get_auth_request con 0x7f13140a6a30 auth_method 0 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.419+0000 7f1319279640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13140a6e10 0x7f1314125440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1314139860 0x7f1314125980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): get_auth_request con 0x7f13140a6e10 auth_method 0 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): get_auth_request con 0x7f1314139860 auth_method 0 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:30.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319279640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient(hunting): handle_auth_done global_id 104910 payload 824 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 -- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1314139860 msgr2=0x7f1314125980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1314139860 0x7f1314125980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 -- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13140a6e10 msgr2=0x7f1314125440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13140a6e10 0x7f1314125440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient: _finish_hunting 0 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 monclient: found mon.noname-d 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f1319a7a640 1 -- 172.21.15.71:0/39156100 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1314128d10 con 0x7f13140a6a30 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.420+0000 7f131a27b640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1314139860 0x7f1314125980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f1319a7a640 1 -- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 msgr2=0x7f1314124f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f1319a7a640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 0x7f1314124f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f13100090b0 tx=0x7f13100046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1310037040 con 0x7f13140a6a30 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: dump: 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.438 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.439 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1310042070 con 0x7f13140a6a30 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 5 monclient: authenticate success, global_id 104910 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 10 monclient: _renew_subs 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13140a26b0 con 0x7f13140a6a30 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f131003d8c0 con 0x7f13140a6a30 2024-08-19T11:21:30.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130a7fc640 10 monclient: dump: 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:30.441 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f130bfff640 4 set_mon_vals no callback set 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 10 monclient: _renew_subs 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.422+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f13140a57f0 con 0x7f13140a6a30 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f131003d450 con 0x7f13140a6a30 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f131bcde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f131bcde640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f131bcde640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131413a500 con 0x7f13140a6a30 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f130a7fc640 1 --2- 172.21.15.71:0/39156100 >> v2:172.21.15.135:6800/726754104 conn(0x7f12f803ea80 0x7f12f8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.423+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(323..323 src has 1..323) ==== 3898+0+0 (secure 0 0 0) 0x7f1310071f30 con 0x7f13140a6a30 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.424+0000 7f1319279640 1 --2- 172.21.15.71:0/39156100 >> v2:172.21.15.135:6800/726754104 conn(0x7f12f803ea80 0x7f12f8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.424+0000 7f1319279640 10 monclient: get_auth_request con 0x7f12f803ea80 auth_method 0 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.426+0000 7f1319279640 1 --2- 172.21.15.71:0/39156100 >> v2:172.21.15.135:6800/726754104 conn(0x7f12f803ea80 0x7f12f8040f40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1304009560 tx=0x7f1304009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.428+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f1310070ca0 con 0x7f13140a6a30 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.428+0000 7f130a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:30.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.428+0000 7f130a7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:30.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.669+0000 7f131bcde640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-08-19T11:21:30.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.669+0000 7f131bcde640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-08-19T11:21:30.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.669+0000 7f131bcde640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:30.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.669+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f13140a1200 con 0x7f13140a6a30 2024-08-19T11:21:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.671+0000 7f130a7fc640 1 -- 172.21.15.71:0/39156100 <== mon.6 v2:172.21.15.71:3303/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f1310003a60 con 0x7f13140a6a30 2024-08-19T11:21:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.671+0000 7f130a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-08-19T11:21:30.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.671+0000 7f130a7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:30.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 >> v2:172.21.15.135:6800/726754104 conn(0x7f12f803ea80 msgr2=0x7f12f8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 --2- 172.21.15.71:0/39156100 >> v2:172.21.15.135:6800/726754104 conn(0x7f12f803ea80 0x7f12f8040f40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1304009560 tx=0x7f1304009190 comp rx=0 tx=0).stop 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 10 monclient: shutdown 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 msgr2=0x7f1314124f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 0x7f1314124f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f13100090b0 tx=0x7f13100046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 shutdown_connections 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 --2- 172.21.15.71:0/39156100 >> v2:172.21.15.135:6800/726754104 conn(0x7f12f803ea80 0x7f12f8040f40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f1314139860 0x7f1314125980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13140a6e10 0x7f1314125440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 --2- 172.21.15.71:0/39156100 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f13140a6a30 0x7f1314124f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.673+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 >> 172.21.15.71:0/39156100 conn(0x7f13140ac030 msgr2=0x7f13141390b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:30.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.674+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 shutdown_connections 2024-08-19T11:21:30.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:30.674+0000 7f131bcde640 1 -- 172.21.15.71:0/39156100 wait complete. 2024-08-19T11:21:30.685 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=397491284,config=1747058506,health=1968765668,kv=3646823213,logm=3076933892}) 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=2206697283,config=2586702516,health=1968765668,kv=3646823213,logm=3847673974}) 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=854869235,config=2586702516,health=1968765668,kv=3646823213,logm=3159191170}) 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.930 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=3987697115,config=2586702516,health=1968765668,kv=3646823213,logm=2811227496}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=4067133645,config=2586702516,health=3352610814,kv=183716086,logm=2922414029}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=20,config=2,health=11,kv=12,logm=55} crc {auth=1068180142,config=2586702516,health=1455150337,kv=3646823213,logm=2268842148}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=17,config=2,health=11,kv=12,logm=58} crc {auth=617134062,config=2586702516,health=2638204816,kv=3646823213,logm=645653967}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=108950190,config=2586702516,health=1968765668,kv=3646823213,logm=112733947}) 2024-08-19T11:21:30.931 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.927+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=462973381,config=2586702516,health=1968765668,kv=3223243934,logm=4271452672}) 2024-08-19T11:21:30.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1478916194}) 2024-08-19T11:21:30.936 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1638451609}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1150638778}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4164830537}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3650952553}) 2024-08-19T11:21:30.937 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2697185220}) 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2734856485}) 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993107819}) 2024-08-19T11:21:30.938 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:30.935+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3695269254}) 2024-08-19T11:21:30.942 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:30.942 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29316]: starting. 2024-08-19T11:21:30.943 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29316]: deleting pool ceph_test_rados_delete_pools_parallel.smithi135-29280 2024-08-19T11:21:30.943 INFO:teuthology.orchestra.run.smithi135.stdout:process_4_[29316]: shutting down. 2024-08-19T11:21:30.944 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:30.944 INFO:teuthology.orchestra.run.smithi135.stdout:******************************* 2024-08-19T11:21:30.944 INFO:teuthology.orchestra.run.smithi135.stdout:******* SUCCESS ********** 2024-08-19T11:21:30.947 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-08-19T11:21:30.956 INFO:tasks.mon_thrash:joining mon_thrasher 2024-08-19T11:21:30.956 ERROR:teuthology.run_tasks:Manager failed: mon_thrash Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-19T11:21:30.957 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-19T11:21:30.965 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-19T11:21:30.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:21:31.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.035 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2483218356}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1591221455}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2471181467}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1016259915}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.036 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3840324638}) 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1813281162}) 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1556589911}) 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301683263}) 2024-08-19T11:21:31.037 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=651261015}) 2024-08-19T11:21:31.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=690931453}) 2024-08-19T11:21:31.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2745651798}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3185183006}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2356079727}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3387387733}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3156260785}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443725923}) 2024-08-19T11:21:31.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4021502745}) 2024-08-19T11:21:31.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.040+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1392300630}) 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.047+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.047+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.047+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2866977294}) 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2230766680}) 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=673189853}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2800326493}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2113745993}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3121860253}) 2024-08-19T11:21:31.051 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3829781547}) 2024-08-19T11:21:31.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859040596}) 2024-08-19T11:21:31.052 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.048+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1963420969}) 2024-08-19T11:21:31.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.084+0000 7f3b695f2640 10 monclient: get_monmap_and_config 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.084+0000 7f3b695f2640 10 monclient: build_initial_monmap 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.084+0000 7f3b695f2640 10 monclient: monmap: 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:31.085522+0000 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:31.085522+0000 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:31.086 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:31.087 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 1 Processor -- start 2024-08-19T11:21:31.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 1 -- start start 2024-08-19T11:21:31.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 10 monclient: init 2024-08-19T11:21:31.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:31.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 10 monclient: _add_conns ranks=[6,4,7,1,2,0,10,9,5,8,3] 2024-08-19T11:21:31.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 0x7f3b640a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 10 monclient(hunting): picked mon.noname-d con 0x7f3b640a57d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.085+0000 7f3b695f2640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 0x7f3b640a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): picked mon.noname-c con 0x7f3b64072400 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b640a60f0 0x7f3b64137580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): picked mon.noname-i con 0x7f3b640a60f0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f3b64072880 con 0x7f3b64072400 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f3b640741c0 con 0x7f3b640a57d0 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f3b640a6530 con 0x7f3b640a60f0 2024-08-19T11:21:31.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b695f2640 10 monclient(hunting): authenticate will time out at 1349.127047s 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 0x7f3b640a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 0x7f3b640a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 0x7f3b640a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38756/0 (socket says 172.21.15.71:38756) 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 0x7f3b640a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:51370/0 (socket says 172.21.15.71:51370) 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 1 -- 172.21.15.71:0/3420852600 learned_addr learned my addr 172.21.15.71:0/3420852600 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): get_auth_request con 0x7f3b64072400 auth_method 0 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): get_auth_request con 0x7f3b640a57d0 auth_method 0 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_done global_id 104919 payload 274 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 -- 172.21.15.71:0/3420852600 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b640a60f0 msgr2=0x7f3b64137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b640a60f0 0x7f3b64137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 -- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 msgr2=0x7f3b640a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 0x7f3b640a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 monclient: found mon.noname-d 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b62ffd640 1 -- 172.21.15.71:0/3420852600 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b640a72a0 con 0x7f3b640a57d0 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.086+0000 7f3b5a7fc640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 0x7f3b640a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b62ffd640 1 -- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 msgr2=0x7f3b640a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:31.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b62ffd640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 0x7f3b640a17d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009800 tx=0x7f3b54029fe0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=952e184735c1ffbc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 1 -- 172.21.15.71:0/3420852600 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b54037070 con 0x7f3b640a57d0 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: dump: 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.099 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 1 -- 172.21.15.71:0/3420852600 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5402ad00 con 0x7f3b640a57d0 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b695f2640 5 monclient: authenticate success, global_id 104919 2024-08-19T11:21:31.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b695f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b695f2640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 1 -- 172.21.15.71:0/3420852600 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b54030c20 con 0x7f3b640a57d0 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b695f2640 4 set_mon_vals no callback set 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.089+0000 7f3b627fc640 10 monclient: dump: 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.101 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.102 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 10 monclient: shutdown 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 -- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 msgr2=0x7f3b640a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 0x7f3b640a17d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009800 tx=0x7f3b54029fe0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 -- 172.21.15.71:0/3420852600 shutdown_connections 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f3b640a60f0 0x7f3b64137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f3b64072400 0x7f3b640a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 --2- 172.21.15.71:0/3420852600 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f3b640a57d0 0x7f3b640a17d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 -- 172.21.15.71:0/3420852600 >> 172.21.15.71:0/3420852600 conn(0x7f3b640aa3f0 msgr2=0x7f3b640a68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 -- 172.21.15.71:0/3420852600 shutdown_connections 2024-08-19T11:21:31.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 1 -- 172.21.15.71:0/3420852600 wait complete. 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 10 monclient: build_initial_monmap 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.090+0000 7f3b695f2640 10 monclient: monmap: 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:31.104 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 Processor -- start 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 -- start start 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient: init 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient: _add_conns ranks=[2,3,5,4,6,7,0,1,8] 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 0x7f3b64122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): picked mon.noname-b con 0x7f3b64072400 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:31.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b640a57d0 0x7f3b64123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): picked mon.noname-g con 0x7f3b640a57d0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b640a60f0 0x7f3b64123770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): picked mon.noname-h con 0x7f3b640a60f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b64137e50 con 0x7f3b64072400 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3b64137cd0 con 0x7f3b640a57d0 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f3b64137fd0 con 0x7f3b640a60f0 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b695f2640 10 monclient(hunting): authenticate will time out at 1349.132796s 2024-08-19T11:21:31.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 0x7f3b64122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 0x7f3b64122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48088/0 (socket says 172.21.15.71:48088) 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 1 -- 172.21.15.71:0/4112499844 learned_addr learned my addr 172.21.15.71:0/4112499844 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 10 monclient(hunting): get_auth_request con 0x7f3b64072400 auth_method 0 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.091+0000 7f3b62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b5a7fc640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b640a57d0 0x7f3b64123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b637fe640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b640a60f0 0x7f3b64123770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b5a7fc640 10 monclient(hunting): get_auth_request con 0x7f3b640a57d0 auth_method 0 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b5a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b5a7fc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b637fe640 10 monclient(hunting): get_auth_request con 0x7f3b640a60f0 auth_method 0 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b637fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b637fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 10 monclient(hunting): handle_auth_done global_id 76052 payload 824 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 1 -- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b640a60f0 msgr2=0x7f3b64123770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b640a60f0 0x7f3b64123770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 1 -- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b640a57d0 msgr2=0x7f3b64123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b640a57d0 0x7f3b64123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 10 monclient: _finish_hunting 0 2024-08-19T11:21:31.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 1 monclient: found mon.noname-b 2024-08-19T11:21:31.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:31.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.092+0000 7f3b62ffd640 1 -- 172.21.15.71:0/4112499844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b64126970 con 0x7f3b64072400 2024-08-19T11:21:31.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b62ffd640 1 -- 172.21.15.71:0/4112499844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 msgr2=0x7f3b64122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:31.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b62ffd640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 0x7f3b64122cf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009800 tx=0x7f3b540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b54041020 con 0x7f3b64072400 2024-08-19T11:21:31.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: dump: 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: _finish_auth 0 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: _check_auth_tickets 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b54032440 con 0x7f3b64072400 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 5 monclient: authenticate success, global_id 76052 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f3b54037040 con 0x7f3b64072400 2024-08-19T11:21:31.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 10 monclient: _renew_subs 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b640a5c40 con 0x7f3b64072400 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b5bfff640 10 monclient: dump: 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.114 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b61ffb640 4 set_mon_vals no callback set 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 10 monclient: _renew_subs 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.094+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b64125b00 con 0x7f3b64072400 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f3b54044020 con 0x7f3b64072400 2024-08-19T11:21:31.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b695f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b695f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b695f2640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b640a17d0 con 0x7f3b64072400 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b5bfff640 1 --2- 172.21.15.71:0/4112499844 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b4403ea80 0x7f3b44040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.095+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f3b54071e90 con 0x7f3b64072400 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.096+0000 7f3b5a7fc640 1 --2- 172.21.15.71:0/4112499844 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b4403ea80 0x7f3b44040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.096+0000 7f3b5a7fc640 10 monclient: get_auth_request con 0x7f3b4403ea80 auth_method 0 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.098+0000 7f3b5a7fc640 1 --2- 172.21.15.71:0/4112499844 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b4403ea80 0x7f3b44040f40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b64124410 tx=0x7f3b4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.100+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f3b5404b030 con 0x7f3b64072400 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.100+0000 7f3b5bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.100+0000 7f3b5bfff640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=834227659}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3522315106}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2416359094}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.153 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=806932297}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2879776480}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1547728039}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3017220074}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=120752431}) 2024-08-19T11:21:31.154 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2666007237}) 2024-08-19T11:21:31.160 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2746046593}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4175234874}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1728488225}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3857587234}) 2024-08-19T11:21:31.161 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2878994337}) 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=937313544}) 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=329351375}) 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.162 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577821903}) 2024-08-19T11:21:31.163 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2584929042}) 2024-08-19T11:21:31.173 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.170+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.173 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.170+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.173 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.170+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=663790048}) 2024-08-19T11:21:31.173 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.170+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.170+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.170+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1756131403}) 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337352263}) 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=469293599}) 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.174 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1111185216}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=474448529}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1315367378}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3262913127}) 2024-08-19T11:21:31.175 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.171+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2875730340}) 2024-08-19T11:21:31.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.283+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b64124610 con 0x7f3b4403ea80 2024-08-19T11:21:31.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.285+0000 7f3b5bfff640 1 -- 172.21.15.71:0/4112499844 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (secure 0 0 0) 0x7f3b64124610 con 0x7f3b4403ea80 2024-08-19T11:21:31.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:21:31.287 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:21:31.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b4403ea80 msgr2=0x7f3b44040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 --2- 172.21.15.71:0/4112499844 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b4403ea80 0x7f3b44040f40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b64124410 tx=0x7f3b4c008040 comp rx=0 tx=0).stop 2024-08-19T11:21:31.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 10 monclient: shutdown 2024-08-19T11:21:31.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:31.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 msgr2=0x7f3b64122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 0x7f3b64122cf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009800 tx=0x7f3b540046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 shutdown_connections 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 --2- 172.21.15.71:0/4112499844 >> v2:172.21.15.135:6800/726754104 conn(0x7f3b4403ea80 0x7f3b44040f40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f3b640a60f0 0x7f3b64123770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3b640a57d0 0x7f3b64123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 --2- 172.21.15.71:0/4112499844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b64072400 0x7f3b64122cf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 >> 172.21.15.71:0/4112499844 conn(0x7f3b640aa3f0 msgr2=0x7f3b64136e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 shutdown_connections 2024-08-19T11:21:31.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.287+0000 7f3b695f2640 1 -- 172.21.15.71:0/4112499844 wait complete. 2024-08-19T11:21:31.298 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":653,"stamp":"2024-08-19T11:21:31.035952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":180124,"kb_used_data":17956,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566050916,"statfs":{"total":579820584960,"available":579636137984,"internally_reserved":0,"allocated":18386944,"data_stored":9058899,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.283215"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755911+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:21:26.755911+0000","last_peered":"2024-08-19T11:21:26.755911+0000","last_clean":"2024-08-19T11:21:26.755911+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:21:26.755911+0000","last_undegraded":"2024-08-19T11:21:26.755911+0000","last_fullsized":"2024-08-19T11:21:26.755911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":621,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:27.629065+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:21:27.629065+0000","last_peered":"2024-08-19T11:21:27.629065+0000","last_clean":"2024-08-19T11:21:27.629065+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:21:27.629065+0000","last_undegraded":"2024-08-19T11:21:27.629065+0000","last_fullsized":"2024-08-19T11:21:27.629065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755855+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:21:26.755855+0000","last_peered":"2024-08-19T11:21:26.755855+0000","last_clean":"2024-08-19T11:21:26.755855+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:21:26.755855+0000","last_undegraded":"2024-08-19T11:21:26.755855+0000","last_fullsized":"2024-08-19T11:21:26.755855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.757162+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:21:26.757162+0000","last_peered":"2024-08-19T11:21:26.757162+0000","last_clean":"2024-08-19T11:21:26.757162+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:21:26.757162+0000","last_undegraded":"2024-08-19T11:21:26.757162+0000","last_fullsized":"2024-08-19T11:21:26.757162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":630,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.756191+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:21:26.756191+0000","last_peered":"2024-08-19T11:21:26.756191+0000","last_clean":"2024-08-19T11:21:26.756191+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:21:26.756191+0000","last_undegraded":"2024-08-19T11:21:26.756191+0000","last_fullsized":"2024-08-19T11:21:26.756191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":626,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.754591+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:21:26.754591+0000","last_peered":"2024-08-19T11:21:26.754591+0000","last_clean":"2024-08-19T11:21:26.754591+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:21:26.754591+0000","last_undegraded":"2024-08-19T11:21:26.754591+0000","last_fullsized":"2024-08-19T11:21:26.754591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.757392+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:21:26.757392+0000","last_peered":"2024-08-19T11:21:26.757392+0000","last_clean":"2024-08-19T11:21:26.757392+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:21:26.757392+0000","last_undegraded":"2024-08-19T11:21:26.757392+0000","last_fullsized":"2024-08-19T11:21:26.757392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":626,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755327+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:21:26.755327+0000","last_peered":"2024-08-19T11:21:26.755327+0000","last_clean":"2024-08-19T11:21:26.755327+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:21:26.755327+0000","last_undegraded":"2024-08-19T11:21:26.755327+0000","last_fullsized":"2024-08-19T11:21:26.755327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":716,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.754565+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:21:26.754565+0000","last_peered":"2024-08-19T11:21:26.754565+0000","last_clean":"2024-08-19T11:21:26.754565+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:21:26.754565+0000","last_undegraded":"2024-08-19T11:21:26.754565+0000","last_fullsized":"2024-08-19T11:21:26.754565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640391,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30052,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341788,"statfs":{"total":96636764160,"available":96605990912,"internally_reserved":0,"allocated":3096576,"data_stored":1862689,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607687,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30044,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341796,"statfs":{"total":96636764160,"available":96605999104,"internally_reserved":0,"allocated":3084288,"data_stored":1332219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607687,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3035136,"data_stored":1333761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607687,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3035136,"data_stored":1333761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607686,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30052,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341788,"statfs":{"total":96636764160,"available":96605990912,"internally_reserved":0,"allocated":3096576,"data_stored":1862689,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607687,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3039232,"data_stored":1333780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:21:31.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:21:31.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.405 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3463316680}) 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1988154789}) 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3287968427}) 2024-08-19T11:21:31.406 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.407 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.407 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2847578020}) 2024-08-19T11:21:31.407 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.407 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.407 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3608076320}) 2024-08-19T11:21:31.407 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.408 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.389+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.408 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2025151110}) 2024-08-19T11:21:31.408 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.408 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.408 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=778203485}) 2024-08-19T11:21:31.408 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.409 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508679495}) 2024-08-19T11:21:31.409 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.390+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2836956030}) 2024-08-19T11:21:31.409 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.409 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.409 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2064404995}) 2024-08-19T11:21:31.409 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.410 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.410 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1380569005}) 2024-08-19T11:21:31.410 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.410 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.410 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1106648126}) 2024-08-19T11:21:31.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=707212904}) 2024-08-19T11:21:31.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.411 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1289854510}) 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2375938496}) 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=922352007}) 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.412 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4038850991}) 2024-08-19T11:21:31.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.391+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1333859228}) 2024-08-19T11:21:31.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2030321197}) 2024-08-19T11:21:31.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.413 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.414 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=103738070}) 2024-08-19T11:21:31.414 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.414 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.414 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=395908930}) 2024-08-19T11:21:31.414 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2881643360}) 2024-08-19T11:21:31.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=505287451}) 2024-08-19T11:21:31.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=289387440}) 2024-08-19T11:21:31.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1012057400}) 2024-08-19T11:21:31.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3614759629}) 2024-08-19T11:21:31.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.393+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3510737774}) 2024-08-19T11:21:31.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4203051195}) 2024-08-19T11:21:31.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1625817227}) 2024-08-19T11:21:31.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.419 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2065421944}) 2024-08-19T11:21:31.419 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.419 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.419 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3882166358}) 2024-08-19T11:21:31.419 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.419 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.420 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2681194334}) 2024-08-19T11:21:31.420 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.420 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.420 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=661539246}) 2024-08-19T11:21:31.420 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.420 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.421 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3998315196}) 2024-08-19T11:21:31.421 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:31.421 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=774950104}) 2024-08-19T11:21:31.421 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:31.394+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=740038637}) 2024-08-19T11:21:31.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.399+0000 7f0859da0640 10 monclient: get_monmap_and_config 2024-08-19T11:21:31.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.399+0000 7f0859da0640 10 monclient: build_initial_monmap 2024-08-19T11:21:31.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.399+0000 7f0859da0640 10 monclient: monmap: 2024-08-19T11:21:31.438 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:31.438 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.438 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:31.399852+0000 2024-08-19T11:21:31.439 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:31.399852+0000 2024-08-19T11:21:31.439 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:31.439 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.439 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:31.439 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:31.440 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:31.441 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:31.441 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:31.441 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.399+0000 7f0859da0640 1 Processor -- start 2024-08-19T11:21:31.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 1 -- start start 2024-08-19T11:21:31.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient: init 2024-08-19T11:21:31.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:31.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient: _add_conns ranks=[3,10,1,4,5,0,8,9,7,2,6] 2024-08-19T11:21:31.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 0x7f08540a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): picked mon.noname-g con 0x7f08540a7880 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:31.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f085406d5b0 0x7f08540a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): picked mon.noname-f con 0x7f085406d5b0 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f08540a0e90 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540a1860 con 0x7f08540a0e90 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f08540a86e0 con 0x7f085406d5b0 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f08540a1b40 con 0x7f08540a7880 2024-08-19T11:21:31.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0859da0640 10 monclient(hunting): authenticate will time out at 1349.441534s 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f085959f640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f08540a0e90 0x7f0854136130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.71:47502/0 (socket says 172.21.15.71:47502) 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 0x7f08540a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f085959f640 1 -- 172.21.15.71:0/451267926 learned_addr learned my addr 172.21.15.71:0/451267926 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): get_auth_request con 0x7f08540a7880 auth_method 0 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 1 --2- 172.21.15.71:0/451267926 >> v2:172.21.15.135:3300/0 conn(0x7f085406d5b0 0x7f08540a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): get_auth_request con 0x7f085406d5b0 auth_method 0 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0853fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.400+0000 7f0858d9e640 10 monclient(hunting): handle_auth_done global_id 46353 payload 274 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 1 -- 172.21.15.71:0/451267926 >> v2:172.21.15.135:3300/0 conn(0x7f085406d5b0 msgr2=0x7f08540a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:31.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 1 --2- 172.21.15.71:0/451267926 >> v2:172.21.15.135:3300/0 conn(0x7f085406d5b0 0x7f08540a81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 1 -- 172.21.15.71:0/451267926 >> v1:172.21.15.135:6789/0 conn(0x7f08540a0e90 legacy=0x7f0854136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 10 monclient: _finish_hunting 0 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 1 monclient: found mon.noname-g 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.135:3301/0 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.401+0000 7f0858d9e640 1 -- 172.21.15.71:0/451267926 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08540a5e50 con 0x7f08540a7880 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.403+0000 7f0858d9e640 1 -- 172.21.15.71:0/451267926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 msgr2=0x7f08540a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.403+0000 7f0858d9e640 1 --2- 172.21.15.71:0/451267926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 0x7f08540a7c60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f084c0097a0 tx=0x7f084c029fd0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=977fe3b83c81a3c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.403+0000 7f08537fe640 1 -- 172.21.15.71:0/451267926 <== mon.3 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f084c037070 con 0x7f08540a7880 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-08-19T11:21:31.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: dump: 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 1 -- 172.21.15.71:0/451267926 <== mon.3 v2:172.21.15.135:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c02ad30 con 0x7f08540a7880 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 1 -- 172.21.15.71:0/451267926 <== mon.3 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f084c030c20 con 0x7f08540a7880 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 5 monclient: authenticate success, global_id 46353 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 4 set_mon_vals no callback set 2024-08-19T11:21:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f08537fe640 10 monclient: dump: 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 10 monclient: shutdown 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 -- 172.21.15.71:0/451267926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 msgr2=0x7f08540a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 --2- 172.21.15.71:0/451267926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 0x7f08540a7c60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f084c0097a0 tx=0x7f084c029fd0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 -- 172.21.15.71:0/451267926 shutdown_connections 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 --2- 172.21.15.71:0/451267926 >> v2:172.21.15.135:3300/0 conn(0x7f085406d5b0 0x7f08540a81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 --2- 172.21.15.71:0/451267926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08540a7880 0x7f08540a7c60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 -- 172.21.15.71:0/451267926 >> 172.21.15.71:0/451267926 conn(0x7f08540a8fa0 msgr2=0x7f08540a5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 -- 172.21.15.71:0/451267926 shutdown_connections 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.404+0000 7f0859da0640 1 -- 172.21.15.71:0/451267926 wait complete. 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.405+0000 7f0859da0640 10 monclient: build_initial_monmap 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.405+0000 7f0859da0640 10 monclient: monmap: 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.405+0000 7f0859da0640 1 Processor -- start 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.405+0000 7f0859da0640 1 -- start start 2024-08-19T11:21:31.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.405+0000 7f0859da0640 10 monclient: init 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient: _add_conns ranks=[7,2,1,0,5,6,3,8,4] 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f085406d5b0 0x7f08541ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): picked mon.noname-i con 0x7f085406d5b0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 0x7f08541cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): picked mon.noname-b con 0x7f08540a0e90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540a7880 0x7f0854122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): picked mon.noname-f con 0x7f08540a7880 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0854136a50 con 0x7f08540a7880 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f08540644e0 con 0x7f08540a0e90 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f0854136bd0 con 0x7f085406d5b0 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0859da0640 10 monclient(hunting): authenticate will time out at 1349.447307s 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 0x7f08541cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 0x7f08541cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48098/0 (socket says 172.21.15.71:48098) 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 -- 172.21.15.71:0/92427485 learned_addr learned my addr 172.21.15.71:0/92427485 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): get_auth_request con 0x7f08540a0e90 auth_method 0 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f085959f640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540a7880 0x7f0854122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f085959f640 10 monclient(hunting): get_auth_request con 0x7f08540a7880 auth_method 0 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0858d9e640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f085406d5b0 0x7f08541ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f085959f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f085959f640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f085959f640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0858d9e640 10 monclient(hunting): get_auth_request con 0x7f085406d5b0 auth_method 0 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0858d9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0858d9e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0858d9e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient(hunting): handle_auth_done global_id 76061 payload 824 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 -- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f085406d5b0 msgr2=0x7f08541ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f085406d5b0 0x7f08541ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 -- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540a7880 msgr2=0x7f0854122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540a7880 0x7f0854122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 monclient: found mon.noname-b 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f0853fff640 1 -- 172.21.15.71:0/92427485 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08540a4a60 con 0x7f08540a0e90 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.406+0000 7f085959f640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540a7880 0x7f0854122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.408+0000 7f0853fff640 1 -- 172.21.15.71:0/92427485 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 msgr2=0x7f08541cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.408+0000 7f0853fff640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 0x7f08541cef00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f084400efc0 tx=0x7f084400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f0844018020 con 0x7f08540a0e90 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: dump: 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08440148f0 con 0x7f08540a0e90 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 5 monclient: authenticate success, global_id 76061 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 10 monclient: _renew_subs 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0854073680 con 0x7f08540a0e90 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f08440133e0 con 0x7f08540a0e90 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f08517fa640 10 monclient: dump: 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 10 monclient: _renew_subs 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0852ffd640 4 set_mon_vals no callback set 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.409+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08541246b0 con 0x7f08540a0e90 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f0844005d10 con 0x7f08540a0e90 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f0859da0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f0859da0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f0859da0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0854136130 con 0x7f08540a0e90 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f08517fa640 1 --2- 172.21.15.71:0/92427485 >> v2:172.21.15.135:6800/726754104 conn(0x7f083403ea80 0x7f0834040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f0844052960 con 0x7f08540a0e90 2024-08-19T11:21:31.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f0858d9e640 1 --2- 172.21.15.71:0/92427485 >> v2:172.21.15.135:6800/726754104 conn(0x7f083403ea80 0x7f0834040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.410+0000 7f0858d9e640 10 monclient: get_auth_request con 0x7f083403ea80 auth_method 0 2024-08-19T11:21:31.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.413+0000 7f0858d9e640 1 --2- 172.21.15.71:0/92427485 >> v2:172.21.15.135:6800/726754104 conn(0x7f083403ea80 0x7f0834040f40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f084c034000 tx=0x7f084c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.414+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f0844022030 con 0x7f08540a0e90 2024-08-19T11:21:31.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.414+0000 7f08517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.414+0000 7f08517fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:31.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.587+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0854074350 con 0x7f083403ea80 2024-08-19T11:21:31.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.588+0000 7f08517fa640 1 -- 172.21.15.71:0/92427485 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (secure 0 0 0) 0x7f0854074350 con 0x7f083403ea80 2024-08-19T11:21:31.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:21:31.590 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:21:31.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 >> v2:172.21.15.135:6800/726754104 conn(0x7f083403ea80 msgr2=0x7f0834040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 --2- 172.21.15.71:0/92427485 >> v2:172.21.15.135:6800/726754104 conn(0x7f083403ea80 0x7f0834040f40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f084c034000 tx=0x7f084c02e000 comp rx=0 tx=0).stop 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 10 monclient: shutdown 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 msgr2=0x7f08541cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 0x7f08541cef00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f084400efc0 tx=0x7f084400c490 comp rx=0 tx=0).stop 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 shutdown_connections 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 --2- 172.21.15.71:0/92427485 >> v2:172.21.15.135:6800/726754104 conn(0x7f083403ea80 0x7f0834040f40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08540a7880 0x7f0854122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f08540a0e90 0x7f08541cef00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 --2- 172.21.15.71:0/92427485 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f085406d5b0 0x7f08541ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 >> 172.21.15.71:0/92427485 conn(0x7f08540a8fa0 msgr2=0x7f0854071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:31.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 shutdown_connections 2024-08-19T11:21:31.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.590+0000 7f0859da0640 1 -- 172.21.15.71:0/92427485 wait complete. 2024-08-19T11:21:31.602 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":653,"stamp":"2024-08-19T11:21:31.035952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":180124,"kb_used_data":17956,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566050916,"statfs":{"total":579820584960,"available":579636137984,"internally_reserved":0,"allocated":18386944,"data_stored":9058899,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.283215"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755911+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:21:26.755911+0000","last_peered":"2024-08-19T11:21:26.755911+0000","last_clean":"2024-08-19T11:21:26.755911+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:21:26.755911+0000","last_undegraded":"2024-08-19T11:21:26.755911+0000","last_fullsized":"2024-08-19T11:21:26.755911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":621,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:27.629065+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:21:27.629065+0000","last_peered":"2024-08-19T11:21:27.629065+0000","last_clean":"2024-08-19T11:21:27.629065+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:21:27.629065+0000","last_undegraded":"2024-08-19T11:21:27.629065+0000","last_fullsized":"2024-08-19T11:21:27.629065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755855+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:21:26.755855+0000","last_peered":"2024-08-19T11:21:26.755855+0000","last_clean":"2024-08-19T11:21:26.755855+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:21:26.755855+0000","last_undegraded":"2024-08-19T11:21:26.755855+0000","last_fullsized":"2024-08-19T11:21:26.755855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.757162+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:21:26.757162+0000","last_peered":"2024-08-19T11:21:26.757162+0000","last_clean":"2024-08-19T11:21:26.757162+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:21:26.757162+0000","last_undegraded":"2024-08-19T11:21:26.757162+0000","last_fullsized":"2024-08-19T11:21:26.757162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":630,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.756191+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:21:26.756191+0000","last_peered":"2024-08-19T11:21:26.756191+0000","last_clean":"2024-08-19T11:21:26.756191+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:21:26.756191+0000","last_undegraded":"2024-08-19T11:21:26.756191+0000","last_fullsized":"2024-08-19T11:21:26.756191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":626,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.754591+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:21:26.754591+0000","last_peered":"2024-08-19T11:21:26.754591+0000","last_clean":"2024-08-19T11:21:26.754591+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:21:26.754591+0000","last_undegraded":"2024-08-19T11:21:26.754591+0000","last_fullsized":"2024-08-19T11:21:26.754591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.757392+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:21:26.757392+0000","last_peered":"2024-08-19T11:21:26.757392+0000","last_clean":"2024-08-19T11:21:26.757392+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:21:26.757392+0000","last_undegraded":"2024-08-19T11:21:26.757392+0000","last_fullsized":"2024-08-19T11:21:26.757392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":626,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755327+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:21:26.755327+0000","last_peered":"2024-08-19T11:21:26.755327+0000","last_clean":"2024-08-19T11:21:26.755327+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:21:26.755327+0000","last_undegraded":"2024-08-19T11:21:26.755327+0000","last_fullsized":"2024-08-19T11:21:26.755327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":716,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.754565+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:21:26.754565+0000","last_peered":"2024-08-19T11:21:26.754565+0000","last_clean":"2024-08-19T11:21:26.754565+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:21:26.754565+0000","last_undegraded":"2024-08-19T11:21:26.754565+0000","last_fullsized":"2024-08-19T11:21:26.754565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640391,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30052,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341788,"statfs":{"total":96636764160,"available":96605990912,"internally_reserved":0,"allocated":3096576,"data_stored":1862689,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607687,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30044,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341796,"statfs":{"total":96636764160,"available":96605999104,"internally_reserved":0,"allocated":3084288,"data_stored":1332219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607687,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3035136,"data_stored":1333761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607687,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3035136,"data_stored":1333761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607686,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30052,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341788,"statfs":{"total":96636764160,"available":96605990912,"internally_reserved":0,"allocated":3096576,"data_stored":1862689,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607687,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3039232,"data_stored":1333780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:21:31.603 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-19T11:21:31.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:21:31.686 ERROR:tasks.mon_thrash.mon_thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 272, in do_thrash self._do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 321, in _do_thrash while not self.stopping.is_set(): AttributeError: 'bool' object has no attribute 'is_set' 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.699+0000 7fc744128640 10 monclient: get_monmap_and_config 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.699+0000 7fc744128640 10 monclient: build_initial_monmap 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.699+0000 7fc744128640 10 monclient: monmap: 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:31.700156+0000 2024-08-19T11:21:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:31.700156+0000 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:31.702 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 Processor -- start 2024-08-19T11:21:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 -- start start 2024-08-19T11:21:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient: init 2024-08-19T11:21:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient: _add_conns ranks=[2,9,6,1,8,7,10,5,4,0,3] 2024-08-19T11:21:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 0x7fc73c0a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): picked mon.noname-b con 0x7fc73c0a6a30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 0x7fc73c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): picked mon.noname-a con 0x7fc73c0a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc73c139860 0x7fc73c139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): picked mon.noname-d con 0x7fc73c139860 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fc73c0a4f90 con 0x7fc73c0a6e10 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc73c0a6380 con 0x7fc73c0a6a30 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fc73c0a49d0 con 0x7fc73c139860 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc744128640 10 monclient(hunting): authenticate will time out at 1349.741852s 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc741ec4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 0x7fc73c0a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc7416c3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 0x7fc73c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc7426c5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc73c139860 0x7fc73c139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc741ec4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 0x7fc73c0a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48104/0 (socket says 172.21.15.71:48104) 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.700+0000 7fc7416c3640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 0x7fc73c0a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46264/0 (socket says 172.21.15.71:46264) 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 -- 172.21.15.71:0/3884001879 learned_addr learned my addr 172.21.15.71:0/3884001879 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): get_auth_request con 0x7fc73c0a6a30 auth_method 0 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): get_auth_request con 0x7fc73c139860 auth_method 0 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): get_auth_request con 0x7fc73c0a6e10 auth_method 0 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient(hunting): handle_auth_done global_id 76070 payload 274 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 -- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc73c139860 msgr2=0x7fc73c139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc73c139860 0x7fc73c139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 -- 172.21.15.71:0/3884001879 >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 msgr2=0x7fc73c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3884001879 >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 0x7fc73c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient: _finish_hunting 0 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 monclient: found mon.noname-b 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc741ec4640 1 -- 172.21.15.71:0/3884001879 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c0a46f0 con 0x7fc73c0a6a30 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7426c5640 1 --2- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc73c139860 0x7fc73c139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.701+0000 7fc7416c3640 1 --2- 172.21.15.71:0/3884001879 >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 0x7fc73c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:31.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc741ec4640 1 -- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 msgr2=0x7fc73c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:31.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 0x7fc73c0a57f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098a0 tx=0x7fc73802a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431c04dcbc9788ac server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 1 -- 172.21.15.71:0/3884001879 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc738037070 con 0x7fc73c0a6a30 2024-08-19T11:21:31.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: dump: 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.716 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: _finish_auth 0 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: _check_auth_tickets 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 1 -- 172.21.15.71:0/3884001879 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73802adf0 con 0x7fc73c0a6a30 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 5 monclient: authenticate success, global_id 76070 2024-08-19T11:21:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 1 -- 172.21.15.71:0/3884001879 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc738030c20 con 0x7fc73c0a6a30 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 4 set_mon_vals no callback set 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc740ec2640 10 monclient: dump: 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.718 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.719 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 10 monclient: shutdown 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 -- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 msgr2=0x7fc73c0a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 --2- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 0x7fc73c0a57f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc7380098a0 tx=0x7fc73802a0d0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 -- 172.21.15.71:0/3884001879 shutdown_connections 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 --2- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fc73c139860 0x7fc73c139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 --2- 172.21.15.71:0/3884001879 >> v2:172.21.15.71:3300/0 conn(0x7fc73c0a6e10 0x7fc73c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 --2- 172.21.15.71:0/3884001879 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc73c0a6a30 0x7fc73c0a57f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 -- 172.21.15.71:0/3884001879 >> 172.21.15.71:0/3884001879 conn(0x7fc73c0ac030 msgr2=0x7fc73c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 -- 172.21.15.71:0/3884001879 shutdown_connections 2024-08-19T11:21:31.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.704+0000 7fc744128640 1 -- 172.21.15.71:0/3884001879 wait complete. 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.705+0000 7fc744128640 10 monclient: build_initial_monmap 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.705+0000 7fc744128640 10 monclient: monmap: 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:31.721 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.705+0000 7fc744128640 1 Processor -- start 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.705+0000 7fc744128640 1 -- start start 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.705+0000 7fc744128640 10 monclient: init 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient: _add_conns ranks=[4,1,8,6,0,3,5,2,7] 2024-08-19T11:21:31.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): picked mon.noname-c con 0x7fc73c0a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc73c0a6e10 0x7fc73c124e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): picked mon.noname-f con 0x7fc73c0a6e10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc73c139860 0x7fc73c125380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): picked mon.noname-e con 0x7fc73c139860 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c0a7730 con 0x7fc73c0a6e10 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fc73c13a200 con 0x7fc73c0a6a30 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fc73c128bc0 con 0x7fc73c139860 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:31.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc744128640 10 monclient(hunting): authenticate will time out at 1349.747297s 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38758/0 (socket says 172.21.15.71:38758) 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 -- 172.21.15.71:0/3552533945 learned_addr learned my addr 172.21.15.71:0/3552533945 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): get_auth_request con 0x7fc73c0a6a30 auth_method 0 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc73c139860 0x7fc73c125380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): get_auth_request con 0x7fc73c139860 auth_method 0 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:31.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient(hunting): handle_auth_done global_id 85531 payload 824 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 -- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc73c139860 msgr2=0x7fc73c125380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc73c139860 0x7fc73c125380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 -- 172.21.15.71:0/3552533945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc73c0a6e10 msgr2=0x7fc73c124e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7416c3640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc73c0a6e10 0x7fc73c124e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc73c0a6e10 0x7fc73c124e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient: _finish_hunting 0 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 monclient: found mon.noname-c 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:31.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc741ec4640 1 -- 172.21.15.71:0/3552533945 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c0a2260 con 0x7fc73c0a6a30 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.706+0000 7fc7426c5640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc73c139860 0x7fc73c125380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.708+0000 7fc741ec4640 1 -- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 msgr2=0x7fc73c1273c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.708+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7380090b0 tx=0x7fc7380046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc738037040 con 0x7fc73c0a6a30 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: dump: 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.727 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738004490 con 0x7fc73c0a6a30 2024-08-19T11:21:31.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 5 monclient: authenticate success, global_id 85531 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fc738030c20 con 0x7fc73c0a6a30 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 10 monclient: _renew_subs 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c127d50 con 0x7fc73c0a6a30 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc733fff640 4 set_mon_vals no callback set 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc7327fc640 10 monclient: dump: 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:31.729 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:31.730 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 10 monclient: _renew_subs 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c1288e0 con 0x7fc73c0a6a30 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.709+0000 7fc741ec4640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7380090b0 tx=0x7fc7380046c0 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fc738044030 mgrmap(e 5) 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fc738044030 con 0x7fc73c0a6a30 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc744128640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc744128640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc744128640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73c13a560 con 0x7fc73c0a6a30 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc7327fc640 1 --2- 172.21.15.71:0/3552533945 >> v2:172.21.15.135:6800/726754104 conn(0x7fc72003eab0 0x7fc720040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc7416c3640 1 --2- 172.21.15.71:0/3552533945 >> v2:172.21.15.135:6800/726754104 conn(0x7fc72003eab0 0x7fc720040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.710+0000 7fc7416c3640 10 monclient: get_auth_request con 0x7fc72003eab0 auth_method 0 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.713+0000 7fc7416c3640 1 --2- 172.21.15.71:0/3552533945 >> v2:172.21.15.135:6800/726754104 conn(0x7fc72003eab0 0x7fc720040f70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009560 tx=0x7fc72c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:31.731 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:31.715+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7fc738042020 con 0x7fc73c0a6a30 2024-08-19T11:21:32.028 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.028 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.028 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1754054174}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1389800118}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1005718889}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=80408759}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=566479396}) 2024-08-19T11:21:32.029 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1297114832}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1923896222}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541171288}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.021+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2124592996}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1694316350}) 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.030 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1492452904}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4087080376}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2989249918}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3327656839}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.031 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2623344938}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1810797163}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=583071735}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.023+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3836578666}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=328862883}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1649138446}) 2024-08-19T11:21:32.032 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=397184050}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1125526284}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1449749386}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3784510644}) 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.033 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4252646402}) 2024-08-19T11:21:32.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2071236869}) 2024-08-19T11:21:32.034 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.024+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=897770514}) 2024-08-19T11:21:32.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3353374912}) 2024-08-19T11:21:32.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.042 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1055468425}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2497377047}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2823071092}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=276496530}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.043 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1267270166}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1497564895}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2883833237}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.032+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1786501882}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2504514639}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2585193761}) 2024-08-19T11:21:32.044 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2482767696}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1466981664}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4131115856}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=21630839}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2486969839}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1896826494}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.033+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2379970299}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4263133323}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2716463934}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3857894844}) 2024-08-19T11:21:32.046 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=343687588}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=356874237}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2961142143}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=861388601}) 2024-08-19T11:21:32.047 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898789524}) 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.035+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4178845628}) 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=763267900}) 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1916690859}) 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.048 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3928315489}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3280315816}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1390539133}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2694284907}) 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.049 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624295846}) 2024-08-19T11:21:32.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1651909181}) 2024-08-19T11:21:32.050 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.036+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3187168816}) 2024-08-19T11:21:32.168 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.168 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3200428595}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3355385808}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2484888244}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3069386151}) 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.169 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1832583437}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=759669575}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4277531905}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441954500}) 2024-08-19T11:21:32.170 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1765883822}) 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1984807838}) 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2303856523}) 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3359346155}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3579463130}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=565732390}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2792240785}) 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4207619628}) 2024-08-19T11:21:32.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3689927166}) 2024-08-19T11:21:32.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.183+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=724742432}) 2024-08-19T11:21:32.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2145566494}) 2024-08-19T11:21:32.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1372495431}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1549367966}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=356632048}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2942288587}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4210740480}) 2024-08-19T11:21:32.252 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1539956989}) 2024-08-19T11:21:32.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3551609148}) 2024-08-19T11:21:32.253 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.249+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2631697729}) 2024-08-19T11:21:32.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2228437451}) 2024-08-19T11:21:32.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.254 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3427666643}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252073070}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2326529387}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2295727808}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3684426599}) 2024-08-19T11:21:32.255 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.256 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.256 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4113701769}) 2024-08-19T11:21:32.256 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.256 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3241128505}) 2024-08-19T11:21:32.256 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.251+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3256635766}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3709765256}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3335856583}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2273714493}) 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.487 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2632909031}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1495279087}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2078963348}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3705312671}) 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.488 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702012604}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.448+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3069268958}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2629761398}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.449+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1661089690}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1896369030}) 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.489 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=617194947}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4141504805}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1069462022}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1185151171}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1572374678}) 2024-08-19T11:21:32.490 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.450+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2607185053}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1615795203}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=404478783}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1735327727}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1141609090}) 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.491 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2887695036}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3224854378}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1421463633}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927295143}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.451+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=14710687}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.492 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3144234308}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1687653903}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3082565387}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2246236071}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2451524167}) 2024-08-19T11:21:32.493 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2277229400}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3321077137}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=647927659}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.452+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3972065296}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4185736851}) 2024-08-19T11:21:32.494 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1320153215}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4135071230}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1215496105}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2877031516}) 2024-08-19T11:21:32.495 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1261561000}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2290884542}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1988611181}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.453+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4161977051}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.454+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.454+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.454+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1858414730}) 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.454+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.496 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.454+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1347074444}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4032682729}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1045947638}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2212992015}) 2024-08-19T11:21:32.497 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4208958362}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=323635095}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950520607}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.455+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3951337025}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2808007227}) 2024-08-19T11:21:32.498 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=73329325}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3778891702}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2521896137}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=955820343}) 2024-08-19T11:21:32.499 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3497437996}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=586648396}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586885471}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.456+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2410446746}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1721786108}) 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.500 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3618485314}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1040279343}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2565882270}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2939547193}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1335299358}) 2024-08-19T11:21:32.501 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.457+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.458+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2706150902}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.458+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.458+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802790204}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.458+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=500969915}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1806269134}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3615171465}) 2024-08-19T11:21:32.502 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2021653154}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3812557060}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2804404785}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4225093573}) 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.503 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700539955}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=813733128}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.459+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1533909108}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1653214377}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2172790989}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.504 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3672233710}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1775570618}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1387275745}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=415371276}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=388599994}) 2024-08-19T11:21:32.505 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589173707}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.460+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2686023971}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2222761617}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2092648001}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.461+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2303415599}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.506 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=475405085}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=339854655}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=227145606}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3680137039}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=784506076}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.462+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3061301187}) 2024-08-19T11:21:32.507 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1617832630}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2006714028}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2443149655}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=922656378}) 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.508 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=727844753}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1902501907}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=792938677}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2867242224}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.463+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2867534066}) 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.509 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1816926361}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3857359643}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4027675798}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.464+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1665492849}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.510 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2677577894}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3273609791}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=580853981}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3039414866}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.465+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3258942356}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2701149181}) 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.511 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2481224876}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3753365096}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1286400818}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2335386150}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1489708375}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.512 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=459081340}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1872151247}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.466+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4194034715}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1140045160}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=657960829}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1755235049}) 2024-08-19T11:21:32.513 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1291848038}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2374909990}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3353133219}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3790464018}) 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.514 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882659072}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.467+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1170598550}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1964400923}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=96609721}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=510488559}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=131766849}) 2024-08-19T11:21:32.515 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2842846842}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2945319155}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1871397675}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659788502}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.469+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1141949308}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.516 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1402845738}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1071119943}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2569567218}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1029206860}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1304624702}) 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.517 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=975368228}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=631331974}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360506071}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.470+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=337192087}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1691245390}) 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.518 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=999266438}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3561084492}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3590942502}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3063346545}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.519 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2722792693}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4237057130}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=874306307}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.472+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3325823112}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1990434958}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2071376993}) 2024-08-19T11:21:32.520 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=26274529}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=160110737}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2612868726}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1177165612}) 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.521 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1649052897}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=260758740}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.474+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3822532759}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=220148256}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3413526869}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.522 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3130142754}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=654727161}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2552501395}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=953671993}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2126519716}) 2024-08-19T11:21:32.523 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.475+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.476+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1409972366}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.476+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3419111144}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4201413023}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1605167252}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3670471457}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.524 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2009167282}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3323846288}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3753609494}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2305697538}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=735667847}) 2024-08-19T11:21:32.525 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.477+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=863008373}) 2024-08-19T11:21:32.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.538+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fc73804b060 con 0x7fc73c0a6a30 2024-08-19T11:21:32.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.538+0000 7fc7327fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:32.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.538+0000 7fc7327fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2988531949}) 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=932969559}) 2024-08-19T11:21:32.556 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.553+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3942202683}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=225813701}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3775361348}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=835847429}) 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.557 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1286862972}) 2024-08-19T11:21:32.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:32.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1269636579}) 2024-08-19T11:21:32.558 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:32.554+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3356182453}) 2024-08-19T11:21:32.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.711+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc73c0a3ff0 con 0x7fc72003eab0 2024-08-19T11:21:32.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.712+0000 7fc7327fc640 1 -- 172.21.15.71:0/3552533945 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (secure 0 0 0) 0x7fc73c0a3ff0 con 0x7fc72003eab0 2024-08-19T11:21:32.714 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:21:32.714 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 >> v2:172.21.15.135:6800/726754104 conn(0x7fc72003eab0 msgr2=0x7fc720040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 --2- 172.21.15.71:0/3552533945 >> v2:172.21.15.135:6800/726754104 conn(0x7fc72003eab0 0x7fc720040f70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009560 tx=0x7fc72c008040 comp rx=0 tx=0).stop 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 10 monclient: shutdown 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 msgr2=0x7fc73c1273c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7380090b0 tx=0x7fc7380046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 shutdown_connections 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 --2- 172.21.15.71:0/3552533945 >> v2:172.21.15.135:6800/726754104 conn(0x7fc72003eab0 0x7fc720040f70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc73c0a6e10 0x7fc73c124e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fc73c139860 0x7fc73c125380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 --2- 172.21.15.71:0/3552533945 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fc73c0a6a30 0x7fc73c1273c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 >> 172.21.15.71:0/3552533945 conn(0x7fc73c0ac030 msgr2=0x7fc73c139060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:32.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 shutdown_connections 2024-08-19T11:21:32.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.714+0000 7fc744128640 1 -- 172.21.15.71:0/3552533945 wait complete. 2024-08-19T11:21:32.726 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":654,"stamp":"2024-08-19T11:21:32.318275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":180124,"kb_used_data":17956,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566050916,"statfs":{"total":579820584960,"available":579636137984,"internally_reserved":0,"allocated":18386944,"data_stored":9058899,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000924"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755911+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:21:26.755911+0000","last_peered":"2024-08-19T11:21:26.755911+0000","last_clean":"2024-08-19T11:21:26.755911+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:21:26.755911+0000","last_undegraded":"2024-08-19T11:21:26.755911+0000","last_fullsized":"2024-08-19T11:21:26.755911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":621,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:27.629065+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:21:27.629065+0000","last_peered":"2024-08-19T11:21:27.629065+0000","last_clean":"2024-08-19T11:21:27.629065+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:21:27.629065+0000","last_undegraded":"2024-08-19T11:21:27.629065+0000","last_fullsized":"2024-08-19T11:21:27.629065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":625,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755855+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:21:26.755855+0000","last_peered":"2024-08-19T11:21:26.755855+0000","last_clean":"2024-08-19T11:21:26.755855+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:21:26.755855+0000","last_undegraded":"2024-08-19T11:21:26.755855+0000","last_fullsized":"2024-08-19T11:21:26.755855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.757162+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:21:26.757162+0000","last_peered":"2024-08-19T11:21:26.757162+0000","last_clean":"2024-08-19T11:21:26.757162+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:21:26.757162+0000","last_undegraded":"2024-08-19T11:21:26.757162+0000","last_fullsized":"2024-08-19T11:21:26.757162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":630,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.756191+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:21:26.756191+0000","last_peered":"2024-08-19T11:21:26.756191+0000","last_clean":"2024-08-19T11:21:26.756191+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:21:26.756191+0000","last_undegraded":"2024-08-19T11:21:26.756191+0000","last_fullsized":"2024-08-19T11:21:26.756191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":626,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.754591+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:21:26.754591+0000","last_peered":"2024-08-19T11:21:26.754591+0000","last_clean":"2024-08-19T11:21:26.754591+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:21:26.754591+0000","last_undegraded":"2024-08-19T11:21:26.754591+0000","last_fullsized":"2024-08-19T11:21:26.754591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":623,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.757392+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:21:26.757392+0000","last_peered":"2024-08-19T11:21:26.757392+0000","last_clean":"2024-08-19T11:21:26.757392+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:21:26.757392+0000","last_undegraded":"2024-08-19T11:21:26.757392+0000","last_fullsized":"2024-08-19T11:21:26.757392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":626,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.755327+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:21:26.755327+0000","last_peered":"2024-08-19T11:21:26.755327+0000","last_clean":"2024-08-19T11:21:26.755327+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:21:26.755327+0000","last_undegraded":"2024-08-19T11:21:26.755327+0000","last_fullsized":"2024-08-19T11:21:26.755327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":716,"reported_epoch":321,"state":"active+clean","last_fresh":"2024-08-19T11:21:26.754565+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:21:26.754565+0000","last_peered":"2024-08-19T11:21:26.754565+0000","last_clean":"2024-08-19T11:21:26.754565+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:21:26.754565+0000","last_undegraded":"2024-08-19T11:21:26.754565+0000","last_fullsized":"2024-08-19T11:21:26.754565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640391,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30052,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341788,"statfs":{"total":96636764160,"available":96605990912,"internally_reserved":0,"allocated":3096576,"data_stored":1862689,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607687,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30044,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341796,"statfs":{"total":96636764160,"available":96605999104,"internally_reserved":0,"allocated":3084288,"data_stored":1332219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607687,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3035136,"data_stored":1333761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607687,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3035136,"data_stored":1333761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607686,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30052,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341788,"statfs":{"total":96636764160,"available":96605990912,"internally_reserved":0,"allocated":3096576,"data_stored":1862689,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607687,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29992,"kb_used_data":2968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341848,"statfs":{"total":96636764160,"available":96606052352,"internally_reserved":0,"allocated":3039232,"data_stored":1333780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:21:32.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T11:21:32.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.822+0000 7f9c40755640 10 monclient: get_monmap_and_config 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.822+0000 7f9c40755640 10 monclient: build_initial_monmap 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.822+0000 7f9c40755640 10 monclient: monmap: 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:32.823432+0000 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:32.823432+0000 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:32.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.823+0000 7f9c40755640 1 Processor -- start 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.823+0000 7f9c40755640 1 -- start start 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.823+0000 7f9c40755640 10 monclient: init 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient: _add_conns ranks=[5,7,8,3,9,1,2,0,4,10,6] 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a58d0 0x7f9c380a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): picked mon.noname-h con 0x7f9c380a58d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c380a61f0 0x7f9c381376f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): picked mon.noname-i con 0x7f9c380a61f0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 0x7f9c38138090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): picked mon.noname-e con 0x7f9c38137c30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9c380a0ea0 con 0x7f9c380a58d0 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f9c38073e90 con 0x7f9c380a61f0 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f9c38074170 con 0x7f9c38137c30 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c40755640 10 monclient(hunting): authenticate will time out at 1350.865171s 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 0x7f9c38138090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 0x7f9c38138090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55590/0 (socket says 172.21.15.71:55590) 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 -- 172.21.15.71:0/1749024890 learned_addr learned my addr 172.21.15.71:0/1749024890 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): get_auth_request con 0x7f9c38137c30 auth_method 0 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3e4f1640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a58d0 0x7f9c380a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_done global_id 124217 payload 274 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3dcf0640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c380a61f0 0x7f9c381376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 -- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c380a61f0 msgr2=0x7f9c381376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c380a61f0 0x7f9c381376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 -- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a58d0 msgr2=0x7f9c380a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a58d0 0x7f9c380a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient: _finish_hunting 0 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 monclient: found mon.noname-e 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3ecf2640 1 -- 172.21.15.71:0/1749024890 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380725b0 con 0x7f9c38137c30 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3e4f1640 10 monclient: get_auth_request con 0x7f9c380a58d0 auth_method 0 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3e4f1640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a58d0 0x7f9c380a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3dcf0640 10 monclient: get_auth_request con 0x7f9c380a61f0 auth_method 0 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.824+0000 7f9c3dcf0640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c380a61f0 0x7f9c381376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:32.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3ecf2640 1 -- 172.21.15.71:0/1749024890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 msgr2=0x7f9c38138090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3ecf2640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 0x7f9c38138090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009e80 tx=0x7f9c3002a660 comp rx=0 tx=0).ready entity=mon.8 client_cookie=ad3e0a58533d05fa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 1 -- 172.21.15.71:0/1749024890 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9c30036070 con 0x7f9c38137c30 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: dump: 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:32.836 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: _finish_auth 0 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: _check_auth_tickets 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 1 -- 172.21.15.71:0/1749024890 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c30007a70 con 0x7f9c38137c30 2024-08-19T11:21:32.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c40755640 5 monclient: authenticate success, global_id 124217 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c40755640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c40755640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 1 -- 172.21.15.71:0/1749024890 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9c30007c20 con 0x7f9c38137c30 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c40755640 4 set_mon_vals no callback set 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.827+0000 7f9c3d4ef640 10 monclient: dump: 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.838 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:32.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 10 monclient: shutdown 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 -- 172.21.15.71:0/1749024890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 msgr2=0x7f9c38138090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 0x7f9c38138090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009e80 tx=0x7f9c3002a660 comp rx=0 tx=0).stop 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 -- 172.21.15.71:0/1749024890 shutdown_connections 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f9c38137c30 0x7f9c38138090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f9c380a61f0 0x7f9c381376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 --2- 172.21.15.71:0/1749024890 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a58d0 0x7f9c380a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 -- 172.21.15.71:0/1749024890 >> 172.21.15.71:0/1749024890 conn(0x7f9c380aa4f0 msgr2=0x7f9c380a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 -- 172.21.15.71:0/1749024890 shutdown_connections 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 1 -- 172.21.15.71:0/1749024890 wait complete. 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 10 monclient: build_initial_monmap 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.828+0000 7f9c40755640 10 monclient: monmap: 2024-08-19T11:21:32.840 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:32.841 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 Processor -- start 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 -- start start 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient: init 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient: _add_conns ranks=[4,5,0,8,1,3,6,2,7] 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 0x7f9c381cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): picked mon.noname-c con 0x7f9c380a58d0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a61f0 0x7f9c38136900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): picked mon.noname-h con 0x7f9c380a61f0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:32.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38137c30 0x7f9c38136e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): picked mon.noname-a con 0x7f9c38137c30 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c38074600 con 0x7f9c38137c30 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f9c38071f30 con 0x7f9c380a58d0 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f9c380a7430 con 0x7f9c380a61f0 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c40755640 10 monclient(hunting): authenticate will time out at 1350.870660s 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 0x7f9c381cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 0x7f9c381cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38764/0 (socket says 172.21.15.71:38764) 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 1 -- 172.21.15.71:0/432723802 learned_addr learned my addr 172.21.15.71:0/432723802 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): get_auth_request con 0x7f9c380a58d0 auth_method 0 2024-08-19T11:21:32.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38137c30 0x7f9c38136e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): get_auth_request con 0x7f9c38137c30 auth_method 0 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a61f0 0x7f9c38136900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:32.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3ecf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): get_auth_request con 0x7f9c380a61f0 auth_method 0 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3dcf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.829+0000 7f9c3e4f1640 10 monclient(hunting): handle_auth_done global_id 85540 payload 824 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 1 -- 172.21.15.71:0/432723802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a61f0 msgr2=0x7f9c38136900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a61f0 0x7f9c38136900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 1 -- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38137c30 msgr2=0x7f9c38136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:32.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38137c30 0x7f9c38136e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 10 monclient: _finish_hunting 0 2024-08-19T11:21:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 1 monclient: found mon.noname-c 2024-08-19T11:21:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3e4f1640 1 -- 172.21.15.71:0/432723802 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c381242c0 con 0x7f9c380a58d0 2024-08-19T11:21:32.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.830+0000 7f9c3ecf2640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38137c30 0x7f9c38136e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:32.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c3e4f1640 1 -- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 msgr2=0x7f9c381cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:32.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c3e4f1640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 0x7f9c381cbec0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c7f0 tx=0x7f9c3400cbf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:32.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9c34015070 con 0x7f9c380a58d0 2024-08-19T11:21:32.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:32.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: dump: 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:32.849 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: _finish_auth 0 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 5 monclient: authenticate success, global_id 85540 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3400ce40 con 0x7f9c380a58d0 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:32.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 10 monclient: _renew_subs 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9c34011860 con 0x7f9c380a58d0 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c38137710 con 0x7f9c380a58d0 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c3ccee640 4 set_mon_vals no callback set 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c2effd640 10 monclient: dump: 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:32.851 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 10 monclient: _renew_subs 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:32.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.832+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c380a9b80 con 0x7f9c380a58d0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c40755640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c40755640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c40755640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c380a1810 con 0x7f9c380a58d0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9c34018070 con 0x7f9c380a58d0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c2effd640 1 --2- 172.21.15.71:0/432723802 >> v2:172.21.15.135:6800/726754104 conn(0x7f9c1c03ea80 0x7f9c1c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.833+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f9c34051a90 con 0x7f9c380a58d0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.834+0000 7f9c3dcf0640 1 --2- 172.21.15.71:0/432723802 >> v2:172.21.15.135:6800/726754104 conn(0x7f9c1c03ea80 0x7f9c1c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.834+0000 7f9c3dcf0640 10 monclient: get_auth_request con 0x7f9c1c03ea80 auth_method 0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.836+0000 7f9c3dcf0640 1 --2- 172.21.15.71:0/432723802 >> v2:172.21.15.135:6800/726754104 conn(0x7f9c1c03ea80 0x7f9c1c040f40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c38121bb0 tx=0x7f9c28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.838+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f9c34050980 con 0x7f9c380a58d0 2024-08-19T11:21:32.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.838+0000 7f9c2effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:32.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:32.838+0000 7f9c2effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:33.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.013+0000 7f9c40755640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:21:33.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.013+0000 7f9c40755640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:21:33.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.013+0000 7f9c40755640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:33.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.013+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c3806fe20 con 0x7f9c380a58d0 2024-08-19T11:21:33.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.014+0000 7f9c2effd640 1 -- 172.21.15.71:0/432723802 <== mon.4 v2:172.21.15.71:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v325) ==== 74+0+10854 (secure 0 0 0) 0x7f9c340113f0 con 0x7f9c380a58d0 2024-08-19T11:21:33.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.014+0000 7f9c2effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-08-19T11:21:33.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.014+0000 7f9c2effd640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:33.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:21:33.016 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":325,"fsid":"e00860b6-633c-4a91-b05e-d46659da1ed6","created":"2024-08-19T11:10:14.302002+0000","modified":"2024-08-19T11:21:31.032623+0000","last_up_change":"2024-08-19T11:10:28.285326+0000","last_in_change":"2024-08-19T11:10:20.171174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T11:10:28.605759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-08-19T11:10:35.665770+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4cd56453-bc2e-438f-a8b0-6ab2980ae8a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1867070009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6801","nonce":1867070009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6803","nonce":1867070009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1867070009}]},"public_addr":"172.21.15.71:6800/1867070009","cluster_addr":"172.21.15.71:6801/1867070009","heartbeat_back_addr":"172.21.15.71:6803/1867070009","heartbeat_front_addr":"172.21.15.71:6802/1867070009","state":["exists","up"]},{"osd":1,"uuid":"21f6bd64-11ab-44cb-b905-aadbedbf636f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":227121352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":227121352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":227121352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":227121352}]},"public_addr":"172.21.15.71:6804/227121352","cluster_addr":"172.21.15.71:6805/227121352","heartbeat_back_addr":"172.21.15.71:6807/227121352","heartbeat_front_addr":"172.21.15.71:6806/227121352","state":["exists","up"]},{"osd":2,"uuid":"94e08bf3-3063-40a2-98b7-d8ca5247b521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":80758171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":80758171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":80758171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":80758171}]},"public_addr":"172.21.15.71:6808/80758171","cluster_addr":"172.21.15.71:6809/80758171","heartbeat_back_addr":"172.21.15.71:6811/80758171","heartbeat_front_addr":"172.21.15.71:6810/80758171","state":["exists","up"]},{"osd":3,"uuid":"db4fe71c-7178-4d23-9459-aa91d3e27aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":3339144447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3339144447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3339144447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6807","nonce":3339144447}]},"public_addr":"172.21.15.135:6805/3339144447","cluster_addr":"172.21.15.135:6806/3339144447","heartbeat_back_addr":"172.21.15.135:6808/3339144447","heartbeat_front_addr":"172.21.15.135:6807/3339144447","state":["exists","up"]},{"osd":4,"uuid":"40bf3a44-e244-4a0c-92a9-83b53eca16cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":879361358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":879361358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":879361358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6811","nonce":879361358}]},"public_addr":"172.21.15.135:6809/879361358","cluster_addr":"172.21.15.135:6810/879361358","heartbeat_back_addr":"172.21.15.135:6812/879361358","heartbeat_front_addr":"172.21.15.135:6811/879361358","state":["exists","up"]},{"osd":5,"uuid":"942f3892-f798-41d8-ba74-498d61449191","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":2277825240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2277825240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2277825240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6803","nonce":2277825240}]},"public_addr":"172.21.15.135:6801/2277825240","cluster_addr":"172.21.15.135:6802/2277825240","heartbeat_back_addr":"172.21.15.135:6804/2277825240","heartbeat_front_addr":"172.21.15.135:6803/2277825240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.215895+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.920536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.414247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.789439+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:27.153740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T11:10:26.131984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T11:21:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 >> v2:172.21.15.135:6800/726754104 conn(0x7f9c1c03ea80 msgr2=0x7f9c1c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 --2- 172.21.15.71:0/432723802 >> v2:172.21.15.135:6800/726754104 conn(0x7f9c1c03ea80 0x7f9c1c040f40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c38121bb0 tx=0x7f9c28008040 comp rx=0 tx=0).stop 2024-08-19T11:21:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 10 monclient: shutdown 2024-08-19T11:21:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:33.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 msgr2=0x7f9c381cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 0x7f9c381cbec0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c7f0 tx=0x7f9c3400cbf0 comp rx=0 tx=0).stop 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 shutdown_connections 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 --2- 172.21.15.71:0/432723802 >> v2:172.21.15.135:6800/726754104 conn(0x7f9c1c03ea80 0x7f9c1c040f40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c38137c30 0x7f9c38136e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f9c380a61f0 0x7f9c38136900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 --2- 172.21.15.71:0/432723802 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f9c380a58d0 0x7f9c381cbec0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 >> 172.21.15.71:0/432723802 conn(0x7f9c380aa4f0 msgr2=0x7f9c381bf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 shutdown_connections 2024-08-19T11:21:33.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:33.016+0000 7f9c40755640 1 -- 172.21.15.71:0/432723802 wait complete. 2024-08-19T11:21:33.032 INFO:tasks.daemonwatchdog.daemon_watchdog:MonitorThrasher failed 2024-08-19T11:21:33.032 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/daemonwatchdog.py", line 42, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/daemonwatchdog.py", line 120, in watch thrasher.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-19T11:21:33.176 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1897943013}) 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3018084757}) 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4048933190}) 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2765264326}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=862857325}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1187564490}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.178 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3572162163}) 2024-08-19T11:21:33.179 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.179 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=751839092}) 2024-08-19T11:21:33.179 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.174+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2154761755}) 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3498884548}) 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1733581259}) 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3412106123}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2741509677}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4039881059}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=382268331}) 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=309730528}) 2024-08-19T11:21:33.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440597561}) 2024-08-19T11:21:33.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.181+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=993789505}) 2024-08-19T11:21:33.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=647992680}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2231693259}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1472328672}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.206+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2550252430}) 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1145323084}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=869196203}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=801139394}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=906414383}) 2024-08-19T11:21:33.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.207+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4200460375}) 2024-08-19T11:21:33.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.415 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2979836711}) 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1860615894}) 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4237812379}) 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.416 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2989530350}) 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2611625393}) 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3320116390}) 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.417 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3200365530}) 2024-08-19T11:21:33.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780483133}) 2024-08-19T11:21:33.418 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.413+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=709317810}) 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1924817847}) 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1003955618}) 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=127005800}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=785427470}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1933584837}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=706924434}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1899976587}) 2024-08-19T11:21:33.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2813280972}) 2024-08-19T11:21:33.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3203892459}) 2024-08-19T11:21:33.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.960+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.960+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.960+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2014048529}) 2024-08-19T11:21:33.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.960+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.991 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.960+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1229218269}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2990538550}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=429297232}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=650337130}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.992 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=460791770}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2628196115}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=837606512}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.961+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=896120443}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2486793018}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1250616919}) 2024-08-19T11:21:33.993 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3102601032}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3472194771}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2664417925}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2042232082}) 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.994 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2042825593}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3730289081}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.962+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1474873081}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1023281424}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3582288800}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3454824796}) 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.995 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1655421222}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1540177137}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=332826663}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.996 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3871595312}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3714410183}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.964+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2369322247}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3268795048}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2281239797}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2702379572}) 2024-08-19T11:21:33.997 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=718497467}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.965+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3568710865}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2568408416}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2379034477}) 2024-08-19T11:21:33.998 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1904386076}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.966+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2989451940}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2068250435}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2507537248}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:33.999 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2913311609}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2926519668}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1458059766}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=989053833}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:34.000 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285053539}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=277933241}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.967+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3674434453}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1667728331}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2916153085}) 2024-08-19T11:21:34.001 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4277137392}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1760380545}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=941391078}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.968+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2031117724}) 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.002 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3709248424}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189991855}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.969+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1560848059}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=829088476}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2196103309}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4200957555}) 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1287921200}) 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=384438918}) 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3689269625}) 2024-08-19T11:21:34.004 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935219333}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2507701174}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.970+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1182814624}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.971+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.971+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1890845909}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1546066339}) 2024-08-19T11:21:34.005 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4186332871}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=891297762}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1385714044}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1881303006}) 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.006 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4128143576}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3460961565}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.972+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4215661060}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=236384228}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3330106976}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1582511113}) 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4154101820}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=193722762}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=340428295}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2398485824}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1602159807}) 2024-08-19T11:21:34.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.973+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1840140916}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3649790823}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1660331027}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1767290635}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3196450552}) 2024-08-19T11:21:34.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2500400825}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1852151577}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2278660057}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250972484}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.975+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=822937045}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1073099398}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4020630696}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=948422637}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3137517832}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.976+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=138583780}) 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1633669684}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2768748746}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3554692075}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.977+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=604467040}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1792534313}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1918809634}) 2024-08-19T11:21:34.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1171215475}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=758061208}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1780605283}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=5478992}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4255154523}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2873364960}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.978+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2452022315}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.979+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.979+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.979+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4072232567}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1557520780}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1231770173}) 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1581453912}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2719361578}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3977017519}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2673192307}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681861255}) 2024-08-19T11:21:34.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.980+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3960294022}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3822818530}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2628142848}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1595596632}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1732197456}) 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2473818085}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3491695386}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390958681}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2680892841}) 2024-08-19T11:21:34.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:33.981+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1615349824}) 2024-08-19T11:21:34.029 INFO:tasks.ceph:Scrubbing osd.0 2024-08-19T11:21:34.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.131+0000 7f6084daa640 10 monclient: get_monmap_and_config 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.131+0000 7f6084daa640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.131+0000 7f6084daa640 10 monclient: monmap: 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:34.131833+0000 2024-08-19T11:21:34.132 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:34.131833+0000 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.133 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:34.134 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:34.134 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.131+0000 7f6084daa640 1 Processor -- start 2024-08-19T11:21:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 1 -- start start 2024-08-19T11:21:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient: init 2024-08-19T11:21:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient: _add_conns ranks=[1,9,3,5,4,2,7,10,0,8,6] 2024-08-19T11:21:34.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f60800a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60800a7520 0x7f608013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): picked mon.noname-a con 0x7f60800a7520 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f6080140f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): picked mon.noname-g con 0x7f60800a7920 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60800a8910 con 0x7f60800a6a30 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f60800a3800 con 0x7f60800a7520 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f608006d1c0 con 0x7f60800a7920 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6084daa640 10 monclient(hunting): authenticate will time out at 1352.173544s 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60800a7520 0x7f608013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60800a7520 0x7f608013ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46294/0 (socket says 172.21.15.71:46294) 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 -- 172.21.15.71:0/3628052926 learned_addr learned my addr 172.21.15.71:0/3628052926 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): get_auth_request con 0x7f60800a7520 auth_method 0 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f607ed9d640 1 --2- 172.21.15.71:0/3628052926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f6080140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient(hunting): handle_auth_done global_id 76050 payload 274 2024-08-19T11:21:34.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 -- 172.21.15.71:0/3628052926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 msgr2=0x7f6080140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 --2- 172.21.15.71:0/3628052926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f6080140f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 -- 172.21.15.71:0/3628052926 >> v1:172.21.15.135:6789/0 conn(0x7f60800a6a30 legacy=0x7f60800a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.132+0000 7f6077fff640 1 -- 172.21.15.71:0/3628052926 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60800a2fc0 con 0x7f60800a7520 2024-08-19T11:21:34.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.135+0000 7f6077fff640 1 -- 172.21.15.71:0/3628052926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 msgr2=0x7f608013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.135+0000 7f6077fff640 1 --2- 172.21.15.71:0/3628052926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f608013ea30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84eee4e92c33ba40 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.135+0000 7f607dd9b640 1 -- 172.21.15.71:0/3628052926 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6068037070 con 0x7f60800a7520 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.135+0000 7f607dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: dump: 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.146 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 1 -- 172.21.15.71:0/3628052926 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60680307b0 con 0x7f60800a7520 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 5 monclient: authenticate success, global_id 76050 2024-08-19T11:21:34.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 4 set_mon_vals no callback set 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 1 -- 172.21.15.71:0/3628052926 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6068030dd0 con 0x7f60800a7520 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f607dd9b640 10 monclient: dump: 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.148 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 10 monclient: shutdown 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 -- 172.21.15.71:0/3628052926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 msgr2=0x7f608013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 --2- 172.21.15.71:0/3628052926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f608013ea30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606802a130 comp rx=0 tx=0).stop 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 -- 172.21.15.71:0/3628052926 shutdown_connections 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 --2- 172.21.15.71:0/3628052926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f6080140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 --2- 172.21.15.71:0/3628052926 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f608013ea30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 -- 172.21.15.71:0/3628052926 >> 172.21.15.71:0/3628052926 conn(0x7f60800ac030 msgr2=0x7f60800ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 -- 172.21.15.71:0/3628052926 shutdown_connections 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.136+0000 7f6084daa640 1 -- 172.21.15.71:0/3628052926 wait complete. 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.137+0000 7f6084daa640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.137+0000 7f6084daa640 10 monclient: monmap: 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:34.150 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.151 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.137+0000 7f6084daa640 1 Processor -- start 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.137+0000 7f6084daa640 1 -- start start 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.137+0000 7f6084daa640 10 monclient: init 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient: _add_conns ranks=[4,0,3,7,8,6,1,5,2] 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60800a6a30 0x7f6080125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): picked mon.noname-c con 0x7f60800a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f6080122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): picked mon.noname-a con 0x7f60800a7520 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f60801232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): picked mon.noname-g con 0x7f60800a7920 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f60800a5990 con 0x7f60800a7520 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f60800a5140 con 0x7f60800a7920 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f60801414c0 con 0x7f60800a6a30 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6084daa640 10 monclient(hunting): authenticate will time out at 1352.179216s 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f6080122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60800a6a30 0x7f6080125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f6080122d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46310/0 (socket says 172.21.15.71:46310) 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 -- 172.21.15.71:0/1244794057 learned_addr learned my addr 172.21.15.71:0/1244794057 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): get_auth_request con 0x7f60800a7520 auth_method 0 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): get_auth_request con 0x7f60800a6a30 auth_method 0 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607ed9d640 1 --2- 172.21.15.71:0/1244794057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f60801232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607ed9d640 10 monclient(hunting): get_auth_request con 0x7f60800a7920 auth_method 0 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f607ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient(hunting): handle_auth_done global_id 76059 payload 824 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 -- 172.21.15.71:0/1244794057 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60800a6a30 msgr2=0x7f6080125220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 --2- 172.21.15.71:0/1244794057 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f60800a6a30 0x7f6080125220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 -- 172.21.15.71:0/1244794057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 msgr2=0x7f60801232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 --2- 172.21.15.71:0/1244794057 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f60800a7920 0x7f60801232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.138+0000 7f6077fff640 1 -- 172.21.15.71:0/1244794057 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6080126a20 con 0x7f60800a7520 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.140+0000 7f6077fff640 1 -- 172.21.15.71:0/1244794057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 msgr2=0x7f6080122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.140+0000 7f6077fff640 1 --2- 172.21.15.71:0/1244794057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f6080122d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f60680097c0 tx=0x7f60680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.140+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6068042070 con 0x7f60800a7520 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: dump: 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.156 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 5 monclient: authenticate success, global_id 76059 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6068030b70 con 0x7f60800a7520 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f6068037040 con 0x7f60800a7520 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 10 monclient: _renew_subs 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60800a9530 con 0x7f60800a7520 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f607d59a640 4 set_mon_vals no callback set 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6076ffd640 10 monclient: dump: 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.158 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.159 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 10 monclient: _renew_subs 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608013c540 con 0x7f60800a7520 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.141+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6080140430 con 0x7f60800a7520 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f6068003610 con 0x7f60800a7520 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.135:6800/726754104 conn(0x7f606003ea80 0x7f6060040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f6068071490 con 0x7f60800a7520 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.71:6800/1867070009 conn(0x7f6060044590 0x7f60600469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 --> v2:172.21.15.71:6800/1867070009 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6068035e70 con 0x7f6060044590 2024-08-19T11:21:34.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (secure 0 0 0) 0x7f6068078050 con 0x7f60800a7520 2024-08-19T11:21:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f6076ffd640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-08-19T11:21:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f607ed9d640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.71:6800/1867070009 conn(0x7f6060044590 0x7f60600469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f607ed9d640 10 monclient: get_auth_request con 0x7f6060044590 auth_method 0 2024-08-19T11:21:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f607e59c640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.135:6800/726754104 conn(0x7f606003ea80 0x7f6060040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.142+0000 7f607e59c640 10 monclient: get_auth_request con 0x7f606003ea80 auth_method 0 2024-08-19T11:21:34.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.145+0000 7f607e59c640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.135:6800/726754104 conn(0x7f606003ea80 0x7f6060040f40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6070004f60 tx=0x7f6070007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.147+0000 7f607ed9d640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.71:6800/1867070009 conn(0x7f6060044590 0x7f60600469b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.147+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== osd.0 v2:172.21.15.71:6800/1867070009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6068035e70 con 0x7f6060044590 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 --> v2:172.21.15.71:6800/1867070009 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6080077950 con 0x7f6060044590 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6076ffd640 1 -- 172.21.15.71:0/1244794057 <== osd.0 v2:172.21.15.71:6800/1867070009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6080077950 con 0x7f6060044590 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T11:21:34.162 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:34.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 >> v2:172.21.15.71:6800/1867070009 conn(0x7f6060044590 msgr2=0x7f60600469b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.71:6800/1867070009 conn(0x7f6060044590 0x7f60600469b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 >> v2:172.21.15.135:6800/726754104 conn(0x7f606003ea80 msgr2=0x7f6060040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 --2- 172.21.15.71:0/1244794057 >> v2:172.21.15.135:6800/726754104 conn(0x7f606003ea80 0x7f6060040f40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6070004f60 tx=0x7f6070007e30 comp rx=0 tx=0).stop 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 10 monclient: shutdown 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 msgr2=0x7f6080122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 --2- 172.21.15.71:0/1244794057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60800a7520 0x7f6080122d90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f60680097c0 tx=0x7f60680046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f607ed9d640 1 -- 172.21.15.71:0/1244794057 reap_dead start 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 shutdown_connections 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 >> 172.21.15.71:0/1244794057 conn(0x7f60800ac030 msgr2=0x7f608013fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 shutdown_connections 2024-08-19T11:21:34.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.160+0000 7f6084daa640 1 -- 172.21.15.71:0/1244794057 wait complete. 2024-08-19T11:21:34.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-19T11:21:34.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4017501931}) 2024-08-19T11:21:34.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2037906675}) 2024-08-19T11:21:34.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=668847725}) 2024-08-19T11:21:34.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2777342425}) 2024-08-19T11:21:34.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=310656609}) 2024-08-19T11:21:34.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1324231511}) 2024-08-19T11:21:34.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4187251356}) 2024-08-19T11:21:34.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3030509307}) 2024-08-19T11:21:34.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4151950331}) 2024-08-19T11:21:34.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2080968517}) 2024-08-19T11:21:34.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2504011890}) 2024-08-19T11:21:34.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1978160558}) 2024-08-19T11:21:34.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1544139275}) 2024-08-19T11:21:34.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=682154802}) 2024-08-19T11:21:34.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3119556322}) 2024-08-19T11:21:34.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3852378435}) 2024-08-19T11:21:34.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=78587906}) 2024-08-19T11:21:34.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.211+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1544782130}) 2024-08-19T11:21:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.278+0000 7fce8489f640 10 monclient: get_monmap_and_config 2024-08-19T11:21:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.278+0000 7fce8489f640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.278+0000 7fce8489f640 10 monclient: monmap: 2024-08-19T11:21:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.279 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:34.278797+0000 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:34.278797+0000 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.280 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.281 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.281 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:34.281 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:34.281 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.278+0000 7fce8489f640 1 Processor -- start 2024-08-19T11:21:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.278+0000 7fce8489f640 1 -- start start 2024-08-19T11:21:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.278+0000 7fce8489f640 10 monclient: init 2024-08-19T11:21:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient: _add_conns ranks=[5,9,1,0,7,10,8,2,3,4,6] 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce8009b5a0 0x7fce800a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): picked mon.noname-h con 0x7fce8009b5a0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce8009b980 0x7fce800a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): picked mon.noname-a con 0x7fce8009b980 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fce8009bd60 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce800a00f0 con 0x7fce8009bd60 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7fce80069620 con 0x7fce8009b980 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fce800a09e0 con 0x7fce8009b5a0 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce8489f640 10 monclient(hunting): authenticate will time out at 1352.320558s 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce8009b980 0x7fce800a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce8009b980 0x7fce800a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:46336/0 (socket says 172.21.15.71:46336) 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 -- 172.21.15.71:0/3369877043 learned_addr learned my addr 172.21.15.71:0/3369877043 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): get_auth_request con 0x7fce8009b980 auth_method 0 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 1 --2- 172.21.15.71:0/3369877043 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce8009b5a0 0x7fce800a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): get_auth_request con 0x7fce8009b5a0 auth_method 0 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_done global_id 76068 payload 274 2024-08-19T11:21:34.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 -- 172.21.15.71:0/3369877043 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce8009b5a0 msgr2=0x7fce800a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 --2- 172.21.15.71:0/3369877043 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce8009b5a0 0x7fce800a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 -- 172.21.15.71:0/3369877043 >> v1:172.21.15.135:6789/0 conn(0x7fce8009bd60 legacy=0x7fce800a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 monclient: found mon.noname-a 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.279+0000 7fce7dd9b640 1 -- 172.21.15.71:0/3369877043 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce800693a0 con 0x7fce8009b980 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7dd9b640 1 -- 172.21.15.71:0/3369877043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8009b980 msgr2=0x7fce800a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7dd9b640 1 --2- 172.21.15.71:0/3369877043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8009b980 0x7fce800a3d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fce68009870 tx=0x7fce6802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3427992a56d3be95 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 1 -- 172.21.15.71:0/3369877043 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce68037070 con 0x7fce8009b980 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: dump: 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.295 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 1 -- 172.21.15.71:0/3369877043 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6802ae00 con 0x7fce8009b980 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 1 -- 172.21.15.71:0/3369877043 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce68030c20 con 0x7fce8009b980 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce8489f640 5 monclient: authenticate success, global_id 76068 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce8489f640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:34.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce8489f640 4 set_mon_vals no callback set 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.282+0000 7fce7d59a640 10 monclient: dump: 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.297 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 10 monclient: shutdown 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 -- 172.21.15.71:0/3369877043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8009b980 msgr2=0x7fce800a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 --2- 172.21.15.71:0/3369877043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8009b980 0x7fce800a3d80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fce68009870 tx=0x7fce6802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 -- 172.21.15.71:0/3369877043 shutdown_connections 2024-08-19T11:21:34.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 --2- 172.21.15.71:0/3369877043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8009b980 0x7fce800a3d80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 --2- 172.21.15.71:0/3369877043 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fce8009b5a0 0x7fce800a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 -- 172.21.15.71:0/3369877043 >> 172.21.15.71:0/3369877043 conn(0x7fce800a4e70 msgr2=0x7fce800a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 -- 172.21.15.71:0/3369877043 shutdown_connections 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.283+0000 7fce8489f640 1 -- 172.21.15.71:0/3369877043 wait complete. 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.284+0000 7fce8489f640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.284+0000 7fce8489f640 10 monclient: monmap: 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.299 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.284+0000 7fce8489f640 1 Processor -- start 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.284+0000 7fce8489f640 1 -- start start 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.284+0000 7fce8489f640 10 monclient: init 2024-08-19T11:21:34.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient: _add_conns ranks=[2,7,8,6,1,3,0,4,5] 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 0x7fce80094c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): picked mon.noname-b con 0x7fce8009b5a0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fce8009b980 0x7fce80092770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): picked mon.noname-i con 0x7fce8009b980 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 0x7fce80092cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): picked mon.noname-e con 0x7fce8009bd60 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fce8009f870 con 0x7fce8009b5a0 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fce800a5db0 con 0x7fce8009b980 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fce800a49d0 con 0x7fce8009bd60 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce8489f640 10 monclient(hunting): authenticate will time out at 1352.326225s 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 0x7fce80094c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 0x7fce80092cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 0x7fce80094c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:48120/0 (socket says 172.21.15.71:48120) 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 1 -- 172.21.15.71:0/1645824976 learned_addr learned my addr 172.21.15.71:0/1645824976 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): get_auth_request con 0x7fce8009b5a0 auth_method 0 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): get_auth_request con 0x7fce8009bd60 auth_method 0 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fce8009b980 0x7fce80092770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): get_auth_request con 0x7fce8009b980 auth_method 0 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient(hunting): handle_auth_done global_id 124226 payload 824 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 -- 172.21.15.71:0/1645824976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fce8009b980 msgr2=0x7fce80092770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fce8009b980 0x7fce80092770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 -- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 msgr2=0x7fce80094c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 0x7fce80094c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 monclient: found mon.noname-e 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:34.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7ed9d640 1 -- 172.21.15.71:0/1645824976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80096190 con 0x7fce8009bd60 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.285+0000 7fce7e59c640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 0x7fce80094c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.287+0000 7fce7ed9d640 1 -- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 msgr2=0x7fce80092cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.287+0000 7fce7ed9d640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 0x7fce80092cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce7800b410 tx=0x7fce7800b8d0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.287+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce78015020 con 0x7fce8009bd60 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: dump: 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.305 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 5 monclient: authenticate success, global_id 124226 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce78011cb0 con 0x7fce8009bd60 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fce78011e60 con 0x7fce8009bd60 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 10 monclient: _renew_subs 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce80096470 con 0x7fce8009bd60 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce7cd99640 4 set_mon_vals no callback set 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 10 monclient: dump: 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.307 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.308 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 10 monclient: _renew_subs 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fce80095600 con 0x7fce8009bd60 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.288+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fce78018020 con 0x7fce8009bd60 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce76ffd640 1 --2- 172.21.15.71:0/1645824976 >> v2:172.21.15.135:6800/726754104 conn(0x7fce6003ea80 0x7fce60040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce8489f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce8489f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce8489f640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7fce780515a0 con 0x7fce8009bd60 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce800a4230 con 0x7fce8009bd60 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce7e59c640 1 --2- 172.21.15.71:0/1645824976 >> v2:172.21.15.135:6800/726754104 conn(0x7fce6003ea80 0x7fce60040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.289+0000 7fce7e59c640 10 monclient: get_auth_request con 0x7fce6003ea80 auth_method 0 2024-08-19T11:21:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.291+0000 7fce7e59c640 1 --2- 172.21.15.71:0/1645824976 >> v2:172.21.15.135:6800/726754104 conn(0x7fce6003ea80 0x7fce60040f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce70009a40 tx=0x7fce7000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.293+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fce800a4230 con 0x7fce8009bd60 2024-08-19T11:21:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.293+0000 7fce76ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:34.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.293+0000 7fce76ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:34.321 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=710413541}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4055707508}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785087269}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.322 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2483933486}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2763784004}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=980358358}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3579036741}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=303115443}) 2024-08-19T11:21:34.323 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.319+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=73489965}) 2024-08-19T11:21:34.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.471+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fce800a04a0 con 0x7fce6003ea80 2024-08-19T11:21:34.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.471+0000 7fce76ffd640 1 -- 172.21.15.71:0/1645824976 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fce800a04a0 con 0x7fce6003ea80 2024-08-19T11:21:34.473 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 >> v2:172.21.15.135:6800/726754104 conn(0x7fce6003ea80 msgr2=0x7fce60040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 --2- 172.21.15.71:0/1645824976 >> v2:172.21.15.135:6800/726754104 conn(0x7fce6003ea80 0x7fce60040f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce70009a40 tx=0x7fce7000b040 comp rx=0 tx=0).stop 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 10 monclient: shutdown 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 msgr2=0x7fce80092cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 0x7fce80092cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce7800b410 tx=0x7fce7800b8d0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 shutdown_connections 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 --2- 172.21.15.71:0/1645824976 >> v2:172.21.15.135:6800/726754104 conn(0x7fce6003ea80 0x7fce60040f40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fce8009bd60 0x7fce80092cb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fce8009b980 0x7fce80092770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 --2- 172.21.15.71:0/1645824976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fce8009b5a0 0x7fce80094c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 >> 172.21.15.71:0/1645824976 conn(0x7fce800a4e70 msgr2=0x7fce800a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 shutdown_connections 2024-08-19T11:21:34.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.474+0000 7fce8489f640 1 -- 172.21.15.71:0/1645824976 wait complete. 2024-08-19T11:21:34.485 INFO:tasks.ceph:Scrubbing osd.1 2024-08-19T11:21:34.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-19T11:21:34.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.627+0000 7fde063ba640 10 monclient: get_monmap_and_config 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.627+0000 7fde063ba640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.627+0000 7fde063ba640 10 monclient: monmap: 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:34.628469+0000 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:34.628469+0000 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.629 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:34.630 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.628+0000 7fde063ba640 1 Processor -- start 2024-08-19T11:21:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.628+0000 7fde063ba640 1 -- start start 2024-08-19T11:21:34.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.628+0000 7fde063ba640 10 monclient: init 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient: _add_conns ranks=[1,8,10,6,0,9,4,2,5,7,3] 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fde000a6a30 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 0x7fde0013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): picked mon.noname-e con 0x7fde000a7520 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fde000a7920 0x7fde00140f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): picked mon.noname-f con 0x7fde000a7920 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde000a8910 con 0x7fde000a6a30 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fde000a3800 con 0x7fde000a7920 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fde0006d1c0 con 0x7fde000a7520 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde063ba640 10 monclient(hunting): authenticate will time out at 1352.670129s 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 0x7fde0013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 0x7fde0013ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55618/0 (socket says 172.21.15.71:55618) 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 -- 172.21.15.71:0/1725301595 learned_addr learned my addr 172.21.15.71:0/1725301595 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): get_auth_request con 0x7fde000a7520 auth_method 0 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde04957640 1 --2- 172.21.15.71:0/1725301595 >> v2:172.21.15.135:3300/0 conn(0x7fde000a7920 0x7fde00140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde04957640 10 monclient(hunting): get_auth_request con 0x7fde000a7920 auth_method 0 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde04957640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde04957640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde04957640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient(hunting): handle_auth_done global_id 124235 payload 274 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 -- 172.21.15.71:0/1725301595 >> v2:172.21.15.135:3300/0 conn(0x7fde000a7920 msgr2=0x7fde00140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 --2- 172.21.15.71:0/1725301595 >> v2:172.21.15.135:3300/0 conn(0x7fde000a7920 0x7fde00140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 -- 172.21.15.71:0/1725301595 >> v1:172.21.15.135:6789/0 conn(0x7fde000a6a30 legacy=0x7fde000a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 monclient: found mon.noname-e 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fddff7fe640 1 -- 172.21.15.71:0/1725301595 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde000a2fc0 con 0x7fde000a7520 2024-08-19T11:21:34.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.629+0000 7fde04957640 1 --2- 172.21.15.71:0/1725301595 >> v2:172.21.15.135:3300/0 conn(0x7fde000a7920 0x7fde00140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddff7fe640 1 -- 172.21.15.71:0/1725301595 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 msgr2=0x7fde0013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddff7fe640 1 --2- 172.21.15.71:0/1725301595 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 0x7fde0013ea30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fddf40098a0 tx=0x7fddf402a150 comp rx=0 tx=0).ready entity=mon.8 client_cookie=567d48131c1b77c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 1 -- 172.21.15.71:0/1725301595 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fddf4037070 con 0x7fde000a7520 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: dump: 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.638 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 1 -- 172.21.15.71:0/1725301595 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf40307b0 con 0x7fde000a7520 2024-08-19T11:21:34.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 5 monclient: authenticate success, global_id 124235 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 1 -- 172.21.15.71:0/1725301595 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fddf4030e10 con 0x7fde000a7520 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 4 set_mon_vals no callback set 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fddfeffd640 10 monclient: dump: 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.640 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 10 monclient: shutdown 2024-08-19T11:21:34.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 1 -- 172.21.15.71:0/1725301595 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 msgr2=0x7fde0013ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.632+0000 7fde063ba640 1 --2- 172.21.15.71:0/1725301595 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 0x7fde0013ea30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fddf40098a0 tx=0x7fddf402a150 comp rx=0 tx=0).stop 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 -- 172.21.15.71:0/1725301595 shutdown_connections 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 --2- 172.21.15.71:0/1725301595 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a7520 0x7fde0013ea30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 --2- 172.21.15.71:0/1725301595 >> v2:172.21.15.135:3300/0 conn(0x7fde000a7920 0x7fde00140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 -- 172.21.15.71:0/1725301595 >> 172.21.15.71:0/1725301595 conn(0x7fde000ac030 msgr2=0x7fde000ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 -- 172.21.15.71:0/1725301595 shutdown_connections 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 -- 172.21.15.71:0/1725301595 wait complete. 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 10 monclient: monmap: 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:34.642 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.643 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.633+0000 7fde063ba640 1 Processor -- start 2024-08-19T11:21:34.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 -- start start 2024-08-19T11:21:34.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient: init 2024-08-19T11:21:34.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient: _add_conns ranks=[8,3,7,4,6,5,1,2,0] 2024-08-19T11:21:34.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): picked mon.noname-e con 0x7fde000a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde000a7520 0x7fde001cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): picked mon.noname-g con 0x7fde000a7520 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde000a7920 0x7fde00138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): picked mon.noname-i con 0x7fde000a7920 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde000a5990 con 0x7fde000a7520 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7fde000a5140 con 0x7fde000a7920 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fde001414c0 con 0x7fde000a6a30 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fde063ba640 10 monclient(hunting): authenticate will time out at 1352.675610s 2024-08-19T11:21:34.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:55620/0 (socket says 172.21.15.71:55620) 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 learned_addr learned my addr 172.21.15.71:0/610620815 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): get_auth_request con 0x7fde000a6a30 auth_method 0 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient(hunting): handle_auth_done global_id 124244 payload 824 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde000a7920 msgr2=0x7fde00138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7fde000a7920 0x7fde00138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde000a7520 msgr2=0x7fde001cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde000a7520 0x7fde001cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 monclient: found mon.noname-e 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.634+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde000a9630 con 0x7fde000a6a30 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.635+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 msgr2=0x7fde000a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.635+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 msgr2=0x7fde000a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.635+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7fddf000c460 tx=0x7fddf000c920 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:34.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.635+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient: get_auth_request con 0x7fde000a6a30 auth_method 0 2024-08-19T11:21:34.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 0 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient: ms_handle_reset current mon [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 msgr2=0x7fde000a15f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fde000a6a30 0x7fde000a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient: _add_conns ranks=[0,6,5,2,4,1] 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 0x7fddec005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): picked mon.noname-a con 0x7fddec0035d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fddec0065c0 0x7fddec008a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): picked mon.noname-d con 0x7fddec0065c0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fddec009630 0x7fddec00baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): picked mon.noname-h con 0x7fddec009630 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:34.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fddec00c6e0 con 0x7fddec0035d0 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7fddec00c860 con 0x7fddec009630 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fddec00ca60 con 0x7fddec0065c0 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfcff9640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 0x7fddec005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fddec0065c0 0x7fddec008a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): get_auth_request con 0x7fddec0035d0 auth_method 0 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:34.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): get_auth_request con 0x7fddec0065c0 auth_method 0 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddfffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.836+0000 7fddff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 10 monclient(hunting): handle_auth_done global_id 124244 payload 293 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fddec0065c0 msgr2=0x7fddec008a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fddec0065c0 0x7fddec008a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fddec009630 msgr2=0x7fddec00baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7fddec009630 0x7fddec00baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 1 monclient: found mon.noname-a 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fde04957640 1 -- 172.21.15.71:0/610620815 reap_dead start 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddec00cd20 con 0x7fddec0035d0 2024-08-19T11:21:34.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.837+0000 7fddff7fe640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fddec0065c0 0x7fddec008a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:34.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfffff640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 msgr2=0x7fddec005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfffff640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 0x7fddec005a20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fde00123300 tx=0x7fddf0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fddf0012880 con 0x7fddec0035d0 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: dump: 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.846 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf0022070 con 0x7fddec0035d0 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 5 monclient: authenticate success, global_id 124244 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 10 monclient: _renew_subs 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fddf001dd40 con 0x7fddec0035d0 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde000a2630 con 0x7fddec0035d0 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfcff9640 10 monclient: dump: 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.848 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fddfe7fc640 4 set_mon_vals no callback set 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 10 monclient: _renew_subs 2024-08-19T11:21:34.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.839+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde000a0a90 con 0x7fddec0035d0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.840+0000 7fde063ba640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.840+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde00069870 con 0x7fddec0035d0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.840+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fddf001b070 con 0x7fddec0035d0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddfcff9640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.135:6800/726754104 conn(0x7fddec043300 0x7fddec0457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7fddf0018050 con 0x7fddec0035d0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddfcff9640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.71:6804/227121352 conn(0x7fddec048d90 0x7fddec04b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 --> v2:172.21.15.71:6804/227121352 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddec04b820 con 0x7fddec048d90 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (secure 0 0 0) 0x7fddf0059050 con 0x7fddec0035d0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddfcff9640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fde04957640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.71:6804/227121352 conn(0x7fddec048d90 0x7fddec04b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fde04957640 10 monclient: get_auth_request con 0x7fddec048d90 auth_method 0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddff7fe640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.135:6800/726754104 conn(0x7fddec043300 0x7fddec0457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.841+0000 7fddff7fe640 10 monclient: get_auth_request con 0x7fddec043300 auth_method 0 2024-08-19T11:21:34.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.844+0000 7fddff7fe640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.135:6800/726754104 conn(0x7fddec043300 0x7fddec0457c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fde0006eb70 tx=0x7fddf402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.845+0000 7fde04957640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.71:6804/227121352 conn(0x7fddec048d90 0x7fddec04b1b0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.846+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== osd.1 v2:172.21.15.71:6804/227121352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddec04b820 con 0x7fddec048d90 2024-08-19T11:21:34.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.858+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 --> v2:172.21.15.71:6804/227121352 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fde001234a0 con 0x7fddec048d90 2024-08-19T11:21:34.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.858+0000 7fddfcff9640 1 -- 172.21.15.71:0/610620815 <== osd.1 v2:172.21.15.71:6804/227121352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fddf8009790 con 0x7fddec048d90 2024-08-19T11:21:34.859 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:34.860 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T11:21:34.860 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 >> v2:172.21.15.71:6804/227121352 conn(0x7fddec048d90 msgr2=0x7fddec04b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.71:6804/227121352 conn(0x7fddec048d90 0x7fddec04b1b0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 >> v2:172.21.15.135:6800/726754104 conn(0x7fddec043300 msgr2=0x7fddec0457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.135:6800/726754104 conn(0x7fddec043300 0x7fddec0457c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fde0006eb70 tx=0x7fddf402c000 comp rx=0 tx=0).stop 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 10 monclient: shutdown 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 msgr2=0x7fddec005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 0x7fddec005a20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fde00123300 tx=0x7fddf0007ef0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 shutdown_connections 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.71:6804/227121352 conn(0x7fddec048d90 0x7fddec04b1b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 --2- 172.21.15.71:0/610620815 >> v2:172.21.15.135:6800/726754104 conn(0x7fddec043300 0x7fddec0457c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 --2- 172.21.15.71:0/610620815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddec0035d0 0x7fddec005a20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 >> 172.21.15.71:0/610620815 conn(0x7fde000ac030 msgr2=0x7fde0013ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 shutdown_connections 2024-08-19T11:21:34.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.859+0000 7fde063ba640 1 -- 172.21.15.71:0/610620815 wait complete. 2024-08-19T11:21:34.870 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-19T11:21:34.961 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1401880816}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2250791273}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3885990818}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.955+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2626997730}) 2024-08-19T11:21:34.962 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2709967430}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1969536161}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3187900978}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=54550657}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.956+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3679056827}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.963 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3752169933}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2477396858}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3099908530}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1387834090}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2452971182}) 2024-08-19T11:21:34.964 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2995057511}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=85681601}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316225103}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.957+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4009752672}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3858710505}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.965 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2322869347}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1267448117}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3757163240}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2954749988}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=130445517}) 2024-08-19T11:21:34.966 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724430665}) 2024-08-19T11:21:34.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:34.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1709983598}) 2024-08-19T11:21:34.967 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:34.959+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2743423521}) 2024-08-19T11:21:34.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.970+0000 7fccbef04640 10 monclient: get_monmap_and_config 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.970+0000 7fccbef04640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.970+0000 7fccbef04640 10 monclient: monmap: 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:34.970687+0000 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:34.970687+0000 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.971 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:34.972 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.970+0000 7fccbef04640 1 Processor -- start 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.970+0000 7fccbef04640 1 -- start start 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.970+0000 7fccbef04640 10 monclient: init 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient: _add_conns ranks=[6,2,4,7,9,10,5,8,1,0,3] 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 0x7fccb80a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): picked mon.noname-d con 0x7fccb80a3c30 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a4550 0x7fccb8139970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): picked mon.noname-b con 0x7fccb80a4550 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb813a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): picked mon.noname-c con 0x7fccb8139eb0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80a5000 con 0x7fccb80a4550 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fccb80a13b0 con 0x7fccb8139eb0 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fccb80a0b10 con 0x7fccb80a3c30 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbef04640 10 monclient(hunting): authenticate will time out at 1353.012437s 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 0x7fccb80a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a4550 0x7fccb8139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb813a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 0x7fccb80a4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:48014/0 (socket says 172.21.15.71:48014) 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a4550 0x7fccb8139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37450/0 (socket says 172.21.15.71:37450) 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 -- 172.21.15.71:0/3615811855 learned_addr learned my addr 172.21.15.71:0/3615811855 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): get_auth_request con 0x7fccb80a3c30 auth_method 0 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): get_auth_request con 0x7fccb80a4550 auth_method 0 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): get_auth_request con 0x7fccb8139eb0 auth_method 0 2024-08-19T11:21:34.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccb7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient(hunting): handle_auth_done global_id 104937 payload 274 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 -- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 msgr2=0x7fccb813a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb813a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 -- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a4550 msgr2=0x7fccb8139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a4550 0x7fccb8139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 monclient: found mon.noname-d 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbcca0640 1 -- 172.21.15.71:0/3615811855 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80a0df0 con 0x7fccb80a3c30 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.971+0000 7fccbd4a1640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb813a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccbcca0640 1 -- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 msgr2=0x7fccb80a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccbcca0640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 0x7fccb80a4010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fccac0098d0 tx=0x7fccac02a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c4c996140a14f820 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 1 -- 172.21.15.71:0/3615811855 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccac037070 con 0x7fccb80a3c30 2024-08-19T11:21:34.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: dump: 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.982 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 1 -- 172.21.15.71:0/3615811855 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac02adc0 con 0x7fccb80a3c30 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccbef04640 5 monclient: authenticate success, global_id 104937 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccbef04640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccbef04640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 1 -- 172.21.15.71:0/3615811855 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccac030c20 con 0x7fccb80a3c30 2024-08-19T11:21:34.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccbef04640 4 set_mon_vals no callback set 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.974+0000 7fccb77fe640 10 monclient: dump: 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.984 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 10 monclient: shutdown 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 -- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 msgr2=0x7fccb80a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 0x7fccb80a4010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fccac0098d0 tx=0x7fccac02a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 -- 172.21.15.71:0/3615811855 shutdown_connections 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb813a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a4550 0x7fccb8139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 --2- 172.21.15.71:0/3615811855 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fccb80a3c30 0x7fccb80a4010 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 -- 172.21.15.71:0/3615811855 >> 172.21.15.71:0/3615811855 conn(0x7fccb80a91d0 msgr2=0x7fccb80a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 -- 172.21.15.71:0/3615811855 shutdown_connections 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 1 -- 172.21.15.71:0/3615811855 wait complete. 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 10 monclient: build_initial_monmap 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.975+0000 7fccbef04640 10 monclient: monmap: 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.986 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 Processor -- start 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 -- start start 2024-08-19T11:21:34.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient: init 2024-08-19T11:21:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient: _add_conns ranks=[2,1,4,3,0,6,5,8,7] 2024-08-19T11:21:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 0x7fccb81cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient(hunting): picked mon.noname-b con 0x7fccb80a3c30 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb80a4550 0x7fccb81cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient(hunting): picked mon.noname-f con 0x7fccb80a4550 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb8126250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient(hunting): picked mon.noname-c con 0x7fccb8139eb0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80a5570 con 0x7fccb80a4550 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.976+0000 7fccbef04640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fccb806cbd0 con 0x7fccb80a3c30 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbef04640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbef04640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fccb80a4930 con 0x7fccb8139eb0 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbef04640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbef04640 10 monclient(hunting): authenticate will time out at 1353.018012s 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 0x7fccb81cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 0x7fccb81cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37466/0 (socket says 172.21.15.71:37466) 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 1 -- 172.21.15.71:0/2989768137 learned_addr learned my addr 172.21.15.71:0/2989768137 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): get_auth_request con 0x7fccb80a3c30 auth_method 0 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb8126250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): get_auth_request con 0x7fccb8139eb0 auth_method 0 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb80a4550 0x7fccb81cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): get_auth_request con 0x7fccb80a4550 auth_method 0 2024-08-19T11:21:34.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccb7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient(hunting): handle_auth_done global_id 85567 payload 824 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 -- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 msgr2=0x7fccb81cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 0x7fccb81cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 -- 172.21.15.71:0/2989768137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb80a4550 msgr2=0x7fccb81cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb80a4550 0x7fccb81cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient: _finish_hunting 0 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 monclient: found mon.noname-c 2024-08-19T11:21:34.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbd4a1640 1 -- 172.21.15.71:0/2989768137 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb813a5c0 con 0x7fccb8139eb0 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.977+0000 7fccbcca0640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 0x7fccb81cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbd4a1640 1 -- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 msgr2=0x7fccb8126250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbd4a1640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb8126250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccb000ef90 tx=0x7fccb000c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccb0018020 con 0x7fccb8139eb0 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: dump: 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:34.997 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb00148f0 con 0x7fccb8139eb0 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 5 monclient: authenticate success, global_id 85567 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 10 monclient: _renew_subs 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb8127d40 con 0x7fccb8139eb0 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:34.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fccb00133e0 con 0x7fccb8139eb0 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb57fa640 10 monclient: dump: 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:34.999 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 10 monclient: _renew_subs 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccb6ffd640 4 set_mon_vals no callback set 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.979+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb81294f0 con 0x7fccb8139eb0 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.980+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fccb0005d10 con 0x7fccb8139eb0 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.980+0000 7fccbef04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.980+0000 7fccbef04640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.980+0000 7fccbef04640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.980+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb8068e10 con 0x7fccb8139eb0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.980+0000 7fccb57fa640 1 --2- 172.21.15.71:0/2989768137 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc9c03eab0 0x7fcc9c040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.981+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7fccb00527b0 con 0x7fccb8139eb0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.981+0000 7fccbcca0640 1 --2- 172.21.15.71:0/2989768137 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc9c03eab0 0x7fcc9c040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.981+0000 7fccbcca0640 10 monclient: get_auth_request con 0x7fcc9c03eab0 auth_method 0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.983+0000 7fccbcca0640 1 --2- 172.21.15.71:0/2989768137 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc9c03eab0 0x7fcc9c040f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fccac0090b0 tx=0x7fccac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.985+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fccb8068e10 con 0x7fccb8139eb0 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.985+0000 7fccb57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:34.985+0000 7fccb57fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:35.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.159+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fccb80a5210 con 0x7fcc9c03eab0 2024-08-19T11:21:35.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.160+0000 7fccb57fa640 1 -- 172.21.15.71:0/2989768137 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fccb80a5210 con 0x7fcc9c03eab0 2024-08-19T11:21:35.161 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc9c03eab0 msgr2=0x7fcc9c040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 --2- 172.21.15.71:0/2989768137 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc9c03eab0 0x7fcc9c040f70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fccac0090b0 tx=0x7fccac02e000 comp rx=0 tx=0).stop 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 10 monclient: shutdown 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 msgr2=0x7fccb8126250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb8126250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccb000ef90 tx=0x7fccb000c490 comp rx=0 tx=0).stop 2024-08-19T11:21:35.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 shutdown_connections 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 --2- 172.21.15.71:0/2989768137 >> v2:172.21.15.135:6800/726754104 conn(0x7fcc9c03eab0 0x7fcc9c040f70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fccb8139eb0 0x7fccb8126250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccb80a4550 0x7fccb81cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 --2- 172.21.15.71:0/2989768137 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccb80a3c30 0x7fccb81cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 >> 172.21.15.71:0/2989768137 conn(0x7fccb80a91d0 msgr2=0x7fccb8070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 shutdown_connections 2024-08-19T11:21:35.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.162+0000 7fccbef04640 1 -- 172.21.15.71:0/2989768137 wait complete. 2024-08-19T11:21:35.173 INFO:tasks.ceph:Scrubbing osd.2 2024-08-19T11:21:35.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-19T11:21:35.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1676238600}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=338135743}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=963296491}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=457216351}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2630048804}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1013898090}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3909175881}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1106507968}) 2024-08-19T11:21:35.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.198+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3640583022}) 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.203+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3700071893}) 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2879605191}) 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=565721194}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2069258662}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4086270190}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=516366010}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1989150381}) 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3199804128}) 2024-08-19T11:21:35.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.204+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1324647997}) 2024-08-19T11:21:35.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1349611002}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2173752361}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=786875762}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=394559996}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=426096532}) 2024-08-19T11:21:35.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3646974792}) 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=638179473}) 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3304608985}) 2024-08-19T11:21:35.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.222+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3973592397}) 2024-08-19T11:21:35.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.281+0000 7f86dd186640 10 monclient: get_monmap_and_config 2024-08-19T11:21:35.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.281+0000 7f86dd186640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.281+0000 7f86dd186640 10 monclient: monmap: 2024-08-19T11:21:35.282 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:35.282134+0000 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:35.282134+0000 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.283 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.284 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.284 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.284 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:35.284 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:35.284 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 Processor -- start 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 -- start start 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient: init 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient: _add_conns ranks=[8,5,4,3,10,9,7,6,0,1,2] 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 0x7f86d809b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): picked mon.noname-e con 0x7f86d809b5a0 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f86d8137700 0x7f86d8137b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): picked mon.noname-h con 0x7f86d8137700 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8138040 0x7f86d813ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): picked mon.noname-c con 0x7f86d8138040 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f86d806ec90 con 0x7f86d8138040 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f86d80a2120 con 0x7f86d8137700 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f86d809e6d0 con 0x7f86d809b5a0 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86dd186640 10 monclient(hunting): authenticate will time out at 1353.323720s 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 0x7f86d809b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 0x7f86d809b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45538/0 (socket says 172.21.15.71:45538) 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1449223415 learned_addr learned my addr 172.21.15.71:0/1449223415 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): get_auth_request con 0x7f86d809b5a0 auth_method 0 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8138040 0x7f86d813ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): get_auth_request con 0x7f86d8138040 auth_method 0 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86ce59c640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f86d8137700 0x7f86d8137b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86d759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86ce59c640 10 monclient(hunting): get_auth_request con 0x7f86d8137700 auth_method 0 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86ce59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86ce59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.282+0000 7f86ce59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_done global_id 124253 payload 274 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1449223415 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f86d8137700 msgr2=0x7f86d8137b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f86d8137700 0x7f86d8137b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8138040 msgr2=0x7f86d813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8138040 0x7f86d813ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 1 monclient: found mon.noname-e 2024-08-19T11:21:35.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1449223415 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d809ef50 con 0x7f86d809b5a0 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86ce59c640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f86d8137700 0x7f86d8137b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.283+0000 7f86d759e640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8138040 0x7f86d813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 msgr2=0x7f86d809b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 0x7f86d809b980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098a0 tx=0x7f86c802a080 comp rx=0 tx=0).ready entity=mon.8 client_cookie=6677a7e759836f1f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 1 -- 172.21.15.71:0/1449223415 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86c8037070 con 0x7f86d809b5a0 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 10 monclient: dump: 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.295 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.296 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86dd186640 5 monclient: authenticate success, global_id 124253 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 1 -- 172.21.15.71:0/1449223415 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c802ade0 con 0x7f86d809b5a0 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86dd186640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.285+0000 7f86d659c640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 4 set_mon_vals no callback set 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86d659c640 1 -- 172.21.15.71:0/1449223415 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86c8030c20 con 0x7f86d809b5a0 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86d659c640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86d659c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:35.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86d659c640 10 monclient: dump: 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.298 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 10 monclient: shutdown 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 -- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 msgr2=0x7f86d809b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 0x7f86d809b980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098a0 tx=0x7f86c802a080 comp rx=0 tx=0).stop 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 -- 172.21.15.71:0/1449223415 shutdown_connections 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f86d8137700 0x7f86d8137b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8138040 0x7f86d813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 --2- 172.21.15.71:0/1449223415 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f86d809b5a0 0x7f86d809b980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 -- 172.21.15.71:0/1449223415 >> 172.21.15.71:0/1449223415 conn(0x7f86d80a4fc0 msgr2=0x7f86d80a53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 -- 172.21.15.71:0/1449223415 shutdown_connections 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.286+0000 7f86dd186640 1 -- 172.21.15.71:0/1449223415 wait complete. 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.287+0000 7f86dd186640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.287+0000 7f86dd186640 10 monclient: monmap: 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:35.300 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.287+0000 7f86dd186640 1 Processor -- start 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.287+0000 7f86dd186640 1 -- start start 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.287+0000 7f86dd186640 10 monclient: init 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient: _add_conns ranks=[0,4,1,5,2,3,6,8,7] 2024-08-19T11:21:35.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 0x7f86d81cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): picked mon.noname-a con 0x7f86d809b5a0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8137700 0x7f86d81cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): picked mon.noname-c con 0x7f86d8137700 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d8138040 0x7f86d81ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): picked mon.noname-f con 0x7f86d8138040 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86d809f9c0 con 0x7f86d809b5a0 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86d809f300 con 0x7f86d8138040 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f86d81384c0 con 0x7f86d8137700 2024-08-19T11:21:35.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86dd186640 10 monclient(hunting): authenticate will time out at 1353.329348s 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 0x7f86d81cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8137700 0x7f86d81cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 0x7f86d81cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58136/0 (socket says 172.21.15.71:58136) 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1815024921 learned_addr learned my addr 172.21.15.71:0/1815024921 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): get_auth_request con 0x7f86d809b5a0 auth_method 0 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): get_auth_request con 0x7f86d8137700 auth_method 0 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d759e640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d8138040 0x7f86d81ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d759e640 10 monclient(hunting): get_auth_request con 0x7f86d8138040 auth_method 0 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d759e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d759e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient(hunting): handle_auth_done global_id 76077 payload 824 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8137700 msgr2=0x7f86d81cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8137700 0x7f86d81cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1815024921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d8138040 msgr2=0x7f86d81ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86d8138040 0x7f86d81ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 monclient: found mon.noname-a 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1815024921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d8136030 con 0x7f86d809b5a0 2024-08-19T11:21:35.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.288+0000 7f86ce59c640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f86d8137700 0x7f86d81cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:35.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.290+0000 7f86d6d9d640 1 -- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 msgr2=0x7f86d81cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.290+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 0x7f86d81cd8e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86c80090b0 tx=0x7f86c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86c8042070 con 0x7f86d809b5a0 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: dump: 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.308 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8003c50 con 0x7f86d809b5a0 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 5 monclient: authenticate success, global_id 76077 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f86c8037040 con 0x7f86d809b5a0 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 10 monclient: _renew_subs 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d8136310 con 0x7f86d809b5a0 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86cffff640 10 monclient: dump: 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.310 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.311 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86d5d9b640 4 set_mon_vals no callback set 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 10 monclient: _renew_subs 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d8135d50 con 0x7f86d809b5a0 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.291+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86d809a770 con 0x7f86d809b5a0 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86d6d9d640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 0x7f86d81cd8e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86c80090b0 tx=0x7f86c8004730 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7f86c8045060 mgrmap(e 5) 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f86c8045060 con 0x7f86d809b5a0 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86cffff640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.135:6800/726754104 conn(0x7f86b803ea80 0x7f86b8040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f86c8071250 con 0x7f86d809b5a0 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86cffff640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.71:6808/80758171 conn(0x7f86b8044520 0x7f86b8046940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 --> v2:172.21.15.71:6808/80758171 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86c802ade0 con 0x7f86b8044520 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86ce59c640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.135:6800/726754104 conn(0x7f86b803ea80 0x7f86b8040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86d759e640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.71:6808/80758171 conn(0x7f86b8044520 0x7f86b8046940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86d759e640 10 monclient: get_auth_request con 0x7f86b8044520 auth_method 0 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.292+0000 7f86ce59c640 10 monclient: get_auth_request con 0x7f86b803ea80 auth_method 0 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.295+0000 7f86ce59c640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.135:6800/726754104 conn(0x7f86b803ea80 0x7f86b8040f40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f86d8137660 tx=0x7f86c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.297+0000 7f86d759e640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.71:6808/80758171 conn(0x7f86b8044520 0x7f86b8046940 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.297+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== osd.2 v2:172.21.15.71:6808/80758171 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86c802ade0 con 0x7f86b8044520 2024-08-19T11:21:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.309+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 --> v2:172.21.15.71:6808/80758171 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f86d80a5e10 con 0x7f86b8044520 2024-08-19T11:21:35.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== osd.2 v2:172.21.15.71:6808/80758171 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f86d80a5e10 con 0x7f86b8044520 2024-08-19T11:21:35.314 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:35.314 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T11:21:35.314 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:35.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 >> v2:172.21.15.71:6808/80758171 conn(0x7f86b8044520 msgr2=0x7f86b8046940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.71:6808/80758171 conn(0x7f86b8044520 0x7f86b8046940 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 >> v2:172.21.15.135:6800/726754104 conn(0x7f86b803ea80 msgr2=0x7f86b8040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 --2- 172.21.15.71:0/1815024921 >> v2:172.21.15.135:6800/726754104 conn(0x7f86b803ea80 0x7f86b8040f40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f86d8137660 tx=0x7f86c0008040 comp rx=0 tx=0).stop 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 10 monclient: shutdown 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 20 monclient: shutdown canceling and discarding version request 1 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 msgr2=0x7f86d81cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 --2- 172.21.15.71:0/1815024921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86d809b5a0 0x7f86d81cd8e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86c80090b0 tx=0x7f86c8004730 comp rx=0 tx=0).stop 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86d759e640 1 -- 172.21.15.71:0/1815024921 reap_dead start 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86cffff640 1 -- 172.21.15.71:0/1815024921 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 0 0 0) 0x7f86c8078050 con 0x7f86d809b5a0 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86cffff640 10 monclient: discarding stray monitor message mon_get_version_reply(handle=1 version=325) 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 shutdown_connections 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 >> 172.21.15.71:0/1815024921 conn(0x7f86d80a4fc0 msgr2=0x7f86d809fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 shutdown_connections 2024-08-19T11:21:35.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.310+0000 7f86dd186640 1 -- 172.21.15.71:0/1815024921 wait complete. 2024-08-19T11:21:35.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-19T11:21:35.399 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2363769159}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1196598129}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1299812961}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3986429973}) 2024-08-19T11:21:35.400 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1521022362}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1856297340}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2447327591}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3101303283}) 2024-08-19T11:21:35.401 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.397+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3954410911}) 2024-08-19T11:21:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.459+0000 7f7b84d21640 10 monclient: get_monmap_and_config 2024-08-19T11:21:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.459+0000 7f7b84d21640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.459+0000 7f7b84d21640 10 monclient: monmap: 2024-08-19T11:21:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:35.460410+0000 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:35.460410+0000 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.461 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.462 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:35.462 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:35.462 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.460+0000 7f7b84d21640 1 Processor -- start 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.460+0000 7f7b84d21640 1 -- start start 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.460+0000 7f7b84d21640 10 monclient: init 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient: _add_conns ranks=[3,2,0,10,4,1,9,7,6,5,8] 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b800a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): picked mon.noname-g con 0x7f7b800a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 0x7f7b800a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): picked mon.noname-b con 0x7f7b800a6e10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7b80139860 addr v1:172.21.15.71:6789/0 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b800a4f90 con 0x7f7b80139860 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800a6380 con 0x7f7b800a6e10 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800a49d0 con 0x7f7b800a6a30 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b84d21640 10 monclient(hunting): authenticate will time out at 1353.502262s 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 0x7f7b800a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 0x7f7b800a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37468/0 (socket says 172.21.15.71:37468) 2024-08-19T11:21:35.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/73163468 learned_addr learned my addr 172.21.15.71:0/73163468 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): get_auth_request con 0x7f7b800a6e10 auth_method 0 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7ed9d640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7b80139860 0x7f7b80139c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59742/0 (socket says 172.21.15.71:59742) 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7e59c640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b800a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7e59c640 10 monclient(hunting): get_auth_request con 0x7f7b800a6a30 auth_method 0 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_done global_id 76106 payload 274 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/73163468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 msgr2=0x7f7b800a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b800a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/73163468 >> v1:172.21.15.71:6789/0 conn(0x7f7b80139860 legacy=0x7f7b80139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 monclient: found mon.noname-b 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/73163468 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b800a46f0 con 0x7f7b800a6e10 2024-08-19T11:21:35.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.461+0000 7f7b7e59c640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b800a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/73163468 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 msgr2=0x7f7b800a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7dd9b640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 0x7f7b800a71f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b740098a0 tx=0x7f7b7402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b3e92fa0550f2b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 1 -- 172.21.15.71:0/73163468 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b74037070 con 0x7f7b800a6e10 2024-08-19T11:21:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:35.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: dump: 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.474 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 1 -- 172.21.15.71:0/73163468 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7402ade0 con 0x7f7b800a6e10 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b84d21640 5 monclient: authenticate success, global_id 76106 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b84d21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 1 -- 172.21.15.71:0/73163468 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b74030c20 con 0x7f7b800a6e10 2024-08-19T11:21:35.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b84d21640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b84d21640 4 set_mon_vals no callback set 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.464+0000 7f7b7d59a640 10 monclient: dump: 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.476 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 10 monclient: shutdown 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 -- 172.21.15.71:0/73163468 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 msgr2=0x7f7b800a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 0x7f7b800a71f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7b740098a0 tx=0x7f7b7402a080 comp rx=0 tx=0).stop 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 -- 172.21.15.71:0/73163468 shutdown_connections 2024-08-19T11:21:35.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7b800a6e10 0x7f7b800a71f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 --2- 172.21.15.71:0/73163468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b800a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 -- 172.21.15.71:0/73163468 >> 172.21.15.71:0/73163468 conn(0x7f7b800ac030 msgr2=0x7f7b800ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 -- 172.21.15.71:0/73163468 shutdown_connections 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 1 -- 172.21.15.71:0/73163468 wait complete. 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.465+0000 7f7b84d21640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient: monmap: 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.478 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 Processor -- start 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 -- start start 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient: init 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient: _add_conns ranks=[3,8,0,6,2,4,7,1,5] 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b801ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): picked mon.noname-g con 0x7f7b800a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 0x7f7b801cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): picked mon.noname-e con 0x7f7b800a6e10 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 0x7f7b801cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): picked mon.noname-a con 0x7f7b80139860 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800a7730 con 0x7f7b80139860 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8013a370 con 0x7f7b800a6a30 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f7b800a3ff0 con 0x7f7b800a6e10 2024-08-19T11:21:35.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.466+0000 7f7b84d21640 10 monclient(hunting): authenticate will time out at 1353.507921s 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 0x7f7b801cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 0x7f7b801cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 0x7f7b801cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58138/0 (socket says 172.21.15.71:58138) 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 0x7f7b801cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45540/0 (socket says 172.21.15.71:45540) 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 1 -- 172.21.15.71:0/119057969 learned_addr learned my addr 172.21.15.71:0/119057969 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): get_auth_request con 0x7f7b80139860 auth_method 0 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): get_auth_request con 0x7f7b800a6e10 auth_method 0 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b801ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): get_auth_request con 0x7f7b800a6a30 auth_method 0 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient(hunting): handle_auth_done global_id 124262 payload 824 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/119057969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 msgr2=0x7f7b801ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b801ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 msgr2=0x7f7b801cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 0x7f7b801cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 monclient: found mon.noname-e 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/119057969 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b800a2860 con 0x7f7b800a6e10 2024-08-19T11:21:35.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.467+0000 7f7b7ed9d640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 0x7f7b801cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b7dd9b640 1 -- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 msgr2=0x7f7b801cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b7dd9b640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 0x7f7b801cee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b74031000 tx=0x7f7b74004730 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b74037040 con 0x7f7b800a6e10 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: dump: 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.484 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 5 monclient: authenticate success, global_id 124262 2024-08-19T11:21:35.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b74003c50 con 0x7f7b800a6e10 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 10 monclient: _renew_subs 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b80128af0 con 0x7f7b800a6e10 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f7b74003e00 con 0x7f7b800a6e10 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b6effd640 10 monclient: dump: 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.486 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b7cd99640 4 set_mon_vals no callback set 2024-08-19T11:21:35.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 10 monclient: _renew_subs 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.469+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b800a2380 con 0x7f7b800a6e10 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f7b74030340 con 0x7f7b800a6e10 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b84d21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b84d21640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b84d21640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b80127f60 con 0x7f7b800a6e10 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b6effd640 1 --2- 172.21.15.71:0/119057969 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b6003eab0 0x7f7b60040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.470+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f7b74042070 con 0x7f7b800a6e10 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.471+0000 7f7b7e59c640 1 --2- 172.21.15.71:0/119057969 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b6003eab0 0x7f7b60040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.471+0000 7f7b7e59c640 10 monclient: get_auth_request con 0x7f7b6003eab0 auth_method 0 2024-08-19T11:21:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.473+0000 7f7b7e59c640 1 --2- 172.21.15.71:0/119057969 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b6003eab0 0x7f7b60040f70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7b70003b80 tx=0x7f7b70009910 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.475+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f7b800a2860 con 0x7f7b800a6e10 2024-08-19T11:21:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.475+0000 7f7b6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.475+0000 7f7b6effd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:35.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.650+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f7b80126aa0 con 0x7f7b6003eab0 2024-08-19T11:21:35.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.651+0000 7f7b6effd640 1 -- 172.21.15.71:0/119057969 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7b80126aa0 con 0x7f7b6003eab0 2024-08-19T11:21:35.652 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2024-08-19T11:21:35.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b6003eab0 msgr2=0x7f7b60040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 --2- 172.21.15.71:0/119057969 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b6003eab0 0x7f7b60040f70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7b70003b80 tx=0x7f7b70009910 comp rx=0 tx=0).stop 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 10 monclient: shutdown 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 msgr2=0x7f7b801cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 0x7f7b801cee30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b74031000 tx=0x7f7b74004730 comp rx=0 tx=0).stop 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 shutdown_connections 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 --2- 172.21.15.71:0/119057969 >> v2:172.21.15.135:6800/726754104 conn(0x7f7b6003eab0 0x7f7b60040f70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b80139860 0x7f7b801cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f7b800a6e10 0x7f7b801cee30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 --2- 172.21.15.71:0/119057969 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800a6a30 0x7f7b801ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 >> 172.21.15.71:0/119057969 conn(0x7f7b800ac030 msgr2=0x7f7b8009eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 shutdown_connections 2024-08-19T11:21:35.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.653+0000 7f7b84d21640 1 -- 172.21.15.71:0/119057969 wait complete. 2024-08-19T11:21:35.665 INFO:tasks.ceph:Scrubbing osd.3 2024-08-19T11:21:35.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-19T11:21:35.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.806+0000 7f82930a6640 10 monclient: get_monmap_and_config 2024-08-19T11:21:35.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.806+0000 7f82930a6640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.806+0000 7f82930a6640 10 monclient: monmap: 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:35.807483+0000 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:35.807483+0000 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.808 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:35.809 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:35.809 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.807+0000 7f82930a6640 1 Processor -- start 2024-08-19T11:21:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.807+0000 7f82930a6640 1 -- start start 2024-08-19T11:21:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.807+0000 7f82930a6640 10 monclient: init 2024-08-19T11:21:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient: _add_conns ranks=[4,8,9,1,5,10,2,7,0,6,3] 2024-08-19T11:21:35.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 0x7f828c0a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): picked mon.noname-c con 0x7f828c0a6a30 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 0x7f828c0a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): picked mon.noname-e con 0x7f828c0a7350 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f828c1397f0 0x7f828c139c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): picked mon.noname-a con 0x7f828c1397f0 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f828c0a3800 con 0x7f828c1397f0 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f828c06d1c0 con 0x7f828c0a6a30 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f828c0a5140 con 0x7f828c0a7350 2024-08-19T11:21:35.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f82930a6640 10 monclient(hunting): authenticate will time out at 1353.849178s 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 0x7f828c0a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 0x7f828c0a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f828c1397f0 0x7f828c139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 0x7f828c0a7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45556/0 (socket says 172.21.15.71:45556) 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 0x7f828c0a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38256/0 (socket says 172.21.15.71:38256) 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 -- 172.21.15.71:0/1140628780 learned_addr learned my addr 172.21.15.71:0/1140628780 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): get_auth_request con 0x7f828c0a7350 auth_method 0 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): get_auth_request con 0x7f828c1397f0 auth_method 0 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): get_auth_request con 0x7f828c0a6a30 auth_method 0 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient(hunting): handle_auth_done global_id 124271 payload 274 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 -- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 msgr2=0x7f828c0a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 --2- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 0x7f828c0a6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 -- 172.21.15.71:0/1140628780 >> v2:172.21.15.71:3300/0 conn(0x7f828c1397f0 msgr2=0x7f828c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 --2- 172.21.15.71:0/1140628780 >> v2:172.21.15.71:3300/0 conn(0x7f828c1397f0 0x7f828c139c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 monclient: found mon.noname-e 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f828bfff640 1 -- 172.21.15.71:0/1140628780 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c0a8910 con 0x7f828c0a7350 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8291643640 1 --2- 172.21.15.71:0/1140628780 >> v2:172.21.15.71:3300/0 conn(0x7f828c1397f0 0x7f828c139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.808+0000 7f8290e42640 1 --2- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 0x7f828c0a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828bfff640 1 -- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 msgr2=0x7f828c0a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828bfff640 1 --2- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 0x7f828c0a7750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8274009870 tx=0x7f827402a130 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1044e4a674eb9df8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 1 -- 172.21.15.71:0/1140628780 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8274037070 con 0x7f828c0a7350 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: dump: 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.818 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 1 -- 172.21.15.71:0/1140628780 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740307b0 con 0x7f828c0a7350 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f82930a6640 5 monclient: authenticate success, global_id 124271 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f82930a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:35.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f82930a6640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 1 -- 172.21.15.71:0/1140628780 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8274030e10 con 0x7f828c0a7350 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f82930a6640 4 set_mon_vals no callback set 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.811+0000 7f828b7fe640 10 monclient: dump: 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.820 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 10 monclient: shutdown 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 -- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 msgr2=0x7f828c0a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 --2- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 0x7f828c0a7750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8274009870 tx=0x7f827402a130 comp rx=0 tx=0).stop 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 -- 172.21.15.71:0/1140628780 shutdown_connections 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 --2- 172.21.15.71:0/1140628780 >> v2:172.21.15.71:3300/0 conn(0x7f828c1397f0 0x7f828c139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 --2- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f828c0a7350 0x7f828c0a7750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 --2- 172.21.15.71:0/1140628780 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f828c0a6a30 0x7f828c0a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 -- 172.21.15.71:0/1140628780 >> 172.21.15.71:0/1140628780 conn(0x7f828c0ac030 msgr2=0x7f828c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 -- 172.21.15.71:0/1140628780 shutdown_connections 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 1 -- 172.21.15.71:0/1140628780 wait complete. 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.812+0000 7f82930a6640 10 monclient: monmap: 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:35.822 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.823 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 Processor -- start 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 -- start start 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient: init 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient: _add_conns ranks=[5,7,6,4,8,2,3,0,1] 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f828c0a6a30 0x7f828c1389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): picked mon.noname-h con 0x7f828c0a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f828c0a7350 0x7f828c124340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): picked mon.noname-i con 0x7f828c0a7350 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 0x7f828c124880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): picked mon.noname-d con 0x7f828c1397f0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f828c0a5990 con 0x7f828c0a6a30 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7f828c0a48a0 con 0x7f828c1397f0 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f828c13a150 con 0x7f828c0a7350 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f82930a6640 10 monclient(hunting): authenticate will time out at 1353.854839s 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 0x7f828c124880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 0x7f828c124880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:48026/0 (socket says 172.21.15.71:48026) 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 1 -- 172.21.15.71:0/2078503169 learned_addr learned my addr 172.21.15.71:0/2078503169 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 10 monclient(hunting): get_auth_request con 0x7f828c1397f0 auth_method 0 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.813+0000 7f8291643640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f828bfff640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f828c0a7350 0x7f828c124340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8290e42640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f828c0a6a30 0x7f828c1389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8290e42640 10 monclient(hunting): get_auth_request con 0x7f828c0a6a30 auth_method 0 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8290e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8290e42640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8290e42640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f828bfff640 10 monclient(hunting): get_auth_request con 0x7f828c0a7350 auth_method 0 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f828bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f828bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f828bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 10 monclient(hunting): handle_auth_done global_id 104946 payload 824 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 1 -- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f828c0a7350 msgr2=0x7f828c124340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f828c0a7350 0x7f828c124340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 1 -- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f828c0a6a30 msgr2=0x7f828c1389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f828c0a6a30 0x7f828c1389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 1 monclient: found mon.noname-d 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8291643640 1 -- 172.21.15.71:0/2078503169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c125d90 con 0x7f828c1397f0 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.814+0000 7f8290e42640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f828c0a6a30 0x7f828c1389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f8291643640 1 -- 172.21.15.71:0/2078503169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 msgr2=0x7f828c124880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f8291643640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 0x7f828c124880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f828400e880 tx=0x7f828400ed40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8284017070 con 0x7f828c1397f0 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: dump: 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.832 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.833 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 5 monclient: authenticate success, global_id 104946 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 10 monclient: _renew_subs 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8284013470 con 0x7f828c1397f0 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828c139cc0 con 0x7f828c1397f0 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8284013a90 con 0x7f828c1397f0 2024-08-19T11:21:35.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82897fa640 10 monclient: dump: 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.835 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 10 monclient: _renew_subs 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f828affd640 4 set_mon_vals no callback set 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.816+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f828c1268f0 con 0x7f828c1397f0 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.817+0000 7f82930a6640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.71:3303/0 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.817+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f828c126ac0 con 0x7f828c1397f0 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.817+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== mon.6 v2:172.21.15.71:3303/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8284013c30 con 0x7f828c1397f0 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.817+0000 7f82897fa640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6800/726754104 conn(0x7f826c03ea80 0x7f826c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.817+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== mon.6 v2:172.21.15.71:3303/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f828400f040 con 0x7f828c1397f0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f82897fa640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6805/3339144447 conn(0x7f826c044590 0x7f826c0469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 --> v2:172.21.15.135:6805/3339144447 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8284016ec0 con 0x7f826c044590 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== mon.6 v2:172.21.15.71:3303/0 6 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (secure 0 0 0) 0x7f8284058050 con 0x7f828c1397f0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f82897fa640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f8290e42640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6800/726754104 conn(0x7f826c03ea80 0x7f826c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f8290e42640 10 monclient: get_auth_request con 0x7f826c03ea80 auth_method 0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f828bfff640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6805/3339144447 conn(0x7f826c044590 0x7f826c0469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.818+0000 7f828bfff640 10 monclient: get_auth_request con 0x7f826c044590 auth_method 0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.820+0000 7f8290e42640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6800/726754104 conn(0x7f826c03ea80 0x7f826c040f40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f827c007520 tx=0x7f827c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.822+0000 7f828bfff640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6805/3339144447 conn(0x7f826c044590 0x7f826c0469b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.823+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== osd.3 v2:172.21.15.135:6805/3339144447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8284016ec0 con 0x7f826c044590 2024-08-19T11:21:35.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.835+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 --> v2:172.21.15.135:6805/3339144447 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f828c1c1ca0 con 0x7f826c044590 2024-08-19T11:21:35.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.836+0000 7f82897fa640 1 -- 172.21.15.71:0/2078503169 <== osd.3 v2:172.21.15.135:6805/3339144447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f828c1c1ca0 con 0x7f826c044590 2024-08-19T11:21:35.838 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:35.838 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T11:21:35.838 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:35.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.836+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6805/3339144447 conn(0x7f826c044590 msgr2=0x7f826c0469b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6805/3339144447 conn(0x7f826c044590 0x7f826c0469b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6800/726754104 conn(0x7f826c03ea80 msgr2=0x7f826c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 --2- 172.21.15.71:0/2078503169 >> v2:172.21.15.135:6800/726754104 conn(0x7f826c03ea80 0x7f826c040f40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f827c007520 tx=0x7f827c00b040 comp rx=0 tx=0).stop 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 10 monclient: shutdown 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 msgr2=0x7f828c124880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 --2- 172.21.15.71:0/2078503169 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7f828c1397f0 0x7f828c124880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f828400e880 tx=0x7f828400ed40 comp rx=0 tx=0).stop 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f8291643640 1 -- 172.21.15.71:0/2078503169 reap_dead start 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 shutdown_connections 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 >> 172.21.15.71:0/2078503169 conn(0x7f828c0ac030 msgr2=0x7f828c0ab630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 shutdown_connections 2024-08-19T11:21:35.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.837+0000 7f82930a6640 1 -- 172.21.15.71:0/2078503169 wait complete. 2024-08-19T11:21:35.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-19T11:21:35.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1275964039}) 2024-08-19T11:21:35.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.915 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=429876924}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3883201189}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4292624642}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=61697668}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.916 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3655804389}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=64508303}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354490043}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.902+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1571243204}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=868088263}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=314232290}) 2024-08-19T11:21:35.917 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=44743890}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1526201636}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4205328200}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1082759260}) 2024-08-19T11:21:35.918 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4236386004}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891807129}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.904+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2590670719}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3068549496}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1143770838}) 2024-08-19T11:21:35.919 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=428349587}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3746967593}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1360855602}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2329737678}) 2024-08-19T11:21:35.920 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.905+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.906+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.906+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3133431657}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.906+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.906+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3202882123}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.906+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1854682176}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3525154544}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=789050696}) 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.921 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628714880}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2668842333}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=86258886}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3117279059}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.922 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2711643998}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3073876526}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.907+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1437146817}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2633992840}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1367623842}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.923 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.908+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2742300492}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1222364185}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2335733330}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3400894033}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=236741153}) 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.924 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947736442}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.909+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=910032010}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1521052413}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2406402524}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1764199441}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.925 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4016955068}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3298069621}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2902284086}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=842716766}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2712398278}) 2024-08-19T11:21:35.926 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:35.910+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=457976547}) 2024-08-19T11:21:35.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.950+0000 7f96125a3640 10 monclient: get_monmap_and_config 2024-08-19T11:21:35.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.950+0000 7f96125a3640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.951+0000 7f96125a3640 10 monclient: monmap: 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:35.951636+0000 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:35.951636+0000 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.952 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:35.953 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.951+0000 7f96125a3640 1 Processor -- start 2024-08-19T11:21:35.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.951+0000 7f96125a3640 1 -- start start 2024-08-19T11:21:35.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.951+0000 7f96125a3640 10 monclient: init 2024-08-19T11:21:35.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient: _add_conns ranks=[5,7,4,8,1,9,6,2,0,10,3] 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 0x7f960c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): picked mon.noname-h con 0x7f960c0a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c0a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): picked mon.noname-i con 0x7f960c0a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): picked mon.noname-c con 0x7f960c1397f0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f960c0a5d50 con 0x7f960c1397f0 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f960c0a4cb0 con 0x7f960c0a6a30 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f960c0a4f90 con 0x7f960c0a6e10 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f96125a3640 10 monclient(hunting): authenticate will time out at 1353.993373s 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38272/0 (socket says 172.21.15.71:38272) 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 -- 172.21.15.71:0/1367206006 learned_addr learned my addr 172.21.15.71:0/1367206006 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 10 monclient(hunting): get_auth_request con 0x7f960c1397f0 auth_method 0 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 0x7f960c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c0a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 -- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 msgr2=0x7f960c139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-19T11:21:35.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 -- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 msgr2=0x7f960c139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): get_auth_request con 0x7f960c0a6a30 auth_method 0 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f9610b40640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): get_auth_request con 0x7f960c0a6e10 auth_method 0 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient(hunting): handle_auth_done global_id 46697 payload 274 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 -- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 msgr2=0x7f960c0a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c0a71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 -- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 msgr2=0x7f960c139c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 monclient: found mon.noname-h 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960bfff640 1 -- 172.21.15.71:0/1367206006 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c0a8590 con 0x7f960c0a6a30 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.952+0000 7f960b7fe640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.955+0000 7f960bfff640 1 -- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 msgr2=0x7f960c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.955+0000 7f960bfff640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 0x7f960c0a5810 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009800 tx=0x7f95f4029fe0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=2bb04465d3f4a799 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.955+0000 7f960affd640 1 -- 172.21.15.71:0/1367206006 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95f4037070 con 0x7f960c0a6a30 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: dump: 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.968 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 1 -- 172.21.15.71:0/1367206006 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f402ad00 con 0x7f960c0a6a30 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 5 monclient: authenticate success, global_id 46697 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 1 -- 172.21.15.71:0/1367206006 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95f4030c20 con 0x7f960c0a6a30 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 4 set_mon_vals no callback set 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:21:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f960affd640 10 monclient: dump: 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 10 monclient: shutdown 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 -- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 msgr2=0x7f960c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 0x7f960c0a5810 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009800 tx=0x7f95f4029fe0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 -- 172.21.15.71:0/1367206006 shutdown_connections 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f960c1397f0 0x7f960c139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c0a71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 --2- 172.21.15.71:0/1367206006 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f960c0a6a30 0x7f960c0a5810 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 -- 172.21.15.71:0/1367206006 >> 172.21.15.71:0/1367206006 conn(0x7f960c0ac030 msgr2=0x7f960c0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 -- 172.21.15.71:0/1367206006 shutdown_connections 2024-08-19T11:21:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.956+0000 7f96125a3640 1 -- 172.21.15.71:0/1367206006 wait complete. 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.957+0000 7f96125a3640 10 monclient: build_initial_monmap 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.957+0000 7f96125a3640 10 monclient: monmap: 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.957+0000 7f96125a3640 1 Processor -- start 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.957+0000 7f96125a3640 1 -- start start 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.957+0000 7f96125a3640 10 monclient: init 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient: _add_conns ranks=[8,7,3,4,2,1,5,6,0] 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 0x7f960c124ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): picked mon.noname-e con 0x7f960c0a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c125420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): picked mon.noname-i con 0x7f960c0a6e10 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f960c1397f0 0x7f960c125960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): picked mon.noname-g con 0x7f960c1397f0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f960c0a7730 con 0x7f960c1397f0 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f960c0a87d0 con 0x7f960c0a6e10 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7f960c128c90 con 0x7f960c0a6a30 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f96125a3640 10 monclient(hunting): authenticate will time out at 1353.999144s 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 0x7f960c124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 0x7f960c124ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45566/0 (socket says 172.21.15.71:45566) 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 -- 172.21.15.71:0/722702763 learned_addr learned my addr 172.21.15.71:0/722702763 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): get_auth_request con 0x7f960c0a6a30 auth_method 0 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c125420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f9610b40640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f960c1397f0 0x7f960c125960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): get_auth_request con 0x7f960c0a6e10 auth_method 0 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f9610b40640 10 monclient(hunting): get_auth_request con 0x7f960c1397f0 auth_method 0 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f9610b40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f9610b40640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f9610b40640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient(hunting): handle_auth_done global_id 124280 payload 824 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 -- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 msgr2=0x7f960c125420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c125420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 -- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f960c1397f0 msgr2=0x7f960c125960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f960c1397f0 0x7f960c125960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:35.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 monclient: found mon.noname-e 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f960bfff640 1 -- 172.21.15.71:0/722702763 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c0a2040 con 0x7f960c0a6a30 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.958+0000 7f9610b40640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f960c1397f0 0x7f960c125960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.960+0000 7f960bfff640 1 -- 172.21.15.71:0/722702763 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 msgr2=0x7f960c124ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.960+0000 7f960bfff640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 0x7f960c124ee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009920 tx=0x7f95f40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.960+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95f4041020 con 0x7f960c0a6a30 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: dump: 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.978 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.979 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: _finish_auth 0 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: _check_auth_tickets 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f4032440 con 0x7f960c0a6a30 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f95f4037040 con 0x7f960c0a6a30 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 5 monclient: authenticate success, global_id 124280 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f9608ff9640 10 monclient: dump: 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.980 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f960a7fc640 4 set_mon_vals no callback set 2024-08-19T11:21:35.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 10 monclient: _renew_subs 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960c0a4010 con 0x7f960c0a6a30 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 10 monclient: _renew_subs 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.961+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f960c126930 con 0x7f960c0a6a30 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f95f4044020 con 0x7f960c0a6a30 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f96125a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f96125a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f96125a3640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960c0a5810 con 0x7f960c0a6a30 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f9608ff9640 1 --2- 172.21.15.71:0/722702763 >> v2:172.21.15.135:6800/726754104 conn(0x7f95ec03ea80 0x7f95ec040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f95f4071d00 con 0x7f960c0a6a30 2024-08-19T11:21:35.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f960b7fe640 1 --2- 172.21.15.71:0/722702763 >> v2:172.21.15.135:6800/726754104 conn(0x7f95ec03ea80 0x7f95ec040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:35.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.962+0000 7f960b7fe640 10 monclient: get_auth_request con 0x7f95ec03ea80 auth_method 0 2024-08-19T11:21:35.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.965+0000 7f960b7fe640 1 --2- 172.21.15.71:0/722702763 >> v2:172.21.15.135:6800/726754104 conn(0x7f95ec03ea80 0x7f95ec040f40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009560 tx=0x7f95fc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:35.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.966+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f95f404b030 con 0x7f960c0a6a30 2024-08-19T11:21:35.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.966+0000 7f9608ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:35.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:35.966+0000 7f9608ff9640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:36.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.140+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f960c06ca70 con 0x7f95ec03ea80 2024-08-19T11:21:36.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.141+0000 7f9608ff9640 1 -- 172.21.15.71:0/722702763 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f960c06ca70 con 0x7f95ec03ea80 2024-08-19T11:21:36.141 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2024-08-19T11:21:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 >> v2:172.21.15.135:6800/726754104 conn(0x7f95ec03ea80 msgr2=0x7f95ec040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 --2- 172.21.15.71:0/722702763 >> v2:172.21.15.135:6800/726754104 conn(0x7f95ec03ea80 0x7f95ec040f40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009560 tx=0x7f95fc009190 comp rx=0 tx=0).stop 2024-08-19T11:21:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 10 monclient: shutdown 2024-08-19T11:21:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 msgr2=0x7f960c124ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 0x7f960c124ee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009920 tx=0x7f95f40046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 shutdown_connections 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 --2- 172.21.15.71:0/722702763 >> v2:172.21.15.135:6800/726754104 conn(0x7f95ec03ea80 0x7f95ec040f40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f960c1397f0 0x7f960c125960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f960c0a6e10 0x7f960c125420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 --2- 172.21.15.71:0/722702763 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7f960c0a6a30 0x7f960c124ee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 >> 172.21.15.71:0/722702763 conn(0x7f960c0ac030 msgr2=0x7f960c139060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 shutdown_connections 2024-08-19T11:21:36.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.143+0000 7f96125a3640 1 -- 172.21.15.71:0/722702763 wait complete. 2024-08-19T11:21:36.155 INFO:tasks.ceph:Scrubbing osd.4 2024-08-19T11:21:36.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-19T11:21:36.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1882767872}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2007558562}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4093103696}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4047131920}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=197020963}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2113555929}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3562661961}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131939767}) 2024-08-19T11:21:36.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.217+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=947428920}) 2024-08-19T11:21:36.236 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.236 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.236 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2122335241}) 2024-08-19T11:21:36.236 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4287525306}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3529299559}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1920065779}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1504052040}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.237 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1047199137}) 2024-08-19T11:21:36.238 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.238 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.238 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2024083805}) 2024-08-19T11:21:36.238 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.238 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3329598410}) 2024-08-19T11:21:36.238 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.235+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3387153299}) 2024-08-19T11:21:36.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.262+0000 7f246449f640 10 monclient: get_monmap_and_config 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.262+0000 7f246449f640 10 monclient: build_initial_monmap 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.262+0000 7f246449f640 10 monclient: monmap: 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:36.262795+0000 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:36.262795+0000 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:36.263 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:36.264 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.262+0000 7f246449f640 1 Processor -- start 2024-08-19T11:21:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.262+0000 7f246449f640 1 -- start start 2024-08-19T11:21:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.262+0000 7f246449f640 10 monclient: init 2024-08-19T11:21:36.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient: _add_conns ranks=[5,4,10,1,7,2,0,9,3,6,8] 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f245c1379d0 0x7f245c09d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): picked mon.noname-h con 0x7f245c1379d0 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 0x7f245c137db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): picked mon.noname-c con 0x7f245c0a2aa0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f245c0a47c0 0x7f245c0a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): picked mon.noname-f con 0x7f245c0a47c0 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f245c06cd60 con 0x7f245c0a47c0 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f245c09cd00 con 0x7f245c0a2aa0 2024-08-19T11:21:36.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f245c06d420 con 0x7f245c1379d0 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246449f640 10 monclient(hunting): authenticate will time out at 1354.304485s 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 0x7f245c137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 0x7f245c137db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38280/0 (socket says 172.21.15.71:38280) 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 -- 172.21.15.71:0/2312430955 learned_addr learned my addr 172.21.15.71:0/2312430955 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): get_auth_request con 0x7f245c0a2aa0 auth_method 0 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2462a3c640 1 --2- 172.21.15.71:0/2312430955 >> v2:172.21.15.135:3300/0 conn(0x7f245c0a47c0 0x7f245c0a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2462a3c640 10 monclient(hunting): get_auth_request con 0x7f245c0a47c0 auth_method 0 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2462a3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2462a3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246223b640 1 --2- 172.21.15.71:0/2312430955 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f245c1379d0 0x7f245c09d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2462a3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246223b640 10 monclient(hunting): get_auth_request con 0x7f245c1379d0 auth_method 0 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246223b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246223b640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f246223b640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient(hunting): handle_auth_done global_id 85603 payload 274 2024-08-19T11:21:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 -- 172.21.15.71:0/2312430955 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f245c1379d0 msgr2=0x7f245c09d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 --2- 172.21.15.71:0/2312430955 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f245c1379d0 0x7f245c09d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 -- 172.21.15.71:0/2312430955 >> v2:172.21.15.135:3300/0 conn(0x7f245c0a47c0 msgr2=0x7f245c0a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 --2- 172.21.15.71:0/2312430955 >> v2:172.21.15.135:3300/0 conn(0x7f245c0a47c0 0x7f245c0a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient: _finish_hunting 0 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 monclient: found mon.noname-c 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2461a3a640 1 -- 172.21.15.71:0/2312430955 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c0a62c0 con 0x7f245c0a2aa0 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.263+0000 7f2462a3c640 1 --2- 172.21.15.71:0/2312430955 >> v2:172.21.15.135:3300/0 conn(0x7f245c0a47c0 0x7f245c0a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461a3a640 1 -- 172.21.15.71:0/2312430955 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 msgr2=0x7f245c137db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461a3a640 1 --2- 172.21.15.71:0/2312430955 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 0x7f245c137db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24500098a0 tx=0x7f245002a0d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=3c57b426528a87d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 1 -- 172.21.15.71:0/2312430955 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2450037070 con 0x7f245c0a2aa0 2024-08-19T11:21:36.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: dump: 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.276 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: _finish_auth 0 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: _check_auth_tickets 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 1 -- 172.21.15.71:0/2312430955 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245002adf0 con 0x7f245c0a2aa0 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f246449f640 5 monclient: authenticate success, global_id 85603 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f246449f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:36.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f246449f640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 1 -- 172.21.15.71:0/2312430955 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2450030c20 con 0x7f245c0a2aa0 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f246449f640 4 set_mon_vals no callback set 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.266+0000 7f2461239640 10 monclient: dump: 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.278 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 10 monclient: shutdown 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 -- 172.21.15.71:0/2312430955 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 msgr2=0x7f245c137db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 --2- 172.21.15.71:0/2312430955 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 0x7f245c137db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24500098a0 tx=0x7f245002a0d0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 -- 172.21.15.71:0/2312430955 shutdown_connections 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 --2- 172.21.15.71:0/2312430955 >> v2:172.21.15.135:3300/0 conn(0x7f245c0a47c0 0x7f245c0a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 --2- 172.21.15.71:0/2312430955 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a2aa0 0x7f245c137db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 --2- 172.21.15.71:0/2312430955 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f245c1379d0 0x7f245c09d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 -- 172.21.15.71:0/2312430955 >> 172.21.15.71:0/2312430955 conn(0x7f245c0a93e0 msgr2=0x7f245c0a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 -- 172.21.15.71:0/2312430955 shutdown_connections 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 1 -- 172.21.15.71:0/2312430955 wait complete. 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.267+0000 7f246449f640 10 monclient: build_initial_monmap 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient: monmap: 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:36.280 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 Processor -- start 2024-08-19T11:21:36.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 -- start start 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient: init 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient: _add_conns ranks=[3,4,2,6,8,1,0,5,7] 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f245c0a2aa0 0x7f245c1cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): picked mon.noname-g con 0x7f245c0a2aa0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 0x7f245c1ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): picked mon.noname-c con 0x7f245c0a47c0 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 0x7f245c121e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): picked mon.noname-b con 0x7f245c1379d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f245c09fd40 con 0x7f245c1379d0 2024-08-19T11:21:36.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f245c0a5190 con 0x7f245c0a2aa0 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f245c09e7f0 con 0x7f245c0a47c0 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f246449f640 10 monclient(hunting): authenticate will time out at 1354.309841s 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 0x7f245c1ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2462a3c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 0x7f245c121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 0x7f245c1ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38292/0 (socket says 172.21.15.71:38292) 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 1 -- 172.21.15.71:0/586072883 learned_addr learned my addr 172.21.15.71:0/586072883 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2462a3c640 10 monclient(hunting): get_auth_request con 0x7f245c1379d0 auth_method 0 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2462a3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2462a3c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2462a3c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 10 monclient(hunting): get_auth_request con 0x7f245c0a47c0 auth_method 0 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2461a3a640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.268+0000 7f2462a3c640 1 -- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 msgr2=0x7f245c121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2462a3c640 1 -- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 msgr2=0x7f245c121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2462a3c640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 0x7f245c121e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2462a3c640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 0x7f245c121e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 10 monclient(hunting): handle_auth_done global_id 85612 payload 824 2024-08-19T11:21:36.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 1 -- 172.21.15.71:0/586072883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f245c0a2aa0 msgr2=0x7f245c1cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f246223b640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f245c0a2aa0 0x7f245c1cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f245c0a2aa0 0x7f245c1cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 1 -- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 msgr2=0x7f245c121e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f245c1379d0 0x7f245c121e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 10 monclient: _finish_hunting 0 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 1 monclient: found mon.noname-c 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:36.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:36.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f2461a3a640 1 -- 172.21.15.71:0/586072883 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c1246a0 con 0x7f245c0a47c0 2024-08-19T11:21:36.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f246223b640 10 monclient: get_auth_request con 0x7f245c0a2aa0 auth_method 0 2024-08-19T11:21:36.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.269+0000 7f246223b640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f245c0a2aa0 0x7f245c1cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:36.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f2461a3a640 1 -- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 msgr2=0x7f245c1ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:36.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f2461a3a640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 0x7f245c1ccba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24500097c0 tx=0x7f24500046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2450041020 con 0x7f245c0a47c0 2024-08-19T11:21:36.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:36.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: dump: 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.289 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: _finish_auth 0 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2450003c50 con 0x7f245c0a47c0 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2450037040 con 0x7f245c0a47c0 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:36.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f245affd640 10 monclient: dump: 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 5 monclient: authenticate success, global_id 85612 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 10 monclient: _renew_subs 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f2460a38640 4 set_mon_vals no callback set 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c1257f0 con 0x7f245c0a47c0 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 10 monclient: _renew_subs 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.271+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c125ad0 con 0x7f245c0a47c0 2024-08-19T11:21:36.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f246449f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f245c0a87c0 con 0x7f245c0a47c0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f2450044020 con 0x7f245c0a47c0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6800/726754104 conn(0x7f244803ea80 0x7f2448040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f2450071e70 con 0x7f245c0a47c0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6809/879361358 conn(0x7f2448044590 0x7f24480469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 --> v2:172.21.15.135:6809/879361358 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2450034e90 con 0x7f2448044590 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (secure 0 0 0) 0x7f2450074440 con 0x7f245c0a47c0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.272+0000 7f245affd640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.273+0000 7f246223b640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6800/726754104 conn(0x7f244803ea80 0x7f2448040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.273+0000 7f246223b640 10 monclient: get_auth_request con 0x7f244803ea80 auth_method 0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.273+0000 7f2462a3c640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6809/879361358 conn(0x7f2448044590 0x7f24480469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.273+0000 7f2462a3c640 10 monclient: get_auth_request con 0x7f2448044590 auth_method 0 2024-08-19T11:21:36.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.275+0000 7f246223b640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6800/726754104 conn(0x7f244803ea80 0x7f2448040f40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f244c009ed0 tx=0x7f244c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.277+0000 7f2462a3c640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6809/879361358 conn(0x7f2448044590 0x7f24480469b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.278+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== osd.4 v2:172.21.15.135:6809/879361358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2450034e90 con 0x7f2448044590 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3584420015}) 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4179615374}) 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1606627503}) 2024-08-19T11:21:36.296 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1308963255}) 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2313864917}) 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2272064488}) 2024-08-19T11:21:36.297 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.298 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.298 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3337276278}) 2024-08-19T11:21:36.298 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.298 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934085713}) 2024-08-19T11:21:36.298 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.281+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=993900770}) 2024-08-19T11:21:36.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.291+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 --> v2:172.21.15.135:6809/879361358 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f245c0a54c0 con 0x7f2448044590 2024-08-19T11:21:36.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f245affd640 1 -- 172.21.15.71:0/586072883 <== osd.4 v2:172.21.15.135:6809/879361358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f245c0a54c0 con 0x7f2448044590 2024-08-19T11:21:36.299 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:36.299 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T11:21:36.299 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6809/879361358 conn(0x7f2448044590 msgr2=0x7f24480469b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6809/879361358 conn(0x7f2448044590 0x7f24480469b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6800/726754104 conn(0x7f244803ea80 msgr2=0x7f2448040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 --2- 172.21.15.71:0/586072883 >> v2:172.21.15.135:6800/726754104 conn(0x7f244803ea80 0x7f2448040f40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f244c009ed0 tx=0x7f244c00b040 comp rx=0 tx=0).stop 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 10 monclient: shutdown 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 msgr2=0x7f245c1ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 --2- 172.21.15.71:0/586072883 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f245c0a47c0 0x7f245c1ccba0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24500097c0 tx=0x7f24500046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f2462a3c640 1 -- 172.21.15.71:0/586072883 reap_dead start 2024-08-19T11:21:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 shutdown_connections 2024-08-19T11:21:36.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 >> 172.21.15.71:0/586072883 conn(0x7f245c0a93e0 msgr2=0x7f245c0a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:36.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 shutdown_connections 2024-08-19T11:21:36.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.292+0000 7f246449f640 1 -- 172.21.15.71:0/586072883 wait complete. 2024-08-19T11:21:36.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.402+0000 7fcf3838a640 10 monclient: get_monmap_and_config 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.402+0000 7fcf3838a640 10 monclient: build_initial_monmap 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.402+0000 7fcf3838a640 10 monclient: monmap: 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:36.402682+0000 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:36.402682+0000 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:36.404 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.402+0000 7fcf3838a640 1 Processor -- start 2024-08-19T11:21:36.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.402+0000 7fcf3838a640 1 -- start start 2024-08-19T11:21:36.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.402+0000 7fcf3838a640 10 monclient: init 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient: _add_conns ranks=[8,6,2,10,0,5,4,3,1,9,7] 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf300a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): picked mon.noname-e con 0x7fcf300a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 0x7fcf300a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): picked mon.noname-d con 0x7fcf300a6e10 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 0x7fcf30139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): picked mon.noname-b con 0x7fcf30139860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcf300a4f90 con 0x7fcf30139860 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fcf300a6380 con 0x7fcf300a6e10 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcf300a49d0 con 0x7fcf300a6a30 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf3838a640 10 monclient(hunting): authenticate will time out at 1354.444447s 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 0x7fcf300a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 0x7fcf30139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf300a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 0x7fcf300a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:48034/0 (socket says 172.21.15.71:48034) 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 0x7fcf30139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37486/0 (socket says 172.21.15.71:37486) 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 -- 172.21.15.71:0/3689734311 learned_addr learned my addr 172.21.15.71:0/3689734311 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): get_auth_request con 0x7fcf300a6e10 auth_method 0 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): get_auth_request con 0x7fcf300a6a30 auth_method 0 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): get_auth_request con 0x7fcf30139860 auth_method 0 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient(hunting): handle_auth_done global_id 104955 payload 274 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 -- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 msgr2=0x7fcf300a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf300a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 -- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 msgr2=0x7fcf30139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 0x7fcf30139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient: _finish_hunting 0 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 monclient: found mon.noname-d 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:36.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf35925640 1 -- 172.21.15.71:0/3689734311 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300a46f0 con 0x7fcf300a6e10 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36126640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf300a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.403+0000 7fcf36927640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 0x7fcf30139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35925640 1 -- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 msgr2=0x7fcf300a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35925640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 0x7fcf300a71f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098d0 tx=0x7fcf2002a0a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=178c52901ccfe76e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 1 -- 172.21.15.71:0/3689734311 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf20037070 con 0x7fcf300a6e10 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: dump: 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.413 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.414 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: _finish_auth 0 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: _check_auth_tickets 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 1 -- 172.21.15.71:0/3689734311 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2002adc0 con 0x7fcf300a6e10 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf3838a640 5 monclient: authenticate success, global_id 104955 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 1 -- 172.21.15.71:0/3689734311 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf20030c20 con 0x7fcf300a6e10 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf3838a640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf3838a640 4 set_mon_vals no callback set 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.406+0000 7fcf35124640 10 monclient: dump: 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.415 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 10 monclient: shutdown 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 -- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 msgr2=0x7fcf300a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 0x7fcf300a71f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098d0 tx=0x7fcf2002a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 -- 172.21.15.71:0/3689734311 shutdown_connections 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf30139860 0x7fcf30139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fcf300a6e10 0x7fcf300a71f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 --2- 172.21.15.71:0/3689734311 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf300a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 -- 172.21.15.71:0/3689734311 >> 172.21.15.71:0/3689734311 conn(0x7fcf300ac030 msgr2=0x7fcf300ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 -- 172.21.15.71:0/3689734311 shutdown_connections 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.407+0000 7fcf3838a640 1 -- 172.21.15.71:0/3689734311 wait complete. 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient: build_initial_monmap 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient: monmap: 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:36.417 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:36.418 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 Processor -- start 2024-08-19T11:21:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 -- start start 2024-08-19T11:21:36.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient: init 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient: _add_conns ranks=[8,0,4,2,3,1,7,6,5] 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient(hunting): picked mon.noname-e con 0x7fcf300a6a30 addr [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6e10 0x7fcf30138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient(hunting): picked mon.noname-a con 0x7fcf300a6e10 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcf30139860 0x7fcf301390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient(hunting): picked mon.noname-c con 0x7fcf30139860 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf300a7730 con 0x7fcf300a6e10 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.408+0000 7fcf3838a640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7fcf3013a1a0 con 0x7fcf30139860 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf3838a640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf3838a640 1 -- --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_getmap magic: 0 -- 0x7fcf30124270 con 0x7fcf300a6a30 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf3838a640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf3838a640 10 monclient(hunting): authenticate will time out at 1354.450019s 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 --2- >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3304/0 says I am v2:172.21.15.71:45588/0 (socket says 172.21.15.71:45588) 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 -- 172.21.15.71:0/2837192510 learned_addr learned my addr 172.21.15.71:0/2837192510 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): get_auth_request con 0x7fcf300a6a30 auth_method 0 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36927640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcf30139860 0x7fcf301390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6e10 0x7fcf30138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36927640 10 monclient(hunting): get_auth_request con 0x7fcf30139860 auth_method 0 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36927640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36927640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36927640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): get_auth_request con 0x7fcf300a6e10 auth_method 0 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf35925640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:36.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient(hunting): handle_auth_done global_id 124298 payload 824 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 -- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcf30139860 msgr2=0x7fcf301390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcf30139860 0x7fcf301390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 -- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6e10 msgr2=0x7fcf30138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6e10 0x7fcf30138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient: _finish_hunting 0 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 monclient: found mon.noname-e 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.71:3304/0 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.409+0000 7fcf36126640 1 -- 172.21.15.71:0/2837192510 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300a21f0 con 0x7fcf300a6a30 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf36126640 1 -- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 msgr2=0x7fcf301ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf36126640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00ebe0 tx=0x7fcf2c00c520 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mon.8 v2:172.21.15.71:3304/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2c017070 con 0x7fcf300a6a30 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: dump: 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.427 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: _finish_auth 0 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mon.8 v2:172.21.15.71:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00cde0 con 0x7fcf300a6a30 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf3838a640 5 monclient: authenticate success, global_id 124298 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf3838a640 10 monclient: _renew_subs 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf3838a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf30126260 con 0x7fcf300a6a30 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mon.8 v2:172.21.15.71:3304/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fcf2c013d50 con 0x7fcf300a6a30 2024-08-19T11:21:36.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf26ffd640 10 monclient: dump: 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:36.429 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 10 monclient: _renew_subs 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.411+0000 7fcf34923640 4 set_mon_vals no callback set 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf300a26b0 con 0x7fcf300a6a30 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf36126640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00ebe0 tx=0x7fcf2c00c520 comp rx=0 tx=0).queue_received will delay after 1.72407e+09 on 0x7fcf2c01a070 mgrmap(e 5) 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.71:3304/0 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 --> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf3013a500 con 0x7fcf300a6a30 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.412+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mon.8 v2:172.21.15.71:3304/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fcf2c01a070 con 0x7fcf300a6a30 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.413+0000 7fcf26ffd640 1 --2- 172.21.15.71:0/2837192510 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:36.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.413+0000 7fcf35925640 1 --2- 172.21.15.71:0/2837192510 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:36.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.413+0000 7fcf35925640 10 monclient: get_auth_request con 0x7fcf1403eab0 auth_method 0 2024-08-19T11:21:36.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.416+0000 7fcf35925640 1 --2- 172.21.15.71:0/2837192510 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcf20034000 tx=0x7fcf2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:36.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:36.417+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mon.8 v2:172.21.15.71:3304/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7fcf2c00f040 con 0x7fcf300a6a30 2024-08-19T11:21:36.545 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3083437023}) 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2645958661}) 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.546 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3652511869}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3622291421}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=205997764}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=946741405}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.547 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1613754041}) 2024-08-19T11:21:36.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3000145238}) 2024-08-19T11:21:36.548 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.543+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1000889878}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3293126320}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3907814642}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3441709725}) 2024-08-19T11:21:36.858 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2621762901}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2558095891}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=444308157}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31401194}) 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.859 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3557941096}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.853+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=803140499}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2337678064}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=587967033}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3236835235}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.860 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=11071701}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1723786688}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3640837918}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3758428627}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3491788522}) 2024-08-19T11:21:36.861 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.854+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=52146164}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3083898881}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1911156245}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1649666664}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.862 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2198157916}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=399845986}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1130665365}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2859357122}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=977041843}) 2024-08-19T11:21:36.863 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.856+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=216936870}) 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3805301263}) 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2298412913}) 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.872 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=607860981}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3378798822}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4145621657}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3479023534}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=194016903}) 2024-08-19T11:21:36.873 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325691008}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.857+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3772961462}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3412608270}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=232374182}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993104492}) 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.858+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.874 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2051131456}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4276453140}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2944513957}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3950744130}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163084574}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.859+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1743620437}) 2024-08-19T11:21:36.875 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2150360917}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=636434933}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2123522539}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1824516597}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.876 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2182577455}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=413180943}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=466099519}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=887388218}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.860+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1865489125}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3463420959}) 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.877 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=823927191}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3723444538}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=245822160}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3565837688}) 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.878 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=465562525}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2021074881}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167819618}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.861+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1940659722}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1641235147}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.879 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=182670806}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=927509890}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2086197390}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4193777768}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=781734422}) 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.862+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.880 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1526465708}) 2024-08-19T11:21:36.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:36.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4238054157}) 2024-08-19T11:21:36.881 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:36.863+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=318083}) 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1452336667}) 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2764335067}) 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3496185161}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3639353205}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=57843428}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=638968619}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2243881039}) 2024-08-19T11:21:37.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463739915}) 2024-08-19T11:21:37.226 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.221+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=936197748}) 2024-08-19T11:21:37.229 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.229 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.229 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4144726686}) 2024-08-19T11:21:37.230 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.230 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.230 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=806925681}) 2024-08-19T11:21:37.230 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.230 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.230 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1857258010}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=497302377}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=424904352}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2821167497}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=204787006}) 2024-08-19T11:21:37.231 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.232 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175164000}) 2024-08-19T11:21:37.232 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.227+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=811457636}) 2024-08-19T11:21:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.240+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mon.8 v2:172.21.15.71:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fcf2c021070 con 0x7fcf300a6a30 2024-08-19T11:21:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.240+0000 7fcf26ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.240+0000 7fcf26ffd640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:37.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2155498920}) 2024-08-19T11:21:37.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2628800313}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3544096284}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2044510842}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=698359498}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3671451032}) 2024-08-19T11:21:37.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330887937}) 2024-08-19T11:21:37.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:37.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3046859545}) 2024-08-19T11:21:37.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.245+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3083608027}) 2024-08-19T11:21:37.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.416+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcf30124f30 con 0x7fcf1403eab0 2024-08-19T11:21:37.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.417+0000 7fcf26ffd640 1 -- 172.21.15.71:0/2837192510 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcf2002adc0 con 0x7fcf1403eab0 2024-08-19T11:21:37.418 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2024-08-19T11:21:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 msgr2=0x7fcf14040f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 --2- 172.21.15.71:0/2837192510 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcf20034000 tx=0x7fcf2002e000 comp rx=0 tx=0).stop 2024-08-19T11:21:37.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 10 monclient: shutdown 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 msgr2=0x7fcf301ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00ebe0 tx=0x7fcf2c00c520 comp rx=0 tx=0).stop 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 shutdown_connections 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 --2- 172.21.15.71:0/2837192510 >> v2:172.21.15.135:6800/726754104 conn(0x7fcf1403eab0 0x7fcf14040f70 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf300a6e10 0x7fcf30138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7fcf30139860 0x7fcf301390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 --2- 172.21.15.71:0/2837192510 >> [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] conn(0x7fcf300a6a30 0x7fcf301ce2d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 >> 172.21.15.71:0/2837192510 conn(0x7fcf300ac030 msgr2=0x7fcf301c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 shutdown_connections 2024-08-19T11:21:37.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.419+0000 7fcf3838a640 1 -- 172.21.15.71:0/2837192510 wait complete. 2024-08-19T11:21:37.430 INFO:tasks.ceph:Scrubbing osd.5 2024-08-19T11:21:37.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-19T11:21:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.531+0000 7f205643f640 10 monclient: get_monmap_and_config 2024-08-19T11:21:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.531+0000 7f205643f640 10 monclient: build_initial_monmap 2024-08-19T11:21:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.531+0000 7f205643f640 10 monclient: monmap: 2024-08-19T11:21:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.532 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:37.532139+0000 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:37.532139+0000 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:37.533 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:37.534 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 Processor -- start 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 -- start start 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient: init 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient: _add_conns ranks=[9,5,0,1,10,4,6,3,2,7,8] 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f20500a6a30 0x7f20500a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): picked mon.noname-a con 0x7f20500a6a30 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:37.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 0x7f20500a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): picked mon.noname-h con 0x7f20500a7350 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f20501397f0 addr v1:172.21.15.71:6789/0 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20500a8910 con 0x7f20501397f0 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f20500a3800 con 0x7f20500a6a30 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f205006d1c0 con 0x7f20500a7350 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f205643f640 10 monclient(hunting): authenticate will time out at 1355.573819s 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f20500a6a30 0x7f20500a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f20500a6a30 0x7f20500a6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58176/0 (socket says 172.21.15.71:58176) 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 1 -- 172.21.15.71:0/4100012457 learned_addr learned my addr 172.21.15.71:0/4100012457 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 10 monclient(hunting): get_auth_request con 0x7f20500a6a30 auth_method 0 2024-08-19T11:21:37.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.532+0000 7f204ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 1 --2- 172.21.15.71:0/4100012457 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 0x7f20500a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): get_auth_request con 0x7f20500a7350 auth_method 0 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient(hunting): handle_auth_done global_id 46715 payload 274 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 1 -- 172.21.15.71:0/4100012457 >> v2:172.21.15.71:3300/0 conn(0x7f20500a6a30 msgr2=0x7f20500a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 1 --2- 172.21.15.71:0/4100012457 >> v2:172.21.15.71:3300/0 conn(0x7f20500a6a30 0x7f20500a6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 1 -- 172.21.15.71:0/4100012457 >> v1:172.21.15.71:6789/0 conn(0x7f20501397f0 legacy=0x7f2050139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 1 monclient: found mon.noname-h 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.135:3302/0 2024-08-19T11:21:37.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.533+0000 7f204f7fe640 1 -- 172.21.15.71:0/4100012457 --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20500a2fc0 con 0x7f20500a7350 2024-08-19T11:21:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204f7fe640 1 -- 172.21.15.71:0/4100012457 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 msgr2=0x7f20500a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204f7fe640 1 --2- 172.21.15.71:0/4100012457 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 0x7f20500a7750 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f20440097d0 tx=0x7f204402a080 comp rx=0 tx=0).ready entity=mon.5 client_cookie=c0bf7e1534e28745 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 1 -- 172.21.15.71:0/4100012457 <== mon.5 v2:172.21.15.135:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2044037070 con 0x7f20500a7350 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: dump: 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.545 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: _finish_auth 0 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: _check_auth_tickets 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 1 -- 172.21.15.71:0/4100012457 <== mon.5 v2:172.21.15.135:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204402ada0 con 0x7f20500a7350 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f205643f640 5 monclient: authenticate success, global_id 46715 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f205643f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:37.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f205643f640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 1 -- 172.21.15.71:0/4100012457 <== mon.5 v2:172.21.15.135:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2044030c20 con 0x7f20500a7350 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f205643f640 4 set_mon_vals no callback set 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.536+0000 7f204effd640 10 monclient: dump: 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.547 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 10 monclient: shutdown 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 -- 172.21.15.71:0/4100012457 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 msgr2=0x7f20500a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 --2- 172.21.15.71:0/4100012457 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 0x7f20500a7750 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f20440097d0 tx=0x7f204402a080 comp rx=0 tx=0).stop 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 -- 172.21.15.71:0/4100012457 shutdown_connections 2024-08-19T11:21:37.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 --2- 172.21.15.71:0/4100012457 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a7350 0x7f20500a7750 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 --2- 172.21.15.71:0/4100012457 >> v2:172.21.15.71:3300/0 conn(0x7f20500a6a30 0x7f20500a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 -- 172.21.15.71:0/4100012457 >> 172.21.15.71:0/4100012457 conn(0x7f20500ac030 msgr2=0x7f20500ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 -- 172.21.15.71:0/4100012457 shutdown_connections 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 1 -- 172.21.15.71:0/4100012457 wait complete. 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 10 monclient: build_initial_monmap 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.537+0000 7f205643f640 10 monclient: monmap: 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.549 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 Processor -- start 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 -- start start 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient: init 2024-08-19T11:21:37.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient: _add_conns ranks=[5,4,2,0,3,1,8,7,6] 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a6a30 0x7f2050138510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): picked mon.noname-h con 0x7f20500a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 0x7f2050138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): picked mon.noname-c con 0x7f20500a7350 addr [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20501397f0 0x7f2050124230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): picked mon.noname-b con 0x7f20501397f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f20500a5990 con 0x7f20501397f0 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 -- --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_getmap magic: 0 -- 0x7f20500a5140 con 0x7f20500a7350 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f205013a3b0 con 0x7f20500a6a30 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f205643f640 10 monclient(hunting): authenticate will time out at 1355.579757s 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 0x7f2050138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20501397f0 0x7f2050124230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 1 --2- >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 0x7f2050138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3302/0 says I am v2:172.21.15.71:38314/0 (socket says 172.21.15.71:38314) 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20501397f0 0x7f2050124230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37502/0 (socket says 172.21.15.71:37502) 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 1 -- 172.21.15.71:0/2761443991 learned_addr learned my addr 172.21.15.71:0/2761443991 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): get_auth_request con 0x7f20500a7350 auth_method 0 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): get_auth_request con 0x7f20501397f0 auth_method 0 2024-08-19T11:21:37.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f204f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.538+0000 7f20549dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204ffff640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a6a30 0x7f2050138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 10 monclient(hunting): handle_auth_done global_id 85630 payload 824 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 1 -- 172.21.15.71:0/2761443991 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a6a30 msgr2=0x7f2050138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a6a30 0x7f2050138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 1 -- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20501397f0 msgr2=0x7f2050124230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20501397f0 0x7f2050124230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 10 monclient: _finish_hunting 0 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 1 monclient: found mon.noname-c 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3302/0 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204f7fe640 1 -- 172.21.15.71:0/2761443991 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2050138f90 con 0x7f20500a7350 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204ffff640 10 monclient: get_auth_request con 0x7f20500a6a30 auth_method 0 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f204ffff640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f20500a6a30 0x7f2050138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.539+0000 7f20549dc640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20501397f0 0x7f2050124230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204f7fe640 1 -- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 msgr2=0x7f2050138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204f7fe640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 0x7f2050138a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2044035040 tx=0x7f20440046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== mon.4 v2:172.21.15.71:3302/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f2044037040 con 0x7f20500a7350 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-08-19T11:21:37.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: dump: 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.555 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: _finish_auth 0 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: _check_auth_tickets 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== mon.4 v2:172.21.15.71:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044042070 con 0x7f20500a7350 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 5 monclient: authenticate success, global_id 85630 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 10 monclient: _renew_subs 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20501394d0 con 0x7f20500a7350 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== mon.4 v2:172.21.15.71:3302/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f204403d8b0 con 0x7f20500a7350 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204cff9640 10 monclient: dump: 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.557 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 10 monclient: _renew_subs 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f2050127ef0 con 0x7f20500a7350 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.541+0000 7f204e7fc640 4 set_mon_vals no callback set 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.542+0000 7f205643f640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3302/0 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.542+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 --> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20500a6e10 con 0x7f20500a7350 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.542+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== mon.4 v2:172.21.15.71:3302/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f204403d440 con 0x7f20500a7350 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.542+0000 7f204cff9640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6800/726754104 conn(0x7f203c03ea80 0x7f203c040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.542+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== mon.4 v2:172.21.15.71:3302/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f2044071df0 con 0x7f20500a7350 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f204cff9640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6801/2277825240 conn(0x7f203c044520 0x7f203c046940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 --> v2:172.21.15.135:6801/2277825240 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f204403ee50 con 0x7f203c044520 2024-08-19T11:21:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== mon.4 v2:172.21.15.71:3302/0 6 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (secure 0 0 0) 0x7f20440743c0 con 0x7f20500a7350 2024-08-19T11:21:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f204cff9640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-08-19T11:21:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f204ffff640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6800/726754104 conn(0x7f203c03ea80 0x7f203c040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f204ffff640 10 monclient: get_auth_request con 0x7f203c03ea80 auth_method 0 2024-08-19T11:21:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f20549dc640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6801/2277825240 conn(0x7f203c044520 0x7f203c046940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.543+0000 7f20549dc640 10 monclient: get_auth_request con 0x7f203c044520 auth_method 0 2024-08-19T11:21:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.545+0000 7f204ffff640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6800/726754104 conn(0x7f203c03ea80 0x7f203c040f40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2040009ac0 tx=0x7f2040008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.548+0000 7f20549dc640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6801/2277825240 conn(0x7f203c044520 0x7f203c046940 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.548+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== osd.5 v2:172.21.15.135:6801/2277825240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f204403ee50 con 0x7f203c044520 2024-08-19T11:21:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.561+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 --> v2:172.21.15.135:6801/2277825240 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20500644e0 con 0x7f203c044520 2024-08-19T11:21:37.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f204cff9640 1 -- 172.21.15.71:0/2761443991 <== osd.5 v2:172.21.15.135:6801/2277825240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f20500644e0 con 0x7f203c044520 2024-08-19T11:21:37.563 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-08-19T11:21:37.563 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-19T11:21:37.563 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6801/2277825240 conn(0x7f203c044520 msgr2=0x7f203c046940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6801/2277825240 conn(0x7f203c044520 0x7f203c046940 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6800/726754104 conn(0x7f203c03ea80 msgr2=0x7f203c040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 --2- 172.21.15.71:0/2761443991 >> v2:172.21.15.135:6800/726754104 conn(0x7f203c03ea80 0x7f203c040f40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2040009ac0 tx=0x7f2040008040 comp rx=0 tx=0).stop 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 10 monclient: shutdown 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 msgr2=0x7f2050138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 --2- 172.21.15.71:0/2761443991 >> [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] conn(0x7f20500a7350 0x7f2050138a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2044035040 tx=0x7f20440046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f20549dc640 1 -- 172.21.15.71:0/2761443991 reap_dead start 2024-08-19T11:21:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 shutdown_connections 2024-08-19T11:21:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 >> 172.21.15.71:0/2761443991 conn(0x7f20500ac030 msgr2=0x7f20501c0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 shutdown_connections 2024-08-19T11:21:37.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.562+0000 7f205643f640 1 -- 172.21.15.71:0/2761443991 wait complete. 2024-08-19T11:21:37.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.670+0000 7f91365aa640 10 monclient: get_monmap_and_config 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.670+0000 7f91365aa640 10 monclient: build_initial_monmap 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.670+0000 7f91365aa640 10 monclient: monmap: 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:37.670757+0000 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:37.670757+0000 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.671 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:37.672 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.670+0000 7f91365aa640 1 Processor -- start 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 1 -- start start 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient: init 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient: _add_conns ranks=[1,2,9,4,8,6,10,3,5,7,0] 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f91300a3cd0 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 0x7f91300a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): picked mon.noname-b con 0x7f91300a40b0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f913013ed00 0x7f91301410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): picked mon.noname-a con 0x7f913013ed00 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:37.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91300a0ae0 con 0x7f91300a3cd0 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f91300a1410 con 0x7f913013ed00 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91300a0dc0 con 0x7f91300a40b0 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f91365aa640 10 monclient(hunting): authenticate will time out at 1355.712653s 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 0x7f91300a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 0x7f91300a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37512/0 (socket says 172.21.15.71:37512) 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 1 -- 172.21.15.71:0/1781003313 learned_addr learned my addr 172.21.15.71:0/1781003313 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): get_auth_request con 0x7f91300a40b0 auth_method 0 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 1 --2- 172.21.15.71:0/1781003313 >> v2:172.21.15.71:3300/0 conn(0x7f913013ed00 0x7f91301410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): get_auth_request con 0x7f913013ed00 auth_method 0 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9134b47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.671+0000 7f9127fff640 10 monclient(hunting): handle_auth_done global_id 76142 payload 274 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 1 -- 172.21.15.71:0/1781003313 >> v2:172.21.15.71:3300/0 conn(0x7f913013ed00 msgr2=0x7f91301410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 1 --2- 172.21.15.71:0/1781003313 >> v2:172.21.15.71:3300/0 conn(0x7f913013ed00 0x7f91301410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 1 -- 172.21.15.71:0/1781003313 >> v1:172.21.15.135:6789/0 conn(0x7f91300a3cd0 legacy=0x7f91300a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 1 monclient: found mon.noname-b 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:37.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.672+0000 7f9127fff640 1 -- 172.21.15.71:0/1781003313 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300a10a0 con 0x7f91300a40b0 2024-08-19T11:21:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f9127fff640 1 -- 172.21.15.71:0/1781003313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 msgr2=0x7f91300a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f9127fff640 1 --2- 172.21.15.71:0/1781003313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 0x7f91300a44d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9118009870 tx=0x7f911802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c2e12d25918017 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 1 -- 172.21.15.71:0/1781003313 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9118037070 con 0x7f91300a40b0 2024-08-19T11:21:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:37.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: dump: 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.685 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 1 -- 172.21.15.71:0/1781003313 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911802ae00 con 0x7f91300a40b0 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f91365aa640 5 monclient: authenticate success, global_id 76142 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f91365aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 1 -- 172.21.15.71:0/1781003313 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9118030c20 con 0x7f91300a40b0 2024-08-19T11:21:37.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f91365aa640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f91365aa640 4 set_mon_vals no callback set 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.674+0000 7f912f7fe640 10 monclient: dump: 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.687 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 10 monclient: shutdown 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:37.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 -- 172.21.15.71:0/1781003313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 msgr2=0x7f91300a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 --2- 172.21.15.71:0/1781003313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 0x7f91300a44d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9118009870 tx=0x7f911802a0a0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 -- 172.21.15.71:0/1781003313 shutdown_connections 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 --2- 172.21.15.71:0/1781003313 >> v2:172.21.15.71:3300/0 conn(0x7f913013ed00 0x7f91301410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 --2- 172.21.15.71:0/1781003313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91300a40b0 0x7f91300a44d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 -- 172.21.15.71:0/1781003313 >> 172.21.15.71:0/1781003313 conn(0x7f91300a91d0 msgr2=0x7f91300a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 -- 172.21.15.71:0/1781003313 shutdown_connections 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.675+0000 7f91365aa640 1 -- 172.21.15.71:0/1781003313 wait complete. 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient: build_initial_monmap 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient: monmap: 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:37.689 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 Processor -- start 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 -- start start 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient: init 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient: _add_conns ranks=[7,0,3,1,8,4,5,2,6] 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 --2- >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91300a3cd0 0x7f913013a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): picked mon.noname-i con 0x7f91300a3cd0 addr [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 0x7f913013ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): picked mon.noname-a con 0x7f91300a40b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f913013ed00 0x7f913013b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): picked mon.noname-g con 0x7f913013ed00 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9130141630 con 0x7f91300a40b0 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f91300a4a10 con 0x7f913013ed00 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 1 -- --> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] -- mon_getmap magic: 0 -- 0x7f91301417b0 con 0x7f91300a3cd0 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.676+0000 7f91365aa640 10 monclient(hunting): authenticate will time out at 1355.717994s 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 0x7f913013ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 0x7f913013ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58190/0 (socket says 172.21.15.71:58190) 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 -- 172.21.15.71:0/3899200619 learned_addr learned my addr 172.21.15.71:0/3899200619 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): get_auth_request con 0x7f91300a40b0 auth_method 0 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9134b47640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f913013ed00 0x7f913013b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f912ffff640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91300a3cd0 0x7f913013a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f912ffff640 10 monclient(hunting): get_auth_request con 0x7f91300a3cd0 auth_method 0 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f912ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f912ffff640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f912ffff640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9134b47640 10 monclient(hunting): get_auth_request con 0x7f913013ed00 auth_method 0 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9134b47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9134b47640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9134b47640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient(hunting): handle_auth_done global_id 76131 payload 824 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 -- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91300a3cd0 msgr2=0x7f913013a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91300a3cd0 0x7f913013a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 -- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f913013ed00 msgr2=0x7f913013b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f913013ed00 0x7f913013b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient: _finish_hunting 0 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 monclient: found mon.noname-a 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9127fff640 1 -- 172.21.15.71:0/3899200619 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300a27b0 con 0x7f91300a40b0 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f912ffff640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91300a3cd0 0x7f913013a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.677+0000 7f9134b47640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f913013ed00 0x7f913013b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f9127fff640 1 -- 172.21.15.71:0/3899200619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 msgr2=0x7f913013ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:37.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f9127fff640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 0x7f913013ae30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f91180097c0 tx=0x7f91180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9118041020 con 0x7f91300a40b0 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: dump: 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.695 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: _finish_auth 0 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: _check_auth_tickets 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9118003c50 con 0x7f91300a40b0 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 5 monclient: authenticate success, global_id 76131 2024-08-19T11:21:37.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 10 monclient: _renew_subs 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9130141100 con 0x7f91300a40b0 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f9118037040 con 0x7f91300a40b0 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912d7fa640 10 monclient: dump: 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.697 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 10 monclient: _renew_subs 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:37.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913013e130 con 0x7f91300a40b0 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.679+0000 7f912effd640 4 set_mon_vals no callback set 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.680+0000 7f91365aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.680+0000 7f91365aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.680+0000 7f91365aa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.680+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91300a44d0 con 0x7f91300a40b0 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.681+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f9118044020 con 0x7f91300a40b0 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.681+0000 7f912d7fa640 1 --2- 172.21.15.71:0/3899200619 >> v2:172.21.15.135:6800/726754104 conn(0x7f911003ea80 0x7f9110040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.681+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f9118071a60 con 0x7f91300a40b0 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.681+0000 7f912ffff640 1 --2- 172.21.15.71:0/3899200619 >> v2:172.21.15.135:6800/726754104 conn(0x7f911003ea80 0x7f9110040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.681+0000 7f912ffff640 10 monclient: get_auth_request con 0x7f911003ea80 auth_method 0 2024-08-19T11:21:37.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.684+0000 7f912ffff640 1 --2- 172.21.15.71:0/3899200619 >> v2:172.21.15.135:6800/726754104 conn(0x7f911003ea80 0x7f9110040f40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9120003eb0 tx=0x7f9120009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.685+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f911804b070 con 0x7f91300a40b0 2024-08-19T11:21:37.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.685+0000 7f912d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.685+0000 7f912d7fa640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:37.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.858+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f913006ed40 con 0x7f911003ea80 2024-08-19T11:21:37.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.859+0000 7f912d7fa640 1 -- 172.21.15.71:0/3899200619 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f913006ed40 con 0x7f911003ea80 2024-08-19T11:21:37.860 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 >> v2:172.21.15.135:6800/726754104 conn(0x7f911003ea80 msgr2=0x7f9110040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 --2- 172.21.15.71:0/3899200619 >> v2:172.21.15.135:6800/726754104 conn(0x7f911003ea80 0x7f9110040f40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9120003eb0 tx=0x7f9120009040 comp rx=0 tx=0).stop 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 10 monclient: shutdown 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 msgr2=0x7f913013ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 0x7f913013ae30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f91180097c0 tx=0x7f91180046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 shutdown_connections 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 --2- 172.21.15.71:0/3899200619 >> v2:172.21.15.135:6800/726754104 conn(0x7f911003ea80 0x7f9110040f40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f913013ed00 0x7f913013b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91300a40b0 0x7f913013ae30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 --2- 172.21.15.71:0/3899200619 >> [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] conn(0x7f91300a3cd0 0x7f913013a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.861+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 >> 172.21.15.71:0/3899200619 conn(0x7f91300a91d0 msgr2=0x7f913009ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.862+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 shutdown_connections 2024-08-19T11:21:37.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.862+0000 7f91365aa640 1 -- 172.21.15.71:0/3899200619 wait complete. 2024-08-19T11:21:37.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:21:37.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.970+0000 7f10691f7640 10 monclient: get_monmap_and_config 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.970+0000 7f10691f7640 10 monclient: build_initial_monmap 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.970+0000 7f10691f7640 10 monclient: monmap: 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:37.970683+0000 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:37.970683+0000 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:37.971 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:37.972 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.970+0000 7f10691f7640 1 Processor -- start 2024-08-19T11:21:37.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.970+0000 7f10691f7640 1 -- start start 2024-08-19T11:21:37.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.970+0000 7f10691f7640 10 monclient: init 2024-08-19T11:21:37.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:37.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient: _add_conns ranks=[2,0,1,10,8,7,6,3,4,9,5] 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f10640a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient(hunting): picked mon.noname-b con 0x7f10640a3cb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f10640a5020 addr v1:172.21.15.71:6789/0 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f10640a45d0 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10640a4da0 con 0x7f10640a5020 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f106413a790 con 0x7f10640a45d0 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f10640a13d0 con 0x7f10640a3cb0 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f10691f7640 10 monclient(hunting): authenticate will time out at 1356.012219s 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f10640a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f106259c640 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f10640a5020 0x7f1064139970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59762/0 (socket says 172.21.15.71:59762) 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f106259c640 1 -- 172.21.15.71:0/3620832745 learned_addr learned my addr 172.21.15.71:0/3620832745 (peer_addr_for_me v1:172.21.15.71:0/0) 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): get_auth_request con 0x7f10640a3cb0 auth_method 0 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient(hunting): handle_auth_done global_id 76151 payload 274 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 1 -- 172.21.15.71:0/3620832745 >> v1:172.21.15.135:6789/0 conn(0x7f10640a45d0 legacy=0x7f106413a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 1 -- 172.21.15.71:0/3620832745 >> v1:172.21.15.71:6789/0 conn(0x7f10640a5020 legacy=0x7f1064139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:37.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:37.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 1 monclient: found mon.noname-b 2024-08-19T11:21:37.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:37.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:37.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.971+0000 7f1062d9d640 1 -- 172.21.15.71:0/3620832745 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10640a0b30 con 0x7f10640a3cb0 2024-08-19T11:21:37.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1062d9d640 1 -- 172.21.15.71:0/3620832745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 msgr2=0x7f10640a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:37.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1062d9d640 1 --2- 172.21.15.71:0/3620832745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f10640a4090 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f10540097d0 tx=0x7f1054029fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b186e3b357aeba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 1 -- 172.21.15.71:0/3620832745 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1054037070 con 0x7f10640a3cb0 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: dump: 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.983 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: _finish_auth 0 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: _check_auth_tickets 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f10691f7640 5 monclient: authenticate success, global_id 76151 2024-08-19T11:21:37.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f10691f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 1 -- 172.21.15.71:0/3620832745 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f105402adf0 con 0x7f10640a3cb0 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f10691f7640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f10691f7640 4 set_mon_vals no callback set 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 1 -- 172.21.15.71:0/3620832745 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1054030c20 con 0x7f10640a3cb0 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.974+0000 7f1061d9b640 10 monclient: dump: 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.985 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 10 monclient: shutdown 2024-08-19T11:21:37.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 -- 172.21.15.71:0/3620832745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 msgr2=0x7f10640a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 --2- 172.21.15.71:0/3620832745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f10640a4090 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f10540097d0 tx=0x7f1054029fb0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 -- 172.21.15.71:0/3620832745 shutdown_connections 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 --2- 172.21.15.71:0/3620832745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f10640a4090 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 -- 172.21.15.71:0/3620832745 >> 172.21.15.71:0/3620832745 conn(0x7f10640a91d0 msgr2=0x7f10640a95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 -- 172.21.15.71:0/3620832745 shutdown_connections 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 1 -- 172.21.15.71:0/3620832745 wait complete. 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 10 monclient: build_initial_monmap 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.975+0000 7f10691f7640 10 monclient: monmap: 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:37.987 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 Processor -- start 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 -- start start 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient: init 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient: _add_conns ranks=[2,0,1,7,6,3,5,4,8] 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f1064125fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): picked mon.noname-b con 0x7f10640a3cb0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 0x7f1064126510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): picked mon.noname-a con 0x7f10640a45d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10640a5020 0x7f1064126a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): picked mon.noname-f con 0x7f10640a5020 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f106406cb70 con 0x7f10640a45d0 2024-08-19T11:21:37.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1064074530 con 0x7f10640a5020 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f10640a54f0 con 0x7f10640a3cb0 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f10691f7640 10 monclient(hunting): authenticate will time out at 1356.017835s 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f1064125fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f106259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 0x7f1064126510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f1064125fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:37540/0 (socket says 172.21.15.71:37540) 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f106259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 0x7f1064126510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58196/0 (socket says 172.21.15.71:58196) 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 1 -- 172.21.15.71:0/1215415088 learned_addr learned my addr 172.21.15.71:0/1215415088 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 10 monclient(hunting): get_auth_request con 0x7f10640a3cb0 auth_method 0 2024-08-19T11:21:37.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f1062d9d640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f106259c640 10 monclient(hunting): get_auth_request con 0x7f10640a45d0 auth_method 0 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f106259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f106259c640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.976+0000 7f106259c640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:37.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106359e640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10640a5020 0x7f1064126a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106359e640 10 monclient(hunting): get_auth_request con 0x7f10640a5020 auth_method 0 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106359e640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106359e640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 10 monclient(hunting): handle_auth_done global_id 76160 payload 824 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 1 -- 172.21.15.71:0/1215415088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10640a5020 msgr2=0x7f1064126a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10640a5020 0x7f1064126a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 1 -- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 msgr2=0x7f1064126510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 0x7f1064126510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 10 monclient: _finish_hunting 0 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 1 monclient: found mon.noname-b 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:37.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f1062d9d640 1 -- 172.21.15.71:0/1215415088 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1064129d60 con 0x7f10640a3cb0 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.977+0000 7f106259c640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 0x7f1064126510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f1062d9d640 1 -- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 msgr2=0x7f1064125fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f1062d9d640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f1064125fd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1054035040 tx=0x7f10540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1054041020 con 0x7f10640a3cb0 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: dump: 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.993 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: _finish_auth 0 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: _check_auth_tickets 2024-08-19T11:21:37.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 5 monclient: authenticate success, global_id 76160 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 10 monclient: _renew_subs 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1054003bb0 con 0x7f10640a3cb0 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1064073380 con 0x7f10640a3cb0 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f1054037040 con 0x7f10640a3cb0 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f104b7fe640 10 monclient: dump: 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:37.995 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:37.996 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 10 monclient: _renew_subs 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1064127a00 con 0x7f10640a3cb0 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.979+0000 7f106159a640 4 set_mon_vals no callback set 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f10691f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f10691f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f10691f7640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f1054044020 con 0x7f10640a3cb0 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10640a4090 con 0x7f10640a3cb0 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f104b7fe640 1 --2- 172.21.15.71:0/1215415088 >> v2:172.21.15.135:6800/726754104 conn(0x7f105003ea80 0x7f1050040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:37.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.980+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f1054071da0 con 0x7f10640a3cb0 2024-08-19T11:21:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.981+0000 7f106259c640 1 --2- 172.21.15.71:0/1215415088 >> v2:172.21.15.135:6800/726754104 conn(0x7f105003ea80 0x7f1050040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.981+0000 7f106259c640 10 monclient: get_auth_request con 0x7f105003ea80 auth_method 0 2024-08-19T11:21:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.983+0000 7f106259c640 1 --2- 172.21.15.71:0/1215415088 >> v2:172.21.15.135:6800/726754104 conn(0x7f105003ea80 0x7f1050040f40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1064128070 tx=0x7f10580098a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.985+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f105404b070 con 0x7f10640a3cb0 2024-08-19T11:21:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.985+0000 7f104b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:37.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:37.985+0000 7f104b7fe640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:38.007 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=640991058}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4243055372}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=710444404}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.008 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=931851193}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3817728373}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1492806385}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071950112}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1502858342}) 2024-08-19T11:21:38.009 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.995+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1212772291}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2449400734}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3229118387}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=556170443}) 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.010 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1105793255}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4021307571}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3231201103}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=110156915}) 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.011 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371032509}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.997+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=857487592}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2213048952}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=128819298}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2947568710}) 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.012 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2559252795}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2577994860}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2235566884}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2905150460}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3888769379}) 2024-08-19T11:21:38.013 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.998+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=932912150}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1862687101}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3966148707}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1759869379}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2175773651}) 2024-08-19T11:21:38.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:37.999+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2370400246}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=122727459}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2058622976}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3684632772}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.000+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=857808314}) 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.015 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=890619733}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1652977679}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1439142199}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3796282191}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.016 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=442372022}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3844967463}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2563218895}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=574658945}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.001+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3627001590}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=483175462}) 2024-08-19T11:21:38.017 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=492646148}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1622897876}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3791862633}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2999577160}) 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.018 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=348010788}) 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3019476050}) 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=493396665}) 2024-08-19T11:21:38.019 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.002+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2618885457}) 2024-08-19T11:21:38.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=930540169}) 2024-08-19T11:21:38.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.136 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3416883161}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3313113380}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.132+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3557066886}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=424952950}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=128580391}) 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.137 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2562861410}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4281924234}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.133+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=722284549}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1078360624}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2934478429}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=74849350}) 2024-08-19T11:21:38.138 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=339160578}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1955202230}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4250997227}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2226733356}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2757550751}) 2024-08-19T11:21:38.139 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.134+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3990854008}) 2024-08-19T11:21:38.181 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.181 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.181 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2146051798}) 2024-08-19T11:21:38.181 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4087483081}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=295433957}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3337394095}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2521657211}) 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.182 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3821100738}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=805025630}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442140654}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.142+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1510235}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1682328327}) 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.183 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4260408176}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1888792083}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2672759151}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3351282984}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2435233308}) 2024-08-19T11:21:38.184 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2166157316}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3355456696}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.143+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3632755921}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.144+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.144+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.144+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=345300024}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3271652407}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3444739366}) 2024-08-19T11:21:38.185 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1603067189}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=496127835}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1484608685}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3137923200}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441649459}) 2024-08-19T11:21:38.186 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.145+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3809356503}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1847716718}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=734021118}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1905134721}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1141782470}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=566523894}) 2024-08-19T11:21:38.187 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1426289617}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216210475}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4205769805}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.146+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=295328045}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1626067546}) 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.188 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2179655500}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2912473785}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3632742373}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2281428931}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=633199903}) 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.189 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3616890790}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625066070}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.147+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3416206456}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2694600643}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3183602911}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1439109302}) 2024-08-19T11:21:38.190 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1484628448}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3833791463}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3962570891}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=328811130}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1526720088}) 2024-08-19T11:21:38.191 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.148+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2331766540}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2504284707}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=875078006}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=577383617}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2159848859}) 2024-08-19T11:21:38.192 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1861994529}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3961354348}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=536682696}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1604896693}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.149+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2738569705}) 2024-08-19T11:21:38.193 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3384374636}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1256004365}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1320790794}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1614576254}) 2024-08-19T11:21:38.194 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2117207630}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2940198234}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4211243694}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3612490638}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.150+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2027028622}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.195 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4018844505}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=943616263}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3361326926}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4199979507}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.196 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3606708872}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1024311379}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4285425697}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683865022}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.151+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=15242557}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.197 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3053895372}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=35759669}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4134269659}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3550587949}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=338512901}) 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.198 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=853496822}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2579608138}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927500298}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.152+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=692139165}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=885455255}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3139345738}) 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.199 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2143603389}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3511809704}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2229351286}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2671615515}) 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.200 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1448878633}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3251229107}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.153+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=220223496}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3013510418}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2316965475}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.201 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2925991933}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1143353998}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1451827776}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3454390691}) 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.202 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=765182629}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2329904088}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.154+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3422534343}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1377911205}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=768652828}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.203 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1104972619}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1934919335}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3427991230}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4015160123}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.204 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935907296}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492829060}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.155+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2730052194}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2257408003}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3298843949}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=317259916}) 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.205 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2518560796}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2650965471}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2425709285}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3774124290}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3140047746}) 2024-08-19T11:21:38.206 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.156+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=877435819}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1925188085}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1062508628}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3925080723}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3559518003}) 2024-08-19T11:21:38.207 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=681752994}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2127049632}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2940235303}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3323459647}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.157+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=331875132}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.208 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=363665090}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3818719740}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2552035854}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3229109698}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.209 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=916295816}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3298307519}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1327303633}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853350831}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.158+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=488147140}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1392011956}) 2024-08-19T11:21:38.210 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3009393659}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1095371779}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2923213253}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=945868670}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.211 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=923948852}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2423338630}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=750683698}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.159+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1383048417}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2557705781}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2076712656}) 2024-08-19T11:21:38.212 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3471716800}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3484441677}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=115665014}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=902575041}) 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.213 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2090198082}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3383091860}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.160+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1360608870}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1608177964}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2057233272}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.214 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2957209495}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1583264295}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=582936592}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1406997261}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=22164180}) 2024-08-19T11:21:38.215 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4148135019}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.161+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3005972704}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2356743652}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=430572630}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1752894376}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.216 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3196568532}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1618593856}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2562751073}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1110574652}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2280706580}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.163+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=609109381}) 2024-08-19T11:21:38.217 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1661864326}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=173297346}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=518920537}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2428930385}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.218 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3922511365}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4257887396}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2969343580}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796979341}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.164+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=225431528}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1571032584}) 2024-08-19T11:21:38.219 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=476575561}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3711407589}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1275338309}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3505695980}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.220 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2899063613}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.165+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1805381650}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057594069}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3102047320}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=220975872}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2598649270}) 2024-08-19T11:21:38.221 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1410773536}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4246218203}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.166+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2492752981}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2786783337}) 2024-08-19T11:21:38.222 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3721747256}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206917956}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1086406307}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3765434176}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3073533965}) 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.167+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.223 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4272657214}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2931479103}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=81172159}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3377653067}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.224 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2024497611}) 2024-08-19T11:21:38.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1218034262}) 2024-08-19T11:21:38.225 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.168+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2845661572}) 2024-08-19T11:21:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.171+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f106406ed40 con 0x7f105003ea80 2024-08-19T11:21:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.172+0000 7f104b7fe640 1 -- 172.21.15.71:0/1215415088 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34101 (secure 0 0 0) 0x7f106406ed40 con 0x7f105003ea80 2024-08-19T11:21:38.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:21:38.226 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 >> v2:172.21.15.135:6800/726754104 conn(0x7f105003ea80 msgr2=0x7f1050040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 --2- 172.21.15.71:0/1215415088 >> v2:172.21.15.135:6800/726754104 conn(0x7f105003ea80 0x7f1050040f40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1064128070 tx=0x7f10580098a0 comp rx=0 tx=0).stop 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 10 monclient: shutdown 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 msgr2=0x7f1064125fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f1064125fd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1054035040 tx=0x7f10540046c0 comp rx=0 tx=0).stop 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 shutdown_connections 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 --2- 172.21.15.71:0/1215415088 >> v2:172.21.15.135:6800/726754104 conn(0x7f105003ea80 0x7f1050040f40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10640a5020 0x7f1064126a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10640a45d0 0x7f1064126510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 --2- 172.21.15.71:0/1215415088 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10640a3cb0 0x7f1064125fd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 >> 172.21.15.71:0/1215415088 conn(0x7f10640a91d0 msgr2=0x7f106409c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 shutdown_connections 2024-08-19T11:21:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:38.174+0000 7f10691f7640 1 -- 172.21.15.71:0/1215415088 wait complete. 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.175+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.175+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.175+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=73,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=12,mon_config_key=3} crc {logm=14945909,mdsmap=4204236774,mgr=1229682511,mgr_metadata=880626121,mgrstat=195679823,mon_config_key=615356354}) 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.175+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.175+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.175+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=72,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=4} crc {logm=3937872593,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=803517088,mon_config_key=4165856449}) 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.240 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=77,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11} crc {logm=3176452433,mdsmap=3140514009,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=567787458}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=74,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=2} crc {logm=769381065,mdsmap=4204236774,mgr=3044166884,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823,mon_config_key=1392351436}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=73,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=4} crc {logm=3291319868,mdsmap=4081106307,mgr=2490355337,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823,mon_config_key=4165856448}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=5} crc {logm=3672132394,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=803517088,mon_config_key=3303737824}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.241 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=1} crc {logm=237060565,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823,mon_config_key=767785337}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=75,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12} crc {logm=3449964991,mdsmap=4204236774,mgr=1229682511,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=195679823}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.176+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=74,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=4} crc {logm=2552335041,mdsmap=4204236774,mgr=4091103352,mgr_command_descs=3626727126,mgr_metadata=880626121,mgrstat=2804946086,mon_config_key=4165856448}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=790904193}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=2307173880,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=3561464417}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=2844450399,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=238440147}) 2024-08-19T11:21:38.242 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mon_config_key=16,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=73} crc {mon_config_key=3852131474,monmap=1080203526,osd_metadata=186790487,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=2228916639}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mon_config_key=17,monmap=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=2720761110,monmap=1080203526,osd_metadata=624310928,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=2104873290}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mon_config_key=17,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=2720761110,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=305623264}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=17,monmap=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=73} crc {mon_config_key=2720761110,monmap=3140514009,osd_metadata=186790487,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=1645175016}) 2024-08-19T11:21:38.243 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=16,monmap=2,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=74} crc {mon_config_key=1903644540,monmap=3140514009,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=3823785925,osdmap=2284504146}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.177+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mon_config_key=16,monmap=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=64829097,monmap=1080203526,osd_metadata=2544538045,osd_pg_creating=2768155471,osd_snap=421676469,osdmap=3094176251}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=435018996}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3955630338}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3170692950}) 2024-08-19T11:21:38.244 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=4286038904}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2903111847}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=280605480}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1765499176}) 2024-08-19T11:21:38.245 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2812666212}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.179+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1423791821}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1333724356}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2854424236}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.246 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3396768660}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2948633184}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=4004862356}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=846729637}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.247 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=184070889}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4061470662}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.180+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3368722488}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2002021117}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=486761245}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2511938709}) 2024-08-19T11:21:38.248 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1412897864}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2234216966}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=4281474710}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3605793479}) 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.249 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3059514297}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.182+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=512117407}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=340574786}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2914980936}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2227705049}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.250 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3801010282}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.184+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=547915796}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2132458605}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2197611728}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=411318565}) 2024-08-19T11:21:38.251 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.185+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3159373953}) 2024-08-19T11:21:38.252 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":656,"stamp":"2024-08-19T11:21:36.319260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":180340,"kb_used_data":18128,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566050700,"statfs":{"total":579820584960,"available":579635916800,"internally_reserved":0,"allocated":18563072,"data_stored":9159268,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.390349"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":633,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.040201+0000","last_change":"2024-08-19T11:10:39.666800+0000","last_active":"2024-08-19T11:21:31.040201+0000","last_peered":"2024-08-19T11:21:31.040201+0000","last_clean":"2024-08-19T11:21:31.040201+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:21:31.040201+0000","last_undegraded":"2024-08-19T11:21:31.040201+0000","last_fullsized":"2024-08-19T11:21:31.040201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:36:53.082033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":629,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.037448+0000","last_change":"2024-08-19T11:10:39.663942+0000","last_active":"2024-08-19T11:21:31.037448+0000","last_peered":"2024-08-19T11:21:31.037448+0000","last_clean":"2024-08-19T11:21:31.037448+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:21:31.037448+0000","last_undegraded":"2024-08-19T11:21:31.037448+0000","last_fullsized":"2024-08-19T11:21:31.037448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:29:40.776869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":633,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.040100+0000","last_change":"2024-08-19T11:10:39.666449+0000","last_active":"2024-08-19T11:21:31.040100+0000","last_peered":"2024-08-19T11:21:31.040100+0000","last_clean":"2024-08-19T11:21:31.040100+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:21:31.040100+0000","last_undegraded":"2024-08-19T11:21:31.040100+0000","last_fullsized":"2024-08-19T11:21:31.040100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:03:05.251972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":635,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.037952+0000","last_change":"2024-08-19T11:10:39.664799+0000","last_active":"2024-08-19T11:21:31.037952+0000","last_peered":"2024-08-19T11:21:31.037952+0000","last_clean":"2024-08-19T11:21:31.037952+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:21:31.037952+0000","last_undegraded":"2024-08-19T11:21:31.037952+0000","last_fullsized":"2024-08-19T11:21:31.037952+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:53:01.372708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":638,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.042298+0000","last_change":"2024-08-19T11:10:39.665250+0000","last_active":"2024-08-19T11:21:31.042298+0000","last_peered":"2024-08-19T11:21:31.042298+0000","last_clean":"2024-08-19T11:21:31.042298+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:21:31.042298+0000","last_undegraded":"2024-08-19T11:21:31.042298+0000","last_fullsized":"2024-08-19T11:21:31.042298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T13:38:35.637081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":634,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.037367+0000","last_change":"2024-08-19T11:10:39.664603+0000","last_active":"2024-08-19T11:21:31.037367+0000","last_peered":"2024-08-19T11:21:31.037367+0000","last_clean":"2024-08-19T11:21:31.037367+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:21:31.037367+0000","last_undegraded":"2024-08-19T11:21:31.037367+0000","last_fullsized":"2024-08-19T11:21:31.037367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T14:04:17.799588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":631,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.039133+0000","last_change":"2024-08-19T11:10:39.738122+0000","last_active":"2024-08-19T11:21:31.039133+0000","last_peered":"2024-08-19T11:21:31.039133+0000","last_clean":"2024-08-19T11:21:31.039133+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:21:31.039133+0000","last_undegraded":"2024-08-19T11:21:31.039133+0000","last_fullsized":"2024-08-19T11:21:31.039133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:13:23.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":634,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.040291+0000","last_change":"2024-08-19T11:10:39.666487+0000","last_active":"2024-08-19T11:21:31.040291+0000","last_peered":"2024-08-19T11:21:31.040291+0000","last_clean":"2024-08-19T11:21:31.040291+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:21:31.040291+0000","last_undegraded":"2024-08-19T11:21:31.040291+0000","last_fullsized":"2024-08-19T11:21:31.040291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:36.637219+0000","last_clean_scrub_stamp":"2024-08-19T11:10:36.637219+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:52:08.016875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":724,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:31.040091+0000","last_change":"2024-08-19T11:10:31.364806+0000","last_active":"2024-08-19T11:21:31.040091+0000","last_peered":"2024-08-19T11:21:31.040091+0000","last_clean":"2024-08-19T11:21:31.040091+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:21:31.040091+0000","last_undegraded":"2024-08-19T11:21:31.040091+0000","last_fullsized":"2024-08-19T11:21:31.040091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:10:29.355919+0000","last_clean_scrub_stamp":"2024-08-19T11:10:29.355919+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:49:36.145497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640392,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30096,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341744,"statfs":{"total":96636764160,"available":96605945856,"internally_reserved":0,"allocated":3133440,"data_stored":1879157,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607688,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30036,"kb_used_data":3004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341804,"statfs":{"total":96636764160,"available":96606007296,"internally_reserved":0,"allocated":3076096,"data_stored":1350248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607688,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30036,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341804,"statfs":{"total":96636764160,"available":96606007296,"internally_reserved":0,"allocated":3072000,"data_stored":1350229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607688,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30036,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341804,"statfs":{"total":96636764160,"available":96606007296,"internally_reserved":0,"allocated":3072000,"data_stored":1350229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607687,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30100,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341740,"statfs":{"total":96636764160,"available":96605941760,"internally_reserved":0,"allocated":3133440,"data_stored":1879157,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607688,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30036,"kb_used_data":3004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341804,"statfs":{"total":96636764160,"available":96606007296,"internally_reserved":0,"allocated":3076096,"data_stored":1350248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.256 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.257 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-08-19T11:10:36.637219+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=36, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.257 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-19T11:10:29.355919+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=10, tm_sec=29, tm_wday=0, tm_yday=232, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=19, tm_hour=11, tm_min=21, tm_sec=33, tm_wday=0, tm_yday=232, tm_isdst=0) 2024-08-19T11:21:38.257 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-19T11:21:38.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3508979835}) 2024-08-19T11:21:38.258 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=6} crc {osdmap=237790416}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3508979835}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=4} crc {osdmap=78910194}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3508979835}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=6} crc {osdmap=237790416}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3508979835}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=4} crc {osdmap=644063936}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3508979835}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=6} crc {osdmap=237790416}) 2024-08-19T11:21:38.259 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-08-19T11:21:38.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3508979835}) 2024-08-19T11:21:38.260 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-08-19T11:21:38.194+0000 7f66d8a4a640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=5} crc {osdmap=412336956}) 2024-08-19T11:21:58.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-19T11:21:58.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.368+0000 7f8f27714640 10 monclient: get_monmap_and_config 2024-08-19T11:21:58.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.368+0000 7f8f27714640 10 monclient: build_initial_monmap 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.368+0000 7f8f27714640 10 monclient: monmap: 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:58.369819+0000 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:58.369819+0000 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:58.371 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:58.372 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.368+0000 7f8f27714640 1 Processor -- start 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 -- start start 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient: init 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient: _add_conns ranks=[3,9,5,0,1,4,8,2,6,10,7] 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f200a6a30 0x7f8f200a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): picked mon.noname-g con 0x7f8f200a6a30 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8f200a6e10 0x7f8f200a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): picked mon.noname-a con 0x7f8f200a6e10 addr v2:172.21.15.71:3300/0 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f20139860 0x7f8f20139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): picked mon.noname-h con 0x7f8f20139860 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 -- 0x7f8f200a4f90 con 0x7f8f200a6e10 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200a6380 con 0x7f8f200a6a30 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8f200a49d0 con 0x7f8f20139860 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:58.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f27714640 10 monclient(hunting): authenticate will time out at 1376.411581s 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8f200a6e10 0x7f8f200a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8f200a6e10 0x7f8f200a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48074/0 (socket says 172.21.15.71:48074) 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 1 -- 172.21.15.71:0/942856517 learned_addr learned my addr 172.21.15.71:0/942856517 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): get_auth_request con 0x7f8f200a6e10 auth_method 0 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f24caf640 10 monclient(hunting): handle_auth_done global_id 76149 payload 274 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f254b0640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f200a6a30 0x7f8f200a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.369+0000 7f8f25cb1640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f20139860 0x7f8f20139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 1 -- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f20139860 msgr2=0x7f8f20139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f20139860 0x7f8f20139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 1 -- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f200a6a30 msgr2=0x7f8f200a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f200a6a30 0x7f8f200a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 10 monclient: _finish_hunting 0 2024-08-19T11:21:58.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 1 monclient: found mon.noname-a 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f24caf640 1 -- 172.21.15.71:0/942856517 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200a46f0 con 0x7f8f200a6e10 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f25cb1640 10 monclient: get_auth_request con 0x7f8f20139860 auth_method 0 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f25cb1640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f20139860 0x7f8f20139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f254b0640 10 monclient: get_auth_request con 0x7f8f200a6a30 auth_method 0 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.370+0000 7f8f254b0640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f200a6a30 0x7f8f200a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T11:21:58.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.372+0000 7f8f24caf640 1 -- 172.21.15.71:0/942856517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f200a6e10 msgr2=0x7f8f200a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.372+0000 7f8f24caf640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f200a6e10 0x7f8f200a71f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009e80 tx=0x7f8f0802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4256917b79798ad8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 1 -- 172.21.15.71:0/942856517 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8f08036070 con 0x7f8f200a6e10 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: dump: 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.388 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.389 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: _finish_auth 0 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: _check_auth_tickets 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 1 -- 172.21.15.71:0/942856517 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f08007a70 con 0x7f8f200a6e10 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 5 monclient: authenticate success, global_id 76149 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:58.390 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 1 -- 172.21.15.71:0/942856517 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8f08007ca0 con 0x7f8f200a6e10 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 4 set_mon_vals no callback set 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f1ffff640 10 monclient: dump: 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.392 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 10 monclient: shutdown 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 -- 172.21.15.71:0/942856517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f200a6e10 msgr2=0x7f8f200a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f200a6e10 0x7f8f200a71f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009e80 tx=0x7f8f0802a580 comp rx=0 tx=0).stop 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 -- 172.21.15.71:0/942856517 shutdown_connections 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f20139860 0x7f8f20139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f200a6e10 0x7f8f200a71f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 --2- 172.21.15.71:0/942856517 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f200a6a30 0x7f8f200a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 -- 172.21.15.71:0/942856517 >> 172.21.15.71:0/942856517 conn(0x7f8f200ac030 msgr2=0x7f8f200ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 -- 172.21.15.71:0/942856517 shutdown_connections 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.373+0000 7f8f27714640 1 -- 172.21.15.71:0/942856517 wait complete. 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.374+0000 7f8f27714640 10 monclient: build_initial_monmap 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.374+0000 7f8f27714640 10 monclient: monmap: 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:58.394 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:58.395 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.374+0000 7f8f27714640 1 Processor -- start 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.374+0000 7f8f27714640 1 -- start start 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.374+0000 7f8f27714640 10 monclient: init 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient: _add_conns ranks=[5,1,2,6,0,8,7,3,4] 2024-08-19T11:21:58.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f200a6a30 0x7f8f201ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): picked mon.noname-h con 0x7f8f200a6a30 addr [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f200a6e10 0x7f8f20138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): picked mon.noname-f con 0x7f8f200a6e10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 0x7f8f20139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): picked mon.noname-b con 0x7f8f20139860 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200a7730 con 0x7f8f200a6e10 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2013a200 con 0x7f8f20139860 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 1 -- --> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] -- mon_getmap magic: 0 -- 0x7f8f201ce960 con 0x7f8f200a6a30 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f27714640 10 monclient(hunting): authenticate will time out at 1376.417383s 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 0x7f8f20139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f200a6a30 0x7f8f201ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 0x7f8f20139240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:47000/0 (socket says 172.21.15.71:47000) 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 1 --2- >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f200a6a30 0x7f8f201ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3302/0 says I am v2:172.21.15.71:50116/0 (socket says 172.21.15.71:50116) 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 -- 172.21.15.71:0/1377710711 learned_addr learned my addr 172.21.15.71:0/1377710711 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): get_auth_request con 0x7f8f20139860 auth_method 0 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): get_auth_request con 0x7f8f200a6a30 auth_method 0 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f200a6e10 0x7f8f20138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): get_auth_request con 0x7f8f200a6e10 auth_method 0 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f254b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f24caf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient(hunting): handle_auth_done global_id 76169 payload 824 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 -- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f200a6a30 msgr2=0x7f8f201ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f200a6a30 0x7f8f201ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 -- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f200a6e10 msgr2=0x7f8f20138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f200a6e10 0x7f8f20138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient: _finish_hunting 0 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 monclient: found mon.noname-b 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.71:3301/0 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.375+0000 7f8f25cb1640 1 -- 172.21.15.71:0/1377710711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f20125630 con 0x7f8f20139860 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f25cb1640 1 -- 172.21.15.71:0/1377710711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 msgr2=0x7f8f20139240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f25cb1640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 0x7f8f20139240 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000c7f0 tx=0x7f8f1000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8f10015020 con 0x7f8f20139860 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: dump: 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.402 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: _finish_auth 0 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: _check_auth_tickets 2024-08-19T11:21:58.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10004240 con 0x7f8f20139860 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 5 monclient: authenticate success, global_id 76169 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 10 monclient: _renew_subs 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f200a3ed0 con 0x7f8f20139860 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7f8f100043f0 con 0x7f8f20139860 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1dffb640 10 monclient: dump: 2024-08-19T11:21:58.404 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.405 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f1f7fe640 4 set_mon_vals no callback set 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 10 monclient: _renew_subs 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.378+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f201266c0 con 0x7f8f20139860 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7f8f10018020 con 0x7f8f20139860 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f27714640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f27714640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:58.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f27714640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.71:3301/0 2024-08-19T11:21:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f200a7510 con 0x7f8f20139860 2024-08-19T11:21:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f1dffb640 1 --2- 172.21.15.71:0/1377710711 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f0003ea80 0x7f8f00040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.379+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7f8f10051ad0 con 0x7f8f20139860 2024-08-19T11:21:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.380+0000 7f8f254b0640 1 --2- 172.21.15.71:0/1377710711 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f0003ea80 0x7f8f00040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.380+0000 7f8f254b0640 10 monclient: get_auth_request con 0x7f8f0003ea80 auth_method 0 2024-08-19T11:21:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.382+0000 7f8f254b0640 1 --2- 172.21.15.71:0/1377710711 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f0003ea80 0x7f8f00040f40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800ab60 tx=0x7f8f18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.384+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7f8f200a7510 con 0x7f8f20139860 2024-08-19T11:21:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.384+0000 7f8f1dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:58.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.384+0000 7f8f1dffb640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.555+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 --> v2:172.21.15.135:6800/726754104 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f20126320 con 0x7f8f0003ea80 2024-08-19T11:21:58.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.557+0000 7f8f1dffb640 1 -- 172.21.15.71:0/1377710711 <== mgr.4105 v2:172.21.15.135:6800/726754104 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34030 (secure 0 0 0) 0x7f8f20126320 con 0x7f8f0003ea80 2024-08-19T11:21:58.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-08-19T11:21:58.559 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-08-19T11:21:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f0003ea80 msgr2=0x7f8f00040f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 --2- 172.21.15.71:0/1377710711 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f0003ea80 0x7f8f00040f40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800ab60 tx=0x7f8f18008040 comp rx=0 tx=0).stop 2024-08-19T11:21:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 10 monclient: shutdown 2024-08-19T11:21:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:58.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 msgr2=0x7f8f20139240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 0x7f8f20139240 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000c7f0 tx=0x7f8f1000ccb0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 shutdown_connections 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 --2- 172.21.15.71:0/1377710711 >> v2:172.21.15.135:6800/726754104 conn(0x7f8f0003ea80 0x7f8f00040f40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8f20139860 0x7f8f20139240 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f200a6e10 0x7f8f20138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 --2- 172.21.15.71:0/1377710711 >> [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] conn(0x7f8f200a6a30 0x7f8f201ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 >> 172.21.15.71:0/1377710711 conn(0x7f8f200ac030 msgr2=0x7f8f201c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 shutdown_connections 2024-08-19T11:21:58.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.559+0000 7f8f27714640 1 -- 172.21.15.71:0/1377710711 wait complete. 2024-08-19T11:21:58.571 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":667,"stamp":"2024-08-19T11:21:58.323474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":180272,"kb_used_data":18128,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566050768,"statfs":{"total":579820584960,"available":579635986432,"internally_reserved":0,"allocated":18563072,"data_stored":9159268,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002435"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":642,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:38.358208+0000","last_change":"2024-08-19T11:21:38.358231+0000","last_active":"2024-08-19T11:21:38.358208+0000","last_peered":"2024-08-19T11:21:38.358208+0000","last_clean":"2024-08-19T11:21:38.358208+0000","last_became_active":"2024-08-19T11:10:37.665172+0000","last_became_peered":"2024-08-19T11:10:37.665172+0000","last_unstale":"2024-08-19T11:21:38.358208+0000","last_undegraded":"2024-08-19T11:21:38.358208+0000","last_fullsized":"2024-08-19T11:21:38.358208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:21:38.358138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:21:38.358138+0000","last_clean_scrub_stamp":"2024-08-19T11:21:38.358138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T15:01:38.370634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070980700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":638,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:37.620183+0000","last_change":"2024-08-19T11:21:37.620222+0000","last_active":"2024-08-19T11:21:37.620183+0000","last_peered":"2024-08-19T11:21:37.620183+0000","last_clean":"2024-08-19T11:21:37.620183+0000","last_became_active":"2024-08-19T11:10:37.664972+0000","last_became_peered":"2024-08-19T11:10:37.664972+0000","last_unstale":"2024-08-19T11:21:37.620183+0000","last_undegraded":"2024-08-19T11:21:37.620183+0000","last_fullsized":"2024-08-19T11:21:37.620183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:21:37.620094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:21:37.620094+0000","last_clean_scrub_stamp":"2024-08-19T11:21:37.620094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T20:46:38.824178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046318599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":642,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:35.415781+0000","last_change":"2024-08-19T11:21:35.415818+0000","last_active":"2024-08-19T11:21:35.415781+0000","last_peered":"2024-08-19T11:21:35.415781+0000","last_clean":"2024-08-19T11:21:35.415781+0000","last_became_active":"2024-08-19T11:10:37.659901+0000","last_became_peered":"2024-08-19T11:10:37.659901+0000","last_unstale":"2024-08-19T11:21:35.415781+0000","last_undegraded":"2024-08-19T11:21:35.415781+0000","last_fullsized":"2024-08-19T11:21:35.415781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:21:35.415711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:21:35.415711+0000","last_clean_scrub_stamp":"2024-08-19T11:21:35.415711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T16:39:21.453282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043085900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":644,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:37.879541+0000","last_change":"2024-08-19T11:21:37.879585+0000","last_active":"2024-08-19T11:21:37.879541+0000","last_peered":"2024-08-19T11:21:37.879541+0000","last_clean":"2024-08-19T11:21:37.879541+0000","last_became_active":"2024-08-19T11:10:37.659109+0000","last_became_peered":"2024-08-19T11:10:37.659109+0000","last_unstale":"2024-08-19T11:21:37.879541+0000","last_undegraded":"2024-08-19T11:21:37.879541+0000","last_fullsized":"2024-08-19T11:21:37.879541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:21:37.879437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:21:37.879437+0000","last_clean_scrub_stamp":"2024-08-19T11:21:37.879437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T18:22:22.233390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046609800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"325'3","reported_seq":648,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:35.222872+0000","last_change":"2024-08-19T11:21:35.222898+0000","last_active":"2024-08-19T11:21:35.222872+0000","last_peered":"2024-08-19T11:21:35.222872+0000","last_clean":"2024-08-19T11:21:35.222872+0000","last_became_active":"2024-08-19T11:10:37.657476+0000","last_became_peered":"2024-08-19T11:10:37.657476+0000","last_unstale":"2024-08-19T11:21:35.222872+0000","last_undegraded":"2024-08-19T11:21:35.222872+0000","last_fullsized":"2024-08-19T11:21:35.222872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"325'3","last_scrub_stamp":"2024-08-19T11:21:35.222793+0000","last_deep_scrub":"325'3","last_deep_scrub_stamp":"2024-08-19T11:21:35.222793+0000","last_clean_scrub_stamp":"2024-08-19T11:21:35.222793+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T17:55:15.308286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010703139999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":643,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:36.856526+0000","last_change":"2024-08-19T11:21:36.856589+0000","last_active":"2024-08-19T11:21:36.856526+0000","last_peered":"2024-08-19T11:21:36.856526+0000","last_clean":"2024-08-19T11:21:36.856526+0000","last_became_active":"2024-08-19T11:10:37.662810+0000","last_became_peered":"2024-08-19T11:10:37.662810+0000","last_unstale":"2024-08-19T11:21:36.856526+0000","last_undegraded":"2024-08-19T11:21:36.856526+0000","last_fullsized":"2024-08-19T11:21:36.856526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:21:36.856398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:21:36.856398+0000","last_clean_scrub_stamp":"2024-08-19T11:21:36.856398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T19:48:19.509792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046224500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":640,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:36.006878+0000","last_change":"2024-08-19T11:21:36.006917+0000","last_active":"2024-08-19T11:21:36.006878+0000","last_peered":"2024-08-19T11:21:36.006878+0000","last_clean":"2024-08-19T11:21:36.006878+0000","last_became_active":"2024-08-19T11:10:37.666192+0000","last_became_peered":"2024-08-19T11:10:37.666192+0000","last_unstale":"2024-08-19T11:21:36.006878+0000","last_undegraded":"2024-08-19T11:21:36.006878+0000","last_fullsized":"2024-08-19T11:21:36.006878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T11:21:36.006775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T11:21:36.006775+0000","last_clean_scrub_stamp":"2024-08-19T11:21:36.006775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T22:55:07.345225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000398818,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"325'2","reported_seq":644,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:36.412015+0000","last_change":"2024-08-19T11:21:36.412043+0000","last_active":"2024-08-19T11:21:36.412015+0000","last_peered":"2024-08-19T11:21:36.412015+0000","last_clean":"2024-08-19T11:21:36.412015+0000","last_became_active":"2024-08-19T11:10:37.665925+0000","last_became_peered":"2024-08-19T11:10:37.665925+0000","last_unstale":"2024-08-19T11:21:36.412015+0000","last_undegraded":"2024-08-19T11:21:36.412015+0000","last_fullsized":"2024-08-19T11:21:36.412015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"325'2","last_scrub_stamp":"2024-08-19T11:21:36.411950+0000","last_deep_scrub":"325'2","last_deep_scrub_stamp":"2024-08-19T11:21:36.411950+0000","last_clean_scrub_stamp":"2024-08-19T11:21:36.411950+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T23:01:05.827938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00046407399999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"325'74","reported_seq":735,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-08-19T11:21:37.403694+0000","last_change":"2024-08-19T11:21:37.403744+0000","last_active":"2024-08-19T11:21:37.403694+0000","last_peered":"2024-08-19T11:21:37.403694+0000","last_clean":"2024-08-19T11:21:37.403694+0000","last_became_active":"2024-08-19T11:10:31.364506+0000","last_became_peered":"2024-08-19T11:10:31.364506+0000","last_unstale":"2024-08-19T11:21:37.403694+0000","last_undegraded":"2024-08-19T11:21:37.403694+0000","last_fullsized":"2024-08-19T11:21:37.403694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"325'74","last_scrub_stamp":"2024-08-19T11:21:37.403612+0000","last_deep_scrub":"325'74","last_deep_scrub_stamp":"2024-08-19T11:21:37.403612+0000","last_clean_scrub_stamp":"2024-08-19T11:21:37.403612+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T22:16:49.587321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":59112,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640396,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30084,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341756,"statfs":{"total":96636764160,"available":96605958144,"internally_reserved":0,"allocated":3133440,"data_stored":1879157,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":12,"seq":51539607692,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30028,"kb_used_data":3004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341812,"statfs":{"total":96636764160,"available":96606015488,"internally_reserved":0,"allocated":3076096,"data_stored":1350248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607692,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30024,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341816,"statfs":{"total":96636764160,"available":96606019584,"internally_reserved":0,"allocated":3072000,"data_stored":1350229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607692,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30024,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341816,"statfs":{"total":96636764160,"available":96606019584,"internally_reserved":0,"allocated":3072000,"data_stored":1350229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607691,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30084,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341756,"statfs":{"total":96636764160,"available":96605958144,"internally_reserved":0,"allocated":3133440,"data_stored":1879157,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607692,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30028,"kb_used_data":3004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341812,"statfs":{"total":96636764160,"available":96606015488,"internally_reserved":0,"allocated":3076096,"data_stored":1350248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":29556,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T11:21:58.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-19T11:21:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.667+0000 7fd89fec5640 10 monclient: get_monmap_and_config 2024-08-19T11:21:58.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.667+0000 7fd89fec5640 10 monclient: build_initial_monmap 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.667+0000 7fd89fec5640 10 monclient: monmap: 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:21:58.669493+0000 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:21:58.669493+0000 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:0: v1:172.21.15.71:6789/0 mon.noname-a-legacy 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:1: v1:172.21.15.135:6789/0 mon.noname-f-legacy 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:58.670 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:9: v2:172.21.15.71:3300/0 mon.noname-a 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr:10: v2:172.21.15.135:3300/0 mon.noname-f 2024-08-19T11:21:58.671 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.668+0000 7fd89fec5640 1 Processor -- start 2024-08-19T11:21:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.668+0000 7fd89fec5640 1 -- start start 2024-08-19T11:21:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.668+0000 7fd89fec5640 10 monclient: init 2024-08-19T11:21:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient: _add_conns ranks=[1,10,6,5,0,9,3,7,4,8,2] 2024-08-19T11:21:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd8980a69c0 addr v1:172.21.15.135:6789/0 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd898139e90 0x7fd89813ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): picked mon.noname-f con 0x7fd898139e90 addr v2:172.21.15.135:3300/0 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 0x7fd898141120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): picked mon.noname-d con 0x7fd89813a2d0 addr [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89809c9f0 con 0x7fd8980a69c0 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd8980a5840 con 0x7fd898139e90 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 1 -- --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_getmap magic: 0 -- 0x7fd8980a4740 con 0x7fd89813a2d0 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89fec5640 10 monclient(hunting): authenticate will time out at 1376.711198s 2024-08-19T11:21:58.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 0x7fd898141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 --2- >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 0x7fd898141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3303/0 says I am v2:172.21.15.71:57338/0 (socket says 172.21.15.71:57338) 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 -- 172.21.15.71:0/4012147414 learned_addr learned my addr 172.21.15.71:0/4012147414 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): get_auth_request con 0x7fd89813a2d0 auth_method 0 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89d460640 1 --2- 172.21.15.71:0/4012147414 >> v2:172.21.15.135:3300/0 conn(0x7fd898139e90 0x7fd89813ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89d460640 10 monclient(hunting): get_auth_request con 0x7fd898139e90 auth_method 0 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89d460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89d460640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89d460640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient(hunting): handle_auth_done global_id 104964 payload 274 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 -- 172.21.15.71:0/4012147414 >> v2:172.21.15.135:3300/0 conn(0x7fd898139e90 msgr2=0x7fd89813ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 --2- 172.21.15.71:0/4012147414 >> v2:172.21.15.135:3300/0 conn(0x7fd898139e90 0x7fd89813ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 -- 172.21.15.71:0/4012147414 >> v1:172.21.15.135:6789/0 conn(0x7fd8980a69c0 legacy=0x7fd898139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient: _finish_hunting 0 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 monclient: found mon.noname-d 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.71:3303/0 2024-08-19T11:21:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.669+0000 7fd89e462640 1 -- 172.21.15.71:0/4012147414 --> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8980a4a20 con 0x7fd89813a2d0 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89e462640 1 -- 172.21.15.71:0/4012147414 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 msgr2=0x7fd898141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89e462640 1 --2- 172.21.15.71:0/4012147414 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 0x7fd898141120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd890009e50 tx=0x7fd89002a560 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fd92829ec534f533 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 1 -- 172.21.15.71:0/4012147414 <== mon.6 v2:172.21.15.71:3303/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd890036070 con 0x7fd89813a2d0 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: dump: 2024-08-19T11:21:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.683 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: _finish_auth 0 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: _check_auth_tickets 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 1 -- 172.21.15.71:0/4012147414 <== mon.6 v2:172.21.15.71:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd890007a70 con 0x7fd89813a2d0 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 1 -- 172.21.15.71:0/4012147414 <== mon.6 v2:172.21.15.71:3303/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd890007c60 con 0x7fd89813a2d0 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89cc5f640 10 monclient: dump: 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.684 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.685 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89fec5640 5 monclient: authenticate success, global_id 104964 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89fec5640 10 monclient: get_monmap_and_config success 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.672+0000 7fd89fec5640 4 set_mon_vals no callback set 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 10 monclient: shutdown 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 -- 172.21.15.71:0/4012147414 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 msgr2=0x7fd898141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 --2- 172.21.15.71:0/4012147414 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 0x7fd898141120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd890009e50 tx=0x7fd89002a560 comp rx=0 tx=0).stop 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 -- 172.21.15.71:0/4012147414 shutdown_connections 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 --2- 172.21.15.71:0/4012147414 >> [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] conn(0x7fd89813a2d0 0x7fd898141120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 --2- 172.21.15.71:0/4012147414 >> v2:172.21.15.135:3300/0 conn(0x7fd898139e90 0x7fd89813ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 -- 172.21.15.71:0/4012147414 >> 172.21.15.71:0/4012147414 conn(0x7fd8980abfc0 msgr2=0x7fd8980ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 -- 172.21.15.71:0/4012147414 shutdown_connections 2024-08-19T11:21:58.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 1 -- 172.21.15.71:0/4012147414 wait complete. 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 10 monclient: build_initial_monmap 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.673+0000 7fd89fec5640 10 monclient: monmap: 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 0 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 0.000000 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:created 0.000000 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 0 (unknown) 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-f 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-b 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.noname-g 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.noname-c 2024-08-19T11:21:58.687 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.noname-h 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.noname-d 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.noname-i 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.noname-e 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 Processor -- start 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 -- start start 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient: init 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient: _reopen_session rank -1 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient: _add_conns ranks=[3,1,0,2,5,8,7,6,4] 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8980a69c0 0x7fd898137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): picked mon.noname-g con 0x7fd8980a69c0 addr [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd898139e90 0x7fd898137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): picked mon.noname-f con 0x7fd898139e90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 0x7fd898138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): picked mon.noname-a con 0x7fd89813a2d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8981417e0 con 0x7fd89813a2d0 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd898141660 con 0x7fd898139e90 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): start opening mon connection 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd898141960 con 0x7fd8980a69c0 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): _renew_subs 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89fec5640 10 monclient(hunting): authenticate will time out at 1376.716650s 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 0x7fd898138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 0x7fd898138490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:48086/0 (socket says 172.21.15.71:48086) 2024-08-19T11:21:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 1 -- 172.21.15.71:0/3016348637 learned_addr learned my addr 172.21.15.71:0/3016348637 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): get_auth_request con 0x7fd89813a2d0 auth_method 0 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89e462640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89d460640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd898139e90 0x7fd898137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89dc61640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8980a69c0 0x7fd898137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89d460640 10 monclient(hunting): get_auth_request con 0x7fd898139e90 auth_method 0 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89d460640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89d460640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89d460640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89dc61640 10 monclient(hunting): get_auth_request con 0x7fd8980a69c0 auth_method 0 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89dc61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89dc61640 10 monclient(hunting): _init_auth method 2 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.674+0000 7fd89dc61640 10 monclient(hunting): _init_auth creating new auth 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89dc61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89dc61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89dc61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 10 monclient(hunting): handle_auth_done global_id 76158 payload 824 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 1 -- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8980a69c0 msgr2=0x7fd898137a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8980a69c0 0x7fd898137a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 1 -- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd898139e90 msgr2=0x7fd898137f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd898139e90 0x7fd898137f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 10 monclient: _finish_hunting 0 2024-08-19T11:21:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 1 monclient: found mon.noname-a 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89e462640 1 -- 172.21.15.71:0/3016348637 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89809dd50 con 0x7fd89813a2d0 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.675+0000 7fd89d460640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd898139e90 0x7fd898137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89e462640 1 -- 172.21.15.71:0/3016348637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 msgr2=0x7fd898138490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89e462640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 0x7fd898138490 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd890034040 tx=0x7fd890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd890040020 con 0x7fd89813a2d0 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: dump: 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.692 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.693 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: _finish_auth 0 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: _check_auth_tickets 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd890003ba0 con 0x7fd89813a2d0 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 5 monclient: authenticate success, global_id 76158 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: handle_config config(0 keys) 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 1037+0+0 (secure 0 0 0) 0x7fd890036040 con 0x7fd89813a2d0 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 10 monclient: _renew_subs 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd898140d30 con 0x7fd89813a2d0 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88ffff640 4 set_mon_vals no callback set 2024-08-19T11:21:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd88e7fc640 10 monclient: dump: 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:epoch 1 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:fsid e00860b6-633c-4a91-b05e-d46659da1ed6 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:last_changed 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:created 2024-08-19T11:09:34.396622+0000 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:min_mon_release 19 (squid) 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:election_strategy: 1 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.f 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.b 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:3: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.g 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:4: [v2:172.21.15.71:3302/0,v1:172.21.15.71:6791/0] mon.c 2024-08-19T11:21:58.695 INFO:teuthology.orchestra.run.smithi071.stderr:5: [v2:172.21.15.135:3302/0,v1:172.21.15.135:6791/0] mon.h 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:6: [v2:172.21.15.71:3303/0,v1:172.21.15.71:6792/0] mon.d 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:7: [v2:172.21.15.135:3303/0,v1:172.21.15.135:6792/0] mon.i 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:8: [v2:172.21.15.71:3304/0,v1:172.21.15.71:6793/0] mon.e 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 10 monclient: _renew_subs 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.677+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd898141280 con 0x7fd89813a2d0 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd89fec5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd89fec5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd89fec5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8981394b0 con 0x7fd89813a2d0 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 49845+0+0 (secure 0 0 0) 0x7fd890043020 con 0x7fd89813a2d0 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd88e7fc640 1 --2- 172.21.15.71:0/3016348637 >> v2:172.21.15.135:6800/726754104 conn(0x7fd87c03e9b0 0x7fd87c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T11:21:58.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.678+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 3506+0+0 (secure 0 0 0) 0x7fd890072390 con 0x7fd89813a2d0 2024-08-19T11:21:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.679+0000 7fd89dc61640 1 --2- 172.21.15.71:0/3016348637 >> v2:172.21.15.135:6800/726754104 conn(0x7fd87c03e9b0 0x7fd87c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T11:21:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.679+0000 7fd89dc61640 10 monclient: get_auth_request con 0x7fd87c03e9b0 auth_method 0 2024-08-19T11:21:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.681+0000 7fd89dc61640 1 --2- 172.21.15.71:0/3016348637 >> v2:172.21.15.135:6800/726754104 conn(0x7fd87c03e9b0 0x7fd87c040e70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd894004f60 tx=0x7fd894007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T11:21:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.683+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+194988 (secure 0 0 0) 0x7fd89004a030 con 0x7fd89813a2d0 2024-08-19T11:21:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.683+0000 7fd88e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-08-19T11:21:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.683+0000 7fd88e7fc640 10 monclient: _finish_command 1 = system:0 2024-08-19T11:21:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.857+0000 7fd89fec5640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-08-19T11:21:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.857+0000 7fd89fec5640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-08-19T11:21:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.857+0000 7fd89fec5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-08-19T11:21:58.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.857+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd8980a3d80 con 0x7fd89813a2d0 2024-08-19T11:21:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.860+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fd8980a3d80 con 0x7fd89813a2d0 2024-08-19T11:21:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.860+0000 7fd88e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-08-19T11:21:58.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.860+0000 7fd88e7fc640 10 monclient: _finish_command 2 = system:0 2024-08-19T11:21:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.861+0000 7fd88e7fc640 1 -- 172.21.15.71:0/3016348637 <== mon.0 v2:172.21.15.71:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd890007970 con 0x7fd89813a2d0 2024-08-19T11:21:58.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.861+0000 7fd88e7fc640 10 monclient: handle_config config(1 keys) 2024-08-19T11:21:58.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.861+0000 7fd88f7fe640 4 set_mon_vals no callback set 2024-08-19T11:21:58.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.861+0000 7fd88f7fe640 10 set_mon_vals mon_health_to_clog = false 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 >> v2:172.21.15.135:6800/726754104 conn(0x7fd87c03e9b0 msgr2=0x7fd87c040e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 --2- 172.21.15.71:0/3016348637 >> v2:172.21.15.135:6800/726754104 conn(0x7fd87c03e9b0 0x7fd87c040e70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd894004f60 tx=0x7fd894007e30 comp rx=0 tx=0).stop 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 10 monclient: shutdown 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 20 monclient: shutdown discarding 0 pending message(s) 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 msgr2=0x7fd898138490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 0x7fd898138490 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd890034040 tx=0x7fd890004a40 comp rx=0 tx=0).stop 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 shutdown_connections 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 --2- 172.21.15.71:0/3016348637 >> v2:172.21.15.135:6800/726754104 conn(0x7fd87c03e9b0 0x7fd87c040e70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd89813a2d0 0x7fd898138490 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd898139e90 0x7fd898137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 --2- 172.21.15.71:0/3016348637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8980a69c0 0x7fd898137a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T11:21:58.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 >> 172.21.15.71:0/3016348637 conn(0x7fd8980abfc0 msgr2=0x7fd898134e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T11:21:58.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 shutdown_connections 2024-08-19T11:21:58.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-08-19T11:21:58.863+0000 7fd89fec5640 1 -- 172.21.15.71:0/3016348637 wait complete. 2024-08-19T11:21:58.875 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/ceph.py", line 1980, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-19T11:21:58.876 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-19T11:21:58.877 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-19T11:21:58.877 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-19T11:21:58.877 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:58.912 INFO:tasks.ceph.osd.0:Stopped 2024-08-19T11:21:58.913 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-19T11:21:58.913 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:58.982 INFO:tasks.ceph.osd.1:Stopped 2024-08-19T11:21:58.982 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-19T11:21:58.982 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.054 INFO:tasks.ceph.osd.2:Stopped 2024-08-19T11:21:59.055 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-19T11:21:59.055 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.088 INFO:tasks.ceph.osd.3:Stopped 2024-08-19T11:21:59.088 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-19T11:21:59.088 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.156 INFO:tasks.ceph.osd.4:Stopped 2024-08-19T11:21:59.157 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-19T11:21:59.157 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.242 INFO:tasks.ceph.osd.5:Stopped 2024-08-19T11:21:59.242 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-19T11:21:59.242 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-19T11:21:59.242 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.269 INFO:tasks.ceph.mgr.x:Stopped 2024-08-19T11:21:59.269 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-19T11:21:59.269 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-19T11:21:59.269 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.284 INFO:tasks.ceph.mon.a:Stopped 2024-08-19T11:21:59.285 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-19T11:21:59.285 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.338 INFO:tasks.ceph.mon.b:Stopped 2024-08-19T11:21:59.339 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-19T11:21:59.339 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.392 INFO:tasks.ceph.mon.c:Stopped 2024-08-19T11:21:59.392 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-08-19T11:21:59.392 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.445 INFO:tasks.ceph.mon.d:Stopped 2024-08-19T11:21:59.445 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-08-19T11:21:59.446 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.496 INFO:tasks.ceph.mon.e:Stopped 2024-08-19T11:21:59.497 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-08-19T11:21:59.497 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.510 INFO:tasks.ceph.mon.f:Stopped 2024-08-19T11:21:59.510 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-08-19T11:21:59.510 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.565 INFO:tasks.ceph.mon.g:Stopped 2024-08-19T11:21:59.565 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-08-19T11:21:59.565 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.619 INFO:tasks.ceph.mon.h:Stopped 2024-08-19T11:21:59.619 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-08-19T11:21:59.619 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T11:21:59.671 INFO:tasks.ceph.mon.i:Stopped 2024-08-19T11:21:59.672 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-19T11:21:59.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | head -n 1 2024-08-19T11:21:59.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:21:59.718 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-19T11:22:00.008 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:22:00.008 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-19T11:22:00.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:22:00.091 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-19T11:22:00.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:22:00.140 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-19T11:22:00.327 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:22:00.328 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-19T11:22:00.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:22:00.410 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-19T11:22:00.457 INFO:tasks.ceph:Archiving mon data... 2024-08-19T11:22:00.458 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.a.tgz 2024-08-19T11:22:00.458 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-08-19T11:22:00.475 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.z3jft8diUj 2024-08-19T11:22:00.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.z3jft8diUj 2024-08-19T11:22:00.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.z3jft8diUj 2024-08-19T11:22:00.849 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.z3jft8diUj is 1MB 2024-08-19T11:22:00.932 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.z3jft8diUj 2024-08-19T11:22:00.947 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.b.tgz 2024-08-19T11:22:00.947 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-08-19T11:22:01.002 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.gdRalxiMGS 2024-08-19T11:22:01.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.gdRalxiMGS 2024-08-19T11:22:01.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.gdRalxiMGS 2024-08-19T11:22:01.332 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.gdRalxiMGS is 1MB 2024-08-19T11:22:01.437 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.gdRalxiMGS 2024-08-19T11:22:01.452 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.c.tgz 2024-08-19T11:22:01.452 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-08-19T11:22:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.us29dYcjvj 2024-08-19T11:22:01.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.us29dYcjvj 2024-08-19T11:22:01.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.us29dYcjvj 2024-08-19T11:22:01.832 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.us29dYcjvj is 1MB 2024-08-19T11:22:01.940 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.us29dYcjvj 2024-08-19T11:22:01.955 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.d.tgz 2024-08-19T11:22:01.955 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-08-19T11:22:02.010 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.nklp5lyEae 2024-08-19T11:22:02.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.nklp5lyEae 2024-08-19T11:22:02.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.nklp5lyEae 2024-08-19T11:22:02.340 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.nklp5lyEae is 1MB 2024-08-19T11:22:02.446 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.nklp5lyEae 2024-08-19T11:22:02.462 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.e.tgz 2024-08-19T11:22:02.462 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-08-19T11:22:02.518 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.EyRJrI1Qtg 2024-08-19T11:22:02.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.EyRJrI1Qtg 2024-08-19T11:22:02.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.EyRJrI1Qtg 2024-08-19T11:22:02.848 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.EyRJrI1Qtg is 1MB 2024-08-19T11:22:02.954 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.EyRJrI1Qtg 2024-08-19T11:22:02.969 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.f.tgz 2024-08-19T11:22:02.969 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-08-19T11:22:02.988 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.rLyAIyG1LP 2024-08-19T11:22:02.988 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.rLyAIyG1LP 2024-08-19T11:22:03.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.rLyAIyG1LP 2024-08-19T11:22:03.356 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.rLyAIyG1LP is 1MB 2024-08-19T11:22:03.434 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.rLyAIyG1LP 2024-08-19T11:22:03.450 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.g.tgz 2024-08-19T11:22:03.450 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-08-19T11:22:03.504 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.Xs82uXoCem 2024-08-19T11:22:03.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.Xs82uXoCem 2024-08-19T11:22:03.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.Xs82uXoCem 2024-08-19T11:22:03.836 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.Xs82uXoCem is 1MB 2024-08-19T11:22:03.948 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.Xs82uXoCem 2024-08-19T11:22:03.963 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.h.tgz 2024-08-19T11:22:03.963 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-08-19T11:22:04.017 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.4DucJhb5wm 2024-08-19T11:22:04.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.4DucJhb5wm 2024-08-19T11:22:04.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.4DucJhb5wm 2024-08-19T11:22:04.348 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.4DucJhb5wm is 1MB 2024-08-19T11:22:04.462 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.4DucJhb5wm 2024-08-19T11:22:04.478 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/data/mon.i.tgz 2024-08-19T11:22:04.478 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-08-19T11:22:04.532 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.9IoxXQbplM 2024-08-19T11:22:04.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.9IoxXQbplM 2024-08-19T11:22:04.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.9IoxXQbplM 2024-08-19T11:22:04.859 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.9IoxXQbplM is 1MB 2024-08-19T11:22:04.966 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.9IoxXQbplM 2024-08-19T11:22:04.981 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-19T11:22:04.982 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-19T11:22:04.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-19T11:22:05.069 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-19T11:22:05.101 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-19T11:22:05.101 INFO:tasks.ceph:Archiving crash dumps... 2024-08-19T11:22:05.103 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/remote/smithi071/crash 2024-08-19T11:22:05.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-19T11:22:05.137 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/remote/smithi135/crash 2024-08-19T11:22:05.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-19T11:22:05.164 INFO:tasks.ceph:Compressing logs... 2024-08-19T11:22:05.165 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T11:22:05.182 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T11:22:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28487.log 2024-08-19T11:22:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32997.log 2024-08-19T11:22:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29412.log 2024-08-19T11:22:05.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28487.log: /var/log/ceph/ceph-client.admin.32997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31217.log 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24224.log 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.28487.log.gz 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.32997.log.gz 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21138.log 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.29412.log.gz 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37194.log 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31217.log.gz 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.21138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30466.log 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24224.log.gz 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.21138.log.gz 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29792.log 2024-08-19T11:22:05.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31639.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37194.log.gz 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35896.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30466.log.gz 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31639.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29792.log.gz 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34469.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40601.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31639.log.gz 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40223.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35896.log.gz 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34469.log.gz 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31807.log 2024-08-19T11:22:05.477 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40601.log.gz 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34725.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40223.log.gz 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32531.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29368.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31807.log.gz 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24140.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34725.log.gz 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25106.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32531.log.gz 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36942.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25743.log 2024-08-19T11:22:05.478 INFO:teuthology.orchestra.run.smithi071.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.29368.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24140.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36942.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.25106.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31133.log 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36942.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20793.log 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31343.log 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31133.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.25743.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.20793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32405.log 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31133.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38923.log 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32405.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31343.log.gz 2024-08-19T11:22:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39217.log 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.20793.log.gz 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32405.log.gzgzip 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35054.log 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2%/var/log/ceph/ceph-client.admin.37278.log: -- replaced with /var/log/ceph/ceph-client.admin.38923.log.gz 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34256.log 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.39217.log.gz 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35054.log.gz 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26788.log 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34256.log.gz 2024-08-19T11:22:05.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28277.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33836.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27166.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.26788.log.gz 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28957.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.28277.log.gz 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40475.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33836.log.gz 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32659.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.27166.log.gz 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25701.log 2024-08-19T11:22:05.481 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28957.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27040.log 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40475.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32659.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26039.log 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.25701.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24404.log 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.27040.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37953.log 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27502.log 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.26039.log.gz 2024-08-19T11:22:05.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36772.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.24404.log.gz 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27502.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.40559.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37953.log.gz 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29167.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.27502.log.gz 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39133.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36772.log.gz 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40559.log.gz 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25400.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29167.log.gz 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35432.log 2024-08-19T11:22:05.483 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.39133.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31049.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35432.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38545.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.25400.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33461.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35432.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30382.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31049.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36814.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.38545.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36688.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33461.log.gz 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31005.log 2024-08-19T11:22:05.484 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30382.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32955.log 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.36814.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40307.log 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36688.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38461.log 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31005.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35474.log 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32955.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24008.log 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28529.log 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.38461.log.gz 2024-08-19T11:22:05.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27082.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35474.log.gz 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33123.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24008.log.gz 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28911.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.28529.log.gz 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33708.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27082.log.gz 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33165.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33123.log.gz 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24657.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28911.log.gz 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2024-08-19T11:22:05.486 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33708.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33165.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34968.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24657.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26618.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27981.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27813.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34968.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39845.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.26618.log.gz 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40265.log 2024-08-19T11:22:05.487 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27981.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40265.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.27813.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32279.log 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39845.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40139.log 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40265.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28785.log 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30625.log 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32279.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24951.log 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40139.log.gz 2024-08-19T11:22:05.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28785.log.gz 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29664.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29496.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30625.log.gz 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24951.log.gz 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28361.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29664.log.gz/var/log/ceph/ceph-client.admin.35812.log: 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40055.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.29496.log.gz 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37705.log 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2024-08-19T11:22:05.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28361.log.gz 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40055.log.gz 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30340.log 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.37705.log.gz 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40769.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gz 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29326.log 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30340.log.gz 2024-08-19T11:22:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30753.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24660.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29326.log.gz 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31175.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32237.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30753.log.gz 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30424.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24660.log.gz 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32237.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.31175.log.gz 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27334.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39803.log 2024-08-19T11:22:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30424.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32237.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38123.log 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30424.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24408.log 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39803.log: /var/log/ceph/ceph-client.admin.38123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39374.log 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24408.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.27334.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25871.log 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.39803.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.38123.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26744.log 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24408.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39374.log.gz 2024-08-19T11:22:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28235.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.25871.log.gz 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31681.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26744.log.gz 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25785.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39635.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35938.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28235.log.gz 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25358.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36520.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.25785.log.gz 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34767.log 2024-08-19T11:22:05.493 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39635.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39049.log 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36520.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.25358.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28827.log 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36520.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34767.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28827.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.39049.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39887.log 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26998.log 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28827.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-08-19T11:22:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz -5 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40181.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26998.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.39887.log.gz 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34599.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40181.log: 90.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.26998.log.gz -5 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40391.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34599.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40181.log.gz 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27855.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30795.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.34599.log.gz 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34851.log 2024-08-19T11:22:05.495 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40391.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38291.log 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30795.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.27855.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39459.log 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34851.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31259.log 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30298.log 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38291.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26872.log 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39459.log.gz 2024-08-19T11:22:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35686.log 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31259.log.gz 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36898.log 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26872.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30298.log.gz 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40685.log 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.26872.log.gz 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35686.log.gz 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.36898.log.gz 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40685.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-08-19T11:22:05.497 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31091.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40685.log.gz 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25955.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33039.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27124.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31091.log.gz 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35264.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.25955.log.gz 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24402.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33039.log.gz 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34641.log 2024-08-19T11:22:05.498 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35264.log: /var/log/ceph/ceph-client.admin.24402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40811.log 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.27124.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34641.log: gzip -5 89.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.35264.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.26576.log 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24402.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32701.log 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24064.log 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40811.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24266.log 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.26576.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30044.log/var/log/ceph/ceph-client.admin.24064.log: 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32701.log.gz 2024-08-19T11:22:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33538.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24064.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24266.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36646.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.30044.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24658.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33538.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36391.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25444.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36646.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28445.log 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.24658.log.gz 2024-08-19T11:22:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31301.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36391.log.gz 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26278.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.25444.log.gz 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27208.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.28445.log.gz 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31301.log.gz 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29960.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37621.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.26278.log.gz 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27208.log.gz 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37236.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-19T11:22:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29960.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31849.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.29960.log.gz 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37236.log.gz 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33293.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33962.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32032.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31849.log.gz 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34513.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32032.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.33293.log.gz 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33081.log 2024-08-19T11:22:05.502 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33962.log.gz 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36475.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32032.log.gz 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26702.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33081.log.gz 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26322.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36475.log.gz 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.34513.log.gz 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.16119.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26702.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37663.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31765.log 2024-08-19T11:22:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.16119.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.26702.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.16119.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26322.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37110.log 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33750.log 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31765.log: /var/log/ceph/ceph-client.admin.37110.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.37663.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39303.log 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33750.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31765.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- 96.8% /var/log/ceph/ceph-client.admin.27628.log 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.37110.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39303.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27628.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33750.log.gz 2024-08-19T11:22:05.504 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.39303.log.gz 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24403.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27628.log.gz 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34809.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24407.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25274.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24403.log.gz 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39175.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34809.log.gz 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39175.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24407.log.gz 2024-08-19T11:22:05.505 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34088.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.25274.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26492.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.39175.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24089.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24089.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34088.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25190.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.26492.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25827.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24089.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30921.log 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25190.log: /var/log/ceph/ceph-client.admin.25827.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-08-19T11:22:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33878.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.25190.log.gz 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24832.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26366.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.25827.log.gz 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.30921.log.gz 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30879.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33878.log.gz 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25064.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24832.log.gz 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24182.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.26366.log.gz 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34130.log 2024-08-19T11:22:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24182.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30879.log.gz 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37579.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.25064.log.gz 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34130.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24182.log.gz 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24950.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26081.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34130.log.gz 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34214.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26081.log: 90.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.37579.log.gz -5 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30086.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24950.log.gz 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30669.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.26081.log.gz 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34340.log 2024-08-19T11:22:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30669.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34214.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32195.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30086.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26956.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30669.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31597.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26956.log: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39719.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34340.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26830.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.26956.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38629.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31597.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25533.log 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.39719.log.gz 2024-08-19T11:22:05.509 INFO:teuthology.orchestra.run.smithi071.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.32195.log.gz 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38629.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.26830.log.gz 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25533.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.38629.log.gz 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30711.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33377.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.b.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.25533.log.gz 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38039.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33377.log: /var/log/ceph/ceph-client.admin.36318.log: 89.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35770.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30711.log.gz 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33377.log.gz 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-08-19T11:22:05.510 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31891.log 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40349.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.38039.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24655.log 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35770.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31891.log: gzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25997.log 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25232.log 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31891.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9%/var/log/ceph/ceph-client.admin.25232.log: -- replaced with /var/log/ceph/ceph-client.admin.24655.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25148.log 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.25997.log.gz 2024-08-19T11:22:05.511 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.25232.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24952.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27586.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:gzip/var/log/ceph/ceph-client.admin.24952.log: -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.25148.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33920.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26165.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24952.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28869.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.27586.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26165.log: gzip -5 --verbose 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33920.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr: -- /var/log/ceph/ceph-client.admin.27544.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28869.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.26165.log.gz 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31429.log 2024-08-19T11:22:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34683.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28869.log.gz/var/log/ceph/ceph-client.admin.31429.log: 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39971.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27544.log.gz 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34683.log: gzip -5 --verbose 90.4% -- -- replaced with /var/log/ceph/ceph-client.admin.31429.log.gz /var/log/ceph/ceph-client.admin.36562.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35516.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34683.log.gz 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39007.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39971.log.gz 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35516.log: 90.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.36562.log.gz -5 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30963.log 2024-08-19T11:22:05.513 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35516.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38797.log 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.39007.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30963.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29622.log 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35854.log 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4%/var/log/ceph/ceph-client.admin.29622.log: -- replaced with /var/log/ceph/ceph-client.admin.30963.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40097.log 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.38797.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35854.log: gzip -5 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29622.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35096.log 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40097.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35854.log.gz 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37911.log 2024-08-19T11:22:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35096.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40097.log.gz 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25316.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.d.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35096.log.gz 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37911.log.gz 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38671.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip/var/log/ceph/ceph-client.admin.25316.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26450.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35138.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.25316.log.gz 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26450.log: gzip -5 90.3% -- replaced with /var/log/ceph/ceph-client.admin.38671.log.gz 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32785.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35138.log: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26450.log.gz 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28319.log 2024-08-19T11:22:05.515 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.35138.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40433.log 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32785.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35980.log: /var/log/ceph/ceph-client.admin.28319.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40433.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28319.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40433.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36730.log 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37997.log 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33251.log 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37997.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36730.log.gz 2024-08-19T11:22:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.37997.log.gz 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27418.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39502.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.33251.log.gz 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27418.log: gzip -5 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30170.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39929.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30170.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.27418.log.gz 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37495.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.39502.log.gz 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30170.log.gz 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24852.log 2024-08-19T11:22:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38755.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24852.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39929.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37495.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24852.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38755.log: -- /var/log/ceph/ceph-client.admin.28571.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27460.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.38755.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28571.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28571.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28655.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36190.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.27460.log.gz 2024-08-19T11:22:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36190.log: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28655.log.gz 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32321.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38249.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.36190.log.gz 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34557.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32321.log: /var/log/ceph/ceph-client.admin.31385.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32321.log.gz 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39589.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37365.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34557.log: /var/log/ceph/ceph-client.admin.39589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-08-19T11:22:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37365.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34557.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.39589.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28065.log 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.37365.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30128.log: /var/log/ceph/ceph-client.admin.28065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37537.log 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37323.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28065.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23899.log 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27292.log 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37537.log: /var/log/ceph/ceph-client.admin.23899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31513.log 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27292.log: 89.4% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37537.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23899.log.gz 2024-08-19T11:22:05.520 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27292.log.gz 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36856.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31513.log: /var/log/ceph/ceph-client.admin.36856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32447.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33620.log: 90.0% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31513.log.gz 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36856.log.gz 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38965.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27250.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32447.log: /var/log/ceph/ceph-client.admin.38965.log: 93.8% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32447.log.gz 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.38965.log.gz 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37453.log 2024-08-19T11:22:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27250.log: /var/log/ceph/ceph-client.admin.37409.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27250.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32573.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29242.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25659.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.37453.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29242.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28739.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32573.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36234.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28739.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29242.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.25659.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29834.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28739.log.gz 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21212.log 2024-08-19T11:22:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36234.log: /var/log/ceph/ceph-client.admin.29834.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36234.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.29834.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29748.log 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37865.log 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.21212.log: /var/log/ceph/ceph-client.admin.29748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25913.log 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37865.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29748.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21212.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37865.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25575.log 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32615.log 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25913.log: gzip/var/log/ceph/ceph-client.admin.25575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28107.log 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr: 90.3%/var/log/ceph/ceph-client.admin.32615.log: -- replaced with /var/log/ceph/ceph-client.admin.25913.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.25575.log.gz 2024-08-19T11:22:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32615.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28107.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34383.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28107.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr: -- /var/log/ceph/ceph-client.admin.33794.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.35348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34004.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33794.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25617.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34004.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34004.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38165.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32871.log 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38165.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.25617.log.gz 2024-08-19T11:22:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35180.log 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32871.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38165.log.gz 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr: 90.1%/var/log/ceph/ceph-client.admin.35180.log: -- replaced with /var/log/ceph/ceph-client.admin.32871.log.gz 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29041.log 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35180.log.gz 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34046.log 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29041.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.29041.log.gz 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34046.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34046.log.gz 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32743.log 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36604.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2024-08-19T11:22:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33666.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32743.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32743.log.gz 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33666.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33666.log.gz 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35306.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36148.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38419.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24659.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36148.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36148.log.gz 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32363.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24659.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24659.log.gz 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29083.log 2024-08-19T11:22:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32363.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.32363.log.gz 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28613.log 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29083.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.29083.log.gz 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28403.log 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28613.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.28613.log.gz 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26534.log 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28403.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.28403.log.gz 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24406.log 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26534.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.26534.log.gz 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24831.log 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24406.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24406.log.gz 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37747.log 2024-08-19T11:22:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24831.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24831.log.gz 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35390.log 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37747.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37747.log.gz 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25486.log 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35390.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35390.log.gz 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29918.log 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25486.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.25486.log.gz 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34298.log 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29918.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29918.log.gz 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30256.log 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34298.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34298.log.gz 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32489.log 2024-08-19T11:22:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30256.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30256.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38839.log 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32489.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32489.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38839.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38839.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32827.log 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38207.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38333.log 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32827.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32827.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26123.log 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38333.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.38333.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29454.log 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26123.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.26123.log.gz 2024-08-19T11:22:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33419.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29454.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.29454.log.gz 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33419.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.33419.log.gz 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26660.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30837.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26660.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.26660.log.gz 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30837.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30837.log.gz 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37026.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38587.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26408.log 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37026.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.37026.log.gz 2024-08-19T11:22:05.530 INFO:teuthology.orchestra.run.smithi071.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38503.log 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26408.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.26408.log.gz 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24650.log 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38503.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.38503.log.gz 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.24650.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24650.log.gz 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31723.log 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38375.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27897.log 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31723.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31723.log.gz 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29706.log 2024-08-19T11:22:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27897.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.27897.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27376.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29706.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29706.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28023.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27376.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.27376.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40517.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28023.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28023.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40517.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40517.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30212.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31555.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26914.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30212.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.30212.log.gz 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40851.log 2024-08-19T11:22:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26914.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.26914.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27939.log 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40851.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40851.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40643.log 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27939.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.27939.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28149.log 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40643.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40643.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35600.log 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28149.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28149.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27670.log 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35600.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35600.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28191.log 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27670.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.27670.log.gz 2024-08-19T11:22:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2024-08-19T11:22:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.28191.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.28191.log.gz 2024-08-19T11:22:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27731.log 2024-08-19T11:22:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29538.log 2024-08-19T11:22:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.27731.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27731.log.gz 2024-08-19T11:22:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31933.log 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29538.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29538.log.gz 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29580.log 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31933.log: 89.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29125.log 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31933.log.gz 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29580.log: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30508.log 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29580.log.gz 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.29125.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.29125.log.gz 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30508.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.30508.log.gz 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39761.log 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36984.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-08-19T11:22:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39761.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39761.log.gz 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27456.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27320.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25393.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27837.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25289.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27456.log.gz 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29315.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.27320.log.gz 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.25393.log.gz 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26891.log 2024-08-19T11:22:05.566 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27837.log.gz 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29315.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25461.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25289.log.gz 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24449.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29315.log.gz 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26891.log.gz 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24311.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27732.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24449.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.25461.log.gz 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24311.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24140.log 2024-08-19T11:22:05.567 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26292.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24311.log.gz 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27458.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.27732.log.gz 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24449.log.gz 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28662.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27458.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.24140.log.gz 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27663.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20891.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28662.log: /var/log/ceph/ceph-client.admin.27663.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.26292.log.gz 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29212.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.27458.log.gz 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25888.log 2024-08-19T11:22:05.568 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.20891.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28662.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27663.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29281.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27422.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.20891.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29076.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27422.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29212.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27870.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.25888.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26290.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27870.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29281.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21091.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29076.log.gz 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28905.log 2024-08-19T11:22:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26290.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27422.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.21091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27030.log 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27870.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28181.log 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.21091.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28972.log 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27030.log: /var/log/ceph/ceph-client.admin.28181.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.26290.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28905.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24552.log 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28972.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28181.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.i.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.27030.log.gz 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28491.log 2024-08-19T11:22:05.570 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26823.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28972.log.gz 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26788.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26823.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24552.log.gz 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25186.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26788.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.28491.log.gz 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.26823.log.gz 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26095.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24519.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27765.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24519.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.23997.log 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26788.log.gz 2024-08-19T11:22:05.571 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25186.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26095.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26824.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24519.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27319.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.23997.log: /var/log/ceph/ceph-client.admin.26824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26025.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24104.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27765.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26025.log: gzip 90.7% -- replaced with /var/log/ceph/ceph-client.admin.26824.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- 89.6% -- replaced with /var/log/ceph/ceph-client.admin.23997.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: /var/log/ceph/ceph-client.admin.29213.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24345.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.27319.log.gz 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27097.log 2024-08-19T11:22:05.572 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.26025.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24345.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24104.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28593.log 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29213.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27629.log 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27097.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24345.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25084.log 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24105.log 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28593.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25084.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27629.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26994.log 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27097.log.gz 2024-08-19T11:22:05.573 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24105.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.25084.log.gz 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25889.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26094.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24105.log.gz 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25821.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27249.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.25889.log.gz 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26994.log.gz 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29111.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24657.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.25821.log.gz 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29111.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.26094.log.gz 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25290.log 2024-08-19T11:22:05.574 INFO:teuthology.orchestra.run.smithi135.stderr:gzip/var/log/ceph/ceph-client.admin.24657.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28973.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25290.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29111.log.gz 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27249.log.gz 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28249.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28973.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.25290.log.gz 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25682.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28249.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.27974.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24657.log.gz 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28973.log.gz 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28801.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29109.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26822.log 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28249.log.gz 2024-08-19T11:22:05.575 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27974.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29282.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29109.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.25682.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28801.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24414.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29282.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24414.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29109.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24622.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29282.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26686.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.3.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.26822.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.24414.log.gz 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27836.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27526.log 2024-08-19T11:22:05.576 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24622.log.gz 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26361.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.26686.log.gz 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27354.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26361.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27526.log.gz 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27354.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27836.log.gz 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25820.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.g.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27354.log.gz 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr: --verbose -- /var/log/ceph/ceph-client.admin.25785.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26361.log.gz 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25358.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25785.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28386.log 2024-08-19T11:22:05.577 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25820.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25394.log 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28386.log: -- /var/log/ceph/ceph-client.admin.28077.log 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25785.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25394.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.25358.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28767.log 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28077.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28386.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26027.log 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.25394.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:gzip/var/log/ceph/ceph-client.admin.28767.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25613.log 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28077.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26027.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28767.log.gz 2024-08-19T11:22:05.578 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24978.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24344.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr: 90.4%/var/log/ceph/ceph-client.admin.24978.log: -- replaced with /var/log/ceph/ceph-client.admin.26027.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24871.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.25613.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24871.log: /var/log/ceph/ceph-client.admin.24344.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24978.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27251.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24871.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27251.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24344.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27560.log 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr: 90.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.27251.log.gz 2024-08-19T11:22:05.579 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.20931.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26926.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.20931.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27560.log.gz 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28353.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26926.log: gzip 89.7% -- replaced with /var/log/ceph/ceph-client.admin.20931.log.gz 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26188.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28353.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.26926.log.gz 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28146.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29178.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28353.log.gz 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27457.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.26188.log.gz 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26576.log 2024-08-19T11:22:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27457.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28146.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27457.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29178.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29007.log 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25683.log 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27973.log 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.26576.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26506.log 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27973.log: /var/log/ceph/ceph-client.admin.25683.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.25683.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26256.log 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27973.log.gz 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5/var/log/ceph/ceph-client.admin.26506.log: --verbose -- /var/log/ceph/ceph-client.admin.26397.log 2024-08-19T11:22:05.581 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24658.log 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26397.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.26506.log.gz 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26720.log 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26256.log.gz/var/log/ceph/ceph-client.admin.24658.log: 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24658.log.gz 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26397.log.gz 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26611.log 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26362.log 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28182.log 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26720.log.gz 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28699.log 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26362.log: /var/log/ceph/ceph-client.admin.28182.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.26362.log.gz 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26611.log.gz 2024-08-19T11:22:05.582 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28903.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.28182.log.gz 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25152.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24450.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28699.log.gz 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24765.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24450.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28903.log.gz 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24450.log.gz 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.25152.log.gz 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26505.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28698.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28250.log 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24765.log.gz 2024-08-19T11:22:05.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28661.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7%/var/log/ceph/ceph-client.admin.28698.log: -- replaced with /var/log/ceph/ceph-client.admin.26505.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28250.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28698.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28250.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24035.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28661.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24872.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24035.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28661.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24943.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24872.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.24035.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25462.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24872.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24553.log 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25462.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24943.log.gz 2024-08-19T11:22:05.584 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25462.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21051.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27662.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24553.log: /var/log/ceph/ceph-client.admin.21051.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.21051.log.gz 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.24553.log.gz 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr: 96.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28387.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26468.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24451.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28387.log: /var/log/ceph/ceph-client.admin.26468.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28387.log.gz 89.4% 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27662.log.gz 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24980.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24451.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27628.log 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26468.log.gz 2024-08-19T11:22:05.585 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24980.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.24451.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27525.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24764.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.24980.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28802.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24764.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27628.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27525.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25291.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28802.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24764.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29075.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28594.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28802.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25291.log: /var/log/ceph/ceph-client.admin.29075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25049.log 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28594.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.25291.log.gz 2024-08-19T11:22:05.586 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29075.log.gz 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28870.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28594.log.gz 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27664.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25256.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28870.log.gz 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.25049.log.gz 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24036.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.27664.log.gz 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21011.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27559.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.25256.log.gz 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24036.log: /var/log/ceph/ceph-client.admin.21011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26685.log 2024-08-19T11:22:05.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27559.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24036.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.21011.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24728.log 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24836.log 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26685.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27559.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25615.log 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24836.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26685.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24728.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24836.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28284.log 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28489.log 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25188.log 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.25615.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28489.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28284.log.gz 2024-08-19T11:22:05.588 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28766.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28489.log.gz 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.25188.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.25716.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28490.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28766.log: /var/log/ceph/ceph-client.admin.25716.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.25716.log.gz 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28766.log.gz 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25991.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26789.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25991.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28490.log.gz 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24518.log 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26789.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25991.log.gz 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.26789.log.gz 2024-08-19T11:22:05.589 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27561.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26719.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27561.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24518.log.gz 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27561.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20971.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24241.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.20971.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.20971.log.gz 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.26719.log.gz 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28869.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24621.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28869.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.24241.log.gz 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25359.log 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4%/var/log/ceph/ceph-client.admin.24621.log: -- replaced with /var/log/ceph/ceph-client.admin.28869.log.gz 2024-08-19T11:22:05.590 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24942.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25359.log: 89.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25359.log.gz 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24621.log.gz 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28078.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25614.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28078.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.24942.log.gz 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28078.log.gz 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25392.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25392.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.25614.log.gz 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29316.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29008.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25392.log.gz 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29110.log 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:22:05.591 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27355.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29110.log: /var/log/ceph/ceph-client.admin.29316.log: 88.9% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29316.log.gz 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29110.log.gz 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25992.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27028.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25992.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.27355.log.gz 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24138.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5%/var/log/ceph/ceph-client.admin.27028.log: -- replaced with /var/log/ceph/ceph-client.admin.25992.log.gz 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25050.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24138.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.27028.log.gz 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24766.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25050.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.24138.log.gz 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24037.log 2024-08-19T11:22:05.592 INFO:teuthology.orchestra.run.smithi135.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.25050.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28904.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24037.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.24766.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.24037.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28147.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26925.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28147.log: /var/log/ceph/ceph-client.admin.28904.log: 89.5% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28904.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28147.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28455.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29179.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28455.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.26925.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26995.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29179.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28455.log.gz 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29179.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25255.log 2024-08-19T11:22:05.593 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26575.log 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25255.log: /var/log/ceph/ceph-client.admin.26995.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.26995.log.gz 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24979.log 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.25255.log.gz 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25153.log 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24979.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.24979.log.gz 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26575.log.gz 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27353.log 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27872.log 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27353.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.25153.log.gz 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24310.log 2024-08-19T11:22:05.594 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27872.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27353.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26187.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.27872.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27250.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26187.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24310.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29214.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.26187.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24242.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29214.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27250.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27029.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24242.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.29214.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28456.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3%/var/log/ceph/ceph-client.admin.27029.log: -- replaced with /var/log/ceph/ceph-client.admin.24242.log.gz 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28352.log 2024-08-19T11:22:05.595 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27029.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24207.log 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28352.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28456.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24873.log 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24207.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28352.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27423.log 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24873.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24207.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27423.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.24873.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26469.log 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27423.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24835.log 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26469.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.26469.log.gz 2024-08-19T11:22:05.596 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28559.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24835.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.24835.log.gz 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26189.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28559.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28559.log.gz 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29317.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26189.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.26189.log.gz 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26892.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29317.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.29317.log.gz 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25786.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26892.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.26892.log.gz 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27871.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25786.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25786.log.gz 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27767.log 2024-08-19T11:22:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27871.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27871.log.gz 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26398.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27767.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27767.log.gz 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28283.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26398.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.26398.log.gz 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28283.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28283.log.gz 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28800.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28180.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28800.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28800.log.gz 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28388.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28180.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28180.log.gz 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25717.log 2024-08-19T11:22:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28388.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28388.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28043.log 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25717.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.25717.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24554.log 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28043.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.28043.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24659.log 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24554.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.24554.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28592.log 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24659.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.24659.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25923.log 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28592.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28592.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27940.log 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25923.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.25923.log.gz 2024-08-19T11:22:05.599 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24346.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27940.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27940.log.gz 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24729.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24346.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.24346.log.gz 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29006.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24729.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.24729.log.gz 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24413.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.29006.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29006.log.gz 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25085.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24413.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24413.log.gz 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26257.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25085.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.25085.log.gz 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26504.log 2024-08-19T11:22:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26257.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26257.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26026.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26504.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26504.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25819.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26026.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26026.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26927.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25819.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.25819.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25083.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26927.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.26927.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25187.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25083.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.25083.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27766.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25187.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25187.log.gz 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27939.log 2024-08-19T11:22:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27766.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27766.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25718.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27939.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27939.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26613.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25718.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.25718.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28076.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26613.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.26613.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26291.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28558.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26291.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.26291.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28076.log.gz 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28042.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28558.log: -- /var/log/ceph/ceph-client.admin.24243.log 2024-08-19T11:22:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.28042.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28558.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27975.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24243.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28042.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27098.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27975.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.24243.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27975.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24208.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23998.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27098.log: /var/log/ceph/ceph-client.admin.24208.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27098.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24208.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26612.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.23998.log: -- /var/log/ceph/ceph-client.admin.25924.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26612.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.23998.log.gz 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25922.log 2024-08-19T11:22:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25924.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.26612.log.gz 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27731.log 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.25922.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.25924.log.gz 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28285.log 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.27731.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.25922.log.gz 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26721.log 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr: 89.4%/var/log/ceph/ceph-client.admin.28285.log: -- replaced with /var/log/ceph/ceph-client.admin.27731.log.gz 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.26721.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.28285.log.gz 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24139.log 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.f.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.26721.log.gz 2024-08-19T11:22:05.604 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.24139.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.24139.log.gz 2024-08-19T11:22:05.637 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2024-08-19T11:22:05.760 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2024-08-19T11:22:05.778 INFO:teuthology.orchestra.run.smithi071.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-19T11:22:05.782 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2024-08-19T11:22:05.804 INFO:teuthology.orchestra.run.smithi071.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2024-08-19T11:22:05.864 INFO:teuthology.orchestra.run.smithi071.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-19T11:22:05.911 INFO:teuthology.orchestra.run.smithi071.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2024-08-19T11:22:06.013 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2024-08-19T11:22:06.586 INFO:teuthology.orchestra.run.smithi071.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-19T11:22:07.670 INFO:teuthology.orchestra.run.smithi071.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-19T11:22:07.671 INFO:teuthology.orchestra.run.smithi135.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-19T11:22:07.907 INFO:teuthology.orchestra.run.smithi071.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-19T11:22:07.975 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-19T11:22:08.069 INFO:teuthology.orchestra.run.smithi071.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-19T11:22:08.071 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-08-19T11:22:08.071 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m2.876s 2024-08-19T11:22:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m11.011s 2024-08-19T11:22:08.072 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.626s 2024-08-19T11:22:08.072 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-19T11:22:08.073 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-19T11:22:08.073 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m2.846s 2024-08-19T11:22:08.073 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m9.924s 2024-08-19T11:22:08.073 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.498s 2024-08-19T11:22:08.073 INFO:tasks.ceph:Archiving logs... 2024-08-19T11:22:08.074 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/remote/smithi071/log 2024-08-19T11:22:08.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T11:22:09.965 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/remote/smithi135/log 2024-08-19T11:22:09.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T11:22:11.611 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-19T11:22:11.623 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 466, in task thrash_proc.stop_and_join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 178, in stop_and_join return self.join() File "/home/teuthworker/src/git.ceph.com_ceph_964adda23da9f7b057cb34fdc0b82aeb7ed65324/qa/tasks/mon_thrash.py", line 170, in join self.stopping.set() AttributeError: 'bool' object has no attribute 'set' 2024-08-19T11:22:11.623 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-19T11:22:11.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T11:22:11.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T11:22:11.721 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-19T11:22:11.729 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-19T11:22:11.730 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T11:22:11.732 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T11:22:11.747 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-08-19T11:22:11.749 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-08-19T11:22:11.752 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T11:22:11.752 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-08-19T11:22:11.752 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +552us[ +548us] +/- 53ms 2024-08-19T11:22:11.752 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -701us[ -701us] +/- 59ms 2024-08-19T11:22:11.752 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +99us[ +95us] +/- 61ms 2024-08-19T11:22:11.752 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:22:11.754 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T11:22:11.754 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-08-19T11:22:11.754 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +560us[ +575us] +/- 53ms 2024-08-19T11:22:11.754 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -694us[ -694us] +/- 59ms 2024-08-19T11:22:11.754 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +100us[ +114us] +/- 60ms 2024-08-19T11:22:11.754 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T11:22:11.755 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-19T11:22:11.764 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-19T11:22:11.764 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-19T11:22:11.773 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T11:22:11.853 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T11:22:11.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-19T11:22:11.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:22:11.937 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-19T11:22:11.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:22:11.966 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-19T11:22:11.977 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-19T11:22:12.024 INFO:teuthology.task.internal:Duration was 1003.820267 seconds 2024-08-19T11:22:12.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-19T11:22:12.032 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-19T11:22:12.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T11:22:12.035 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T11:22:12.073 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T11:22:12.076 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T11:22:12.456 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-19T11:22:12.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-08-19T11:22:12.457 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T11:22:12.519 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-08-19T11:22:12.519 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T11:22:12.552 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-19T11:22:12.553 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T11:22:12.562 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T11:22:12.621 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-19T11:22:12.622 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T11:22:12.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T11:22:12.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-19T11:22:12.738 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-19T11:22:12.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T11:22:12.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T11:22:12.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-19T11:22:12.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T11:22:12.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T11:22:12.828 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-08-19T11:22:12.855 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-08-19T11:22:12.897 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T11:22:12.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:22:12.912 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T11:22:12.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T11:22:12.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-19T11:22:12.967 INFO:teuthology.task.internal:Transferring archived files... 2024-08-19T11:22:12.968 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/remote/smithi071 2024-08-19T11:22:12.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T11:22:13.000 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_20:00:17-rados-main-distro-default-smithi/7859447/remote/smithi135 2024-08-19T11:22:13.001 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T11:22:13.032 INFO:teuthology.task.internal:Removing archive directory... 2024-08-19T11:22:13.032 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T11:22:13.038 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T11:22:13.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-19T11:22:13.096 INFO:teuthology.task.internal:Not uploading archives. 2024-08-19T11:22:13.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-19T11:22:13.106 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-19T11:22:13.106 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T11:22:13.109 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T11:22:13.121 INFO:teuthology.orchestra.run.smithi071.stdout: 262218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 11:22 /home/ubuntu/cephtest 2024-08-19T11:22:13.137 INFO:teuthology.orchestra.run.smithi135.stdout: 262218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 11:22 /home/ubuntu/cephtest 2024-08-19T11:22:13.138 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-19T11:22:13.148 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-19T11:22:13.158 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'bool' object has no attribute 'set' 2024-08-19T11:22:13.160 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete} duration: 1003.82026720047 failure_reason: '''bool'' object has no attribute ''set''' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-19T11:22:13.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T11:22:13.285 INFO:teuthology.run:FAIL